With the first Test looming, a number of senior players were rested and there was an unfamiliar look to the three-quarter line which featured Billy Twelvetrees, Brad Barritt, Christian Wade and Shane Williams.
Hogg, playing at fly-half, also twice saw penalties hit the post but captain Best believes it's the pack which did not compete well enough with their Australian counterparts.
"We got physically beaten up, a bit nervy and all the credit to the Brumbies, they were hungrier than us right across the board," said Best, one of eight RaboDirect PRO12 players in the starting line-up.
"I don't think we're looking for an excuse, we brought in quality players and we had a quality team. We just got beaten up at the breakdown.
"If you can't secure that ball you're always going to be under pressure. I think the forwards should stand up and take the heat and deservedly so.
"I think we went in fresh, we had a good team run and were feeling very confident. We knew it was going to be a tough task but we just didn't turn up. Right from the very off they wanted it more. You have to give them massive credit for the way they played.
"We let our standards drop and it'll be up to the 15 and 23 this weekend to raise their game this weekend. We didn't want to lose the momentum we gained on this tour. We've done that and now we have to dust ourselves down and go from there."