But while Holley was far from satisfied with the 26-21 scoreline, he had nothing but praise for the effort of his charges.
He said: "We didn't play anywhere near to how we can play, so we're very disappointed with ourselves. We didn't deal with Connacht's threat. They are a very difficult team to beat, they came with a game plan and it very nearly paid off for them so we are disappointed with our performance but satisfied with the outcome.
"We're about improving, so whereas the scoreboard reflects we're unbeaten, we've still got areas to work on.
"The pleasing aspect is that the boys are showing a lot of determination and resolve. They are playing for each other, playing for the shirt and the cause, and it's shining through at the end of games where we are getting across the line.
"There are a lot of teams that don't have those characteristics. It's what we're working towards. We worked hard over the summer, particularly with a lot of our squad away, to have some character and true values in the squad, and we've certainly found that we've got that."
The Ospreys are now the only unbeaten side left in the league, but Holley refused to get carried away with their current position.
He added: "You don't win anything in September. Every game is difficult in this competition, trust me. Aironi won last week, Treviso, Edinburgh have turned over Munster and the Dragons have beaten Ulster.
"Anyone can beat anyone. Connacht came here expecting to turn us over. That's great for the competition, but it just shows how difficult it is."