Previously unbeaten Ulsterwere brushed aside 32-14 at the Liberty Stadium with fly-half Dan Biggar contributing 20 points.
But while Johnson was delighted with his team's spirit and attitude, he is adamant their application is still lacking despite sitting second in the table, one point behind leaders Munster.
He said: "I'm satisfied with the result and how we did it.We showed great resolve after a poor start, and to turnaround 10 points at the time of the sin binning to get in front on the scoreboard showed great character.
"We weren't clinical in some aspects of the game though. Parts of the performance I'm really pleased about, and I'm really pleased with the character, but I'm not entirely convinced about the process.
"We've just got to be honest and we've just got to keep working. We all try seek perfection but there is none in this game.
"What I like was that there was resolve in our team, they showed great character and they are showing an embodiment of what we want to stand for in this region. We are really happy with the progress we are making but not entirely happy with the performance."
The Ospreys lost several high-profile stars over the summer including British & Irish Lions James Hook and Michael Phillips.
However the next generation of Ospreys are already stamping their mark on affairs and Johnson reserved particular praises for James King who came on as a second-half replacement for second-row James Goode.
He added: "We're uncovering some kids that we're thinking 'okay, we didn't count on that', and there are a few surprise packages.
"I thought James King came on today and did wonderfully well in a position that he's not that comfortable with.
"He's a versatile kid and he can play a few positions, but I thought his display in an uncharacteristic position was terrific. Wales is not endowed with tight head props so it's nice to see a young tight head in Joe Rees come on and do really, really well."