The victory was just their fifth in their RaboDirect PRO12 this year and kept the Blues in tenth position with only Treviso and Zebre below them.
They face Edinburgh next on Friday April 11 before fixtures against Connacht and two duels against the Scarlets - all sides just above them in the table - and Navidi wants to see the Blues chase down their rivals.
"That performance had been a long time coming," Navidi told the Cardiff Blues website. "(Against Ospreys) we didn't come out of the blocks or play. We'd had a good week of training but didn't deliver.
"We had a good week ahead of the game (with Ulster) and we knew we needed to deliver, show what we could do.
"It's coming together nicely now with Chief (Dale McIntosh) and Johnsy (Paul John).
"It's good to get that win and a big positive for the boys. Hopefully we can now take that momentum into the Edinburgh game and the rest of the season.
"It was a big loss against Zebre a few weeks ago and we now need to get on the right path and try and get up that table. I want to finish on a high this year."
Follow us on Facebook, join the conversation on Twitter, sign up to our YouTube channel for extensive match highlights and sign up for our newsletter for regular updates on the RaboDirect PRO12