It saw Munster return to the top of the RaboDirect PRO12 table after Leinster had temporarily leapfrogged them but Penney is taking nothing for granted with a tough run of fixtures to come.
"We are really pleased to get a win. But there's still a long way to go - we are not counting our chickens yet," he said.
"We still have to play Leinster, Glasgow and Ulster, who are all up there fighting, so anything can happen.
"The Liberty Stadium is a difficult place to come. We wore torn apart here last year (losing 30-15), but we are no longer the team who were here 12 months ago.
"A number of our boys have not won here before so it's a wee bit of a special one."
Follow us on Facebook, join the conversation on Twitter, sign up to our YouTube channel for extensive match highlights and sign up for our newsletter for regular updates on the RaboDirect PRO12