They led until the hour mark before conceding two late tries but Goosen wants his team to turn things around against Montpellier, who beat them in the opening game of the tournament.
And Goosen hinted that he could make a few changes to give some new players a chance to stake a claim for a regular starting spot.
He said: "We want to finish this European Cup with a win and we hope we can do that against Montpellier.
"It will be difficult, I saw their game against Ulster and they are a good side. We know that it's always tough to go and win away at French teams but we want to do our bit. We'll maybe change a few players to give some guys a little bit of game time, but we'll have to wait and see.
"Against Leicester the defence was very good in the first half, but things started to go wrong when he got a yellow card. It was partly our fault but I think they stepped things up as well."
Follow us on Facebook, join the conversation on Twitter, sign up to our YouTube channel for extensive match highlights and sign up to our newsletter for regular updates on the RaboDirect PRO12