It was a far tighter affair for the GUINNESS PRO12 side this time around, with Toulouse not even managing a point at the Kingspan Stadium last week, but the return leg in France was always going to pose a tough challenge.
After taking an early lead Ulster had to survive a second-half fightback from the French giants, and after taking nine points in total from the double-header skipper Rory Best admits he is proud of the way his team have resurrected their season in Europe.
"Nobody expected us to come here and win at the start of the campaign and we've done that," he said.
"This is one of the toughest places that I've come to. So to come here, match that physicality, and come out with a win we can be rightly proud. Toulouse are a great team and they have some stars of world rugby.
"Last week we put in a really good performance. This week we knew they were going to be a lot more physical for us and that's what they did."
Elsewhere, Glasgow Warriors emerged victorious in the battle of the GUINNESS PRO12 sides at Scarlets, in a nip-and-tuck affair in South Wales.
It was Finn Russell who kicked the Scots to victory with three penalties in the 9-6 triumph, before Aled Thomas landed two for the home side after the break.
Glasgow were down to 13 men for seven minutes in the second half, but managed to limit the damage as neither side was able to penetrate the other's defences and cross the whitewash.
But it was not all good news for the GUINNESS PRO12 sides as Ospreys, Leinster and Benetton Treviso all struggled against French opposition.
Ospreys did at least come away with two losing bonus points after a stunning eight-try thriller at Bordeaux-Begles finished 33-27.
Dan Evans fed Justin Tipuric to respond early for the Welsh side after Julien Rey put them behind early on, but Bordeaux had a commanding lead by half time.
But both Eli Walker and Alun Wyn Jones went over in the second half, before Dan Biggar grabbed the bonus points by intercepting Baptiste Serin's pass to race 60 metres and score.
Leinster gave European champions Toulon a scare in front of 45,000 people at the Aviva Stadium, but the French side came back from 11 points down to inflict another defeat on the GUINNESS PRO12 side, while Treviso went down 40-14 at Stade Francais Paris.
And Munster also had their hopes of qualification for the knock-out stages all but ended by a stubborn Leicester Tigers side, who won 17-6 at Welford Road to strengthen their grip on Pool 4.
Meanwhile in the Challenge Cup, Newport Gwent Dragons kept their position at the top of Pool 2 after an inspired 34-17 victory at Pau.
Cory Hill got Lyn Jones' side off to a dream start, before tries from Ashton Hewitt and Jason Tovey gave the Welsh region a 24-0 lead at half-time and Carl Meyer wrapped up the bonus point eight minutes after the break.
And Jones was ecstatic after his side showed their discipline and kept double Rugby World Cup winners Colin Slade and Conrad Smith quiet.
"We're absolutely delighted, it was an error-free performance from us tonight and it was as good as you get," he said.
"We were up against a team full of good individuals, but we were far better as a team tonight and we deserved to come away with the spoils.
"They put all the big guns in, but we took their threats away and they couldn't handle us."
GUINNESS PRO12 high-flyers Connacht stay top of their pool despite a 29-5 defeat at Newcastle Falcons, while Zebre climbed to second in Pool 4 after a convincing 25-5 victory over La Rochelle.
Edinburgh kept themselves in contention in an incredibly tight Pool 5 thanks to a narrow 18-15 win over London Irish, but Cardiff Blues were not so lucky at Montpellier where Paul Willemse's last-gasp converted try rescued a dramatic win for the French side.
To buy tickets for the GUINNESS PRO12 Grand Final click here. Also follow us on Facebook, join the conversation on Twitter, sign up to our YouTube channel for extensive match highlights and sign up for our newsletter for regular updates on the GUINNESS PRO12.