The first came in March 2011 when South African half-back Ruan Pienaar banged over a drop goal at the death to snatch a 25-23 Ulster victory, while the following season the home side saw out a 30-12 success.
However, Hughes did win there in a pre-season clash while on loan at Exeter Chiefs, and the 25-year-old centre is keen to bring that success back over with him to Newport.
"I love it and it's probably my favourite away ground," he said. "The atmosphere is great with the new stadium as well so it's a great arena to play in.
"I've come close to winning there with the Dragons and Pienaar has smashed our dreams but we have always fronted up and stepped up to the plate.
"There's always a very vocal crowd and they love their rugby, so it creates a great atmosphere to play in.
"We worked on things from the defeat at Sale that came together against Leinster quite nicely. We had to work hard and it paid off but Ulster are going to have just as many threats with some great runners in their back line, so we are going to have to improve again and go up another step.
"We dealt with them quite well at home and put ourselves in a good position to win but we didn't. We had six or seven minutes in their 22 while they had around 50 seconds but we managed to lose."
To buy tickets for the GUINNESS PRO12 Grand Final click here. Also follow us on Facebook, join the conversation on Twitter, sign up to our YouTube channel for extensive match highlights and sign up for our newsletter for regular updates on the GUINNESS PRO12.