Paul Marshall grabbed the only try of the game as Ulster completed their first away win in the GUINNESS PRO12 since April.
The boot of Dorian Jones dominated the early exchanges as Newport Gwent Dragons - previously unbeaten at home in the competition this season - opened up a nine-point lead.
However, a pack growing in confidence and the boot of Paddy Jackson got the visitors back into it, before Marshall grabbed the decisive score.
And despite late pressure from the Welshmen, Ulster held on to give director of rugby Les Kiss a victory in his first game in charge.
The hosts enjoyed a prolonged spell of pressure inside the opening ten minutes and Jackson was forced into touch when covering across by his own corner flag.
But Ulster stood firm and the Dragons eventually settled for a penalty when Robbie Diack infringed at the breakdown, Jones handing them the lead.
The chance for Ulster to kick-off into opposition territory didn't offer much respite, however, as the home side swiftly returned to the front foot.
A turnover on their own line earned the visitors a chance to gather their thoughts but Stuart McCloskey soon found himself in the sin bin for a trip and Jones made it 6-0.
A third penalty arrived on 20 minutes when teenager Sam Arnold was caught with his hands in the ruck and Jones sent it straight between the uprights.
Ulster found a useful weapon in their rolling maul, powering their way forward and winning a penalty when the hosts were offside, Jackson registering his first points from the tee.
Jackson's second penalty - five minutes before the break - reduced the gap to three and Ulster were on the front foot early in the second half, Dragons skipper Rynard Landman earning ten minutes in the sin bin with his side under pressure.
Excellent work from Sarel Pretorius earned the hosts a vital turnover on their own line but the visitors struck on the 50 minute mark, Marshall sniping around the ruck to score and Jackson converting.
Ulster called on their big guns, with Rory Best and Ruan Pienaar each appearing for their season debuts, but the former was soon showed a yellow card.
Jason Tovey - on for Carl Meyer at full-back - narrowed the gap to one point with his first penalty, shortly before Jackson missed an effort from the tee.
The Ireland fly-half didn't make the same mistake, however, when the Dragons were caught offside ten minutes from time and another three points just two minutes later made it 19-12.
The hosts went in search of a last-gasp try to snatch a draw but in the 84
th minute their resolve was broken and Ulster claimed four points.
To buy tickets for the GUINNESS PRO12 Grand Final click here. Also follow us on Facebook, join the conversation on Twitter, sign up to our YouTube channel for extensive match highlights and sign up for our newsletter for regular updates on the GUINNESS PRO12.