Tries from Nick Williams, Andrew Trimble, Luke Marshall, Stuart McCloskey and Chris Henry overwhelmed the visitors, while Paddy Jackson added four conversions and a first-half penalty before replacement Ian Humphreys slotted a conversion.
The result sees Ulster move up to second in Pool 1, but Kiss is already looking ahead to next week's return clash in France, where he is expecting a backlash from a side not accustomed to losing so heavily.
"We knew against this mob that if you weren't relentless on either side of the tackle they could get quality ball and that's when they are dangerous," he said.
"They are a very good side and we knew we had to be on it right from the off, we knew we would have to take our chances and it was one of those nights where every time we got a chance we came away with some points.
"Our defence was also brilliant and to keep Toulouse to zero is beyond my wildest dreams. The intensity with which we started the game was very pleasing and it gave us a platform to build on.
"But we know next week is going to be a different story. We have to be geared up for that. We have to enjoy this, but make sure we're ready for a massive backlash.
"We've hurt them and they're going to come out fighting. I'm not downplaying this win because we should enjoy it, but there's a job to do next week.
"We have to be honest and say Saracens still have the run of the pool, but we knew if we could do a job against Toulouse we could start to put pressure on the rest of the group. Next week's game in Toulouse is going to be huge."
To buy tickets for the GUINNESS PRO12 Grand Final click here. Also follow us on Facebook, join the conversation on Twitter, sign up to our YouTube channel for extensive match highlights and sign up for our newsletter for regular updates on the GUINNESS PRO12.