Last Friday's 8-3 defeat to Irish rivals Leinster showed some signs of improvement, but Gilroy believes Kiss needs to be given more time to stamp his authority on the side.
And the 24-year-old is confident a string of victories is just around the corner, with Edinburgh up next in the GUINNESS PRO12 this weekend.
"Les knows all the guys, and everyone so much respect for him," he said. "Being with Ireland over the last number of years brings that reputation and it's massive for us as players and for the fans back home to have Les come into the set-up.
"He's fitted in so well and brings so much to the team and I honestly think he'll bring things further. It's been a frustrating couple of years, we just haven't finished it off when silverware was there but we are certainly capable of winning - I wouldn't have stayed on with Ulster if I didn't think so.
"Everyone knows what Les is about. We have to be 100 per cent patient as he will only take us further. I think the fans see that as well, what a high calibre coach he is.
"It's still early in the season and there are a lot of games to go yet. I honestly think we're in a good place. We lost the last two games but it was to quality opposition. We have the strength in the squad to bounce back."
To buy tickets for the GUINNESS PRO12 Grand Final click here. Also follow us on Facebook, join the conversation on Twitter, sign up to our YouTube channel for extensive match highlights and sign up for our newsletter for regular updates on the GUINNESS PRO12.