Ulster remain top of the pile, having won their first 11 matches, but their lead is just three points from the Warriors with third-placed Leinster two points further back.
And Herring believes his side must target victory in all of their remaining six matches if they are to achieve their goals.
"We have six league games left and we want nothing less than a win from all of them," Herring told the Irish Independent.
"Going into the semi-finals we want to make sure we're in top spot so we can get a home semi.
"It's a goal for us and is on everybody's mind. It was very disappointing [to lose to Glasgow Warriors], and we have now lost three out of the last five, but it's the kind of thing we'll bounce back from.
"Yes, we had a bad day out there and it always starts with the set-piece. You have to get that first-phase ball and a bit of momentum."