And while a number of alternative grounds have been suggested, Milne believes they are too small to be considered, insisting that Edinburgh should continue to aim high.
"Edinburgh should realistically be getting 10,000 for most of their games if promoted well and the team are playing well," Milne told the Edinburgh Evening News.
"I have been to Murrayfield quite a lot watching and too much is made of playing in the big ground. If you sit in the East Stand with five or six thousand people, I have never found it as bad as people make out.
"Also, you have tremendous facilities with the bars etc and the stands. It maybe lacks atmosphere but they have to try harder to utilise facilities. A 10 or 12,000 capacity ground purpose-built for Edinburgh would be brilliant but not a facility that accommodates just 6,000."