The Commonwealth Games Federation has demanded the Indian government take immediate steps to improve conditions at the athletes village in Delhi.
Team delegates described the accommodation as filthy, unhygienic and unfit for human habitation.
But the organisers of the games, which run from 3 - 14 October maintain the facilities will be excellent.
The event has been beset by construction delays, accusations of corruption and a dengue fever outbreak in the Indian capital.
A foot bridge near the main Games stadium also collapsed on Tuesday. Police say 23 labourers were injured
The Games village - made up of several blocks of high-rise flats for the athletes who are due to begin arriving on Friday - was meant to be the event's showpiece.
Canada, New Zealand, Scotland and Northern Ireland have demanded their teams be put up in hotels if their accommodation is not ready.
Commonwealth Games Federation president Mike Fennell says the Games will go ahead as planned.
He says the current situation is not acceptable and organisers have not acted quickly enough, but the Games should start on time.
Doubts held by NZ
New Zealand chef de mission Dave Currie has doubts the Games will be able to start on time.
The New Zealand team will be housed in a new apartment tower when members start arriving this weekend.
However, Currie says it is hard to imagine the games will start on time.
He says the NZ Olympic Committee will consider delaying the arrival of New Zealand athletes if village conditions do not improve.