Pacific Island Affairs Minister Hekia Parata, says the ministry is not under threat despite repeatedly failing to meet performance targets.
The ministry's latest annual report detail two performance reviews criticising it for substandard policy advice.
Most services to Pasifika communities are provided by bigger government agencies with their own Pasifika units.
Labour says the ratings will fuel suspicion in Pasifika communities that the Government wants to swallow up the small ministry in a bigger department.
But Ms Parata says her ministry's policy advice ratings and small size aren't a threat to its status.
She says the ministry's already improved its policy advice and is focusing on a few areas like education, rather than spreading itself too thin.