Workers are feeling more pessimistic as they wonder how safe they are in their jobs.
The Westpac McDermott Miller Employment Confidence Index has fallen 3.3 points in the June quarter to 101.5, when compared with the March quarter.
A reading over 100 means optimists outnumber pessimists.
The fall in the index was driven by a decline in workers' expectations about their job security, which is now at its lowest level since late 2012.
Confidence fell in most regions, with the biggest falls in Gisborne and Hawke's Bay, while Waikato, Taranaki, Manawatu and Whanganui rose.
Westpac senior economist Anne Boniface said rising property prices could be a factor.
"We're now seeing strong house-price growth across a large swath of New Zealand and that is likely to be improving confidence across the regions," she said.
But strong migration could be causing some nerves for workers.
"We are sort of seeing very strong net migration population growth at the moment ... so that's boosting the number of people in the labour force and probably leading to strong competition for jobs out there."