Papua New Guinea's Correctional Services Commissioner says rogue officers have been given 24 hours to return to work or they will be suspended without pay.
Michael Waipo had been facing a backlash from some of his officers, amid claims that he has been sacked by the Government.
He said a burglary at the College Armoury at Bomana on Thursday night was an inside job, as the thieves used a key.
They stole ammunition in the form of nine cartridges and a magazine.
Mr Waipo said around 17 officers were celebrating his sacking on Thursday night, which had been confirmed to him from an officer in the ministry, but so far he had not heard from the minister, Jim Simatab.
Mr Waipo said the officers are being paid but need to front at work or they will be officially suspended.
"I have issued instructions today for every officer that is out there to return at midday today. Failing that, those responsible will be suspended without pay and a disciplinary process will take its course."