Lawyer Nicholas Opiyo told AFP that minister of ethics and integrity Simon Lokodo told him ordinary citizens would be "mobilised to defend the moral values of Uganda" and that "if participants were to be beaten by a mob" they would have "brought it upon themselves".
The minister allegedly added that police would arrest anyone attending the parade, Opiyo said.
Organisers said they had postponed the event following the apparent threat, reportedly made at a meeting between the organisers' lawyer and a police representative.
"As the committee, we have agreed that all the remaining events of the pride week be postponed as we await a positive outcome from the already going negotiations," the organisers said in a statement.
Recommended reading
Two Kenyans in gay sex case lose bid to outlaw anal examinations
"We will be communicating the new dates as soon as the negotiations are completed," the statement added.
Pressure group Human Rights Watch (HRW) last year wrote to the pope ahead of a visit to Uganda urging him to "raise a number of human rights issues", among them gay rights.
HRW said gay Ugandans continued to "face arrest, discrimination, eviction from their homes, and violence from government officials and private individuals".