Why do they need justification? what is immoral about not having it?
Because we have a Universal Declaration of Human Rights affords people liberty (Article 3) and freedom from 'arbitrary interference with their privacy, family, home...' (Article 12).
Infringing on that with arbitrary interference is immoral.
And, again, more in hope that expectation, what's your take on it?
O.