Harm necessary for punishment
From Textop Wiki
Harm is necessary for punishment (not just neglect of an advantage).
Secondly, that to be neglected and unpreferred by the public favour is not a punishment, because no new evil is thereby on any man inflicted; he is only left in the estate he was in before.
Hobbes, Lev XXVIII 4