Unattended upgrades calls my machine "localhost" instead of its hostname

On some of my machines, unattended upgrades sends an email to tell me a reboot is required, and says:

[reboot required] unattended-upgrades result for localhost: SUCCESS

While on others, it specifies the correct hostname instead of localhost. Where can I change this to make it specify the hostname correctly?