How do I edit my home address for Google Now/Maps/Latitude?

I just upgraded to the Galaxy Nexus. In the new Google Now, the traffic for my home destination is listed incorrectly. I also noticed that the Home address for myself under the People listing is incorrect. If I try to edit my local profile, there is no field for address. Long pressing on the address only allows me to copy it. How can I update my Home address?