Is it OK to swap batteries while phone is connected to wall charger?

It takes a few minutes to shut down and restart the phone, it would sometimes be handy to be able to swap batteries without shutting down (i.e. swap in a fully charged battery before going out). Will the phone operate without a battery while connected to a wall charger? Is it safe to swap the battery without shutting down?