What reasons are there to not enable the service broker?

I like to enable the Service Broker on all of my non-system databases. I'd probably put it in model, but I recall something preventing that. What reasons are there, no matter how far-fetched, for not enabling the Service Broker everywhere? All that I could find is that it's difficult to grab an exclusive lock in some databases.