Encrypt OfflineIMAP Password

I'm trying to set up OfflineIMAP to authenticate via a gpg encrypted file (that way I can consolidate all my encryption to my gpg-agent process). From the documentation, it seems the only way to encrypt one's server passwords is to use gnome-keyring (which I'd prefer not to run on my headless server). Is there a way to pipe in my password from a gpg file the way you can with mutt? I know you can add extra features to offlineimap with the extension python file, but I'm afraid I wouldn't know where to start with that.