Choose which player is activated by headphones play/pause buttons

I have 3 pairs of Bluetooth headphones: 1. Sony WH-1000xm4 2. Jabra Elite Active 65t 3. Cardo PacTack bold (motorcycle communicator, works as Bluetooth headset) On my Pixel 5 I have 2 sound players installed: 1. YouTube Music (for music) 2. Smart AudioBook Player (for audiobooks) Whenever I am listening to music using YouTube music and press the pause and then resume button on any of my Bluetooth devices, it switches to playing audiobooks in Smart Player! This is very annoying, especially on a motorcycle where I need to stop to be able to unlock my screen to switch back to YouTube! If there is a way to set up which player is activated when a play button on Bluetooth headphones is pressed? Or at least disable some players from being ever activated by a button?