screen mirroring from android tv box to smartphone

I want the opposite of screen mirroring, from android tv box to smartphone. Reason I want remote control apps on android tv box with smartphone but avoid over the air streaming. The android tv box is rooted and connected via ethernet LAN port to my home network. Google TV and other screen cast apps require wifi enabled on tv box (which is disabled). I prefer solution over TCP/IP. scrcpy can control over adb which works on tcpip too, but it's for PC. Therefore I am fine with middle solution control PC from smartphone + control tv box from PC What can I do?