How can I use xmodmap to remap keys when I have language layouts interfering?

I want to remap my "Alt+ijkl" keys to "up,left,down,right", but when I look for my key mappings with xmodmap -pke I get : keycode 31 = i I Cyrillic_sha Cyrillic_SHA rightarrow idotless Arabic_ha division NoSymbol U202C keycode 44 = j J Cyrillic_o Cyrillic_O dead_hook dead_horn Arabic_teh Arabic_tatweel keycode 45 = k K Cyrillic_el Cyrillic_EL kra ampersand Arabic_noon Arabic_comma U066B keycode 46 = l L Cyrillic_de Cyrillic_DE lstroke Lstroke Arabic_meem slash Arabic_kaf colon Arabic_gaf The xmodmap docu on arch wiki seems to contradict this, as the arabic is to the right of the ISO_Level3_Shift which I assume is AlrGr : Each keysym column in the table corresponds to a particular combination of modifier keys: 1. Key 2. Shift+Key 3. Mode_switch+Key 4. Mode_switch+Shift+Key 5. ISO_Level3_Shift+Key 6. ISO_Level3_Shift+Shift+Key Alt_L doesn't seem to be reflected anywhere in my config and actually the rows can have more or less columns too. I had been using KDE's own remapping and later input-remapper when they changed but after all the tutorials who seem to show this remapping as trivial with xmodmap (eg `xmodmap -e "keycode 44 = j J Left" `), I can't find how to solve my problem. I've tried reading the links in this answer about these virtual modifiers but it's not helping.