Rebind Left Alt+Grave/Tilde to Zenkaku/Hankaku

Hello, I’m using the keyboard layout “English (intl., with AltGr dead keys)” or “us(altgr-intl)” which is great for English/Latin languages, but I also need to type Japanese. Traditionally I used left alt+grave which Windows rebinds to Zenkaku/Hankaku for non JP keyboards to toggle the Japanese IME, however this is not the case in the default XKB maps.

I tried unbinding the window manager keybind for left alt+grave and rebound it to the IME switch, which mostly works, but it doesn’t cancel the left alt input and causes programs to open the alt menu. I’m already using some XKB customizations, so I thought it might be possible to do in there, but while I know how to adjust the layers for altgr, I don’t know if it’s possible to additionally rebind only left alt+grave, but leave everything else untouched.

From some research, I thought perhaps the following would be a good start to try, but I couldn’t figure it out after quite some time. Is anyone aware of a better way to do this that won’t result in the alt menu opening each switch? Thank you!

default partial alphanumeric_keys
xkb_symbols "function_keys" {
    key <FK13> { [ F13 ] };
    key <FK14> { [ F14 ] };
    key <FK15> { [ F15 ] };
    key <FK16> { [ F16 ] };
    key <FK17> { [ F17 ] };
    key <FK18> { [ F18 ] };
    key <FK19> { [ F19 ] };
    key <FK20> { [ F20 ] };
    key <FK21> { [ F21 ] };
    key <FK22> { [ F22 ] };
    key <FK23> { [ F23 ] };
    key <FK24> { [ F24 ] };
};

xkb_symbols "alt_grave_hankaku" {
    key <TLDE> {
//        [ grave, asciitilde, dead_grave, dead_tilde ] // This is the default layout for reference
        type = "PC_ALT_LEVEL2",
        symbols[Group1] = [ grave, Zenkaku_Hankaku ],
        actions[Group1] = [ NoAction(), RedirectKey(keycode=<HZTG>, clearmods=Alt) ]
    };
};

xkb_symbols "loader" {
    include "extrafunctionkeys(function_keys)"
    include "extrafunctionkeys(alt_grave_hankaku)"
};