Comment by augusto-moura

Have you tried setting up systemd-oomd [1]? It works by killing the offending process (hopefully) before a true OOM.

When I run in a frozen system because of RAM, I'm a happy user of the Magic SysRq 'f' [2], it bypasses most kernel scheduling so it works even on frozen systems

[1]: https://man.archlinux.org/man/systemd-oomd.8

[2]: https://en.wikipedia.org/wiki/Magic_SysRq_key