A spin on the Markus Lankeit's answer, tested on my Android TV.
- Hold AltAlt key entire time
- Press TabTab key (app switcher will appear)
- With arrow keys, select an app that is running
- Press DelDel or BackspaceBackspace to close the app
- Repeat for other apps
- You can press EscEsc to quit from the app switcher any time
- Release AltAlt key
Overall, this task killing-killing keyboard procedure is essentially the same as on Windows 10, for example.