I just realized that I have an Android TV Box lying around doing nothing. So I was curious if I can turn that TV Box into a Server that hosts my django app?
If you can get a full Python environment running, along with a suitable web server, you should be able to.
You either need root access to the system to bypass Android to install a native os, or one of the “compatibility systems” allowing you to run Python within Android (see Android - Python Wiki)