For those stumbling upon this thread, I have resolved the issue.
The problem was a third party library that required migrations but did not ship with migration files. Because of this, makemigrations was not automatically catching that application and creating migration files, so the test database could not properly run migrations.
I found this out in the more verbose stacktrace using python manage.py test -v 3