Nothing prevents you from adding entries to the DATABASES dict dynamically.
See Multiple dynamic database access
You might be able to load the data into those models, but at that point, you’re not really using the ORM. (You’re not going to have access to querysets, filters, relationship managers, connection management, query caches, etc) This seems like a lot of work for very little gain.