Hi, I’m trying to improve the test coverage of the django ORM. I can run the test with different --settings, so i can test in sqlite, psql and oracle, to be sure that every test is correct with the 3 backends. To improve the flow, and to have a unified coverage i was thinking in editing the tuntests.py to add a flag --shuffle_databases. In case of run test with the shuffle databases, we will run the tests one with each database which name start with default. This will improve the production of test for thr ORM.
What are your opinion about this?
I do not think the added complexity is worth the gain to be honest. We already run tests against all supported databases, shuffling the database might just result in bugs being discovered later. As far as coverage is concerned there are probably tools to merge coverage output.