When to create a new Django app and when not to?

No, it is not always a good idea.

This is a topic that has been discussed multiple times previously.

For starters, see:

(There are others, but most threads end up at some point referencing one of these.)

My opinion on this is at: Structuring external service integrations in Django - #2 by KenWhitesell