I want to add async task execution with Celery to a Django app that’s currently running on AWS ElasticBeanstalk with Docker and I’m having a bit of trouble figuring out the simplest way forward.
As far as I see, I have the following options:
1.- Run everything in ElasticBeanstalk with the “multicontainer” option that’s available (one container for django and other containers for celery, monitoring, etc).
2.- Modify my current image to run both django and celery (keep everything in one container).
3.- Migrate to a more complex infrastructure like using Elastic Container Service directly, which IMHO probably is overkill but might end up being the cleanest solution.
Any advice regarding best practices, opinions on the options listed above or regarding other options I’ve probably missed is greatly appreciated!