Throwing more resources at the problem isn’t always the best solution. 4GB and 2 cores is quite a lot of compute.
If your app is async and doing DB queries, that can cause lots of DB connections, and timeouts with the connection pool. It sounds like pool contention is your main issue, not necessarily resources.