A Redis Job Queue Was Enough
We almost reached for Kafka. Then we counted our jobs per second and put BullMQ on Redis instead. Two years later, here is why we have not regretted it.
2 posts
We almost reached for Kafka. Then we counted our jobs per second and put BullMQ on Redis instead. Two years later, here is why we have not regretted it.
Postgres tops out at a few hundred concurrent connections. Workers and serverless handlers want thousands. Transaction-mode pooling is the cheap fix — and a small set of constraints you have to live with.