Keeping a Postgres Queue Healthy

3 comments

• sebmellen 12 minutes ago
  Postgres can do so much. I see people choose Kafka and SQS for things that Graphile Worker could do all day long.
• simeonGriggs 38 minutes ago
  Yo! Author here, I’ll be around if anyone’s got questions!
  [-]
  • jeeybee 18 minutes ago
    Did you test with fillfactor < 100 on the queue table? With HOT updates, status changes can reuse dead space without creating new index entries, which seems like it could significantly delay the onset of the death spiral?
• richwater 55 minutes ago
  It would be nice if this ad at least explained a little bit of the technical side of the solution.
  [-]
  • sgarland 37 minutes ago
    It sounds vaguely like InnoDB’s concurrency control solution which uses tokens [0] as a unit of maximum work a query can perform.

    0: https://dev.mysql.com/doc/refman/8.4/en/innodb-performance-t...