Asynchronous I/O in DuckDB: Work, Thread, Work

(duckdb.org)

71 points | by pdet 5 days ago

5 comments

  • bburnett44 17 minutes ago
    Using 512gb of ram for a 22gb remote file does feel a bit weird for a benchmark but maybe they couldn’t get a large number of cores without lots of memory?
  • abofh 21 minutes ago
    Do they have SSL updates yet? Signing is great, but using https means not fighting firewalls to start a job
  • myshapeprotocol 2 hours ago
    Deep dive into asynchronous I/O architectures like this is pure engineering gold for high-performance data processing. Excellent breakdown.
  • datadrivenangel 32 minutes ago
    DuckDB is trending towards becoming a query engine, specifically the fastest analytical query engine. This is very good.
  • mansi1010 2 hours ago
    This is such a long waited feature!