Comment by hiyer

For a few TBs of data, well partitioned and stored in parquet or some such format, you could just use duckdb on a single node.