feat: Add experimental Grace Hash Join operator with spill-to-disk support [research, will not merge]#3564

Closed

andygrove wants to merge 61 commits intoapache:mainfrom

andygrove:feat/grace-hash-join

Commits on Feb 21, 2026

feat: Add Grace Hash Join operator with spill-to-disk support

andygrove
and
claude
committed
Add join microbenchmark comparing Sort Merge, Hash, and Grace Hash joins

andygrove
and
claude
committed
chore: Apply formatting (cargo fmt + spotless)

andygrove
and
claude
committed
feat: Remove join type restrictions in RewriteJoin when grace hash join is enabled

andygrove
and
claude
committed
Revert join type restriction removal in RewriteJoin

andygrove
and
claude
committed
perf: Optimize Grace Hash Join partitioning with prefix-sum algorithm

andygrove
and
claude
committed
perf: Optimize Grace Hash Join with take() kernel and whole-batch passthrough

andygrove
and
claude
committed
fix: Improve Grace Hash Join repartition heuristic to prevent OOM

andygrove
and
claude
committed
fix: Track probe-side memory in Grace Hash Join and spill on pressure

andygrove
and
claude
committed
fix: Spill probe-side partitions aggressively to prevent OOM

andygrove
and
claude
committed
fix: Spill ALL partitions on first probe-side memory pressure

andygrove
and
claude
committed
fix: Stream spilled probe data during join phase to prevent OOM

andygrove
and
claude
committed
perf: Skip probe partitioning when build side is small in Grace Hash Join

andygrove
and
claude
committed

Commits on Feb 22, 2026

Commits on Feb 23, 2026