The idea of this work is to move vortex towards a deferred-iterative execution model. ### Deferred We build arrays as physical query plans with late buffer binding and then execute these towards a decompressed form. ### Iterative Go from a recursive execute using the call stack to a explicit cps-like execution model. ## Goals - Efficient deferred execution - A simple model for deferred execution - Efficient iterative execution - A simple model for iterative execute ## Details TODO ## Progress ### Deferred - [x] Deferred execution system - [x] Remove the last usage of buffers from many arrays/encodings - [x] Expose a ExecutionCtx to all methods that access buffers - [x] Make all operations fallible if needed. ### Iterative - [x] Iterative execution system - [x] ExecuteStep - [x] AppendToBuilder - [x] ExecutionStep::AppendToBuilder[+] https://github.com/vortex-data/vortex/pull/7600[/+] - [ ] Append to builder iterative execution kernels ### Optimize - [ ] Remove usage of type_id and downcast - [ ] Use Array id where possible.
Activity
[-]Lazy & Iterative Execution[/-][+]Epic: Lazy & Iterative Execution[/+]connortsui20 commentedon Apr 27, 2026
Whoops codex decided to edit this issue directly, so I just cleaned it up myself. @joseph-isaacs lmk if anything needs to be fixed above
joseph-isaacs commentedon Apr 28, 2026
Reverted
feat: masked array iterative execution clean up (#7690)
feat: add builder execution path with AppendChild step (#7677)
feat: iterative execution for SparseArray (#7711)
Merge upstream Vortex 0.73.0 into spiceai-52 (#53)
feat(arrow): export StringArray and BinaryArray directly (#8902)