Skip to content

Epic: Lazy & Iterative Execution #7674

Open

Description

@joseph-isaacs

The idea of this work is to move vortex towards a deferred-iterative execution model.

Deferred

We build arrays as physical query plans with late buffer binding and then execute these towards a decompressed form.

Iterative

Go from a recursive execute using the call stack to a explicit cps-like execution model.

Goals

  • Efficient deferred execution
  • A simple model for deferred execution
  • Efficient iterative execution
  • A simple model for iterative execute

Details

TODO

Progress

Deferred

  • Deferred execution system
  • Remove the last usage of buffers from many arrays/encodings
  • Expose a ExecutionCtx to all methods that access buffers
  • Make all operations fallible if needed.

Iterative

Optimize

  • Remove usage of type_id and downcast
  • Use Array id where possible.

Activity

  1. added
    epicPublic roadmap umbrella for a major initiative, with work tracked in sub-issues.
    on Apr 27, 2026
  2. changed the title [-]Lazy & Iterative Execution[/-] [+]Epic: Lazy & Iterative Execution[/+] on Apr 27, 2026
  3. connortsui20 commented on Apr 27, 2026

    @connortsui20
    Member

    Whoops codex decided to edit this issue directly, so I just cleaned it up myself. @joseph-isaacs lmk if anything needs to be fixed above

  4. joseph-isaacs commented on Apr 28, 2026

    @joseph-isaacs
    ContributorAuthor

    Reverted

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

epicPublic roadmap umbrella for a major initiative, with work tracked in sub-issues.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions