Skip to content

Teach ArrayVTable about capabilities and let arrays provide extensible capabilities - #9371

Closed
robert3005 wants to merge 1 commit into
developfrom
rk/array-capabilities
Closed

robert3005 wants to merge 1 commit into
developfrom
rk/array-capabilities

Conversation

@robert3005

@robert3005 robert3005 commented Aug 11, 2026 •

Copy link
Copy Markdown
Contributor

execute_until and Matcher give us a mechanism for unwrapping an array tree into a known set of encodings. A Matcher is defined statically, though, so it cannot be extended when it is used as part of another mechanism — an out-of-crate encoding has no way to join the set.

This PR lets arrays claim the capabilities they provide, and lets matchers use a capability as their match condition.

@codspeed

codspeed Bot commented Aug 11, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 11.71%

⚡ 1 improved benchmark
✅ 1961 untouched benchmarks
⏩ 89 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation slice_primitive_tight_loop[10000] 473.8 µs 424.1 µs +11.71%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.


Comparing rk/array-capabilities (c13f3f8) with develop (ca7f626)

Open in CodSpeed

Footnotes

  1. 89 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@robert3005
robert3005 force-pushed the rk/array-capabilities branch from 16976b0 to b7d5cdb Compare August 11, 2026 23:35
…e capabilities

execute_until and Matchers provide us a mechanism for unwrapping an array tree
into a known set of encodings. The Matcher is defined statically and cannot be
extended if it is used as part of another mechanism.

Here we introduce a way for arrays to claim the capabilities they provide, and
let matchers use them as a match condition. VarBinExportable is the first such
capability: it marks encodings whose append_to_builder writes byte values
straight into a VarBinBuilder, which a later change uses to stop Arrow export
before it canonicalizes them.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005

Copy link
Copy Markdown
Contributor Author

going to do this differently, this is too brittle of an api to expose to users. Rest of the stack stays though

@robert3005 robert3005 closed this Aug 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant