Skip to content

DataFusion (Vortex): bump to Vortex 0.90.0 and update results - #3056

Merged
alexey-milovidov merged 2 commits into
ClickHouse:mainfrom
vortex-data:ji/datafusion-vortex-0.90
Nov 15, 2026
Merged

alexey-milovidov merged 2 commits into
ClickHouse:mainfrom
vortex-data:ji/datafusion-vortex-0.90

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor
  • Bump Vortex DataFusion to 0.90.0 (vortex-datafusion-cli tag 0.90.0-55.2.0, DataFusion 55.2.0) for datafusion-vortex and datafusion-vortex-partitioned.
  • Fix the READMEs, which still named tag 0.70.0-53.1.0.
  • Add results for both variants on c8g.metal-48xl, c7a.metal-48xl and c8g.4xlarge.

Build vortex-datafusion-cli 0.90.0-55.2.0 (Vortex 0.90.0, DataFusion
55.2.0) for both the single-file and the partitioned variant, and add
results for c8g.metal-48xl, c7a.metal-48xl and c8g.4xlarge. The READMEs
still named the 0.70.0-53.1.0 tag, so they now match the install scripts.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actions Bot commented Nov 5, 2026

Copy link
Copy Markdown
Contributor

The run of datafusion-vortex on c6a.2xlarge did not produce results.
The run of datafusion-vortex on c6a.4xlarge did not produce results.
The run of datafusion-vortex on c6a.large did not produce results.
The run of datafusion-vortex on c6a.metal did not produce results.
The run of datafusion-vortex on c6a.xlarge did not produce results.
The run of datafusion-vortex on c7a.metal-48xl did not produce results.
The run of datafusion-vortex on c8g.4xlarge did not produce results.
The run of datafusion-vortex on c8g.metal-48xl did not produce results.
The run of datafusion-vortex on t3a.small did not produce results.
The run of datafusion-vortex-partitioned on c6a.2xlarge did not produce results.
The run of datafusion-vortex-partitioned on c6a.4xlarge did not produce results.
The run of datafusion-vortex-partitioned on c6a.large did not produce results.
The run of datafusion-vortex-partitioned on c6a.metal did not produce results.
The run of datafusion-vortex-partitioned on c6a.xlarge did not produce results.
The run of datafusion-vortex-partitioned on c7a.metal-48xl did not produce results.
The run of datafusion-vortex-partitioned on c8g.4xlarge did not produce results.
The run of datafusion-vortex-partitioned on c8g.metal-48xl did not produce results.
The run of datafusion-vortex-partitioned on t3a.small did not produce results.

Logs:

@alexey-milovidov

Copy link
Copy Markdown
Member

Cloning into 'vortex-datafusion-cli'...
error: pathspec '0.90.0-55.2.0' did not match any file(s) known to git

@joseph-isaacs

Copy link
Copy Markdown
Contributor Author

Sorry I did this out of order with merging vortex-data/vortex-datafusion-cli#20 I will merge this now

@joseph-isaacs

Copy link
Copy Markdown
Contributor Author

@alexey-milovidov sorry for the inconvenience, should we good to go now

@github-actions

Copy link
Copy Markdown
Contributor

@github-actions

Copy link
Copy Markdown
Contributor

Results for datafusion-vortex are ready for: c6a.4xlarge, c6a.metal, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for datafusion-vortex-partitioned are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex-partitioned/results/20261115/c7a.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex-partitioned/results/20261115/c6a.metal.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex-partitioned/results/20261115/c8g.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex-partitioned/results/20261115/c8g.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex/results/20261115/c8g.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex/results/20261115/c6a.metal.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex/results/20261115/c7a.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex-partitioned/results/20261115/c6a.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex/results/20261115/c8g.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex-partitioned/results/20261115/c6a.2xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex/results/20261115/c6a.4xlarge.json.
Preview of the benchmark page with these results · Comparison with the previous results

Logs:

@github-actions

Copy link
Copy Markdown
Contributor

Results for datafusion-vortex are ready for: c6a.2xlarge.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex/results/20261115/c6a.2xlarge.json.
Preview of the benchmark page with these results · Comparison with the previous results

Logs:

@github-actions

Copy link
Copy Markdown
Contributor

Results for datafusion-vortex are ready for: c6a.xlarge.
Results for datafusion-vortex-partitioned are ready for: c6a.xlarge.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex-partitioned/results/20261115/c6a.xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as datafusion-vortex/results/20261115/c6a.xlarge.json.
Preview of the benchmark page with these results · Comparison with the previous results

Logs:

alexey-milovidov added a commit that referenced this pull request Nov 15, 2026
The rerun of the automated benchmark of #3056
(after the `0.90.0-55.2.0` tag of `vortex-datafusion-cli` was published) produced
results for `datafusion-vortex` and `datafusion-vortex-partitioned` on 7 machines each.
They are added here, and the manually added result files are removed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
alexey-milovidov added a commit that referenced this pull request Nov 15, 2026
Vortex 0.90.0 for DataFusion and DuckDB with automated results (replaces #3056, #3057)
@alexey-milovidov
alexey-milovidov merged commit 6db45b3 into ClickHouse:main Nov 15, 2026
3 checks passed
@alexey-milovidov

Copy link
Copy Markdown
Member

Thank you! Merged via #3355, together with the other Vortex 0.90.0 PR. The automation cannot push to branches of organization-owned forks, so #3355 adds the results of the automated benchmark runs from this pull request and removes the manually submitted ones.

@github-actions

Copy link
Copy Markdown
Contributor

The run of datafusion-vortex on c6a.large did not produce results.
The run of datafusion-vortex on t3a.small did not produce results.
The run of datafusion-vortex-partitioned on c6a.large did not produce results.
The run of datafusion-vortex-partitioned on t3a.small did not produce results.

Logs:

This branch was previously deployed

1 inactive deployment
benchmark-approval — 432efe68 Deployed Nov 11, 2026 by alexey-milovidov via launch #1151
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

machine:all PR benchmark on every machine type

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants