Repository navigation
server: refactor child --> router communication - #24821
Merged
Merged
Conversation
3 of 4 tasks
ngxson
commented
Jun 19, 2026
Collaborator
Author
There was a problem hiding this comment.
note: this change is unrelated to the current PR
because I planned to move common_params_handle_models to be called by server, I already touched this before realizing that's not a good plan. nevertheless, it will be for the third item of #24822
Collaborator
Author
|
@ServeurpersoCom I'm merging this after the CI passes; no need for testing on your side. I think the next item in my list, "Report model loading progress back to router" will worth testing. The plan is to have |
Contributor
|
That's classy, you're building the advanced version of the initial ask, an instant router response on weights loading. Looking forward to it! |
jimbothigpen
added a commit
to jimbothigpen/af-engn
that referenced
this pull request
Jun 20, 2026
Absorbs PRs ggml-org#24821 ggml-org#24796 ggml-org#24779 ggml-org#24817 ggml-org#23168 ggml-org#24787 ggml-org#24801 ggml-org#24794 ggml-webgpu F16 toggles, server router/agent refactor, cpp-httplib 0.48.0, utf8 windows fix, docker UI build. No conflicts with our custom backends.
adrianhoehne
pushed a commit
to adrianhoehne/llama.cpp
that referenced
this pull request
Jul 5, 2026
* server: refactor child --> router communication * fix wakeup case * add docs * improve update_status() * nits
zommiommy
pushed a commit
to zommiommy/llama.cpp
that referenced
this pull request
Aug 18, 2026
* server: refactor child --> router communication * fix wakeup case * add docs * improve update_status() * nits
zbrad
pushed a commit
to zbrad/llama.cpp
that referenced
this pull request
Sep 10, 2026
* server: refactor child --> router communication * fix wakeup case * add docs * improve update_status() * nits
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
Part of #24822
Refactor the stdin/out communication child --> router
We are now using an "unified" message format:
cmd_child_to_router:state:{json_string}and the json string contains both the state + payloadRequirements