All pull requests

Pull requests

• [Bugfix][Router] Return 503 when the P/D router has no prefill or decode endpoint

  #1215·dundysm opened Nov 13, 2026Contributor·

  ·
  1

  4

• [Bugfix][Router] Detect --enable-sleep-mode in the vllm container args

  #1213·dundysm opened Nov 13, 2026Contributor·3 tasks done·

  ·
  1

  6

• [Bugfix][Router] Route body-less GET /v1/audio/voices by the model query param

  #1211·dundysm opened Nov 13, 2026Contributor·3 tasks done·

  ·
  1

  6

• [Bugfix][Router] Resolve model aliases in disaggregated prefill routes

  #1209·LPhgh opened Nov 12, 2026·3 tasks done·

  ·

• [Bugfix][Router] Forward the resolved priority as vLLM's priority field

  #1207·Sonica-B opened Nov 12, 2026·2 of 3 tasks·

  ·
  3

• [Bugfix][Router] Record decoding length so avg_decoding_length is not always -1

  #1206·dundysm opened Nov 12, 2026Contributor·3 tasks done·

  ·
  1

  1

• [Bugfix][Router] Pick randomly among tied least-loaded engines in PriorityRouter policy

  #1204·Scanf-s opened Nov 12, 2026·3 tasks done·

  ·
  1

  5

• [Feat][Router] Add RFC for request migration on engine failure (#855)

  #1202·punitvara opened Nov 10, 2026Contributor·2 tasks done·

  ·
  10

• [Doc][Router] Propose tenant-constrained routing with session affinity

  #1201·hfeiuhog opened Nov 9, 2026·

  ·
  7

• fix(helm): pin cache server image to v0.5.6 for lmcache_server

  #1200·justrunme opened Nov 9, 2026·

  ·
  1

• [Feat][Bugfix][Doc] Operator: LMCache multiprocess mode, with in-process mode kept

  #1199·h1manshu23 opened Nov 8, 2026·3 tasks done·

  ·
  1

  6

• [Router] Keep a running sum in MovingAverageMonitor

  #1198·waynehacking8 opened Nov 6, 2026·3 tasks done·

  ·
  3

• [Bugfix][Router] Label /sleep and /wake_up on service-name and static discovery

  #1197·chrikrah opened Nov 5, 2026Contributor·3 tasks done·

  ·
  3

• [CI/Build] Restart k8s e2e engines that die during startup

  #1196·rahulssv-ibm opened Nov 5, 2026·3 tasks done·

  ·
  2

• [Bugfix][Router] Make model catalog ordering deterministic

  #1194·surak opened Nov 4, 2026·3 tasks done·

  ·
  1

  3

• [BugFix][Router] Sum DP engine stats instead of keeping the last sample

  #1191·nvisional opened Nov 3, 2026·2 tasks done·

  ·
  1

  6

• [Bugfix][Router] Forward repeated /wake_up tags to the engine

  #1189·chrikrah opened Nov 2, 2026Contributor·3 tasks done·

  ·

• [CI/Build] Let Dependabot update Python dependencies

  #1188·hafkensite opened Nov 2, 2026·3 tasks done·

  ·
  3

• [Router][Feat] Add --disable-access-log-for-endpoints to hide paths from the access log

  #1187·niekvleeuwen opened Oct 31, 2026·

  ·
  1

  7

• [Feat][Helm] Add a router-level Grafana dashboard

  #1186·highlyavailable opened Oct 31, 2026·2 of 3 tasks·

  ·
  1

  3

• [Bugfix][Router] Retry a failed dynamic config slowly instead of every check

  #1184·shubhamkapoor01 opened Oct 29, 2026·3 tasks done·

  ·
  3

• [Bugfix][Router] Return a non-JSON external-provider response instead of retrying it

  #1183·chrikrah opened Oct 28, 2026Contributor·3 tasks done·

  ·
  2

• [Feat][Helm] Harden router and cache-server default security contexts

  #1182·mallyagirish opened Oct 27, 2026·3 tasks done·

  ·
  1

  4

• [Feat] [Operator] Add securityContext support to VLLMRouter and CacheServer CRDs

  #1180·mallyagirish opened Oct 27, 2026·10 of 15 tasks·

  ·
  1

  4

• [Bugfix][Router] Wait the health-check interval after a failed static check

  #1178·chrikrah opened Oct 25, 2026Contributor·3 tasks done·

  ·
  2