Skip to content

[Bug]: 为何配置文件里不给LLM设置超时时间? #333

Closed

Description

@leiwuhen92

Area

src/everos

What happened?

一次问答出现报错:
Image

排查:
1、curl测试模型是可以正常工作的 ---> 推出:everos内部LLM调用超时
2、配置文件.env中可以配置embedding、reranker的超时时间,但无法配置llm的超时时间。
Image

追溯源码:
LLM默认超时时间:60s
Image

embedding默认超时时间:30s
Image

期望
配置文件里也有LLM的超时时间参数

Steps to reproduce

No

Environment

No response

Logs or screenshots

Activity

  1. cyfyifanchen commented on Sep 9, 2026

    @cyfyifanchen
    Collaborator

    Thanks for flagging this. I checked the current 1.3.1 source on main (5076683), and the main application client now accepts a configurable LLM timeout.

    You can add this to the existing [llm] section in your everos.toml, then restart EverOS:

    [llm]
    timeout_seconds = 240

    Or set EVEROS_LLM__TIMEOUT_SECONDS=240 in the environment of the process that starts EverOS. An exported environment value takes precedence over TOML. Putting it only in a .env file requires your launcher to load that file; Settings does not load it automatically.

    I tested both configuration paths against the real client constructors: 180 seconds from the environment and 240 seconds from TOML reached the EverAlgo client, OpenAI SDK, and HTTPX timeouts. I also checked environment-over-TOML precedence, the 60-second default, and rejection of zero/negative values. No live model request was used, so this does not claim that the original endpoint error has been reproduced and eliminated.

    Closing the configuration request as addressed. #341 stays open for the separate provider-factory path and the missing template/documentation updates. If requests still time out after setting this and restarting, please share the EverOS version, model/provider, and a redacted error so we can investigate that behavior separately.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions