Skip to content

Any examples using local models/OpenRouter? #470

Open

Description

@asmith26

Hi there,

Just wondering if there are any example of using this library with local models e.g. via Ollama (or free offerings like OpenRouter.ai)?

Thanks!

Activity

  1. changed the title [-]Any examples using local models?[/-] [+]Any examples using local models/OpenRouter?[/+] on Jan 29, 2026
  2. ultmaster commented on Feb 9, 2026

    @ultmaster
    Contributor

    If you are using APO, using local models via ollama is no different from using OpenAI models.

    If you are using RL, vLLM is still the recommended approach to serve the model if trained with VERL. Ollama is not supported.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionQuestion about a feature or some usage

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions