Skip to content
Discussion options

You must be logged in to vote

Jan does prepend system-level context, but there are two different paths in the current app.

Normal chat

The base prompt is the selected Assistant's instructions. The built-in Jan assistant is defined in useAssistant.ts, and you can inspect/edit an Assistant's instructions in the Assistant configuration UI rather than looking in the llama.cpp model files.

At send time, CustomChatTransport.buildSystemPrompt() combines:

  1. the Assistant's instructions (systemMessage);
  2. attached-file instructions;
  3. Web Search instructions;
  4. Agent Tools instructions.

That combined string is then passed as the system field to streamText() in the same file. So there is not necessarily one static prompt file contain…

Replies: 2 comments 1 reply

Comment options

You must be logged in to vote
1 reply
@abitrolly
Comment options

Answer selected by abitrolly
Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants