Prompt format
You can use {prompt}
or {{prompt}}
to indicate a prompt.
The system prompt can be specified at the beginning of the template in the format [system](<your system prompt>)
.
BOS option:
Adds the Begin Of Session token to the beginning of the prompt.
EOS option:
Adds the End Of Session token to the end of the prompt.
Option Special:
If enabled, the tokenizer will accept special tokens in the template, such as <|user|>
.
Option reverse prompts:
Allows you to specify sequences at the occurrence of which the prediction will be stopped. The sequences are specified using commas.
Example: <|end|>,user:
.
Option skip tokens:
Allows you to specify tokens (in string format) that will not be displayed in the prediction results. Tokens are specified using commas.
Example: <|end|>,<|assistant|>
.
System Prompt
System prompt can be specified in the prompt template field according to the following rule:
[system](<system prompt>)
<template>
Example:
[system](You are a helpful, respectful and honest assistant.)
### User: {prompt}
### Assistant: