27 lines
1.1 KiB
Plaintext
27 lines
1.1 KiB
Plaintext
# ollama-utils-metadata
|
|
# hf_upstream: https://huggingface.co/mistralai/Ministral-3-8B-Reasoning-2512-gguf
|
|
# quantization: q5_k_m
|
|
# capabilities: tools,vision,thinking
|
|
FROM ./Ministral-3-8B-Reasoning-2512-Q5_K_M.gguf
|
|
|
|
# Specialized parser
|
|
PARSER ministral
|
|
|
|
# Parameters tuned for logic/reasoning
|
|
PARAMETER num_ctx 75776
|
|
PARAMETER temperature 0.7
|
|
PARAMETER top_p 0.95
|
|
PARAMETER stop "</s>"
|
|
PARAMETER stop "[INST]"
|
|
PARAMETER stop "[/INST]"
|
|
PARAMETER stop "[/THINK]"
|
|
|
|
# Template
|
|
TEMPLATE """{{ if .System }}[SYSTEM_PROMPT]{{ .System }}[/SYSTEM_PROMPT]{{ end }}[INST]{{ .Prompt }}[/INST]"""
|
|
|
|
SYSTEM """# HOW YOU SHOULD THINK AND ANSWER
|
|
|
|
First draft your thinking process (inner monologue) until you arrive at a response. Format your response using Markdown, and use LaTeX for any mathematical equations. Write both your thoughts and the response in the same language as the input.
|
|
|
|
Your thinking process must follow the template below:[THINK]Your thoughts or/and draft, like working through an exercise on scratch paper. Be as casual and as long as you want until you are confident to generate the response to the user.[/THINK]Here, provide a self-contained response."""
|