initial commit
This commit is contained in:
@@ -0,0 +1,20 @@
|
||||
# ollama-utils-metadata
|
||||
# hf_upstream: https://huggingface.co/mistralai/Ministral-3-3B-Instruct-2512-GGUF/blob/main/Ministral-3-3B-Instruct-2512-Q5_K_M.gguf
|
||||
# capabilities: tools,vision
|
||||
FROM ./Ministral-3-3B-Instruct-2512-Q5_K_M.gguf
|
||||
|
||||
# Specialized parser for Mistral 3 logic
|
||||
PARSER ministral
|
||||
|
||||
# Full context and recommended stability parameters
|
||||
PARAMETER num_ctx 32768
|
||||
PARAMETER temperature 0.15
|
||||
PARAMETER top_p 1.0
|
||||
PARAMETER stop "</s>"
|
||||
PARAMETER stop "[INST]"
|
||||
PARAMETER stop "[/INST]"
|
||||
|
||||
# Template: Basic structure that lets the PARSER handle the heavy lifting
|
||||
TEMPLATE """{{ if .System }}[SYSTEM_PROMPT]{{ .System }}[/SYSTEM_PROMPT]{{ end }}[INST]{{ .Prompt }}[/INST]"""
|
||||
|
||||
SYSTEM """You are a helpful and concise AI assistant."""
|
||||
@@ -0,0 +1,26 @@
|
||||
# ollama-utils-metadata
|
||||
# hf_upstream: https://huggingface.co/mistralai/Ministral-3-3B-Reasoning-2512-gguf
|
||||
# quantization: q5_k_m
|
||||
# capabilities: tools,vision,thinking
|
||||
FROM ./Ministral-3-3B-Reasoning-2512-Q5_K_M.gguf
|
||||
|
||||
# Specialized parser
|
||||
PARSER ministral
|
||||
|
||||
# Parameters tuned for logic/reasoning
|
||||
PARAMETER num_ctx 32768
|
||||
PARAMETER temperature 0.7
|
||||
PARAMETER top_p 0.95
|
||||
PARAMETER stop "</s>"
|
||||
PARAMETER stop "[INST]"
|
||||
PARAMETER stop "[/INST]"
|
||||
PARAMETER stop "[/THINK]"
|
||||
|
||||
# Template
|
||||
TEMPLATE """{{ if .System }}[SYSTEM_PROMPT]{{ .System }}[/SYSTEM_PROMPT]{{ end }}[INST]{{ .Prompt }}[/INST]"""
|
||||
|
||||
SYSTEM """# HOW YOU SHOULD THINK AND ANSWER
|
||||
|
||||
First draft your thinking process (inner monologue) until you arrive at a response. Format your response using Markdown, and use LaTeX for any mathematical equations. Write both your thoughts and the response in the same language as the input.
|
||||
|
||||
Your thinking process must follow the template below:[THINK]Your thoughts or/and draft, like working through an exercise on scratch paper. Be as casual and as long as you want until you are confident to generate the response to the user.[/THINK]Here, provide a self-contained response."""
|
||||
20
modelfile-repo/ministral-3-3b-instruct-2512-q5_k_m.Modelfile
Normal file
20
modelfile-repo/ministral-3-3b-instruct-2512-q5_k_m.Modelfile
Normal file
@@ -0,0 +1,20 @@
|
||||
# ollama-utils-metadata
|
||||
# hf_upstream: https://huggingface.co/mistralai/Ministral-3-3B-Instruct-2512-GGUF/blob/main/Ministral-3-3B-Instruct-2512-Q5_K_M.gguf
|
||||
# capabilities: tools,vision
|
||||
FROM ./Ministral-3-3B-Instruct-2512-Q5_K_M.gguf
|
||||
|
||||
# Specialized parser for Mistral 3 logic
|
||||
PARSER ministral
|
||||
|
||||
# Full context and recommended stability parameters
|
||||
PARAMETER num_ctx 32768
|
||||
PARAMETER temperature 0.15
|
||||
PARAMETER top_p 1.0
|
||||
PARAMETER stop "</s>"
|
||||
PARAMETER stop "[INST]"
|
||||
PARAMETER stop "[/INST]"
|
||||
|
||||
# Template: Basic structure that lets the PARSER handle the heavy lifting
|
||||
TEMPLATE """{{ if .System }}[SYSTEM_PROMPT]{{ .System }}[/SYSTEM_PROMPT]{{ end }}[INST]{{ .Prompt }}[/INST]"""
|
||||
|
||||
SYSTEM """You are a helpful and concise AI assistant."""
|
||||
@@ -0,0 +1,26 @@
|
||||
# ollama-utils-metadata
|
||||
# hf_upstream: https://huggingface.co/mistralai/Ministral-3-3B-Reasoning-2512-gguf
|
||||
# quantization: q5_k_m
|
||||
# capabilities: tools,vision,thinking
|
||||
FROM ./Ministral-3-3B-Reasoning-2512-Q5_K_M.gguf
|
||||
|
||||
# Specialized parser
|
||||
PARSER ministral
|
||||
|
||||
# Parameters tuned for logic/reasoning
|
||||
PARAMETER num_ctx 32768
|
||||
PARAMETER temperature 0.7
|
||||
PARAMETER top_p 0.95
|
||||
PARAMETER stop "</s>"
|
||||
PARAMETER stop "[INST]"
|
||||
PARAMETER stop "[/INST]"
|
||||
PARAMETER stop "[/THINK]"
|
||||
|
||||
# Template
|
||||
TEMPLATE """{{ if .System }}[SYSTEM_PROMPT]{{ .System }}[/SYSTEM_PROMPT]{{ end }}[INST]{{ .Prompt }}[/INST]"""
|
||||
|
||||
SYSTEM """# HOW YOU SHOULD THINK AND ANSWER
|
||||
|
||||
First draft your thinking process (inner monologue) until you arrive at a response. Format your response using Markdown, and use LaTeX for any mathematical equations. Write both your thoughts and the response in the same language as the input.
|
||||
|
||||
Your thinking process must follow the template below:[THINK]Your thoughts or/and draft, like working through an exercise on scratch paper. Be as casual and as long as you want until you are confident to generate the response to the user.[/THINK]Here, provide a self-contained response."""
|
||||
20
modelfile-repo/ministral-3-8b-instruct-2512-q5_k_m.Modelfile
Normal file
20
modelfile-repo/ministral-3-8b-instruct-2512-q5_k_m.Modelfile
Normal file
@@ -0,0 +1,20 @@
|
||||
# ollama-utils-metadata
|
||||
# hf_upstream: https://huggingface.co/mistralai/Ministral-3-3B-Instruct-2512-GGUF/blob/main/Ministral-3-3B-Instruct-2512-Q5_K_M.gguf
|
||||
# capabilities: tools,vision
|
||||
FROM ./Ministral-3-3B-Instruct-2512-Q5_K_M.gguf
|
||||
|
||||
# Specialized parser for Mistral 3 logic
|
||||
PARSER ministral
|
||||
|
||||
# Full context and recommended stability parameters
|
||||
PARAMETER num_ctx 32768
|
||||
PARAMETER temperature 0.15
|
||||
PARAMETER top_p 1.0
|
||||
PARAMETER stop "</s>"
|
||||
PARAMETER stop "[INST]"
|
||||
PARAMETER stop "[/INST]"
|
||||
|
||||
# Template: Basic structure that lets the PARSER handle the heavy lifting
|
||||
TEMPLATE """{{ if .System }}[SYSTEM_PROMPT]{{ .System }}[/SYSTEM_PROMPT]{{ end }}[INST]{{ .Prompt }}[/INST]"""
|
||||
|
||||
SYSTEM """You are a helpful and concise AI assistant."""
|
||||
@@ -0,0 +1,26 @@
|
||||
# ollama-utils-metadata
|
||||
# hf_upstream: https://huggingface.co/mistralai/Ministral-3-3B-Reasoning-2512-gguf
|
||||
# quantization: q5_k_m
|
||||
# capabilities: tools,vision,thinking
|
||||
FROM ./Ministral-3-3B-Reasoning-2512-Q5_K_M.gguf
|
||||
|
||||
# Specialized parser
|
||||
PARSER ministral
|
||||
|
||||
# Parameters tuned for logic/reasoning
|
||||
PARAMETER num_ctx 32768
|
||||
PARAMETER temperature 0.7
|
||||
PARAMETER top_p 0.95
|
||||
PARAMETER stop "</s>"
|
||||
PARAMETER stop "[INST]"
|
||||
PARAMETER stop "[/INST]"
|
||||
PARAMETER stop "[/THINK]"
|
||||
|
||||
# Template
|
||||
TEMPLATE """{{ if .System }}[SYSTEM_PROMPT]{{ .System }}[/SYSTEM_PROMPT]{{ end }}[INST]{{ .Prompt }}[/INST]"""
|
||||
|
||||
SYSTEM """# HOW YOU SHOULD THINK AND ANSWER
|
||||
|
||||
First draft your thinking process (inner monologue) until you arrive at a response. Format your response using Markdown, and use LaTeX for any mathematical equations. Write both your thoughts and the response in the same language as the input.
|
||||
|
||||
Your thinking process must follow the template below:[THINK]Your thoughts or/and draft, like working through an exercise on scratch paper. Be as casual and as long as you want until you are confident to generate the response to the user.[/THINK]Here, provide a self-contained response."""
|
||||
1078
modelfile-repo/script.js
Normal file
1078
modelfile-repo/script.js
Normal file
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user