brandon/oam
1
0
Fork 0
mirror of https://gitea.com/mcereda/oam.git synced 2026-03-04 07:54:25 +00:00
Code Issues Packages Projects Releases Wiki Activity

chore(kb/ai): review and expand notes

Browse Source
This commit is contained in:
Michele Cereda
2026-02-20 02:19:19 +01:00
parent 272661fd34
commit c862d1208c
6 changed files with 121 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
knowledge base/ai/llama.cpp.md
View File

@@ -41,7 +41,7 @@ llama-cli -m 'path/to/target/model.gguf' -md 'path/to/draft/model.gguf'
# Download and run models.
llama-cli -mu 'https://example.org/some/model' # URL
llama-cli -hf 'ggml-org/gemma-3-1b-it-GGUF' -c '32.768' # Hugging Face
llama-cli -dr 'ai/qwen2.5-coder' --offline # Docker Hub
llama-cli -dr 'ai/qwen2.5' --offline # Docker Hub
# Launch the OpenAI-compatible API server.
llama-server -m 'path/to/model.gguf'