Nice, Silkworm next?
10.02.2025 21:57
👍 0
🔁 0
💬 1
📌 0
Nice, Silkworm next?
My favorite books read in 2024
Yes, the error is on the ollama setup of the model as far as I can see. In some cases ollama issues can also have a root in llama.cpp
Same thing I saw. Basically Ollama doesn't stop the llm when the model indicates it's done through the <|endoftext|> token.
Fixed for me through the custom model file link to above (which can be imported through ollama create qwk-fix-stop:latest -f qwq-fix-stop-modelfile.md
FROM qwq:latest)
Think the ollama modelfile for qwq is missing a stopword for <|endoftext|>
See of this helps
github.com/elsewhat/adv...
Testing out qwq local llm against adventofcode.com
The chain of thought reasoning of this 32b model is massively impressive.
See for example
github.com/elsewhat/adv...
Tested out day 1,2,3 and all were solved correctly on first attempt
Great planning for the fourth session of our bouvet internal architecture school.l Focuses on architecture in challenging deliveries through
1. Real life story telling
2. How to get back on track from delivery leads
3. Identify the signals
4. Incident mgmt and post mortems
5. Secure architecture
Only two more days till the release of the final book in Brandon Sandersons Stormlight archives series
www.goodreads.com/book/show/20...
In awe of Qwq 32b model reasoning skills and chain of thoughts. Q4 runs fully in memory on my local 4090 gpu with great speed.
Plan to test some more on the advent of code tasks
ollama.com/library/qwq
Alt+F4 on x account.
Ahhh and now a fresh start
