Wait NVIDIA has just released new SOTA open source models?!
Available in 4 sizes 1.5B, 7B, 14B and 32B that you can run 100% locally.
- OpenReasoning-Nemotron
- SOTA scores across many benchmarks
- Tailored for math, science, code
How to run it on your laptop and details below
You can run them using LM Studio for free:
1. Download LM Studio for macOS, Windows or Linux
2. In the search tab, type "openreasoning"
3. Install the version you want
I suggest the 7B (very good for its size) from Bartowski in the Q4_0 quantization if you're using an ARM processor like me.
Then you can start using it right away!
1. Load it from the top bar
2. Just type your prompt!
Useful links:
→ Official blog post: https://huggingface.co/blog/nvidia/openreasoning-nemotron
→ Models on Hugging Face: https://huggingface.co/collections/nvidia/openreasoning-nemotron-687730dae0170059860f1f01
