Dossier
Needle
Coverage of Needle in the Nexus archive.
- Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
Cactus open-sourced Needle, a 26M parameter model for tool calling on consumer devices, which achieves high performance and efficiency. The model was trained on 200B tokens and can be fine-tuned on Mac/PC. Needle outperforms other models in single-shot function calling.