Show HN: Bonsai – A Competitive Ternary Weight LLM https://ift.tt/PORbYKu

Show HN: Bonsai – A Competitive Ternary Weight LLM Introducing Bonsai 0.5B, one of the first ternary-weight LLMs to rival full-precision models of similar size, such as Qwen 2.5 0.5B and MobileLLM 0.5B. Trained on just 3.8B tokens, using 1,000x less data than other models, Bonsai redefines what’s possible for ultra-efficient training in low-bit models. Next, we're building larger and more powerful ternary-weight models for the edge. Technical Report: https://ift.tt/nXbyp9P... Model (Unpacked): https://ift.tt/RfJycSL Reach us: team@deepgrove.ai https://ift.tt/nOP8fVp March 22, 2025 at 12:52AM

Comments