Model Releases

  • 🤖 prism-ml/Ternary-Bonsai-27B-gguf — A 2-bit ternary GGUF quantization of Qwen3.6-27B built for on-device inference through llama.cpp, with CUDA and Metal backends. If you’re trying to get a 27B model onto a laptop without melting it, this is the kind of artifact worth a look.

  • 🤖 prism-ml/Bonsai-27B-gguf — The 1-bit sibling of the above, same Qwen base pushed further down the quantization rabbit hole. At 1-bit you’re mostly storing vibes, but for tight edge deployments it might just hold together.

  • 🤖 GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking — A community finetune of OpenBMB’s MiniCPM5-1B tuned for instruction-following, coding, and “thinking,” with English and Chinese support. The name is doing a lot of cosplay, but a 1B model that runs anywhere is still a useful thing to have around.

Open Source Releases

  • 🛠️ virattt/ai-hedge-fund — A repo that simulates a team of AI agents making hedge-fund decisions. Whether it beats the market or just your patience is left as an exercise for the reader.

  • 🛠️ HenryNdubuaku/maths-cs-ai-compendium — A curated collection of math, CS, and AI resources aimed at turning readers into competent ML research engineers. Less hype, more linear algebra — which is the correct ratio.

Research Worth Reading

Today’s Synthesis

If you’re building internal tooling that lets non-engineers query databases by typing plain-English questions, today’s drops line up into a tidy, self-hosted stack. Start with a 2-bit quantized 27B like prism-ml/Ternary-Bonsai-27B-gguf and run it entirely inside your own perimeter on a single GPU box — the 2-bit weights trade a little reasoning sharpness for the ability to keep a 27B resident without a rack of H100s, and it dovetails with the tenant-owned, auditable LLM argument in Ontology-Amplified Distillation and Contextuality Auditing for Sovereign Enterprise Language Models : keep the weights and the data local, skip the compliance theater. Then bolt on the grammar-railed decoding from GRID: Grammar-Railed Decoding for Enterprise SQL Generation 🔥 so every generated query is syntactically valid and policy-compliant by construction, not by prayer. The result is a SQL assistant that physically cannot emit a DROP TABLE it isn’t cleared for, and you can show an auditor the guardrails. For teams tired of explaining cloud egress to security, that’s a weekend project, not a quarter-long initiative.