Oops! Something went wrong
[next-mdx-remote-client] error compiling MDX: Could not parse expression with acorn More information: https://mdxjs.com/docs/troubleshooting-mdx
AI Model2026
Ternary Bonsai 27B (prism-ml/Ternary-Bonsai-27B-mlx-2bit)
Runs a full 27B-class Qwen3.6-derived LLM in a ~7.2 GB ternary/2‑bit format for on-device or single‑GPU text generation, retaining ~95% of FP16 performance and supporting a 262K‑token context. Designed for laptop/GPU deployment; exceeds typical phone memory limits.
Introduction
Information
- Websitehuggingface.co
- OrganizationsPrism ML, Hugging Face
- Published date2026/07/04
Categories
More Items
AI Model2026
A GGUF-format Qwen3.6 35B base model image-text-to-text release repaired via tensor-level SVD/scale correction and packaged with Hermes agent tweaks; multimodal (vision + text), MoE architecture, ready for GGUF runtimes like llama.cpp.
AI Model2026
Generates 2048-d multilingual text embeddings for retrieval and semantic search, suited for RAG and dense retrieval. Pruned and distilled from the Ministral-3 family into a ~1.14B BF16 model, supports long contexts (up to 32,768 tokens) and optimized for NVIDIA GPU inference.
AI Model2026
Provides GGUF-format fine-tuned Qwen3.6-27B weights optimized for consumer hardware, offering NEO IMATRIX and MTP quant variants, vision support, 256k native context, and uncensored 'heretic' traces with published benchmark improvements over the base model.