AIAny
AI Model2026
Icon for item

Ternary Bonsai 27B (prism-ml/Ternary-Bonsai-27B-mlx-2bit)

Runs a full 27B-class Qwen3.6-derived LLM in a ~7.2 GB ternary/2‑bit format for on-device or single‑GPU text generation, retaining ~95% of FP16 performance and supporting a 262K‑token context. Designed for laptop/GPU deployment; exceeds typical phone memory limits.

Introduction

Oops! Something went wrong

[next-mdx-remote-client] error compiling MDX: Could not parse expression with acorn More information: https://mdxjs.com/docs/troubleshooting-mdx

Information

  • Websitehuggingface.co
  • OrganizationsPrism ML, Hugging Face
  • Published date2026/07/04

Categories

More Items

Hugging Face
AI Model2026

Generates text conditioned on multimodal inputs (text, image, audio, video) with a 1M-token context window; an open-weights mixture-of-experts model aimed at long-horizon coding and agentic workflows, with NVFP4 checkpoints to reduce memory footprint.

Hugging Face
AI Model2026

Quantized multimodal vision-language model for reasoning, coding, tool use, document and video understanding; 120B total (12B active) with NVFP4 quantization, native Multi-Token Prediction for speculative decoding, and up to 1M-token context — designed for deployment on NVIDIA GPU stacks.

Hugging Face
AI Model2026

Text-only sparse Mixture-of-Experts language model for long-context reasoning, coding, and agentic tool use; 501B total / ~23B active parameters, 1M-token context, and BF16/FP8/NVFP4 checkpoints released under Apache 2.0.