The 1-bit compressed model runs on an iPhone 17 Pro at about 11 tokens per second while keeping most of its accuracy.
Tag: on-device AI
AI field splits between smaller on-device models and larger cloud models
Analysts describe July 16 as a snapshot the day before Google’s Gemini 3.5 Pro launch.