Topic

On-Device

Small and on-device AI — models compressed to run on phones, browsers, and the edge, away from the API.

IEEE Spectrum

Small, on-device AI models gain traction globally

IEEE Spectrum reports growing global adoption of small, low-power AI models that run without a network connection, citing Nigerian startup founder Adebayo Alonge's RxScanner, a handheld spectrometer that identifies counterfeit medication via AI, as an example of a device shrunk to run entirely on an Android phone after cloud latency made it impractical in the field.

Why it matters: Highlights a shift toward compact AI models for regions with limited connectivity.

on-device source ↗

MarkTechPost

Google releases LiteRT.js for running AI models in browsers

Google released LiteRT.js on July 9, 2026, a JavaScript binding for its on-device inference library LiteRT that runs .tflite models directly in browsers. It uses WebAssembly with XNNPACK on CPU, ML Drift over WebGPU, and experimental WebNN for NPUs, with Google reporting up to 3x gains over other web runtimes and 5-60x for GPU/NPU versus its own CPU path.

Why it matters: Gives web developers a faster path to run AI models client-side without a server.

on-device source ↗

← all topics all updates