parallelquant
July 29, 2026 · Berkeley AI Research

Berkeley researchers port CUDA kernel expertise to Apple Silicon

A Berkeley AI Research project called K-Search translates hand-tuned CUDA GPU kernel optimizations - for things like attention and state space models - into architecture-native strategies for Apple's MLX framework, rather than copying instructions one-for-one. The goal is to let newer hardware ecosystems benefit from CUDA's decade of accumulated kernel expertise without rediscovering it from scratch.

Why it matters: As AI hardware diversifies beyond Nvidia toward Apple Silicon and other custom accelerators, portable low-level performance engineering becomes as important a bottleneck as chip design itself - work like this could meaningfully speed up on-device and Apple-hardware inference. It's a concrete example of using AI-assisted translation to close the gap between CUDA's mature tooling and newer silicon platforms, rather than waiting years for each vendor to build it independently.

Related updates