Perplexity details the GPU infrastructure behind its search embeddings

Perplexity's engineering team published a technical account of the serving infrastructure behind its pplx-embed model, covering the GPU stack (internally named Ivy, Tulip, and ROSE) used to run embedding and ranking models at scale. The post focuses on keeping large-scale embedding inference fast and cheap.

Why it matters: Retrieval quality in AI search products is gated as much by serving cost as by model quality, since cheaper inference lets a company embed and re-rank more documents per query. Publishing this level of infrastructure detail is also a credibility play, signaling engineering depth in a market that increasingly competes on search quality rather than model access alone.