Orientation

Updated 2026-07-07

PrismML is a family of small open-weight language models built to run on ordinary hardware such as laptops, phones, and efficient servers. On this page you will learn what the supply chain around those models is, and you will find the fastest route to running one yourself.

Understand the supply chain

A model file on its own does nothing. Before you can type a prompt and get an answer, several tools have to do their part. Someone trains the model, someone compresses the weights so they fit on a small device, a runtime loads them, kernels do the math on your specific chip, and an evaluation loop tells you whether the output is any good. This wiki calls that chain of tools the supply chain, and each stage gets its own set of pages here. This is the short version, and the supply-chain layers page breaks the same chain into nine layers.

For example, when you run the Bonsai model on a laptop with llama.cpp, you touch four stages of the chain at once: the compressed weights on disk, the llama.cpp runtime that loads them, the CPU or GPU kernels that execute them, and the tokens per second you measure at the end.

The diagram below shows every stage and how they connect.

Problems and usersData and featuresModel architectureTraining and post-trainingCompression and formatsKernels and compilersRuntime and servingApps, agents, and devicesEvaluation and feedbackfeedbackIon StoicaIon Stoica: Data and featuresIon Stoica: Training and post-trainingIon Stoica: Runtime and servingIon Stoica: Evaluation and feedbackVinod KhoslaVinod Khosla: Compression and formatsVinod Khosla: Kernels and compilersVinod Khosla: Runtime and servingVinod Khosla: Apps, agents, and devicesPrismMLPrismML: Model architecturePrismML: Compression and formatsPrismML: Runtime and servingPrismML: Apps, agents, and devices

Runtime and serving

How does inference run reliably and cheaply?

Who lives here: llama.cpp, MLX, Ollama, LM Studio, vLLM, SGLang, Ray Serve.

Runtime map

Click a stage to see what it does and where to read more. Dots mark the stages each viewpoint cares about most.

Why the wiki centers on PrismML

PrismML positions its models around concentrated intelligence, which means packing as much capability as possible into weights small enough for local devices. That positioning makes the tradeoffs of the whole supply chain concrete. Model quality still counts, and these pages also treat memory use, energy use, runtime compatibility, and device-local deployment as primary subjects rather than footnotes.

Two other viewpoints shape what the wiki covers:

  • Ion Stoica. His work centers on open-source AI systems, distributed compute, serving, and evaluation infrastructure. Because of that, these pages document shared primitives, reproducible systems paths, and benchmark methodology.
  • Vinod Khosla. He argues that intelligence should become cheaper and more abundant, and less constrained by energy or datacenter bottlenecks. Because of that, these pages track intelligence per dollar, per watt, per gigabyte, and per device.

Know what to trust here

Every canonical page cites durable evidence such as official docs, repos, papers, model cards, release posts, benchmark logs, or reproducible device reports. Claims that only come from social posts stay labeled as unconfirmed until someone verifies them against a durable source. When a page shows commands we have not yet run on hardware, the page says so in plain words.

Next steps

See something wrong? Fix it.