My Setup

The whole stack behind the videos — hardware up to the models, including the configs that make it run. Click any item for specs and config snippets.

⚠ Draft — real software/GPU specs pulled from the rig; items marked “TBD” are physical host details still to fill in.

Apps & Agents

What I actually drive it with2 items

Models

Loaded on demand via llama-swap3 items

Inference & Serving

llama.cpp behind a hot-swapping proxy2 items

Hypervisor / OS

GPUs passed through to a dedicated VM2 items

Hardware

The metal9 items