Local LLMs on a ThinkStation PGX
In 2026 I served open-weight models on a Lenovo ThinkStation PGX, Lenovo's take on the NVIDIA DGX Spark: Qwen3.8-27B, Qwen3.5-122B, Nemotron 3 Super, Gemma 4 and DeepSeek V4 Flash, with vLLM, SGLang and llama.cpp. My first Hermes Agent setup ran on it.
A 2-bit DeepSeek V4 Flash, about 97 GB of weights in 128 GB of memory, read a 420,000-token prompt in a single session on an experimental runtime. Qwen3.8-27B took 260,000-token prompts and reached 32 tokens a second with speculative decoding. On a tool-use benchmark of 84 scenarios, the best of 14 configurations scored 92/100.