vLLM Archives - ITNotes

Mastering Outlines in Python: Guaranteed Structured LLM Output with Regex and CFGs

October 19, 2026

Frustrated with broken JSON from commercial LLM APIs? Discover how Outlines uses regular expressions and context-free grammars to guarantee valid structured outputs in Python.

Deploy SGLang with Docker on Linux: Faster LLM Inference Using RadixAttention

October 8, 2026

SGLang uses RadixAttention to cache shared prefixes across requests — making it significantly faster than vLLM for chatbots, agents, and RAG pipelines. This guide covers deploying SGLang with Docker on Linux: from GPU toolkit setup to a production-ready Docker Compose configuration.

Boost Your Local LLM Speed: A Hands-On Guide to Speculative Decoding

May 6, 2026

Boost your local LLM speed by 2x or more. This guide covers the practical setup for Speculative Decoding using llama.cpp and vLLM on consumer GPUs.

High-Performance LLM Inference: Scaling vLLM and Docker for Production

April 27, 2026

Boost your AI performance with vLLM and Docker. Learn to use PagedAttention, Tensor Parallelism, and quantization to scale LLMs for hundreds of concurrent users.