Skill UI

Automates FastAPI ML endpoint deployments by guiding architecture, producing production-ready code, and validating serving configs when you invoke the ML deployment skill.

SGLang is a high-performance serving framework for LLMs and VLMs that uses RadixAttention prefix caching to deliver structured outputs (JSON/regex/grammar) and agentic workflows with function calls, providing up to 5× faster inference than vLLM across multi-GPU production deployments.

Optimizes large language model inference on NVIDIA GPUs with TensorRT, delivering 10-100× faster throughput, quantized precision (FP8/INT4), multi-GPU scaling, and serving-ready tooling for production deployments.