Skill UI

Outlines guarantees valid JSON/XML/code outputs by applying CFG/FSM-constrained token filtering, Pydantic schemas, and grammar-level sampling while supporting local Transformers, llama.cpp, and vLLM backends for fast inference.

SGLang is a high-performance serving framework for LLMs and VLMs that uses RadixAttention prefix caching to deliver structured outputs (JSON/regex/grammar) and agentic workflows with function calls, providing up to 5× faster inference than vLLM across multi-GPU production deployments.

This comprehensive guide demonstrates how to build a robust AI language tutoring session using the Speak SDK. It covers initiating conversations, submitting student responses (text or audio), performing deep pronunciation assessment at the phoneme level, and generating detailed session summaries with grammar and vocabulary metrics. Ideal for developing language education platforms and testing API integration.