Skill UI

This guide provides comprehensive instructions for installing and configuring the official Groq SDK in both Python and TypeScript environments. It covers dependency setup, secure API key management using environment variables, and provides code examples to verify a successful connection to Groq's ultra-fast LLM inference API. Essential for initiating any project powered by Groq.

This skill automates the setup and configuration of Ollama, allowing users to deploy Large Language Models (LLMs) locally. It performs system assessment (OS, GPU, RAM), selects optimal models based on hardware availability, and handles installation across macOS, Linux, and Docker. Use this when you require free, self-hosted AI alternatives, need offline inference capabilities, or wish to eliminate reliance on costly hosted API services.

This guide provides expert strategies for optimizing GPU inference performance on CoreWeave infrastructure. It covers GPU selection based on workload (LLM, image generation, training), advanced techniques like continuous batching (using vLLM), autoscaling setup (HPA), and benchmarking data. Use this to maximize GPU utilization, minimize latency, and optimize large-scale AI model deployment.

A comprehensive guide to advanced, production-ready LLM inference using LangChain 1.0. This skill addresses common pitfalls and bugs when integrating multiple providers (Claude, GPT-4o, Gemini), covering issues like structured output reliability, correct streaming token accounting, and robust handling of complex AIMessage content blocks. It teaches best practices for model initialization, provider routing, and version-safe code implementation.

A comprehensive reference guide for common errors encountered when interacting with the Together AI API. This includes error codes and solutions for inference, fine-tuning, and model deployment, covering authentication, rate limits, validation failures, and billing issues. Essential for developers integrating OpenAI-compatible LLM services.

A comprehensive workflow guide for fine-tuning open-source Large Language Models (LLMs) using the Together AI API. This process covers preparing structured training data (JSONL format), uploading the file, initiating the fine-tuning job, monitoring the training status, and finally deploying the custom model for inference. Ideal for developers needing to customize models for specific enterprise tasks, such as customer support or specialized content generation.

This tool is a deterministic formatter for generating the final delivery summary for academic papers (meta-paper-write). It accepts JSON inputs including paper contracts, compiled PDFs, and citation maps. It strictly reports only verified fields and consistent citation statistics, ensuring the output is machine-readable and never relies on LLM inference or prose counting.

Configure a Mac mini as a reliable local LLM server with remote access, observability, and power-safe operation. Use when building an always-on private AI inference server on Apple Silicon.

Deploy and manage vLLM for high-throughput LLM inference. Configure continuous batching, tensor parallelism, quantization, and OpenAI-compatible API endpoints for production LLM serving.