Skill UI

Guides ML teams through automated batch inference pipelines, suggesting best practices, monitoring and production readiness, and generating code and configs for deployment.

A comprehensive guide to optimizing Groq API usage and managing inference costs. Learn techniques such as smart model routing (selecting smaller models for simple tasks), minimizing prompt tokens, batching requests to reduce overhead, and implementing caching for deterministic calls. This guide helps developers achieve significant cost savings and improve system efficiency when handling high-volume AI workloads.

Execute complex and compute-intensive workloads directly on fully managed Hugging Face cloud infrastructure. This skill eliminates the need for local setup, allowing users to run jobs using cloud CPUs, GPUs, or TPUs. Ideal for large-scale data processing, batch inference, reproducible model training, and scheduled automation tasks, while persisting results to the Hugging Face Hub.

A comprehensive guide to implementing advanced asynchronous patterns with Mistral AI. This skill covers using the Agents API for stateful, multi-turn workflows, the Batch API for cost-effective bulk inference, and event-driven streaming architectures. It is essential for building robust, long-running, or high-volume AI applications that require reliable background job handling.

Ray Data offers scalable distributed data processing for ML workloads, streaming across CPU/GPU clusters and integrating with PyTorch, TensorFlow, and Ray Train. Use it for batch inference, ETL, and multi-modal preprocessing from a laptop up to hundreds of nodes.

Executes training, fine-tuning, inference, and batch jobs on Modal’s zero-config GPU cloud so you just write Python, run `modal run`, and let Modal auto scale, manage secrets, and halt billing when finishes.

This guide demonstrates how to deploy GPU workloads on the CoreWeave platform using Kubernetes (kubectl). It covers deploying vLLM inference services for large language model (LLM) testing and running batch CUDA jobs for benchmarking. This is ideal for users running their first GPU workloads, testing inference pipelines, or verifying cluster access on bare-metal GPU nodes (A100, H100).

This guide provides expert strategies for optimizing GPU inference performance on CoreWeave infrastructure. It covers GPU selection based on workload (LLM, image generation, training), advanced techniques like continuous batching (using vLLM), autoscaling setup (HPA), and benchmarking data. Use this to maximize GPU utilization, minimize latency, and optimize large-scale AI model deployment.

A comprehensive guide to optimizing operating costs when utilizing Together AI's OpenAI-compatible API. This resource details strategies for cost reduction across various AI tasks, including inference, fine-tuning, and model deployment. Learn how to select appropriate model sizes, implement caching, leverage batch inference, and utilize Turbo variants to maximize efficiency and minimize spending.

Provides comprehensive guidance for performance tuning, inference, and fine-tuning using the Together AI platform. This skill supports working with Together AI's OpenAI-compatible API, covering model deployment, utilizing various open-source models (like Llama, Mixtral), and implementing best practices for efficient and cost-effective batch inference.