Skill UI

Modal is a serverless cloud platform for running Python code on demand, including GPU-accelerated AI/ML workloads. Use for deploying models, serving web APIs, batch processing, and scaling Python applications to cloud containers with automatic scaling from zero to thousands of instances. Supports custom container images, persistent storage, and sub-second cold starts for low-latency inference.

Load Hugging Face Hub models, run pipeline inference, generate text, and fine-tune with the Trainer API across NLP, vision, audio, and multimodal tasks using Python and PyTorch.

This guide covers advanced usage of the Anthropic Messages API. Learn how to implement real-time streaming responses, utilize system prompts for persona control, process visual inputs (Vision), and enforce structured data output (JSON). This is essential for building sophisticated, robust, and multi-modal Claude-powered applications.

Automate the entire deployment lifecycle for ML inference services on CoreWeave GPU cloud. This workflow integrates unit testing, container image building (to GHCR), and rolling deployment to CoreWeave Kubernetes clusters via GitHub Actions. Ideal for ensuring stable, high-performance deployment of GPU-dependent models. Key features include validating GPU manifest requests and managing deployments using standard Kubernetes APIs.

This runbook provides structured steps for responding to critical production incidents on the CoreWeave platform. Use it when dealing with GPU workload failures, inference service outages, or general Kubernetes resource issues. It guides users through checking pod status, node health, and diagnosing common model loading errors to ensure rapid service recovery.

A comprehensive reference guide for common errors encountered when interacting with the Together AI API. This includes error codes and solutions for inference, fine-tuning, and model deployment, covering authentication, rate limits, validation failures, and billing issues. Essential for developers integrating OpenAI-compatible LLM services.

A comprehensive workflow guide for fine-tuning open-source Large Language Models (LLMs) using the Together AI API. This process covers preparing structured training data (JSONL format), uploading the file, initiating the fine-tuning job, monitoring the training status, and finally deploying the custom model for inference. Ideal for developers needing to customize models for specific enterprise tasks, such as customer support or specialized content generation.

This workflow guides users through the complete lifecycle of customizing large language models (LLMs). It covers uploading training data, initiating fine-tuning jobs, monitoring training progress, managing model versions, and finally deploying the optimized model to a dedicated, autoscaling inference endpoint using the Together AI API. Ideal for production-level customization.

A comprehensive guide to optimizing operating costs when utilizing Together AI's OpenAI-compatible API. This resource details strategies for cost reduction across various AI tasks, including inference, fine-tuning, and model deployment. Learn how to select appropriate model sizes, implement caching, leverage batch inference, and utilize Turbo variants to maximize efficiency and minimize spending.

This debug bundle provides comprehensive guidance for working with Together AI's OpenAI-compatible API. It supports critical LLM lifecycle tasks, including inference, fine-tuning, and model deployment for over 100 open-source models (e.g., Llama, Mixtral). It also includes detailed troubleshooting steps and solutions for common API errors (like 401 Unauthorized or 429 Rate limit), ensuring smooth development.

This skill provides a production-grade, containerized integration service for connecting to the Together AI platform. It facilitates high-performance inference, fine-tuning, and model deployment across over 100 open-source models using Together's OpenAI-compatible API. Includes comprehensive Docker setup, environment variable management, health checks, and zero-downtime rolling update strategies for robust, real-time LLM serving.

This guide provides a comprehensive tutorial on running various AI inference tasks using the Together AI API, which is compatible with the OpenAI standard. It demonstrates key functionalities including chat completions, streaming responses, image generation, and creating embeddings. This is ideal for developers who need to test open-source models, compare performance across different LLMs (like Llama or Mixtral), or integrate powerful generative AI features into their applications using Python or Node.js.