Skill UI

This guide provides a comprehensive tutorial on running various AI inference tasks using the Together AI API, which is compatible with the OpenAI standard. It demonstrates key functionalities including chat completions, streaming responses, image generation, and creating embeddings. This is ideal for developers who need to test open-source models, compare performance across different LLMs (like Llama or Mixtral), or integrate powerful generative AI features into their applications using Python or Node.js.

This guide provides comprehensive instructions for setting up and authenticating the Together AI SDK. It covers installation using both Python and Node.js, configuring the necessary API key, and verifying connectivity to utilize the OpenAI-compatible API for powerful open-source model inference and fine-tuning tasks. Ideal for developers starting with Together AI.

Provides comprehensive guidance for performance tuning, inference, and fine-tuning using the Together AI platform. This skill supports working with Together AI's OpenAI-compatible API, covering model deployment, utilizing various open-source models (like Llama, Mixtral), and implementing best practices for efficient and cost-effective batch inference.

A comprehensive guide to implementing production-ready patterns for interacting with the Together AI API. This includes a singleton client for seamless OpenAI-compatible integration, robust error wrappers with retry logic, and a fluent request builder. It covers best practices for LLM inference, model setup, and handling diverse response types (chat, embedding, fine-tuning).

This guide covers essential security best practices for utilizing Together AI's OpenAI-compatible API for inference, fine-tuning, and model deployment. It provides code examples and architectural advice on secure API key management, robust webhook signature verification, input validation using schemas (like Zod), and implementing data redaction pipelines to protect sensitive information in logs and datasets. Essential for building secure AI applications.

This guide provides comprehensive strategies for migrating applications using the Together AI platform. It addresses common issues like model ID deprecations, API schema changes (for fine-tuning or chat completions), and best practices for robust inference and deployment using their OpenAI-compatible API.

This skill provides real-time object detection capabilities by leveraging the Google Coral Edge TPU accelerator. It operates natively within Windows Subsystem for Linux (WSL), allowing high-speed, low-latency inference on live camera frames. By utilizing hardware acceleration, it achieves impressive performance (e.g., ~4ms inference at 320x320), making it ideal for edge computing projects requiring rapid visual analysis and resource efficiency.

A critical discipline for managing expenses when integrating paid AI or inference APIs. This guard treats dollar cost as a third complexity dimension, mandating the definition of cost contracts (max calls per run, max budget per run, max budget per day). It enforces best practices for bounding loops, retries, and fan-out, ensuring that code bugs cannot lead to unexpected overspending. Best practice requires configuring hard caps both in the code and at the provider dashboard for defense in depth.

This skill provides comprehensive methods and frameworks to detect sophisticated AI attacks, including model extraction, membership inference, and model inversion, which abuse inference APIs. It focuses on monitoring per-principal query volume, input distribution, and confidence exposure. Use it for securing public or partner inference APIs, or for conducting pre-deployment red-teaming to assess the model's extractability and overall security posture against MITRE ATLAS techniques.

A comprehensive guide and skill for deploying large language models (LLMs) locally using the llama.cpp framework and GGUF quantization format. It covers searching the Hugging Face Hub, selecting optimal quantizations (e.g., Q4_K_M), running local servers, and achieving OpenAI-compatible API endpoints. Supports various hardware backends including CPU, Mac Metal, CUDA, and ROCm. Ideal for developers needing offline, private LLM inference.

A comprehensive guide for establishing rigorous causal claims in international macro-finance. This skill addresses complex econometric challenges such as global confounders, policy endogeneity, and high-frequency surprises in open-economy models. It provides methodologies for cross-country panel data, capital control analysis, and advanced inference, ensuring results meet the high standards of top-tier international finance journals.

Utilize zero-shot NER to extract custom entity types (e.g., Drug, Symptom, Device) from complex clinical or biomedical text without requiring any labeled training data or fine-tuning. OpenMed wraps GLiNER/GLiNER2, allowing users to define labels on the fly. The workflow involves building a model index and then running inference via CLI or Python API, making it ideal for rapid prototyping or unstable schemas.