Skill UI

Activation-aware weight quantization that compresses 7B-70B models to 4-bit with minimal accuracy loss, delivering ~3x inference speedups and memory reductions for constrained GPU deployments while integrating with vLLM and Marlin kernels.

FAISS (Facebook AI Similarity Search) is a library designed for efficient similarity search and clustering of dense vectors. It supports indexing and searching on billions of vectors at scale, featuring GPU acceleration and multiple index types (Flat, IVF, HNSW, PQ) to balance speed and accuracy. It is essential for building high-performance, large-scale applications requiring fast k-NN retrieval or pure vector similarity matching, especially in fields like RAG and recommendation systems.

A comprehensive guide to using Groq's high-speed LPU for chat completion. This resource provides code examples in TypeScript and Python, covering basic chat interactions, streaming responses, and advanced multimodal features. Ideal for developers building high-performance, low-latency AI applications using the Groq API.

This skill serves as a comprehensive reference guide for Kling AI's various generative models. It details capabilities across video generation (T2V, I2V), image styling, lip sync, and virtual try-on. Users can compare model versions based on quality, speed, and cost to select the optimal model for their creative or production pipeline.

This guide provides comprehensive strategies for optimizing the execution speed, reliability, and cost efficiency of AI agents. Learn how to minimize latency, right-size models (e.g., Flash vs. Opus), consolidate multiple LLM steps into single prompts, and optimize workflow triggers. Ideal for use when agents are slow, consuming excessive credits, or producing inconsistent results.

llama.cpp is a pure C/C++ library designed for efficient LLM inference, optimized to run on resource-constrained environments. It excels in scenarios where high-end NVIDIA GPUs (CUDA) are unavailable, making it ideal for Apple Silicon Macs, AMD/Intel GPUs, or edge deployment devices like Raspberry Pi. It supports GGUF quantization formats, enabling significant memory reduction and speed improvements for local, cross-platform AI applications.

Mamba is a selective state-space model architecture delivering O(n) inference for million-token sequences, offering hardware-aware Mamba-1 and Mamba-2 variants that beat Transformers on speed without KV cache overhead.

This skill provides comprehensive guidance on training Mixture of Experts (MoE) models, including architectures like Mixtral and DeepSeek-V3. It details techniques for achieving large-scale model capacity with significantly reduced computational costs (e.g., 5x reduction vs. dense models). Topics covered include top-k routing, load balancing, expert parallelism, and integration with frameworks like DeepSpeed and HuggingFace for efficient, resource-constrained training.

Speeds up LLM inference by combining speculative decoding with Medusa multiple heads and lookahead techniques so chatbots, code assistants, and other real-time workloads can run with 1.5-3.6× lower latency while preserving target-model quality.

This skill optimizes the performance of TwinMind's meeting AI operations. It fine-tunes transcription accuracy and speed using the advanced Ear-3 model, managing audio quality, and implementing caching strategies. Ideal for developers or system administrators needing to integrate, troubleshoot, or optimize high-volume meeting transcription workflows.

This tool allows users to systematically evaluate and rank the outputs of multiple agents within an AgentHub session. It supports metric-based evaluation (running custom commands for measurable metrics like speed or resource usage), or an advanced LLM Judge Mode. The LLM Judge compares results based on criteria like correctness, simplicity, and overall quality, helping users determine the best-performing agent for the task.

This skill provides advanced sentiment analysis tailored for financial news and market texts. It supports two modes: high-speed, localized analysis using FinBERT, and advanced, reasoning-based analysis via LLM. Users can determine the sentiment polarity (positive, negative, or neutral), score, and specific reason for financial content, making it ideal for market intelligence and data enrichment.