Download

Skill UI

Browse and discover 5160+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search inference , found 33 results

Default Newest Most Downloaded

Sagemaker Endpoint Deployer

sagemaker-endpoint-deployer

jeremylongshore/claude-code-plugins-plus-skills

Auto-activating assistant that guides AWS Sagemaker endpoint deployment, from best practices to production-ready code, configurations, and validation for inference serving and monitoring workflows.

HighThroughput LLMS

serving-llms-vllm

Orchestra-Research/AI-Research-SKILLs

Deploy LLMs with vLLM to maximize throughput and minimize latency through PagedAttention, continuous batching, quantization, and tensor parallelism for production APIs or batch inference on constrained GPUs.

Speculative Decoding Acceleration

speculative-decoding

Orchestra-Research/AI-Research-SKILLs

Speeds up LLM inference by combining speculative decoding with Medusa multi-heads and lookahead Jacobi techniques, letting production services hit 1.5-3.6× throughput while keeping quality intact on limited hardware.

Streaming Inference Setup

streaming-inference-setup

jeremylongshore/claude-code-plugins-plus-skills

Automates guidance for streaming inference setup, covering best practices in ML deployment, serving, monitoring, and production-ready configurations whenever you ask about streaming inference patterns or implementation.

TensorRT LLM Optimizer

Orchestra-Research/AI-Research-SKILLs

Optimizes LLM inference on NVIDIA GPUs, delivering 10-100× faster throughput, sub-10ms latency, and multi-GPU scaling with FP8/INT4 quantization, in-flight batching, and production-ready serving for real-time deployments.

Torchserve Config Generator

torchserve-config-generator

jeremylongshore/claude-code-plugins-plus-skills

Automates generating TorchServe deployment configurations with guided best practices for model serving, MLOps pipelines, inference, and production monitoring so ML deployment workflows stay consistent and reliable.

Triton Inference Config

triton-inference-config

jeremylongshore/claude-code-plugins-plus-skills

Automates Triton inference config guidance for ML deployment, covering serving, MLOps pipelines, monitoring, and production-ready configurations aligned with best practices.

Protein Language Modeling Suite

K-Dense-AI/claude-scientific-skills

Toolkit for ESM protein language models providing generative design, structure prediction, embeddings, function conditioning, and Forge-powered batch inference for protein engineering and representation tasks.

Hugging Face Transformers

K-Dense-AI/claude-scientific-skills

Load Hugging Face Transformers to run pipelines for text, vision, audio, and multimodal inference, customize model loading, tokenize inputs, and fine-tune with distributed training on domain-specific datasets.

Language