Skill UI

llama.cpp is a pure C/C++ library designed for efficient LLM inference, optimized to run on resource-constrained environments. It excels in scenarios where high-end NVIDIA GPUs (CUDA) are unavailable, making it ideal for Apple Silicon Macs, AMD/Intel GPUs, or edge deployment devices like Raspberry Pi. It supports GGUF quantization formats, enabling significant memory reduction and speed improvements for local, cross-platform AI applications.

LlamaIndex is a data-centric framework for building LLM applications, offering 300+ connectors, vector indices, query engines, agents, and multimodal support to power document Q&A, chatbots, knowledge retrieval, and RAG pipelines over private data.

Automatically collects comprehensive diagnostic evidence for Mistral AI support tickets. This bundle includes environment details (OS, Node/Python versions), installed SDK versions, API connectivity test results, available models, and recent error logs. It is essential for reproducing and diagnosing persistent issues when contacting technical support.

Automates guidance for configuring mlflow experiment tracking, covering best practices, code generation, and validation to support ML training workflows.

Automates guidance on identifying and responding to model drift within ML deployment workflows, offering best practices, production-ready code, and validation support so you can keep inference systems stable.

nanoGPT is a simplified, minimalist implementation designed specifically for educational purposes. It reproduces the core architecture of GPT-2 (124M) using clean, hackable code, allowing users to understand the entire transformer pipeline from scratch. The framework supports full workflows, including data preparation on various datasets (e.g., Shakespeare, OpenWebText), model training, and text generation, making it ideal for students and researchers learning NLP and deep learning principles.

A comprehensive workflow designed for clinical professionals to search, retrieve, and synthesize medical evidence. It allows users to query clinical literature with specialized filters (e.g., specialty, evidence level), check potential drug interactions against patient profiles, and look up the latest specialty guidelines from major health organizations (like ACC/AHA, NICE). The output provides structured citations, confidence scores, and evidence grading to support informed clinical decision-making.

This guide provides comprehensive steps to install and authenticate the OpenEvidence SDK/API. It covers setting up environment variables, installing required packages (supporting both Node.js and Python), and verifying the connection using sample code. This is essential for developers integrating OpenEvidence's medical AI capabilities for clinical decision support and evidence-based queries into a new application.

High-performance RLHF framework that combines Ray, vLLM, and ZeRO-3 to accelerate PPO/GRPO/RLOO/DPO training for 7B-70B+ models on distributed GPU clusters, providing a single-stack workflow for reward models and policy optimization.

Outlines guarantees valid JSON/XML/code outputs by applying CFG/FSM-constrained token filtering, Pydantic schemas, and grammar-level sampling while supporting local Transformers, llama.cpp, and vLLM backends for fast inference.

A persistent, file-based planning system for AI coding agents. It maintains task plans, findings, and progress on disk to prevent state loss during context resets, supporting seamless session recovery.

Meta’s Prompt Guard is an 86M-parameter classifier that spots prompt injections and jailbreak attempts before they reach LLMs, filtering user input, third-party data, or RAG documents with multilingual support and sub-2ms latency for fast deployments.