Skill UI

Learn how to monitor, analyze, and optimize the expenditure of Large Language Models (LLMs) using Langfuse's advanced analytics suite. This guide covers techniques like automatic token tracking, programmatic cost reporting via the Metrics API, and implementing smart model routing to automatically select the most cost-effective model based on task complexity and input length. Essential for any developer managing AI budgets and ensuring operational efficiency.

This guide details how to establish comprehensive observability for LLM operations using Langfuse. It covers setting up Prometheus metrics (tracking traces, generation duration, and token usage) and visualizing them in Grafana dashboards. Ideal for monitoring application health, optimizing costs, and tracking performance over time.

Fetch execution traces from LangSmith Studio to inspect LangChain/LangGraph agent runs, analyze errors, tool calls, memory usage, and performance, and export sessions for deeper diagnostics using the langsmith-fetch CLI.

LangSmith centralizes tracing, evaluation, and monitoring for LLM applications, letting teams debug prompts, run regression tests, collect latency/cost metrics, and integrate with OpenAI, Anthropic, LangChain, or LlamaIndex to keep production systems observable.

A comprehensive diagnostic toolkit designed for advanced troubleshooting of Lindy AI agents. This bundle systematically collects environment information (OS, Python, Node.js), tests API connectivity for webhooks and major integrations (Slack, Notion, Gmail), reviews task history, and guides the user in generating a full, structured support ticket for technical support.

A comprehensive runbook detailing procedures for responding to failures and outages across Lindy AI agents. Covers critical scenarios including platform downtime (SEV1), individual agent failures, integration authentication issues, credit exhaustion, and webhook endpoint failures. Provides structured diagnostics and fallback strategies to ensure business continuity during incidents.

This guide provides comprehensive strategies for optimizing the execution speed, reliability, and cost efficiency of AI agents. Learn how to minimize latency, right-size models (e.g., Flash vs. Opus), consolidate multiple LLM steps into single prompts, and optimize workflow triggers. Ideal for use when agents are slow, consuming excessive credits, or producing inconsistent results.

This skill simulates an expert prompt engineer, specializing in optimizing prompts for Large Language Models (LLMs). It applies advanced techniques such as Constitutional AI, Chain-of-Thought reasoning, and model-specific tuning. Use this tool to transform basic instructions into production-ready, high-performance prompts, significantly boosting accuracy, reducing hallucinations, and optimizing token usage.

Practical guide to integrating Claude models: covers API client usage, streaming responses, tool calls, RAG pipelines, document chunking, cost-aware model selection, and anti-pattern warnings for efficient LLM workflows.

Automate the validation and testing of prompts and AI responses within your CI/CD pipeline using Mistral AI. This integration provides robust prompt regression testing, model quality checks, automatic cost estimation for API usage, and deployment gates, ensuring the stability and reliability of your AI features upon every pull request.

Automatically collects comprehensive diagnostic evidence for Mistral AI support tickets. This bundle includes environment details (OS, Node/Python versions), installed SDK versions, API connectivity test results, available models, and recent error logs. It is essential for reproducing and diagnosing persistent issues when contacting technical support.

This guide details advanced methods for merging multiple specialized LLMs (e.g., combining math, coding, and chat capabilities) without the need for expensive retraining. Learn various techniques such as Linear Merging, SLERP, Task Arithmetic, TIES-Merging, and DARE. Use mergekit to create high-performing, specialized model variants quickly, significantly improving performance and reducing computational costs.