Skill UI

Provides comprehensive monitoring for the Clay data enrichment pipeline. It tracks critical operational metrics such as credit consumption velocity, enrichment success rates (hit rates), data quality scores, and lead distribution. Essential for cost control and ensuring pipeline health in data-intensive CRM workflows.

A comprehensive system for implementing policy guardrails in data enrichment pipelines. It enforces critical controls including credit spending limits, blocks the enrichment of sensitive PII (e.g., SSN, bank details), and validates input data quality. Essential for maintaining compliance (GDPR/CCPA) and managing costs when processing large volumes of personal and business data.

This comprehensive checklist guides users through validating and preparing Clay enrichment pipelines for a production launch. It covers critical areas including table schema finalization, data quality gates (validation, deduplication), credit cost management, webhook reliability testing, and establishing robust monitoring and alerting procedures before going live.

This guide provides comprehensive, code-based solutions for diagnosing and fixing common errors encountered in Databricks environments. It covers critical issues such as cluster state failures, Spark OutOfMemory errors, Delta Lake concurrency conflicts, permission problems, and schema mismatches, offering tailored fixes in Python, SQL, and Bash.

This comprehensive diagnostic bundle collects critical evidence from the Databricks environment, including environment setup, cluster state, job run history, and Delta table diagnostics. It generates a redacted, safe tar.gz file specifically designed for submitting detailed support tickets and efficiently troubleshooting complex data pipeline issues.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

This comprehensive guide provides structured steps and code examples for upgrading Databricks Runtime versions and performing critical data migrations. It covers best practices for version compatibility checking, transitioning from Hive Metastore to Unity Catalog using methods like SYNC and CTAS, and updating deprecated API endpoints, ensuring a smooth platform evolution for data pipelines.

This skill provides a comprehensive guide to configuring event-driven workflows and robust notification systems for Databricks jobs. It covers setting up various notification destinations (Slack, Teams, Email, PagerDuty) and triggering alerts based on job lifecycle events (success, failure, start). Furthermore, it demonstrates advanced monitoring using system audit tables and creating automated SQL alerts for critical data pipeline monitoring.

This skill provides comprehensive guidelines for monitoring Granola usage, tracking team meeting patterns, and building detailed analytics dashboards. It guides users in defining critical metrics (e.g., adoption rate, efficiency score) and establishing robust data pipelines. Users can stream meeting metadata from Granola to data warehouses like BigQuery, enabling deep, customizable reporting and automated weekly insights via services like Zapier and Slack.

This skill provides comprehensive tracking and analysis of OpenRouter API usage metrics. It collects critical data points such as per-request total cost, prompt and completion token counts, latency, and usage patterns. Use this skill when building financial dashboards, optimizing AI spending, monitoring API consumption, or generating detailed usage reports.

This skill provides advanced techniques for optimizing PostHog Cloud usage and reducing associated costs. It covers auditing event volume, implementing intelligent event sampling (e.g., sampling pageviews or autocapture events), filtering bot traffic, and tuning session recording rates. The goal is to maintain critical analytical value while staying within budget limits.

This guide provides advanced patterns and best practices for optimizing Apache Spark jobs. It covers critical areas like effective partitioning, memory tuning, minimizing data skew, and optimizing different types of joins (broadcast, bucket). Use this when troubleshooting slow, large-scale data processing workflows or needing to scale Spark pipelines efficiently and reliably.