Skill UI

This skill details how to set up automated CI/CD pipelines for Databricks data pipelines. It leverages Declarative Automation Bundles (DABs) and GitHub Actions to manage the entire deployment lifecycle. Key functionalities include running unit tests on pull requests, validating and deploying to staging environments, and promoting validated code to production upon merge, ensuring reliable and automated data infrastructure.

Use Declarative Automation Bundles (DABs) to manage and deploy Databricks assets, including jobs, DLT pipelines, and ML models, using an Infrastructure-as-Code approach. This skill allows defining resources and deployment targets (dev, staging, prod) in a single YAML file, enabling robust CI/CD practices and controlled promotion of changes across environments.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

This guide outlines a production-ready lakehouse architecture using Unity Catalog, Delta Lake, and the Medallion pattern. It provides best practices for organizing Databricks workspaces, implementing three-level governance, defining compute strategies, and adopting CI/CD best practices with Asset Bundles for robust team collaboration.

Configure automated Continuous Integration and Continuous Deployment (CI/CD) pipelines for Juicebox AI data analysis integrations. This setup utilizes GitHub Actions to run comprehensive unit tests (with mocked datasets) and integration tests (connecting to live APIs) on every PR and merge to main. It ensures that data upload logic, analysis execution, and result parsing workflows are robust and reliable before deployment.

This skill guides you through integrating PostHog's Customer Data Platform (CDP) features. It covers setting up webhooks to trigger real-time actions (e.g., syncing to CRM, sending notifications) when specific user events occur. Furthermore, it demonstrates how to query event data using the Events API and perform complex funnel analysis using HogQL, allowing for deep, custom insights into user behavior.

This comprehensive guide details the implementation of Cloud Data Loss Prevention (DLP) using industry-leading tools such as Amazon Macie, Google Cloud DLP, and Azure Information Protection. It provides structured workflows for discovering, classifying, de-identifying, and protecting sensitive data (PII, PHI, financial data) across cloud storage, databases, and data pipelines. Essential for achieving compliance with global regulations (GDPR, HIPAA, PCI DSS) and integrating robust data governance into CI/CD processes.

This skill provides programmatic access to comprehensive global financial market data via the Alpha Vantage API. Users can retrieve time-series data, including historical prices (OHLCV) for equities, options, forex, commodities, and crypto. It also provides access to fundamental metrics (e.g., P/E ratio, market capitalization), economic indicators (e.g., GDP, CPI), and over 40 technical indicators (e.g., RSI, MACD), making it ideal for quantitative analysis and financial modeling.

Guides agents through validation, dry-run MCP tool usage, and monitors-as-code YAML generation so Monte Carlo monitors can be established via CLI or CI/CD without directly creating assets.

This skill automatically generates an interactive SQL Notebook designed to validate changes in dbt models or snapshots. It processes changes identified from a GitHub PR or local repository, generating comparison queries that compare 'before' (production) and 'after' (development) data states. It is essential for embedding data observability and quality checks into CI/CD pipelines.

This skill guides the setup of CI/CD pipelines for Hex data analytics projects using GitHub Actions. It enables running automated unit tests on pull requests and triggering live project runs on the main branch merge. Use this when establishing automated testing workflows, validating data transformation logic, or integrating Hex outputs into a continuous delivery process.

This guide provides robust solutions for handling Hex API rate limits, implementing backoff, and ensuring idempotent API calls. It includes a rate limiter class and a retry mechanism with exponential backoff. Use this when building reliable data pipelines, running large-scale batch analytics, or integrating Hex into CI/CD environments where API call throttling is expected.