Skill UI

Automates database-focused test work by offering best-practice guidance, fixtures, and configurations for unit, integration, and mocking scenarios in test automation workflows.

This comprehensive guide outlines the end-to-end process of building production-grade ETL data pipelines using Databricks and Delta Lake. It implements the robust Medallion Architecture (Bronze, Silver, Gold) for scalable data management. Techniques covered include Auto Loader for incremental streaming ingestion, MERGE INTO for upsert semantics, data cleansing, and advanced aggregation into analytics-ready layers. Ideal for establishing reliable data pipelines in a data lakehouse environment.

This guide outlines the complete MLOps workflow on Databricks. It covers feature engineering using Feature Store, tracking experiments with MLflow, managing model versions in the Model Registry, and deploying real-time inference endpoints via Mosaic AI Model Serving. Ideal for building robust, production-grade ML pipelines.

A comprehensive guide detailing the setup process for Databricks CLI v2 and Python SDK. It covers essential steps for connecting to various Databricks workspaces, including configuring Personal Access Tokens (PAT), interactive OAuth U2M flows, and secure OAuth M2M service principals for CI/CD pipelines. Essential for developers integrating Databricks into their projects.

A comprehensive guide to setting up a fast, isolated local development loop for data engineering projects using Databricks Connect v2, Asset Bundles, and standard IDEs (like VS Code). This workflow allows developers to run PySpark code locally for debugging and unit testing, while managing resource deployment and ensuring consistency across development, staging, and production environments.

This skill provides a comprehensive guide to configuring event-driven workflows and robust notification systems for Databricks jobs. It covers setting up various notification destinations (Slack, Teams, Email, PagerDuty) and triggering alerts based on job lifecycle events (success, failure, start). Furthermore, it demonstrates advanced monitoring using system audit tables and creating automated SQL alerts for critical data pipeline monitoring.

Automates Datadog monitoring workflows via Composio’s Rube MCP, letting you query metrics, search logs, manage monitors and dashboards, and create events or downtimes after connecting to the MCP toolkit and tools list.

Guides using Rube MCP’s Composio toolkit to discover current Datagma tools, verify connections, and execute workflows while adhering to live schemas, session reuse, and required memory parameters.

Automate Datarobot operations via Composio's Rube MCP by discovering tool schemas, managing connections, and executing workflows with RUBE_MULTI_EXECUTE_TOOL while observing schema compliance and session reuse best practices.

Automates dataset loader creation within ML Training workflows, offering best-practice guidance, validation checks, and production-ready code to accelerate data prep and model tuning.

Automates guidance for date range analytics, covering SQL, visualization, statistics, and BI, with code generation and validation to support data analytics workflows.

Automates dbt test creation within data pipelines, offering guided best practices, code generation, and validation to keep ETL, transformation, and streaming workflows reliable.