Skill UI

A comprehensive guide to building production-ready Apache Airflow Directed Acyclic Graphs (DAGs). This skill covers best practices for operators, sensors, testing, deployment, and designing robust data pipelines. Use this when orchestrating complex workflows, managing ETL processes, or ensuring reliable batch job execution in a production environment.

A comprehensive system for implementing policy guardrails in data enrichment pipelines. It enforces critical controls including credit spending limits, blocks the enrichment of sensitive PII (e.g., SSN, bank details), and validates input data quality. Essential for maintaining compliance (GDPR/CCPA) and managing costs when processing large volumes of personal and business data.

This skill details how to set up automated CI/CD pipelines for Databricks data pipelines. It leverages Declarative Automation Bundles (DABs) and GitHub Actions to manage the entire deployment lifecycle. Key functionalities include running unit tests on pull requests, validating and deploying to staging environments, and promoting validated code to production upon merge, ensuring reliable and automated data infrastructure.

Use Declarative Automation Bundles (DABs) to manage and deploy Databricks assets, including jobs, DLT pipelines, and ML models, using an Infrastructure-as-Code approach. This skill allows defining resources and deployment targets (dev, staging, prod) in a single YAML file, enabling robust CI/CD practices and controlled promotion of changes across environments.

This skill provides a comprehensive guide to configuring event-driven workflows and robust notification systems for Databricks jobs. It covers setting up various notification destinations (Slack, Teams, Email, PagerDuty) and triggering alerts based on job lifecycle events (success, failure, start). Furthermore, it demonstrates advanced monitoring using system audit tables and creating automated SQL alerts for critical data pipeline monitoring.

A guide to production-ready patterns for dbt (data build tool). It covers essential practices for robust data pipeline development, including model organization (staging, intermediate, marts), implementing advanced testing strategies, ensuring data quality, and optimizing incremental processing for large datasets.

This guide provides advanced strategies for optimizing interactions with the Juicebox AI API. It covers crucial best practices such as implementing caching mechanisms (with defined TTLs), executing batch operations for efficiency, managing rate limits, and optimizing data chunking for large datasets. Following these steps can significantly reduce end-to-end analysis time and ensure responsive, scalable data workflows.

Provides automated guidance for managing model versions in ML deployment, including serving, monitoring, and production optimization whenever someone requests the model versioning manager.

Guidance for creating, editing, and analyzing .xlsx workbooks while preserving formulas, formatting, and assumptions, leveraging pandas/openpyxl for data work and LibreOffice recalc to ensure error-free financial models.

The LinkedIn Automation CLI Tool allows users to programmatically interact with LinkedIn content and functionality. It supports fetching detailed profiles, searching people and companies, and managing connections directly from scripts or AI agents. Ideal for building automated research, recruiting, or outreach workflows, providing structured JSON output for reliable integration into custom systems.

Query and download the NCI Imaging Data Commons public cancer imaging datasets via idc-index, filter by metadata, fetch DICOM files, visualize series, and respect licensing details for AI training or research.

LaminDB is a Python-driven open-source framework for managing biological datasets, ensuring traceable, reproducible, FAIR data through lineage tracking, schema validation, ontology annotation, workflow integration, and lakehouse-style querying.