Skill UI

Automates adapting pretrained models via transfer learning by analyzing requirements, generating PyTorch or TensorFlow fine-tuning code, validating data, tracking KPIs, and saving artifacts so you can quickly reuse existing models for new datasets and tasks.

Auto-activating aggregation helper skill for data analytics, following best practices for SQL, visualization and BI workflows, guiding queries/configs, and validating outputs.

Automates beam pipeline builder tasks by guiding best practices, generating production-ready code, and validating ETL, transformation, orchestration, and streaming workflows.

Automates creating and validating GCP BigQuery views with best-practice guidance, production-ready code snippets, and integrations for Vertex AI, Cloud Run, Firebase, and similar services to keep analytics workloads consistent.

This comprehensive checklist guides users through validating and preparing Clay enrichment pipelines for a production launch. It covers critical areas including table schema finalization, data quality gates (validation, deduplication), credit cost management, webhook reliability testing, and establishing robust monitoring and alerting procedures before going live.

Automates dashboard layout planning for data analytics tasks, guiding best practices, generating robust configs, and validating layouts for SQL-driven BI scenarios.

Automated Data Quality Checker offers guidance, best practices, and production-ready code for validating pipelines whenever you work with ETL, streaming, or data transformation scenarios.

This skill details how to set up automated CI/CD pipelines for Databricks data pipelines. It leverages Declarative Automation Bundles (DABs) and GitHub Actions to manage the entire deployment lifecycle. Key functionalities include running unit tests on pull requests, validating and deploying to staging environments, and promoting validated code to production upon merge, ensuring reliable and automated data infrastructure.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

This comprehensive guide provides structured steps and code examples for upgrading Databricks Runtime versions and performing critical data migrations. It covers best practices for version compatibility checking, transitioning from Hive Metastore to Unity Catalog using methods like SYNC and CTAS, and updating deprecated API endpoints, ensuring a smooth platform evolution for data pipelines.

Automates guidance for setting up and validating feature store connectors within ML deployment pipelines, covering best practices, code generation, and production monitoring for inference.

A comprehensive pipeline for processing, validating, and optimizing scraped web content from Firecrawl. This tool handles markdown cleaning, structured data extraction using Zod validation, content deduplication, and chunking tailored for Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. It ensures crawled data is standardized, clean, and ready for downstream consumption or knowledge base indexing.