Skill UI

This skill details how to set up automated CI/CD pipelines for Databricks data pipelines. It leverages Declarative Automation Bundles (DABs) and GitHub Actions to manage the entire deployment lifecycle. Key functionalities include running unit tests on pull requests, validating and deploying to staging environments, and promoting validated code to production upon merge, ensuring reliable and automated data infrastructure.

Configure automated Continuous Integration and Continuous Deployment (CI/CD) pipelines for Juicebox AI data analysis integrations. This setup utilizes GitHub Actions to run comprehensive unit tests (with mocked datasets) and integration tests (connecting to live APIs) on every PR and merge to main. It ensures that data upload logic, analysis execution, and result parsing workflows are robust and reliable before deployment.

Orchestrate Segment customer-data actions through Rube MCP and Composio, covering event tracking, user identification, grouping, page views, batch dispatches, alias merges, and source management while always refreshing schema info first.

A high-performance library built on Polars for advanced genomic interval operations and bioinformatics file I/O. It provides robust support for core interval arithmetic (overlap, merge, complement) and reading/writing major formats like VCF, BAM, BED, and GFF. Features include out-of-core streaming, cloud-native I/O (S3, GCS, Azure), and a powerful SQL interface, making it ideal for large-scale genomic research.

This tool collects comprehensive diagnostic data from ClickHouse system tables. It gathers crucial metrics, query logs, merge statuses, and disk usage information. It is essential for troubleshooting performance bottlenecks, preparing detailed support tickets, or investigating complex database infrastructure issues.

A comprehensive guide and implementation template for building robust data ingestion pipelines into ClickHouse. Supports multiple sources including HTTP webhooks (with batching), Kafka streams, S3, and direct SQL inserts. Demonstrates best practices for data handling, such as deduplication using ReplacingMergeTree and monitoring query logs, ensuring reliable, scalable data analytics.

This comprehensive guide teaches users how to set up a ClickHouse database environment. It covers creating a MergeTree table, inserting structured event data using TypeScript, and executing essential analytical queries (e.g., counting, grouping, unique user metrics). Ideal for beginners learning OLAP databases, testing connections, or mastering core data warehousing concepts.

A comprehensive guide to designing high-performance schemas in ClickHouse. Learn how to select the optimal MergeTree engine (e.g., ReplacingMergeTree, AggregatingMergeTree), structure the ORDER BY key for maximum query efficiency, and implement effective partitioning strategies for large-scale analytical workloads and ETL processes.

This comprehensive checklist guides users through critical operational readiness steps for a ClickHouse production deployment. It covers server tuning (config.xml), schema design best practices, robust backup strategies (S3), detailed monitoring setup (Prometheus/Grafana), security hardening, and application integration verification. Use this document before go-live, during major upgrades, or when auditing production systems to ensure maximum stability and performance.

This skill guides the setup of CI/CD pipelines for Hex data analytics projects using GitHub Actions. It enables running automated unit tests on pull requests and triggering live project runs on the main branch merge. Use this when establishing automated testing workflows, validating data transformation logic, or integrating Hex outputs into a continuous delivery process.

This guide identifies and provides solutions for common anti-patterns and mistakes when working with Snowflake. It covers best practices in SQL writing, warehouse resource management, data loading strategies (e.g., using MERGE), and access control setup. It is essential for auditing existing deployments, onboarding new users, or performing code reviews to ensure cost efficiency and data integrity.