Skill UI

A comprehensive guide to setting up a minimal working example on Databricks. This skill covers creating a development cluster, uploading and executing notebooks (Python SDK), running tasks as jobs, and setting up a Serverless SQL Warehouse. It is ideal for new users or initializing a basic data engineering project.

This skill provides comprehensive guidelines for monitoring Granola usage, tracking team meeting patterns, and building detailed analytics dashboards. It guides users in defining critical metrics (e.g., adoption rate, efficiency score) and establishing robust data pipelines. Users can stream meeting metadata from Granola to data warehouses like BigQuery, enabling deep, customizable reporting and automated weekly insights via services like Zapier and Slack.

Automates Snowflake data warehouse workflows via the Composio MCP, letting you list databases, schemas, and tables, run SQL (SELECT, DDL, DML), and integrate those operations into cross-app pipelines for faster data ops.

An expert agent designed to collect critical data assets—including metadata, data lineage, and query logs—from any data warehouse platform. It uses the push ingestion API to send this data directly to Monte Carlo. This method is essential for integrating data sources that cannot be reliably covered by standard pull collectors, such as custom lineage paths or historical query logs.

Builds a robust, automated workflow to export critical sales data—including forecasts, quota details, adjustments, and CRM totals—from Clari CRM to a designated data warehouse. The pipeline supports multiple targets like Snowflake, BigQuery, and PostgreSQL, ensuring that real-time revenue intelligence is available for advanced analytics and business reporting.

A comprehensive guide to setting up and securing API access for Clari. Learn how to generate API tokens, configure environment variables, and test connectivity to export critical revenue intelligence and forecast data to data warehouses like Snowflake or BigQuery. Includes steps for both standard Clari API and Copilot API integration.

This skill provides comprehensive patterns for extracting and transforming Navan booking and transaction data. It addresses complex data pipeline challenges such as API pagination, date range chunking, and UUID-based deduplication. It supports both direct REST API implementation (via code examples) and configuration for managed connectors like Fivetran and Airbyte. Ideal for populating data warehouses, building robust analytics dashboards, or ensuring data quality from Navan sources.

A comprehensive guide for deep debugging complex Snowflake issues. This guide covers advanced techniques including detailed query profiling (spill analysis), diagnosing lock contention and transaction conflicts, analyzing metadata operations, and optimizing partition usage. Use it when standard troubleshooting fails to address slow queries or warehouse performance bottlenecks.

This comprehensive guide provides blueprints for implementing optimal Snowflake data architectures. It covers diverse patterns, including traditional data warehouses, Lakehouse designs using Iceberg tables, decentralized Data Mesh structures, and advanced data sharing and Snowpark native patterns. Use this when designing enterprise data platforms across varying scales.

This guide identifies and provides solutions for common anti-patterns and mistakes when working with Snowflake. It covers best practices in SQL writing, warehouse resource management, data loading strategies (e.g., using MERGE), and access control setup. It is essential for auditing existing deployments, onboarding new users, or performing code reviews to ensure cost efficiency and data integrity.

This guide provides a comprehensive methodology for load testing and capacity planning within Snowflake data warehouses. It covers optimizing query performance by adjusting warehouse sizes (Scale UP), simulating high concurrency using multi-threading (Scale OUT), and configuring advanced scaling policies (Standard, Economy, Maximized). Users can benchmark critical queries using SQL and simulate real-world user traffic using Python, ensuring robust and cost-efficient production environments.

A comprehensive guide detailing the process of migrating data warehouses to Snowflake from major sources like Amazon Redshift, Google BigQuery, or on-premise databases. This resource covers critical steps including schema conversion (handling dialect differences like STRUCT/ARRAY to VARIANT), robust data transfer methods (S3/Cloud Storage, Python/Pandas), data validation techniques (checksums, row counts), and essential SQL syntax translation patterns.