Skill UI

An expert agent designed to collect critical data assets—including metadata, data lineage, and query logs—from any data warehouse platform. It uses the push ingestion API to send this data directly to Monte Carlo. This method is essential for integrating data sources that cannot be reliably covered by standard pull collectors, such as custom lineage paths or historical query logs.

A comprehensive guide to diagnosing and fixing performance bottlenecks when using Qdrant. Covers optimizing slow uploads, resolving stuck optimizers, and tuning HNSW parameters, including best practices for sharding, bulk loading, and multi-tenant indexing to ensure efficient vector search performance.

A comprehensive guide and implementation template for building robust data ingestion pipelines into ClickHouse. Supports multiple sources including HTTP webhooks (with batching), Kafka streams, S3, and direct SQL inserts. Demonstrates best practices for data handling, such as deduplication using ReplacingMergeTree and monitoring query logs, ensuring reliable, scalable data analytics.

This skill provides a complete solution for deploying Glean custom connectors as scheduled jobs on container platforms (e.g., Cloud Run). It covers building a production-ready Docker image to manage document ingestion, custom data source connectivity, and search query execution. Includes robust health checks and rolling update strategies to ensure continuous, high-availability indexing for enterprise search environments.

Implements robust data governance for Canva Connect API interactions. This skill covers data classification (PII, Secrets, Business), token redaction, temporary URL expiry, and enforces strict data retention policies. It is essential for developers building integrations that must adhere to global privacy standards like GDPR and CCPA, ensuring secure data handling from ingestion to deletion.

Provides a comprehensive, production-ready reference architecture for building advanced analytics platforms powered by ClickHouse. It details everything from project layout (TypeScript/Node.js structure) and data ingestion pipelines (Kafka, Webhooks) to the optimal 3-layer schema design (Raw, Hourly, Daily) and multi-tenancy patterns, ensuring scalable and efficient OLAP query performance.

This skill governs the secure ingestion and indexing of enterprise documents from diverse connectors (e.g., Google Drive, Confluence, Jira). Key functions include mandatory PII filtering (stripping emails, phones, SSNs) before indexing, preserving strict permission boundaries, and enforcing data retention policies to ensure compliance with global regulations like GDPR and CCPA.

This skill provides comprehensive guidelines and implementation examples for managing rate limits when interacting with the Glean Indexing and Search APIs. It includes a custom RateLimiter class, robust retry logic (handling 429 errors and server errors), and best practices for batch processing large datasets, ensuring stable, high-volume data ingestion pipelines.

Implements a robust data pipeline for handling large documents with the Grammarly API. This utility manages text chunking to comply with API character limits (max 100k), processes text in manageable segments, and aggregates multiple scoring metrics (like correctness, clarity, and tone) into a single, comprehensive report. Ideal for large-scale content analysis and data ingestion.

This skill provides a robust solution for managing API rate limits, particularly crucial when integrating with enterprise platforms like Palantir Foundry. It implements advanced techniques including exponential backoff, jittered retries for handling 429/5xx errors, and a token bucket rate limiter for controlled batch throughput. Use this to ensure reliable data ingestion and bulk API operations.

This skill provides advanced methods for interacting with Salesforce, focusing on high-volume data processing. It covers using Bulk API 2.0 for mass data ingestion, querying, and exporting millions of records. Furthermore, it demonstrates the Composite API for executing complex, multi-step, and dependent transactions (e.g., creating Account, then referencing it to create Contact) in a single, atomic call, ensuring data integrity and maximum efficiency.

A comprehensive guide for executing core Snowflake data loading workflows. This covers setting up stages (S3, GCS, Azure), defining file formats (CSV, JSON, Parquet), and using COPY INTO for bulk loading. It also details advanced continuous ingestion using Snowpipe, enabling real-time data synchronization from cloud storage into Snowflake tables.