Download

Skill UI

Browse and discover 15856+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Data Pipelines , found 313 results

Default Newest Most Downloaded

Clay Pitfalls: Avoiding Data Enrichment Mistakes

clay-known-pitfalls

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide identifies and explains common anti-patterns, gotchas, and integration mistakes when using Clay's data enrichment platform. It details the root causes of credit waste, workflow failures, and data loss, providing actionable fixes for auditing configurations, onboarding new team members, or optimizing existing pipelines.

Scaling High-Volume Data Processing Pipelines

clay-load-scale

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide and code implementation for scaling data enrichment pipelines to handle high volumes (10K-100K+ leads monthly). It covers capacity planning, optimizing batch processing using queues (e.g., BullMQ/Redis), managing rate limits, and designing multi-table architectures for robust, large-scale data ingestion.

Clay Local Development Loop Setup

clay-local-dev-loop

jeremylongshore/claude-code-plugins-plus-skills

Establishes a complete local development loop for building and thoroughly testing Clay integrations. This setup allows developers to simulate the full data flow: pushing test data via webhooks, allowing Clay to perform cloud-based enrichment, and finally receiving the enriched results back to a local endpoint (via ngrok). Ideal for iterative development of data pipelines and webhooks.

Data Pipeline Policy Guardrails

clay-policy-guardrails

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive system for implementing policy guardrails in data enrichment pipelines. It enforces critical controls including credit spending limits, blocks the enrichment of sensitive PII (e.g., SSN, bank details), and validates input data quality. Essential for maintaining compliance (GDPR/CCPA) and managing costs when processing large volumes of personal and business data.

Clay Production Readiness Checklist

clay-prod-checklist

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive checklist guides users through validating and preparing Clay enrichment pipelines for a production launch. It covers critical areas including table schema finalization, data quality gates (validation, deduplication), credit cost management, webhook reliability testing, and establishing robust monitoring and alerting procedures before going live.

Implementing Fault-Tolerant Data Pipelines

clay-reliability-patterns

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide to building resilient and fault-tolerant data enrichment pipelines. Learn to implement critical patterns like credit budget circuit breakers, Dead Letter Queues (DLQs) for failed records, and health monitoring to ensure stability and cost control when integrating with external services like Clay.

AutoML Pipeline Builder

building-automl-pipelines

jeremylongshore/claude-code-plugins-plus-skills

Builds AutoML pipelines by analyzing user requests, generating code for data preparation, model selection, hyperparameter tuning, validation, and metrics, then documenting artifacts for streamlined automated machine learning workflows.

Clay Lead Enrichment Pipeline Architecture

clay-reference-architecture

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide for designing production-grade lead enrichment pipelines in Clay. Covers three integration patterns (Webhook, API), detailed table schema design, advanced data waterfall logic, implementing complex ICP scoring formulas, and setting up robust CRM synchronization flows for go-to-market data operations.

Compression Pipeline Optimizer

compression-optimizer

jeremylongshore/claude-code-plugins-plus-skills

Guides users through compression optimizer scenarios within data pipelines, offering best practices, code templates, and validation steps for ETL, transformation, and streaming workflows.

Multi-Environment Customer.io Client Setup

customerio-multi-env-setup

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide for configuring Customer.io across multiple, isolated environments (dev, staging, prod). This method utilizes typed environment configuration, environment-aware client wrappers, and secure use of environment variables to ensure data integrity and prevent cross-contamination in CI/CD pipelines. Ideal for scalable SaaS applications.

Customer.io Enterprise Integration Architecture

customerio-reference-architecture

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive reference architecture guide for implementing enterprise-grade integrations with Customer.io. It details best practices for building robust, scalable, and reliable systems, focusing on event-driven patterns, message queuing (e.g., Redis/Kafka), service layer separation, and idempotency. Ideal for designing complex data pipelines and ensuring high availability in mission-critical applications.

Dagster Pipeline Creator

dagster-pipeline-creator

jeremylongshore/claude-code-plugins-plus-skills

Guides you through building Dagster data pipelines with best-practice advice, ready-to-use configurations, and validation checks for ETL, transformation, orchestration, and streaming workflows whenever the Dagster pipeline creator skill is activated.

Prev 1 234 5 6...25 26 27 Next

Language