Skill UI

A comprehensive guide to building production-ready Apache Airflow Directed Acyclic Graphs (DAGs). This skill covers best practices for operators, sensors, testing, deployment, and designing robust data pipelines. Use this when orchestrating complex workflows, managing ETL processes, or ensuring reliable batch job execution in a production environment.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

Provides detailed evaluation of machine learning models using plugin metrics to assess accuracy, precision, recall, F1, and other key indicators, helping users compare models and validate performance before deployment.

Configure automated Continuous Integration and Continuous Deployment (CI/CD) pipelines for Juicebox AI data analysis integrations. This setup utilizes GitHub Actions to run comprehensive unit tests (with mocked datasets) and integration tests (connecting to live APIs) on every PR and merge to main. It ensures that data upload logic, analysis execution, and result parsing workflows are robust and reliable before deployment.

This comprehensive skill guides the deployment and utilization of MISP, a powerful open-source threat intelligence platform. It covers configuring various threat feeds (TAXII, CSV, etc.) and using the PyMISP Python API to programmatically automate the collection, storage, and correlation of Indicators of Compromise (IOCs) and threat events from diverse community and commercial sources.

This comprehensive tool manages the complete lifecycle of ML experiments, providing robust deployment capabilities across diverse environments. It supports running training jobs on local GPUs, dedicated remote servers, Vast.ai, and serverless platforms like Modal. The workflow handles environment detection, code synchronization (rsync/git), dependency pinning, and integrates advanced logging tools (e.g., W&B), ensuring reliable, scalable, and reproducible ML training runs.

This comprehensive checklist guides users through critical operational readiness steps for a ClickHouse production deployment. It covers server tuning (config.xml), schema design best practices, robust backup strategies (S3), detailed monitoring setup (Prometheus/Grafana), security hardening, and application integration verification. Use this document before go-live, during major upgrades, or when auditing production systems to ensure maximum stability and performance.

This comprehensive guide details best practices for securing a ClickHouse deployment. It covers essential security measures including role-based access control (RBAC) for granular user permissions, implementing row-level security for multi-tenancy, configuring network IP restrictions, enabling TLS encryption, and setting up detailed audit logging. Use this when hardening a production ClickHouse instance or enforcing strict data governance.

Provides a comprehensive checklist for deploying Hex data analytics integrations into production. It covers critical operational best practices, including API key management, rate limit handling, error resilience (circuit breakers, exponential backoff), and robust monitoring strategies. This guide ensures that data pipelines are deployed reliably, minimizing downtime and guaranteeing consistent, high-quality data reporting for go-live scenarios.

This comprehensive checklist guides the deployment of Snowflake data pipelines and integrations into a production environment. It covers critical areas such as authentication best practices, warehouse configuration, data pipeline readiness, access control, monitoring setup, and disaster recovery planning. Use it when preparing for a go-live or validating the stability of your production Snowflake setup.

This guide provides comprehensive standards for achieving auditability and transparency in Computer-Supported Cooperative Work (CSCW) research. It teaches researchers how to document non-shareable evidence, such as field interviews, log traces, and system deployments, by focusing on detailed analysis trails, decision logs, and rigorous process documentation, thus strengthening academic rigor.

A comprehensive pre-writing guide for researchers determining the optimal venue and track for a data science contribution. It outlines a two-stage decision process: first, assessing if the work aligns with the KDD focus on data regimes (scale, drift, heterogeneity); and second, selecting the correct track (Research, ADS, Datasets & Benchmarks, etc.) based on the strongest, most honest evidence available—especially emphasizing real-world deployment outcomes.