Skill UI

A comprehensive guide to designing high-performance schemas in ClickHouse. Learn how to select the optimal MergeTree engine (e.g., ReplacingMergeTree, AggregatingMergeTree), structure the ORDER BY key for maximum query efficiency, and implement effective partitioning strategies for large-scale analytical workloads and ETL processes.

This comprehensive guide provides advanced techniques to diagnose and significantly boost ClickHouse query performance. It covers analyzing slow queries using system tables, optimizing ORDER BY keys, implementing data skipping indexes (Bloom, Set, MinMax), utilizing projections for pre-aggregation, and fine-tuning server settings and materialized views. Essential for high-volume OLAP environments.

This comprehensive checklist guides users through critical operational readiness steps for a ClickHouse production deployment. It covers server tuning (config.xml), schema design best practices, robust backup strategies (S3), detailed monitoring setup (Prometheus/Grafana), security hardening, and application integration verification. Use this document before go-live, during major upgrades, or when auditing production systems to ensure maximum stability and performance.

This comprehensive guide details best practices for securing a ClickHouse deployment. It covers essential security measures including role-based access control (RBAC) for granular user permissions, implementing row-level security for multi-tenancy, configuring network IP restrictions, enabling TLS encryption, and setting up detailed audit logging. Use this when hardening a production ClickHouse instance or enforcing strict data governance.

A structured guide for setting up a robust local development environment for Palantir Foundry data pipelines. This workflow enables users to run Python transforms and unit tests using PySpark against sample data, and mock the Foundry API client, ensuring fast, isolated iteration cycles before deploying code to the official Foundry environment. Ideal for data engineers and developers building complex ETL logic.