Skill UI

Designs scalable batch and streaming pipelines, modern warehouses, and analytics platforms with Spark, dbt, Airflow, cloud data stacks, and governance practices.

Guides data engineering patterns for ETL pipelines, Spark analytics, and quality checks, showcasing Python and SQL snippets to extract, transform, load, validate, and model sales data in modern warehouses.

You are a data pipeline architecture expert specializing in scalable, reliable, and cost-effective data pipelines for batch and streaming data processing.

Guides data-engineering teams through configuring incremental loads in pipelines, covering best practices, orchestration tips, example code, and output validation for streaming or batch workflows.

Guides building scalable data pipelines, ETL/ELT workflows, and modern data infrastructure with Python, SQL, Spark, Airflow, dbt, Kafka, and allied tools, covering architecture decisions, modeling, quality, monitoring, and performance optimization.

Access RCSB PDB to search biomolecular structures via text, sequence, or geometry queries, download coordinate files in PDB/mmCIF/Binary formats, retrieve metadata, and batch-process entries for drug discovery, protein engineering, and structural biology pipelines.

Guides production-grade LLM operations by combining RAG pipelines, embeddings, vector databases, fine-tuning, prompt engineering, cost control, evals, caching, streaming, and agent orchestration.