Skill UI

Guides teams through the Databricks reference architecture with lakehouse layers, Unity Catalog governance, project layout conventions, and CI/CD integration for production analytics platforms.

This skill provides expertise in building production-grade, scalable data systems and pipelines. It covers the full spectrum of data engineering, including designing robust batch ETL/ELT workflows, implementing real-time streaming architectures (Kafka/Flink), and utilizing modern tools like Airflow, Spark, and dbt. Essential for data architecture design, data lakehouse implementation, and data governance.

Explains Fabric Lakehouse storage, data organization, security, shortcuts, and optimization practices so you can design, build, and monitor Lakehouse solutions leveraging Microsoft Fabric best practices.