Skill UI

This skill provides production patterns for implementing robust data quality validation using Great Expectations, dbt tests, and formal data contracts. It is essential for building reliable, automated, and verifiable data pipelines, ensuring data integrity throughout the entire ETL/ELT process, and establishing clear data governance rules.

This comprehensive guide details strategies for migrating enterprise data platforms to Databricks. It provides PySpark examples for discovery, schema mapping (converting types from Hadoop, Snowflake, etc.), and executing robust data transfer methods like SYNC, DEEP CLONE, and CTAS. Use this when moving data from legacy sources like Hadoop, Snowflake, or Redshift to a modern Delta Lake environment.

This comprehensive guide provides structured steps and code examples for upgrading Databricks Runtime versions and performing critical data migrations. It covers best practices for version compatibility checking, transitioning from Hive Metastore to Unity Catalog using methods like SYNC and CTAS, and updating deprecated API endpoints, ensuring a smooth platform evolution for data pipelines.

Provides GraphQL queries to the Open Targets Platform for target-disease associations, tractability, safety, drugs, and multi-omics evidence to guide therapeutic target identification, safety assessment, and repurposing research workflows.

A comprehensive guide to MATLAB and GNU Octave, covering core scientific computing tasks. This skill details capabilities in matrix operations, linear algebra, data visualization (2D/3D), statistical analysis, signal processing, and solving differential equations. It is ideal for users requiring complex numerical simulation, data modeling, and scientific scripting.

Calculates statistical power and required sample sizes for study planning. It supports both closed-form methods (for standard tests like t-tests, ANOVA) and simulation-based methods (for complex models like mixed models or survival analysis). Use this skill to determine the minimum detectable effect (MDE) or justify sample sizes for grants and IRB protocols before data collection.