Skill UI

A comprehensive guide to implementing best practices for security within Databricks. Learn how to manage secrets using scoped storage, enforce the principle of least privilege via Unity Catalog grants, audit API tokens, and apply advanced data protection techniques like column-level masking and row-level security for enhanced data governance and compliance.

TileDB-VCF lets you ingest, store, query, and export large genomic VCF/BCF datasets using TileDB’s sparse arrays, supporting incremental sample growth, parallel regions queries, and cloud-local interoperability for population genomics workflows.

Zarr is a Python toolkit for chunked N-D array storage with compression, sharding, and native integrations with NumPy/Dask/Xarray, ideal for parallel I/O and scalable cloud pipelines.

This tool detects abnormal access patterns across major cloud storage services (AWS S3, GCS, Azure Blob Storage). By analyzing audit logs like CloudTrail, it uses statistical baselines and time-series anomaly detection to identify suspicious activities such as after-hours bulk downloads, access from new IPs, or unusual API call spikes. It is crucial for investigating potential data exfiltration incidents or building robust cloud security detection rules.

This comprehensive skill guides the deployment and utilization of MISP, a powerful open-source threat intelligence platform. It covers configuring various threat feeds (TAXII, CSV, etc.) and using the PyMISP Python API to programmatically automate the collection, storage, and correlation of Indicators of Compromise (IOCs) and threat events from diverse community and commercial sources.

This comprehensive guide details the implementation of Cloud Data Loss Prevention (DLP) using industry-leading tools such as Amazon Macie, Google Cloud DLP, and Azure Information Protection. It provides structured workflows for discovering, classifying, de-identifying, and protecting sensitive data (PII, PHI, financial data) across cloud storage, databases, and data pipelines. Essential for achieving compliance with global regulations (GDPR, HIPAA, PCI DSS) and integrating robust data governance into CI/CD processes.

A comprehensive guide and workflow for recovering deleted files (documents, images, videos, etc.) from damaged storage media, forensic disk images, or corrupted file systems. It utilizes PhotoRec's file signature-based carving engine, allowing data recovery regardless of file system damage. The process includes advanced steps for file validation, hashing, and organizing evidence for forensic analysis.

This framework manages the ingestion, organization, synchronization, and search of knowledge across multiple storage layers, including local files, persistent memory, vector stores, and Git repositories. It provides a structured approach for ensuring knowledge durability, deduplication, and maintaining a 'single source of truth' across complex development and operational contexts.

A comprehensive expert prompt for evaluating Power BI data models. It guides the assessment of model architecture (Star Schema, relationships), storage optimization (Import, DirectQuery, Dual), data quality, performance scalability, and governance best practices. Use this when reviewing an existing BI model to ensure it is robust, maintainable, and highly performant.

LaminDB is an open-source lineage-native lakehouse designed for biological datasets and models. It enables queryable, traceable, and validated data management across various storage formats like S3 and Postgres. Users can track computational workflows, curate data with ontologies via Bionty, and ensure FAIR compliance. Ideal for managing scRNA-seq, spatial transcriptomics, and integrating ML pipelines while maintaining reproducibility and collaboration.

Store and process large N-dimensional arrays with chunking, compression, and parallel I/O. Supports cloud stores like S3/GCS via fsspec and integrates with NumPy, Dask, and Xarray for scientific pipelines.

Provides comprehensive programmatic control over Apify's core data infrastructure, including Datasets, Key-Value Stores, and Request Queues. This skill allows users to perform CRUD operations on various storage types, manage data persistence, and orchestrate complex, multi-stage data pipelines (e.g., scrape -> transform -> export). Ideal for building robust, end-to-end web scraping and data processing automation workflows.