Skill UI

Offers automated guidance for implementing data lineage trackers across ETL and streaming pipelines, including best practices on transformations, orchestration, and validation for production environments.

This skill details how to set up automated CI/CD pipelines for Databricks data pipelines. It leverages Declarative Automation Bundles (DABs) and GitHub Actions to manage the entire deployment lifecycle. Key functionalities include running unit tests on pull requests, validating and deploying to staging environments, and promoting validated code to production upon merge, ensuring reliable and automated data infrastructure.

This guide provides comprehensive, code-based solutions for diagnosing and fixing common errors encountered in Databricks environments. It covers critical issues such as cluster state failures, Spark OutOfMemory errors, Delta Lake concurrency conflicts, permission problems, and schema mismatches, offering tailored fixes in Python, SQL, and Bash.

Use Declarative Automation Bundles (DABs) to manage and deploy Databricks assets, including jobs, DLT pipelines, and ML models, using an Infrastructure-as-Code approach. This skill allows defining resources and deployment targets (dev, staging, prod) in a single YAML file, enabling robust CI/CD practices and controlled promotion of changes across environments.

A comprehensive guide detailing optimization techniques for Databricks environments. It covers optimal cluster sizing for various workloads (ETL, ML, Streaming), advanced Spark configurations (AQE, memory management), and deep data optimization strategies for Delta Lake, including Z-Ordering and Liquid Clustering. It also provides methods for query plan analysis and join optimization.

This skill provides comprehensive, structured audit logging for OpenRouter API interactions. It automatically captures essential metadata like total cost, token usage, model details, latency, and status, while also performing PII redaction. The resulting audit trail is stored in an append-only SQLite database, making it ideal for building compliance-ready systems, detailed cost monitoring, and deep debugging of production environments.

This comprehensive guide outlines advanced strategies for optimizing PostHog in production environments. Key techniques covered include implementing local feature flag evaluation to eliminate network latency, optimizing event batching for network efficiency, utilizing strategic event sampling, and writing efficient HogQL queries. Master these methods to dramatically improve data collection reliability and query speed.

This skill detects advanced cyber-physical attacks mimicking the Stuxnet pattern. It monitors for unauthorized modifications to PLC logic and detects discrepancies between reported sensor readings and actual physical process behavior. Ideal for high-security OT/ICS environments when hunting for APT lateral movement or validating process integrity against sophisticated threats.

Provides a detailed, multi-platform workflow to monitor long-running computational experiments. It checks the status of jobs across various environments (SSH, vast.ai, Modal), collects screen logs, fetches structured JSON results, and pulls detailed training metrics (loss curves, accuracy) from Weights & Biases (W&B). Essential for MLOps and automated result review.

This comprehensive tool manages the complete lifecycle of ML experiments, providing robust deployment capabilities across diverse environments. It supports running training jobs on local GPUs, dedicated remote servers, Vast.ai, and serverless platforms like Modal. The workflow handles environment detection, code synchronization (rsync/git), dependency pinning, and integrates advanced logging tools (e.g., W&B), ensuring reliable, scalable, and reproducible ML training runs.

This skill provides a comprehensive framework for detecting NTLM relay attacks (T1557.001). It achieves this by correlating Windows Security Event 4624 (LogonType 3) to identify IP-to-hostname mismatches, detecting artifacts from Responder/LLMNR poisoning, and auditing SMB/LDAP protocol signing weaknesses. Use it for proactive threat hunting in Active Directory environments, investigating authentication anomalies, or building SIEM correlation rules.

Utilize Bright Data's Scraping Browser with Playwright or Puppeteer to reliably scrape structured data from JavaScript-rendered pages, Single Page Applications (SPAs), and anti-bot-protected sites. This tool manages proxy routing, CAPTCHA solving, and fingerprint management, ensuring robust data collection from complex web environments.