Skill UI

An expert guide for performing complex data analysis, cleaning, and transformation using pandas DataFrames. This skill covers advanced techniques such as vectorized operations, efficient merging, time series resampling, group-by aggregations, and memory optimization, ensuring production-grade code and robust data validation.

Guidance for creating, editing, and analyzing .xlsx workbooks while preserving formulas, formatting, and assumptions, leveraging pandas/openpyxl for data work and LibreOffice recalc to ensure error-free financial models.

Dask is a Python library that scales pandas/NumPy workflows beyond RAM by parallelizing DataFrames, Arrays, Bags, and custom tasks across cores or clusters for ETL, log analysis, and distributed ML.

Provides a Python client for querying the Data Commons knowledge graph so teams can resolve entities, fetch statistical observations, and explore public demographic, economic, and health datasets with optional Pandas support.

GeoPandas extends pandas for geospatial vector data, enabling reading/writing shapefiles, GeoJSON, GeoPackage and PostGIS, performing CRS management, spatial joins, overlays, buffering, area/distance calculations, and producing static or interactive choropleth maps.

Polars is a blazing fast in-memory DataFrame library based on Apache Arrow that replaces pandas for 1-100GB workloads, offering expression-based lazy execution, parallel operators, and rich I/O for ETL pipelines.

PyDESeq2 brings the DESeq2 differential expression workflow to Python, letting users load bulk RNA-seq counts, specify design formulas, fit DESeq2 models, run Wald tests with FDR correction, optionally apply apeGLM shrinkage, and export gene-level statistics within pandas/AnnData pipelines.

Pandas is a Python data analysis library that simplifies loading, cleaning, transforming, and analyzing structured datasets, making it ideal for data wrangling in analytics or engineering workflows.

This tool parses API Gateway access logs from various providers (AWS, Kong, Nginx). It performs statistical analysis using pandas to detect critical security threats such as Broken Object Level Authorization (BOLA/IDOR), credential stuffing, rate limit bypass attempts, and injection vulnerabilities. Ideal for SOC analysts or security engineers investigating API abuse and building advanced threat detection rules.

This script performs statistical analysis on Zeek connection logs (conn.log) to detect Command and Control (C2) beaconing patterns. It leverages the ZAT library to load data into Pandas DataFrames, calculates inter-arrival time statistics, and flags connections with low standard deviation relative to the mean. This technique is crucial for network threat hunting and security incident investigation when identifying malicious, periodic callbacks.

This skill analyzes proxy access logs, DNS query logs, and network flow data to identify unauthorized SaaS and cloud services (Shadow IT). It uses Python and pandas to aggregate traffic, classify domains against known SaaS categories, and calculate risk scores based on data volume and user count. Ideal for conducting thorough security audits and generating actionable remediation reports.

This skill establishes normal network communication patterns by analyzing historical NetFlow/IPFIX data. Utilizing Python pandas, it computes hourly/daily volume distributions, per-host statistics, and top-talker profiles. Anomalies are detected using sophisticated statistical methods like z-score and IQR, allowing SOC analysts to quickly identify deviations such as data exfiltration spikes, persistent beaconing, or unusual port usage.