Skill UI

OpenRLHF is a Ray-based RLHF framework that accelerates large-model PPO, GRPO, RLOO, and DPO training with vLLM inference and ZeRO-3 resource sharing, targeting distributed GPU clusters handling 7B-70B+ parameter models.

Ray Data is a scalable distributed data processing library for ML workloads, streaming execution across CPU/GPU, integrates with Ray Train, PyTorch, TensorFlow, and handles Parquet/CSV/JSON/images for preprocessing, ETL, or batch inference from single node to cluster.

Ray Train orchestrates distributed PyTorch/TensorFlow/HuggingFace training from laptops to thousands of nodes, adding elastic scaling, hyperparameter search, and fault tolerance while keeping most code unchanged.

Behavioral X-Ray probes models through refusal, formatting, reasoning, persona, tool use, and grounding dimensions, auto-tagging each response and building a styled HTML report for red-team, compliance, and selection workflows.