Skill UI

Provides GGUF format and llama.cpp quantization workflows for efficient CPU/Apple Silicon inference, including conversion, quantization, and runtime commands suited for deploying large models without GPUs.

Deploy llama.cpp to run LLM inference across CPUs, Apple Silicon, and non-NVIDIA GPUs, making it ideal for edge devices or CUDA-free setups with GGUF quantization for faster, lower-memory results.

Ray Data is a scalable distributed data processing library for ML workloads, streaming execution across CPU/GPU, integrates with Ray Train, PyTorch, TensorFlow, and handles Parquet/CSV/JSON/images for preprocessing, ETL, or batch inference from single node to cluster.