Download

Skill UI

Browse and discover 6034+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search RDP , found 1 results

Default Newest Most Downloaded

Fast NLP Tokenizers

huggingface-tokenizers

Orchestra-Research/AI-Research-SKILLs

Rust-powered HuggingFace tokenizers deliver <20s per GB speed, trainable BPE/WordPiece/Unigram models, alignment tracking, padding, and transformers integration for production NLP pipelines.

1

Language