LCG Info: Package tokenizers 0.22.1

---

Description:	None
Homepage:	None
Category:	None
Language:	None
License:
Contacts:

---

PKG Version:	0.22.1 0.22.1 0.21.0 0.19.1 0.15.2 0.15.0 0.13.3
Release:	dev4cuda 109 109_cuda 109_swan 109a dev3 dev3cuda dev4 dev4cuda devkey devnxcals devswan
Platforms:	x86_64-el9-gcc13-opt, x86_64-ubuntu2404-gcc13-opt x86_64-el9-gcc13-opt, x86_64-ubuntu2404-gcc13-opt

---

Source code:	tokenizers-0.22.1