gentoo.mahdi.cz
dev-python
:pyonmttok
Fast and customizable text tokenization library with BPE and SentencePiece support [wheel]
https://opennmt.net
pyonmttok-1.37.1
MIT
download
~amd64 ~x86
pypi