AI21Labs/ai21-tokenizer v0.11.2
AI21Labs/ai21-tokenizer
Captured source
source ↗published Jun 20, 2024seen 5dcaptured 13hhttp 200method plain
v0.11.2
Repository: AI21Labs/ai21-tokenizer
Tag: v0.11.2
Published: 2024-06-20T11:30:43Z
Prerelease: no
Release notes:
v0.11.2 (2024-06-20)
Fix
- fix: add missing space tokens init on jursssic (#89)
- fix: missing space tokens init on jursssic, fix import in example
- test: add test for space_tokens init (`4ec43a0`)