ReleaseAI21 LabsAI21 Labspublished Jun 20, 2024seen 5d

AI21Labs/ai21-tokenizer v0.11.2

AI21Labs/ai21-tokenizer

Open original ↗

Captured source

source ↗
GH
GitHub/github.com/AI21Labs/ai21-tokenizer
AI21Labs/ai21-tokenizer v0.11.2
Source ↗
published Jun 20, 2024seen 5dcaptured 13hhttp 200method plain

v0.11.2

Repository: AI21Labs/ai21-tokenizer

Tag: v0.11.2

Published: 2024-06-20T11:30:43Z

Prerelease: no

Release notes:

v0.11.2 (2024-06-20)

Fix

  • fix: add missing space tokens init on jursssic (#89)
  • fix: missing space tokens init on jursssic, fix import in example
  • test: add test for space_tokens init (`4ec43a0`)