friendliai/LLMServingPerfEvaluator v0.0.4
friendliai/LLMServingPerfEvaluator
Captured source
source ↗published Jul 19, 2024seen 5dcaptured 15hhttp 200method plain
Release v0.0.4 🚀
Repository: friendliai/LLMServingPerfEvaluator
Tag: v0.0.4
Published: 2024-07-19T06:04:24Z
Prerelease: no
Release notes:
- Handle
aiohttp.ClientOSErrorwhen evaluating vLLM on high RPS. - Handle invalid unicode by replacing REPLACEMENT CHARACTER(U+FFFD).
- Hofix for generating dummy dataset.
Notability
notability 3.0/10Minor version release of a tool, no notable traction.