ReleaseFriendliAIFriendliAIpublished Jul 19, 2024seen 5d

friendliai/LLMServingPerfEvaluator v0.0.4

friendliai/LLMServingPerfEvaluator

Open original ↗

Captured source

source ↗
published Jul 19, 2024seen 5dcaptured 15hhttp 200method plain

Release v0.0.4 🚀

Repository: friendliai/LLMServingPerfEvaluator

Tag: v0.0.4

Published: 2024-07-19T06:04:24Z

Prerelease: no

Release notes:

  • Handle aiohttp.ClientOSError when evaluating vLLM on high RPS.
  • Handle invalid unicode by replacing REPLACEMENT CHARACTER(U+FFFD).
  • Hofix for generating dummy dataset.

Notability

notability 3.0/10

Minor version release of a tool, no notable traction.