ReleaseFriendliAIFriendliAIpublished Jan 3, 2025seen 5d

friendliai/friendli-model-optimizer v0.9.0

friendliai/friendli-model-optimizer

Open original ↗

Captured source

source ↗
published Jan 3, 2025seen 5dcaptured 9hhttp 200method plain

v0.9.0

Repository: friendliai/friendli-model-optimizer

Tag: v0.9.0

Published: 2025-01-03T10:00:07Z

Prerelease: no

Release notes:

  • Support FP8, INT8, and AWQ for Qwen2-VL
  • More accurate quantization for FP8, INT8, and AWQ.
  • Deprecate Python3.8 support.

Notability

notability 4.0/10

Routine optimization tool release