OpenBMB/UltraEval-Audio v1.1

v1.1

Repository: OpenBMB/UltraEval-Audio

Tag: v1.1

Published: 2026-01-06T11:14:42Z

Prerelease: no

Release notes:

• Popular model replication: Added replication support for popular models, including replication result showcases and one-click replication commands (see replication/).
• Isolated Runtime: Introduced an isolated inference mechanism. Model-specific dependencies are installed/managed automatically; inference runs in the isolated environment and communicates with the main evaluation process via IPC, eliminating dependency conflicts.
• Specialized model evaluation support: Added specialized audio models for TTS, ASR, and Audio Codec, further expanding evaluation coverage.