ModelAI21 LabsAI21 Labspublished Apr 17, 2024seen Jun 6

ai21labs/Jamba-tiny-random

Open original ↗

Captured source

source ↗
published Apr 17, 2024seen Jun 6captured Jun 11http 200method plaintask text-generationlicense apache-2.0library transformersparams 128Mdownloads 11klikes 13

This is a tiny, dummy version of Jamba, used for debugging and experimentation over the Jamba architecture.

It has 128M parameters (instead of 52B), and is initialized with random weights and did not undergo any training.

Notability

notability 4.0/10

Routine tiny model release, moderate downloads