ModelAI21 LabsAI21 Labspublished Apr 17, 2024seen 5d

ai21labs/Jamba-tiny-random

Open original ↗

Captured source

source ↗
published Apr 17, 2024seen 5dcaptured 15hhttp 200method plaintask text-generationlicense apache-2.0library transformersparams 128Mdownloads 11klikes 13

This is a tiny, dummy version of Jamba, used for debugging and experimentation over the Jamba architecture.

It has 128M parameters (instead of 52B), and is initialized with random weights and did not undergo any training.