Confident Adaptive Language Modeling

Introduces the CALM framework for dynamically allocating different amounts of compute per generated token, achieving potential decoding speedup of up to 3x, while maintaining high performance

Implement CALM in language model workflows to reduce compute and speed up inference time without compromising performance