hao-ai-lab.github.io
Consistency Large Language Models: A Family of Efficient Parallel Decoders

TL;DR: LLMs have been traditionally regarded as sequential decoders, decoding one token after another. In this blog, we show pretrained LLMs can be easily taught to operate as efficient parallel decoders. We introduce Consistency Large Language Models (CLLMs)…