This talk gives an introduction to Large Language Models for non-specialists, especially those who might be considering applying them to nature or climate projects. We will cover the recent history of language models and then deep dive on a modern transformer-based language model. We will look at tokenisation, training methods, preference alignment and the future trends in model architectures.

Bio: https://toao.com/