Towards interpretable and controllable deep language modeling

Large language models (LLMs) such as ChatGPT have rapidly become ubiquitous in the technology sector and are being applied in a wide variety of increasingly important domains, including customer service, automated source code generation, and augmenting the efficiency of the UK civil service. However, these models are "black boxes" - no…