Collaborative Research: RI: Small: Evaluation Concepts for Assessing and Improving Large Language Models

Systems based on modern large language models (LLMs) play an increasing role in how users access information and compose text. For instance, a user executing a web search will increasingly rely on LLM-based systems to summarize their search results, rather than viewing individual web pages, and they might use LLM-based systems to “talk to” long…