Large Language Models (LLMs) are part of three major scientific breakthroughs in just 10 years of Deep Learning applied to NLP: word embeddings, transformers with attention and prompt tuning. LLMs have shown surprising effectiveness in all tasks and have been adopted even in cross-cutting creative tasks such as the generation of images, code or music from textual descriptions. They seem to exhibit abilities which go beyond the tasks on which they were trained. Emergent abilities arise with scaling and are a phenomenon still subject to investigation. LLMs also raised concerns, since the release of GPT-2, the withdrawal of Galactica or the unexpected success of ChatGPT. Prof. Giuseppe Attardi (retired professor of Computer Science at the University of Pisa) will discuss their benefits, their limitations and how they will evolve. In particular, if the resources to build them will continue to grow, this might lead to a discrimination between groups of researchers and solutions to avoid this must be considered.
Tuesday, 03-14-2023, 05:00 p.m. – 06:00 p.m., virtual event
More details at: https://www.i-aida.org/events/large-language-models-are-all-you-need/.
This is an event of I-AIDA – International Artificial Intelligence Doctoral Academy.