Venue: School of Computer Science building (Malá Strana Campus), Malostranské náměstí 25, Prague 1, rooms S8 and S9 (1st floor)
Thursday, June 26
8:45 corridor Registration, posters preparation (1st floor, in front of rooms S8, S9) 9:30 S9 Welcome Mirko Rokyta, dean, Faculty of Mathematics and Physics, Charles University Josef van Genabith, LCT project coordinator Evgeniya Ustinova, LCT project management 10:00 S9 Invited talk Jan Hajič, Faculty of Mathematics and Physics, Charles University title: LLMs and symbolic meaning representations - perspectives and questions (slides) abstract: Large Language Models have entered the field of Natural Language processing in a very short time and very deeply. There are many interesting and useful applications, such as chatbots, copilots, image and text generators and many other. While there are even more interesting applications ahead, the talk will focus on the relation between LLMs and how they are traditionally built, and their relation to symbolic meaning representations that rely on our introspection not only about linguistic structure, but also our knowledge of the real world. Several boundary research questions will be then presented for which we still don't have an answer, both from the fundamental research perspective and from the application point of view. 10:45 corridor Coffee break 11:15 corridor Poster session I - Abstracts (both sessions) 12:00 corridor Poster session II 12:45 corridor Lunch 13:45 S9 Student meeting (incl. student rep elections, only for students of the intake 2024) S8 in parallel with coordinators' meeting 15:30 corridor Coffee break Consultations with local coordinators (e.g., individual comments/issues; Y2 information) in parallel with graduates' preparation for ceremony 16:00 Refectory Graduation Ceremony in the Refectory (the same floor) (formal dress required for graduates (a suit for men, and a cocktail dress / pant suit for women); others smart casual) Jan Polák, vice rector, Charles University Jiří Pavlů, vice dean, Faculty of mathematics and Physics, Charles University Josef van Genabith, LCT project coordinator student rep music: George Frideric Händel — Eternal Source, Rejoice, Let the bright Seraphim (organ: Jan Hajič jr., singing: Anna Petrtylová)
18:30 Reception at Café Hamu Malostranské náměstí 258 (the upper part of the square)
Friday, June 27
8:45 corridor registration 9:15 S9 Invited talk Júlia Falcão, Barcelona Supercomputing Center (LCT alumna, intake 2021) title: Training an LLM from scratch: a closer look at the key steps and the challenges abstract: This talk will provide an overview of the complete process of training a Large Language Model (LLM) from scratch, from the perspective of a research engineer in the Language Modeling group at the Barcelona Supercomputing Center (BSC-CNS). This team was responsible for the Salamandra suite of open-source LLMs in 2B, 7B and 40B parameters, trained on 35 European languages and codes. First, I will discuss the motivation behind this project in the context of when it started, in light of the shift that followed the release of ChatGPT. Then I will cover the key steps leading up to the final checkpoints and their release: data collection and curation, architectural choices, the infrastructure that was used, and the evaluation process. Throughout this overview, I will comment on some of the many challenges faced along the way, aiming to provide a realistic view of what is a very intricate process. Finally, I will quickly comment on what we are working on now since the release, and how we are still working to improve the models. The goal of this talk is to provide a behind-the-scenes look at all the effort that goes behind the release of an open-source model that is fully compliant with EU regulations. 10:00 S9 Plenary meeting: consortium & students chair: Michael Awanah Announcement of the new study rep. 11:00 corridor Coffee break 11:30 S9 Alumni session graduates of the intake 2022 will share their experience after finishing the program 12:45 S9 Closing 13:00 Lunch 14:00-17:00 City tour Each participant must have a ticket for public transport (30 mins ticket is enough, see below) start: in front of the building
Accommodation: University Hotel Krystal - the hotel is 17 floors tall, you can’t miss it!
From the airport to Krystal:
From Krystal to the Venue:
City transport in Prague:
Living in Prague - faculty webpage for incoming students with basic practical info
What to see in Prague:
Ambulance | Police | City Police | Fire Brigade | Emergency |
155 | 158 | 156 | 150 | 112 |