Call for Participation: EMit - Categorical Emotions Detection in Italian shared task at EVALITA 2023
______________________________
EMit
Categorical Emotions Detection in Italian shared task at EVALITA 2023
Info: http://www.di.unito.it/~
EVALITA 2023, the 8th evaluation campaign of Natural Language Processing and Speech tools for Italian, 7-8 September 2023, Parma, Italy
Registration is required to obtain data and participate in the shared task.
Subscribe to the google group: emit_evalita2023@googlegroups.
______________________________
CALL FOR PARTICIPATION
The detection of emotions in texts has a long history in international evaluation campaigns (at SemEval in 2007, 2018 and 2019, or TASS 2020, EmoEvalEs 2021, EmotionX 2018 and 2019, and WASSA 2022 and 2023), but has never been addressed in EVALITA where the only shared task to deal with emotions was about emotional speech recognition systems (ERT 2014).
In this context, the EMit (Emotions in Italian) task aims at providing the first evaluation framework for categorical emotion detection in Italian texts (with a specific attention on the entertainment sector) and make new annotated data available to the community.
Task Description
EMit is organized according to two subtasks, both designed as multilabel classification problems:
- SUBTASK A: Categorial Emotion Detection (mandatory). The main proposed subtask concerns the detection of emotions in social media messages about TV shows emitted by RAI (Radiotelevisione italiana, the national public broadcasting company of Italy) and other out-of-domain texts.
- SUBTASK B: Target Detection (optional). The second subtask is about the detection of the target addressed by the author of the message: the topic or the direction. In each text, it should be indicated whether this refers to what the broadcast is about (the topic) or whether it refers to something that is under control of the broadcast itself (the direction).
*Important Dates*
7th February 2023: training data available to participants
30th April 2023: registration closes
2nd-19th May 2023: evaluation window and collection of participants’ results
30th May 2023: assessment returned to participants
14th June 2023: final reports from task participants due to task organizers
25th July 2023: camera ready version deadline
7th-8th September 2023: final workshop in Parma
*Organizers*
Oscar Araque: Universidad Politécnica de Madrid, Madrid, Spain
Simona Frenda: Università degli Studi di Torino, Turin, Italy
Debora Nozza: Università Bocconi, Milan, Italy
Viviana Patti: Università degli Studi di Torino, Turin, Italy
Rachele Sprugnoli: Università di Parma, Parma, Italy
If you have any enquiries/comments, contact us via: emit_evalita2023@googlegroups.