Call for Participation: EMit - Categorical Emotions Detection in Italian shared task at EVALITA 2023




Categorical Emotions Detection in Italian shared task at EVALITA 2023




EVALITA 2023, the 8th evaluation campaign of Natural Language Processing and Speech tools for Italian, 7-8 September 2023, Parma, Italy


Registration is required to obtain data and participate in the shared task.

Subscribe to the google group: 





The detection of emotions in texts has a long history in international evaluation campaigns (at SemEval in 2007, 2018 and 2019, or TASS 2020, EmoEvalEs 2021, EmotionX 2018 and 2019, and WASSA 2022 and 2023), but has never been addressed in EVALITA where the only shared task to deal with emotions was about emotional speech recognition systems (ERT 2014).


In this context, the EMit (Emotions in Italian) task aims at providing the first evaluation framework for categorical emotion detection in Italian texts (with a specific attention on the entertainment sector) and make new annotated data available to the community.


Task Description

EMit  is organized according to two subtasks, both designed as multilabel classification problems:

  1. SUBTASK A: Categorial Emotion Detection (mandatory). The main proposed subtask concerns the detection of emotions in social media messages about TV shows emitted by RAI (Radiotelevisione italiana, the national public broadcasting company of Italy) and other out-of-domain texts.
  2. SUBTASK B: Target Detection (optional). The second subtask is about the detection of the target addressed by the author of the message: the topic or the direction. In each text, it should be indicated whether this refers to what the broadcast is about (the topic) or whether it refers to something that is under control of the broadcast itself (the direction).


*Important Dates*


7th February 2023: training data available to participants

30th April 2023: registration closes 

2nd-19th May 2023: evaluation window and collection of participants’ results

30th May 2023: assessment returned to participants

14th June 2023: final reports from task participants due to task organizers

25th July 2023: camera ready version deadline

7th-8th September 2023: final workshop in Parma




Oscar Araque: Universidad Politécnica de Madrid, Madrid, Spain

Simona Frenda: Università degli Studi di Torino, Turin, Italy 

Debora Nozza: Università Bocconi, Milan, Italy

Viviana Patti: Università degli Studi di Torino, Turin, Italy 

Rachele Sprugnoli: Università di Parma, Parma, Italy

If you have any enquiries/comments, contact us via: