Workshop on Evaluating NLG (Natural Language Generation) Evaluation - EvalNLGEval

Country: Ireland

City: Dublin

Abstr. due: 20.09.2020

Dates: 18.12.20 — 18.12.20

Area Of Sciences: Humanities;

Organizing comittee e-mail:

Organizers: Shubham Agarwal, Ondrej Dusek, Sebastian Gehrmann, Dimitra Gkatzia, Ioannis Konstas, Emiel van Miltenburg, Sashank Santhanam, Samira Shaikh


This workshop is intended as a discussion platform on the status and the future of the evaluation of Natural Language Generation systems. Among other topics, we will discuss current evaluation quality, human versus automated metrics, and the development of shared tasks for NLG evaluation. The workshop also involves an 'unshared task', where participants are invited to experiment with evaluation data from earlier shared tasks.

Conference Web-Site: