Skip to content

Toggle service links

You are here

  1. Home
  2. Dr Jacopo Amidei

Dr Jacopo Amidei

Profile summary

Professional biography

Higher Education

  • Oct. 2017 - Nov. 2020:  Ph.D in Computational Linguistics, The Open University, School of Computing & Communications, UK  
  • Nov. 2012 - June. 2017:  Ph.D in Philosophy, Scuola Normale Superiore (SNS), Italy.  70/70 cum laude
  • Sept. 2008 - Sept. 2012:  Master in Philosophy, University of Siena, Italy    110/110 cum laude
  • Sept. 2004 - Apr. 2008:  Bachelor in Philosophy, University of Siena, Italy  110/110 cum laud

Appointments and Experience

Research interests

Evaluation of Natural Language Generation Systems, Data Annotation and Reliability, Dialogue Generation, Automatic Question Generation, Natural Language Understanding and Philosophy of Language

Publications 

Book chapters

Journal articles 

Conference items

Thesis

Preprint

Impact and engagement

Contributions to conferences

  • Local Organizing committee: XXV meeting of the Italian Association of Logic and its Applications, Scuola Normale Superiore, Pisa, Italy, 14 - 17 April 2014.

Invited lectures

  • Human evaluation of Natural Language Generation: Validity, reliability and more‚ Ruhr- Universität, Bochum, Germany, 26. Jan. 2021.

Publications

Trial and error mathematics: Dialectical systems and completions of theories (2019-01-23)
Amidei, Jacopo; Andrews, Uri; Pianigiani, Duccio; San Mauro, Luca and Sorbi, Andrea
Journal of Logic and Computation, 29(1) (pp. 157-184)


Conservative expansions of substructural logics (2022)
Amidei, J.; Ertola-Biraben, R. C. and Montagna, F.
In: Galatos, Nikolaos and Terui, Kazushige eds. Hiroakira Ono on Substructural Logics. Outstanding Contributions to Logic (pp. 339-368)
ISBN : 978-3-030-76920-8 | Publisher : Springer


QTMM2012c+: A Queryable Empirically- Grounded Resource of Dialogue with Argumentation (2021-11-29)
Amidei, Jacopo; Piwek, Paul and Stoyanchev, Svetlana
In : 5th Workshop on Advances in Argumentation in Artificial Intelligence (29 Nov 2021, Online event)


Identifying Annotator Bias: A new IRT-based method for bias identification (2020)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 28th International Conference on Computational Linguistics (COLING) (8-13 Dec 2020, Barcelona, Spain) (pp. 4787-4797)


Agreement is overrated: A plea for correlation to assess human evaluation reliability (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)


The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)


Evaluation methodologies in Automatic Question Generation 2013-2018 (2018-11-06)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 11th International Natural Language Generation Conference (5-8 Nov 2018, Tilburg, The Netherlands) (pp. 307-317)


Rethinking the Agreement in Human Evaluation Tasks (2018)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 27th International Conference on Computational Linguistics (20-26 Aug 2018, Santa Fe, New Mexico) (pp. 3318-3329)