Skip to content

Toggle service links

You are here

  1. Home
  2. Mr Jacopo Amidei

Mr Jacopo Amidei

Profile summary

Professional biography

Jan. 2021 - present: Post-Doctoral Research Associate, on the Opening Up Minds: Engaging Dialogue Generated from Argument Maps project, The Open University, School of Computing & Communications, UK

Jan. 2020 - May 2020: Visiting Research Fellow, Universitat Pompeu Fabra (UPF), Spain

Oct. 2017 - present:  Ph.D in Computational Linguistics, The Open University, School of Computing & Communications, UK 

Mar. 2016 - Oct. 2016:  Traineeship, ExB, Leipzig, Germany

Nov. 2012 - June. 2017:  Ph.D in Philosophy, Scuola Normale Superiore (SNS), Italy.  70/70 cum laude

Sept. 2008 - Sept. 2012:  Master in Philosophy, University of Siena, Italy    110/110 cum laude

Sept. 2004 - Apr. 2008:  Bachelor in Philosophy, University of Siena, Italy  110/110 cum laude

Research interests

Evaluation of Natural Language Generation Systems, Data Annotation and Reliability, Dialogue Generation, Automatic Question Generation, Natural Language Understanding and Philosophy of Language

Publications 

•  2020

 

 

•  2019

 

•  2018 

 

 

2016 

 

 

•  To appear 

 

Impact and engagement

Local Organizing committee: XXV meeting of the Italian Association of Logic and its Applications, 14 - 17 April 2014 Scuola Normale Superiore, Pisa (Italy)

Publications

Trial and error mathematics: Dialectical systems and completions of theories (2019-01-23)
Amidei, Jacopo; Andrews, Uri; Pianigiani, Duccio; San Mauro, Luca and Sorbi, Andrea
Journal of Logic and Computation, 29(1) (pp. 157-184)


Identifying Annotator Bias: A new IRT-based method for bias identification (2020)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 28th International Conference on Computational Linguistics (COLING) (8-13 Dec 2020, Barcelona, Spain) (pp. 4787-4797)


Agreement is overrated: A plea for correlation to assess human evaluation reliability (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)


The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)


Evaluation methodologies in Automatic Question Generation 2013-2018 (2018-11-06)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 11th International Natural Language Generation Conference (5-8 Nov 2018, Tilburg, The Netherlands) (pp. 307-317)


Rethinking the Agreement in Human Evaluation Tasks (2018)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 27th International Conference on Computational Linguistics (20-26 Aug 2018, Santa Fe, New Mexico) (pp. 3318-3329)