You are here
- Home
- Dr Jacopo Amidei
Dr Jacopo Amidei
Profile summary
- Research Staff
- Research Associate
- Faculty of Science, Technology, Engineering & Mathematics
- School of Computing & Communications
- jacopo.amidei1
Professional biography
Higher Education
- Oct. 2017 - Nov. 2020: Ph.D in Computational Linguistics, The Open University, School of Computing & Communications, UK
- Nov. 2012 - June. 2017: Ph.D in Philosophy, Scuola Normale Superiore (SNS), Italy. 70/70 cum laude
- Sept. 2008 - Sept. 2012: Master in Philosophy, University of Siena, Italy 110/110 cum laude
- Sept. 2004 - Apr. 2008: Bachelor in Philosophy, University of Siena, Italy 110/110 cum laud
Appointments and Experience
- Jan. 2021 - present: Post-Doctoral Research Associate, on the Opening Up Minds: Engaging Dialogue Generated from Argument Maps project, The Open University, School of Computing & Communications, UK
- Jan. 2020 - May 2020: Visiting Research Fellow, Universitat Pompeu Fabra (UPF), Spain
- Mar. 2016 - Oct. 2016: Traineeship, ExB, Leipzig, Germany
Research interests
Evaluation of Natural Language Generation Systems, Data Annotation and Reliability, Dialogue Generation, Automatic Question Generation, Natural Language Understanding and Philosophy of Language
Publications
Book chapters
Journal articles
- J. Amidei, D. Pianigiani, L. San Mauro, G. Simi and A. Sorbi, Trial and error mathematics I: Dialectical and quasidialectical systems, The review of symbolic logic, Volume 9, Number 2, Giugno 2016, pp. 299-324.
- J. Amidei, D. Pianigiani, L. San Mauro and A. Sorbi, Trial and error mathematics II: Dialectical sets and quasidialectical sets, their degrees, and their distribution within the class of limit sets, The review of symbolic logic, Volume 9, Issue 4, December 2016, pp. 810-835.
- J. Amidei and D. Pianigiani, Natura empirica della metamatematica: la filosofia della matematica di Roberto Magari, Matematica, Cultura e società – Rivista dell’Unione matematica Italiana, Serie I, Vol. I, Agosto 2016, pp. 145-159.
Conference items
- J. Amidei, P. Piwek and A. Willis, Identifying Annotator Bias: A new IRT-based method for bias identification, In Proceedings of The 28th International Conference on Computational Linguistics (COLING), Barcelona, Spain, December 8-13, 2020.
- M. Westera, J. Amidei and L. Mayol, Similarity or deeper understanding? Analyzing the TED-Q dataset of evoked questions, In Proceedings of The 28th International Conference on Computational Linguistics (COLING), Barcelona, Spain, December 8-13, 2020.
- J. Amidei, P. Piwek and A. Willis, The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations, In Proceedings of The 12th International Natural Language Generation Conference, Tokyo, Japan, October 29 - November 1, 2019.
- J. Amidei, P. Piwek and A. Willis, Agreement is overrated: A plea for correlation to assess human evaluation reliability, In Proceedings of The 12th International Natural Language Generation Conference, Tokyo, Japan, October 29 - November 1, 2019
- J. Amidei, P. Piwek and A. Willis, Rethinking the Agreement in Human Evaluation Tasks, Proceedings of the 27th International Conference on Computational Linguistics (20-26 Aug. 2018, Santa Fe, New Mexico), pp. 3318-3329.
- J. Amidei, P. Piwek and A. Willis, Evaluation Methodologies in Automatic Question Generation 2013 - 1018, Proceedings of The 11th International Natural Language Generation Conference (5-8 November 2018, Tilburg, The Netherlands), pp 307–317.
Thesis
Preprint
Impact and engagement
Contributions to conferences
- Local Organizing committee: XXV meeting of the Italian Association of Logic and its Applications, Scuola Normale Superiore, Pisa, Italy, 14 - 17 April 2014.
Invited lectures
- Human evaluation of Natural Language Generation: Validity, reliability and more‚ Ruhr- Universität, Bochum, Germany, 26. Jan. 2021.
Publications
Journal articles
Trial and error mathematics: Dialectical systems and completions of theories (2019-01-23)
Amidei, Jacopo; Andrews, Uri; Pianigiani, Duccio; San Mauro, Luca and Sorbi, Andrea
Journal of Logic and Computation, 29(1) (pp. 157-184)
Book chapters
Conservative expansions of substructural logics (2022)
Amidei, J.; Ertola-Biraben, R. C. and Montagna, F.
In: Galatos, Nikolaos and Terui, Kazushige eds. Hiroakira Ono on Substructural Logics. Outstanding Contributions to Logic (pp. 339-368)
ISBN : 978-3-030-76920-8 | Publisher : Springer
Conference items
QTMM2012c+: A Queryable Empirically- Grounded Resource of Dialogue with Argumentation (2021-11-29)
Amidei, Jacopo; Piwek, Paul and Stoyanchev, Svetlana
In : 5th Workshop on Advances in Argumentation in Artificial Intelligence (29 Nov 2021, Online event)
Identifying Annotator Bias: A new IRT-based method for bias identification (2020)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 28th International Conference on Computational Linguistics (COLING) (8-13 Dec 2020, Barcelona, Spain) (pp. 4787-4797)
Agreement is overrated: A plea for correlation to assess human evaluation reliability (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)
The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)
Evaluation methodologies in Automatic Question Generation 2013-2018 (2018-11-06)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 11th International Natural Language Generation Conference (5-8 Nov 2018, Tilburg, The Netherlands) (pp. 307-317)
Rethinking the Agreement in Human Evaluation Tasks (2018)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 27th International Conference on Computational Linguistics (20-26 Aug 2018, Santa Fe, New Mexico) (pp. 3318-3329)
Thesis
Evaluating the Evaluators: Subjective Bias and Consistency in Human Evaluation of Natural Language Generation (2021-01-27)
Amidei, Jacopo
PhD thesis The Open University
