Evaluation of Natural Language Generation Systems, Data Annotation and Reliability, Dialogue Generation, Automatic Question Generation, Natural Language Understanding and Philosophy of Language
Trial and error mathematics: Dialectical systems and completions of theories (2019-01-23)
Amidei, Jacopo; Andrews, Uri; Pianigiani, Duccio; San Mauro, Luca and Sorbi, Andrea
Journal of Logic and Computation, 29(1) (pp. 157-184)
Conservative expansions of substructural logics (2022)
Amidei, J.; Ertola-Biraben, R. C. and Montagna, F.
In: Galatos, Nikolaos and Terui, Kazushige eds. Hiroakira Ono on Substructural Logics. Outstanding Contributions to Logic (pp. 339-368)
ISBN : 978-3-030-76920-8 | Publisher : Springer
QTMM2012c+: A Queryable Empirically- Grounded Resource of Dialogue with Argumentation (2021-11-29)
Amidei, Jacopo; Piwek, Paul and Stoyanchev, Svetlana
In : 5th Workshop on Advances in Argumentation in Artificial Intelligence (29 Nov 2021, Online event)
Identifying Annotator Bias: A new IRT-based method for bias identification (2020)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 28th International Conference on Computational Linguistics (COLING) (8-13 Dec 2020, Barcelona, Spain) (pp. 4787-4797)
Agreement is overrated: A plea for correlation to assess human evaluation reliability (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)
The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations (2019)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 12th International Conference on Natural Language Generation (29 Oct - 1 Nov 2019, Tokyo, Japan)
Evaluation methodologies in Automatic Question Generation 2013-2018 (2018-11-06)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of The 11th International Natural Language Generation Conference (5-8 Nov 2018, Tilburg, The Netherlands) (pp. 307-317)
Rethinking the Agreement in Human Evaluation Tasks (2018)
Amidei, Jacopo; Piwek, Paul and Willis, Alistair
In : Proceedings of the 27th International Conference on Computational Linguistics (20-26 Aug 2018, Santa Fe, New Mexico) (pp. 3318-3329)
Evaluating the Evaluators: Subjective Bias and Consistency in Human Evaluation of Natural Language Generation (2021-01-27)
Amidei, Jacopo
PhD thesis The Open University