COST Action CA17132 - APPLY
European Network for Argumentation and Public Policy Analysis

(2023) “How persuasive is AI-generated argumentation? An analysis of the quality of an argumentative text produced by the GPT-3 AI text generator” by Martin Hinton, Jean H. M. Wagemans

In this paper, we use a pseudo-algorithmic procedure for assessing an AI-generated text. We apply the Comprehensive Assessment Procedure for Natural Argumentation (CAPNA) in evaluating the arguments produced by an Artificial Intelligence text generator, GPT-3, in an opinion piece written for the Guardian newspaper. The CAPNA examines instances of argumentation in three aspects: their Process, Reasoning and Expression. Initial Analysis is conducted using the Argument Type Identification Procedure (ATIP) to establish, firstly, that an argument is present and, secondly, its specific type in terms of the argument classification framework of the Periodic Table of Arguments (PTA). Procedural Questions are then used to test the acceptability of the argument in each of the three aspects. The analysis shows that while the arguments put forward by the AI text generator are varied in terms of their type and follow familiar patterns of human reasoning, they contain obvious weaknesses. From this we can conclude that the automated generation of persuasive, well-reasoned argumentation is a far more difficult task than the generation of meaningful language, and that if AI systems producing arguments are to be persuasive, they require a method of checking the plausibility of their own output.


More details here



COST (European Cooperation in Science and Technology) is a funding agency for research and innovation networks. Our Actions help connect research initiatives across Europe and enable scientists to grow their ideas by sharing them with their peers. This boosts their research, career and innovation.

COST Action CA17132

Providing and criticising reasons is indispensable to achieve sound public policy that commands the support of both citizens and stakeholders. This need is now widely acknowledged in the recent literature and key EU documents, which highlight the perils of populist discourse and policies.

Action Contacts

Andreia Domingues - Grant Manager [CA 17132]
NOVA - FCSH | Avenida de Berna, 26 C
1069-061 Lisboa - Portugal

© 2024 APPLY - All rights reserved. Privacy Policy

Design by Boutik