An introduction to argumentation for UTS:CIC PhD students (with some Learning Analytics examples, but potentially of wider interest to students/researchers)
3. Learning Analytics (LA) sits at the confluence of many
contributing disciplines, which brings the risk of hidden
assumptions inherited from those fields. Here, we consider a
hidden assumption derived from computer science, namely,
that improving computational accuracy in classification is
always a worthy goal. We demonstrate that this assumption is
unlikely to hold in some important educational contexts, and
argue that embracing computational “imperfection” can
improve outcomes for those scenarios. Specifically, we show
that learner-facing approaches aimed at “learning how to
learn” require more holistic validation strategies. We consider
what information must be provided in order to reasonably
evaluate algorithmic tools in LA, to facilitate transparency and
realistic performance comparisons.
https://dl.acm.org/doi/10.1145/3170358.3170413
Quick warm up:
Spot the claimed
knowledge gap
Spot the claimed
contribution
6. UTS:CIC Doctoral Training 6
From the discourse modelling underpinning AcaWriter, you
now recognise the common ‘moves’ we make to signal our
stance in academic writing (including but extending beyond
argumentation)
But this doesn’t explain the underlying building blocks for
arguments — only how they can be expressed
There are different models for understanding argument
structure which we’ll glimpse today…
8. UTS:CIC Doctoral Training 8
Arguments based on domain-specific facts and methods
These are the typical criticisms that we get from reviewers…
A Pearson ranked correlation coefficient would be a better test…
The inter-rater reliability was too low…
Smith et al 1990 has been mis-quoted…
The selection of students is not representative…
The task was so artificial that any practical implications are tenuous…
Bloggs et al specifically state that their survey should not be used with children…
The lit review has omitted a significant body of work on…
Just because F values matter in IR, doesn’t make this valid for LA…
10. UTS:CIC Doctoral Training 10
Issue-Based Information System (IBIS)
Download from the Compendium Institute
& follow the QuickStart Guide
(Windows version recommended; Java on
Mac tricky to configure)
11. UTS:CIC Doctoral Training 11
Mapping IBIS on the web
bCisive is a polished product (free to trial mini-maps) https://www.bcisiveonline.com
12. UTS:CIC Doctoral Training 12
Kirsty Kitto, Simon Buckingham Shum, and Andrew Gibson. (2018).
Embracing Imperfection in Learning Analytics. In Proceedings LAK18:
International Conference on Learning Analytics and Knowledge, March
5–9, 2018, Sydney, NSW, Australia, pp.451-460. (ACM, New York, NY,
USA). https://doi.org/10.1145/3170358.3170413
Issue Mapping part of
the Embracing
Imperfection paper
14. UTS:CIC Doctoral Training 14
Since these are typically hierarchies, you can map using
an outliner, no need to use network maps
15. UTS:CIC Doctoral Training 15
Since these are typically hierarchies, you can map using
an outliner, no need to use network maps
Using the CASE Word macro (Contention,
Argument, Source, Evidence)
http://www.vangeldermonk.com/case.html
to outline map an argument in
http://simon.buckinghamshum.net/2020/0
7/should-predictive-models-of-student-
outcome-be-colour-blind
16. UTS:CIC Doctoral Training 16
Issue-Based Information System (IBIS)
IBIS can be helpful for forcing yourself to clearly articulate good
questions, identify potential answers, and their pros and cons
Issue Mapping an article you’re reading or writing can clarify the
ideas, and helpful ways to structure the argument
There’s a skill and discipline to good IBIS mapping which you can
get into if you get interested
If you get fluent, you can do it in meetings: Dialogue Mapping
https://cic.uts.edu.au/tools/knowledge-cartography
https://cic.uts.edu.au/events/paul-culmsee-mapping-workshops
17. UTS:CIC Doctoral Training 17
A different flavour of argument map
From the British National Front (far right party)
“on every measure of intellectual ability and educational attainment
Blacks perform significantly worse, on average, than Whites. In the
case of average IQ, for example, the average Negro figure is only
85% of the White average.”
“Readers can consult Race by Dr. John R. Baker, former Reader in Cytology at Oxford University, published by the Oxford University
Press, or The Testing of Negro Intelligence, an exhaustive review of hundreds of studies demonstrating racial differences in intellectual
ability by Dr. Audrey M. Shuey, and of course there is The Bell Curve by Herrnstein and Murray.”
18. Buckingham Shum, S. (2007). Undermining Mimetic
Contagion on the Net: Argumentation Tools as Critical
Voices. COV&R’07: Colloquium on Violence & Religion, 4-8
July 2007, Soesterberg, NL www.girard.nl.
https://www.slideshare.net/sbs/undermining-mimetic-
contagion-on-the-net-argumentation-tools-as-critical-voices
19. UTS:CIC Doctoral Training 19
Going deeper: the hidden structure in an IBIS argument
There are in fact many hidden
premises in everyday arguments,
which can be questioned…
20. UTS:CIC Doctoral Training 20
Domain-independent Argumentation Schemes
These arise in everyday debates, and in many academic fields, including LA
When you learn to recognise their patterns, you can construct them – and critique
them – more rigorously, e.g.
Argument from expert opinion:
• “X is true (Source)” (typical form in academic writing)
Argument by analogy
• “X is true in this other similar context, so is plausibly true here”
21. UTS:CIC Doctoral Training 21
Domain-independent Argumentation Schemes
Philosophers of argument have documented
many Argumentation Schemes encountered
in everyday reasoning
Douglas Walton is an authority: get this book!
See the Rationale argument mapping tool:
https://www.rationaleonline.com
Compendium supplies Walton’s schemes
(and more) as visual templates
22. 22
Download from the Compendium Institute
& follow the QuickStart Guide
(Windows version recommended; Java on
Mac tricky to configure)
24. UTS:CIC Doctoral Training 24
Argument from Analogy — in slow motion
“I reckon I’ll like this
movie. Ben thought it
was hilarious.”
25. UTS:CIC Doctoral Training 25
Argument from Analogy — in slow motion
“I reckon I’ll like this
movie. Ben thought it
was hilarious.”
26. UTS:CIC Doctoral Training 26
Argument from Analogy — Argumentation Scheme
https://www.rationaleonline.com/map/tdt8vp/argument-from-analogy
27. UTS:CIC Doctoral Training 27
Argument from Analogy — false analogy
“Hitler was a genius.
He had a moustache.
And Einstein had a moustache.
I rest my case!”
28. UTS:CIC Doctoral Training 28
Argument from Analogy — in slow motion
“Hitler was a genius.
He had a moustache.
And Einstein had a moustache.
I rest my case!”
29. UTS:CIC Doctoral Training 29
Argument from Analogy — in slow motion
“Hitler was a genius.
He had a moustache.
And Einstein had a moustache.
I rest my case!”
32. UTS:CIC Doctoral Training 32
Argument by
Analogy —
LAK18 paper
Kirsty Kitto, Simon Buckingham Shum, and
Andrew Gibson. (2018). Embracing
Imperfection in Learning Analytics.
In Proceedings LAK18: International
Conference on Learning Analytics and
Knowledge, March 5–9, 2018, Sydney,
NSW, Australia, pp.451-460. (ACM, New
York, NY, USA).
https://doi.org/10.1145/3170358.3170413
33. UTS:CIC Doctoral Training 33
Argument by Analogy — Arg. Scheme template using
IBIS to map Critical Questions
Buckingham Shum, Simon and Okada, Alexandra (2008). Knowledge Cartography for Controversies: The Iraq Debate. In: Okada, Alexandra; Buckingham Shum, Simon J. and Sherborne, Tony
eds. Knowledge Cartography: Software Tools and Mapping Techniques. Advanced Information and Knowledge Processing, Springer, pp. 249–265. http://oro.open.ac.uk/11768/1/chapter12.pdf
36. UTS:CIC Doctoral Training 36
Argument from Expert Opinion — in slow motion
“As Sarah Brown (1991)
has argued persuasively,
attacking the Soviet
Union is what really lost
the war for Germany.”
37. UTS:CIC Doctoral Training 37
Argument from Expert Opinion — in slow motion
“As Sarah Brown (1991)
has argued persuasively,
attacking the Soviet
Union is what really lost
the war for Germany.”
38. UTS:CIC Doctoral Training 38
Argument from Expert Opinion — in slow motion
“As Sarah Brown (1991)
has argued persuasively,
attacking the Soviet
Union is what really lost
the war for Germany.”
39. UTS:CIC Doctoral Training 39
Argument from Expert Opinion — in slow motion
“As Sarah Brown (1991)
has argued persuasively,
attacking the Soviet
Union is what really lost
the war for Germany.”
40. UTS:CIC Doctoral Training 40
Argument from Expert Opinion — in slow motion
“As Sarah Brown (1991)
has argued persuasively,
attacking the Soviet
Union is what really lost
the war for Germany.”
41. UTS:CIC Doctoral Training 41
Argument from Expert Opinion — Arg. Scheme
https://www.rationaleonline.com/map/r4g4bh/argument-from-expert-opinion
42. UTS:CIC Doctoral Training 42
Argument from Expert Opinion — ways to attack it
Did they actually
state that?
But other experts
disagree…
No, in fact their expertise does
not cover the current topic
There are doubts about
their integrity…
43. UTS:CIC Doctoral Training 43
Argument from
Expert Opinion —
Critical
Questions
template
using IBIS
Buckingham Shum, Simon and Okada, Alexandra (2008). Knowledge Cartography for
Controversies: The Iraq Debate. In: Okada, Alexandra; Buckingham Shum, Simon J. and
Sherborne, Tony eds. Knowledge Cartography: software tools and mapping techniques.
Advanced Information and Knolwedge Processing, 1. Springer, pp. 249–265.
http://oro.open.ac.uk/11768/1/chapter12.pdf
44. SUMMARY
Mapping your arguments visually can help clarify your thinking
You can learn to recognise different kinds of arguments, and how they
can be critiqued
If you want to do more of this, then we can have a hands-on session
Discussion!