Measuring deliberation

For review look at, and look at my mind map based on the above.

Micro-analytic approaches study the quality of deliberation through closely analyzing the content of participants’ comments during the deliberative process. The macro-analytic approach, in turn, asks coders to make summary judgments of the discussion as a whole.

Studies using direct measures focus on the actual process of deliberation, while studies using indirect measures assess deliberation based on either antecedents (for instance, by measuring the extent to which conditions necessary for deliberation are met) or outcomes of the discussion (for example, by measuring post-deliberation changes in participants. ’ preferences).

Direct Measurments

Those that measure deliberation directly examine the deliberative discussion to determine the extent to which the discussion corresponds to theoretical conceptions of deliberation.

The most common direct measurement of deliberation in small groups is what we call discussion analysis, which includes a range of methods used to systematically evaluate the communication engaged in during a deliberative discussion (also called micro-measurments). Another common method used for the direct study of deliberation is to ask participants for their own assessments of the deliberative process (also called macro-measurments). This is typically done through post-deliberation surveys or interviews in which respondents reflect on their experience as a participant and answer questions about the deliberative quality of the discussion. The case study will be the final direct approach we review. Discussion.

DQI: Measuring Political Deliberation: A Discourse Quality Index (2003), based on Habermas theories.

Bachtiger 2009

An attmept to improve DQI

• Type I deliberation
  • Equality - measured by precentage of participation and number of words for each participent (mean?)
  • Rational Justification:
    • no justification
    • inferior justification where the linkage between reasons and conclusion is tenuous.
    • qualified justification where a linkage between reasons and conclusion is made.
    • sophisticated justification (broad) where at least two complete justifications are given.
    • sophisticated justification (in depth) when at least one justification is explored in-depth, i.e., a problem is examined in a quasi-scientific way from various viewpoints.
  • Common Good Orientation: The importance of referring to the common good is mainly stressed by deliberative theorists drawing on Rawls.
    • whether arguments are cast in terms of narrow group or constituency interests.
    • whether there is neutral reference or mixed reference (i.e., reference to both narrow group interest and common good).
    • whether there is a reference to the common good. With regard to the common good, we focus both on the common good stated in utilitarian terms, i.e. as the best solution for the greatest number of people
    • the common good expressed through the difference principle, i.e. the common good is served when the least advantaged in a society are helped (Rawls 1971).
  • Respect Toward Demands and Counterarguments
    • speakers degrade.
    • treat neutrally.
    • value.
    • agree
  • Interactivity: whether participants refer to other participants and to other participants’ arguments.
  • Cunstructive Politics: This indicator is based upon the principal goal of type I deliberation to reach consensus.
    • positional politics form the lowest level.
    • alternative proposals, i.e. proposals that attempt to mediate but that do not fit the current agenda.
    • consensus appeals.
    • mediating proposals.
  • Trthfulness: There is no way to mesure it by direct obsevations.
• Type II Deliberation:
  • Story Telling: “story-telling” is the most important component of alternative forms of communication. They demonstrate that “story-telling” can play a central role in deliberative processes: “we find that narrative’s conventional openness to interpretation – in essence, its ambiguity – proved a surprising deliberative resource for people with marginalized points of view.”. They use "sourcing" acording to Stormer-Galley
  • Deliberative Negoatiations:
    • deliberative negoatiations: using only arguments.
    • non-deliberative negoatiations: using threts or implicit threts.count whether a speech contains threats or promises.

Diffrent methods of deliberation should have differnt expectd values in the fifferent parts.

From Bechtiger 2009

Holtinger (In German)

Stromer-Galley

read

Argument Repertoire

argument repertoire

Indirect Measurments

Studies using indirect measures assess deliberation based on either antecedents (for example, by measuring the extent to which conditions necessary for deliberation are met) or outcomes of the discussion (for example, by measuring post-deliberation changes in participants).