Designing Argumentation Tools for Collaborative Learning

Discussion and Conclusion

Download 370.23 Kb.
Size370.23 Kb.
1   2   3   4

3.5 Discussion and Conclusion

Education can be viewed as an ongoing process of argumentation (Petraglia, 1997). It is the process of discovering and generating acceptable arguments and lines of reasoning underlying scientific assumptions and bodies of knowledge. In collaborative learning, students can negotiate different perspectives by externalising and articulating them, and learn from each other’s insights and different understandings. Thus, through negotiation processes, including argumentation, they can reconstruct and co-construct knowledge in relationship to specific learning goals.

The present research suggests that the role of argumentation needs to be reconsidered. Across studies, ‘direct’ forms of argumentation (challenges, counter-argumentation) did not relate well to the production of constructive activities, a measure to define learning-in-process. This may be explained by the paradox that students should have a well-established understanding of knowledge in order to take firm positions. However, their knowledge is under discussion and subject to the learning process itself. Therefore, offering support to students to challenge and counter each other’s information may not be the most fruitful approach. However, information checking was shown to be important, which was regarded as an ‘indirect’ form of argumentation. The more information was checked, the more constructive activities were produced. Students can be provoked to critically check each other’s information through instruction and task design.

With regard to computerised learning environments, the research indicates that students particularly need facilitation by means of tools and explicit instruction in co-ordinating electronic and text-based communication, and in keeping track of the main issues while producing networked-based discussions. Technical disturbances and a loss of thematic focus easily occur, especially in synchronous CMC systems, and have a negative effect on collaborative learning processes. Additional tools to keep a (graphical) overview of the issues at hand can be helpful, such as the diagram construction tool provided by the Belvédère system and the TC3 program.

In research by Erkens (1997), focusing, checking and argumentation were revealed as essential factors in collaborative learning processes. In addition, parallel studies aimed at argumentation, epistemic interactions and grounding processes contributed to gaining more understanding of the mechanisms that can support collaborative learning through (electronic) dialogue. We presented some results of a couple of studies in this chapter to explore those relations more in depth.

We found that the Diagram, Outline and Diagram-Advisor conditions all have a positive affect on the number of Argumentatives. This suggests that the moderate availability of extra tools has a positive influence on the number of arguments in the chat, and also on some aspects of the quality of the argumentative text.

The transition patterns show that the experimental groups are more structured in their direct communication than the Control group. This suggests that the planning tools (Diagram, Outline, Advisor) stimulate a more structured dialogue. The same difference in the structure of dialogues can be observed when comparing high scoring and low scoring dyads. This leads us to conclude that the experimental condition (extra tools) has a direct effect on text quality, but also through the communicative function in the chat dialogues.

Some of the results in the last study (Erkens, Prangsma, Jaspers, & Kanselaar, 2002) are not simple to interpret.

The analyses of chat dialogues about the Diagrams suggest that for some participants this tool did not serve as a basis for discussion or a tool for idea generation, as it was intended, but rather functioned as a visual representation. The correspondence of arguments between Diagram and the final text reveals a discrepancy between the two: only about a third of the arguments are found both in the final text and the Diagram. Although the use of wholly original arguments seems to be slightly positively related to text quality, these are hardly used, and most of the arguments are taken directly from the given sources.

With respect to these results, the study of Veerman (2000) can be mentioned in which students used the Belvédère environment to chat electronically and to visualize their discussion about a computer-based design by the use of an argumentative diagram construction tool. It showed that the students only gained from the Belvédère environment, when they linked their chat discussions closely to their diagrams. A significant relationship was found between the amount of overlapping information between chats and diagrams, and the amount of constructive activities produced (Veerman, 2000). However, student groups varied in linking information between chats and diagrams. This appeared to depend heavily on student groups’ task approaches and preparation activities.

We also found that using the private – hence non-collaborative -– notes window (the upper left window in Figure 3.3) is detrimental to the quality of the collaborative product. This confirms our idea that collaboration is necessary on all subtasks, including planning, idea generation, coordination and information processing.

We also found that explicit argumentation on content, coordination, and metacognitive strategies is related positively to text quality, whereas argumentation on technical aspects of the task and on non-task related topics is related negatively to text quality. The relation between non-task chat and text quality is negative throughout the groups, although the relation is the most clear for the Control group.

When we compare the Diagram (Figure 3.4) with the Outline (Figure 3.5), the Outline tool was more successful. Availability and proper use of this planning tool have a positive effect on the dialogue structure, and on the coordination processes of focusing and argumentation, as well as on text quality. The Diagram often functions as a visual representation, and not as a basis for discussion or a tool for idea generation. When a diagram reflects the discussion itself, it can be a valuable starting point for writing the text, and of benefit to textual structure. Students don’t have much experience with the use of Diagram tools. Perhaps a different approach to the task instruction – for example by giving the students time to practice using the complex Diagram tool – could encourage the students to use the tool as it was intended, and thus lead to different results.

Much is possible in electronic learning environments, but so far not enough is known about the relationships between collaborative learning, argumentation and educational technology. This research has shown that such relationships are neither simple nor very predictable. Hence, much more research is needed that examines the role of (interactive) mechanisms such as argumentation and focusing in relationship to features of CSCL situations.

3.6 Acknowledgements

The research reported in this chapter was made possible by grant from the Dutch Scientific Organization (NWO-project 575-33-008)

3.7 References

Andriessen, J., Baker, M., & Suthers, D. (in press). In J. Andriessen, M. Baker & D. Suthers (Eds.), Arguing to learn: Confronting cognitions in computer-supported collaborative learning environments.

Andriessen, J., Erkens. G., Overeem, E., & Jaspers, J. (1996, September). Using complex information in argumentation for collaborative text production. Paper presented at the UCIS '96 conference, Poitier, France.

Baker, M. (1992). Modeling negotiation in intelligent teaching dialogue. In R. Moyse & M. T. Elsom-Cook (Eds.), Knowledge negotiation. London: Academic Press Limited.

Baker, M., De Vries, E., & Lund, K. (1999). Designing computer-mediated epistemic interactions. In S. P. Lajoie & M. Vivet (Eds.), Proceedings of the 9th International Conference on Artificial Intelligence in Education (pp. 139-146). Amsterdam: IOS Press.

Boxtel, C. Van (2000). Collaborative concept learning. Unpublished PhD thesis, Utrecht University, Utrecht, The Netherlands.

Chanquoy, L. (1996, October). Connectives and argumentative text: a developmental study. Paper presented at the First International Workshop on Argumentative Text Processing, Barcelona, Spain.

Coirier, P., Andriessen, J. E. B., & Chanquoy, L. (1999). From planning to translating: The specificity of argumentative writing. In J. E. B. Andriessen & P. Coirier (Eds.), Foundations of argumentative text processing (pp. 1-29). Amsterdam: Amsterdam University Press.

Erkens, G. (1997). Cooperatief probleemoplossen met computers in het onderwijs: Het modelleren van cooperatieve dialogen voor de ontwikkeling van intelligente onderwijssystemen [Cooperative problem solving with computers in education: Modelling of cooperative dialogues for the design of intelligent educational systems]. Unpublished doctoral dissertation, Utrecht University, Utrecht, The Netherlands.

Erkens, G., Prangsma, M. E., Jaspers, J. G. M., & Kanselaar, G. (2002). Computer supported collaborative and argumentative writing. Utrecht : Utrecht University, ICO-ISOR Onderwijsresearch

Glasersfeld, E. von (1989). Cognition, construction of knowledge and teaching. Synthese, 80, 121-140.

Greeno, J. G. (1997). Response: On claims that answer the wrong question. Educational Researcher, 20, 5-17.

Henri, F. (1995). Distance learning and computer mediated communication: Interactive, quasi-interactive or monologue? In C. O'Malley (Ed.), Computer supported collaborative learning (Vol. 128, pp. 145-165). Berlin: Springer.

Kanselaar, G., Jong, T. de, Andriessen, J. E. B., & Goodyear, P. (2000). New technologies. In P .R. J. Simons, J. L. van der Linden & T. Duffy (Eds.),. New learning (pp. 49 - 72). Dordrecht: Kluwer Academic Publishers.

Kanselaar, G., & Erkens, G. (1996). Interactivity in co-operative problem solving with computers. In S. Vosniadou, E. DeCorte, R. Glaser & H. Mandl (Eds.), International perspectives on the design of technology-supported learning environments (pp. 185-202). Mahwah, New Jersey: Lawrence Erlbaum.

Kuhn, D. (1991). The skills of argument. Cambridge: University Press.

Petraglia, J. (1997). The rhetoric and technology of authenticity in education. Mahwah, NJ: Lawrence Erlbaum.

Roschelle, J. (1992). Learning by collaborating: Convergent conceptual change. The journal of the learning sciences, 2, 235-276.

Roschelle, J., & Teasley, S. D. (1995). Construction of shared knowledge in collaborative problem solving. In C. O'Malley (Ed.), Computer-supported collaborative learning (pp. 69-97). New York: Springer Verlag.

Salomon, G. (1993). On the nature of pedagogic computer tools: The case of the writing partner. In S. P. Lajoie & S. J. Derry (Eds.), Computers as cognitive tools (pp. 289-317). Hillsdale, NJ: Lawrence Erlbaum.

Salomon, G. (1997, August 26-30). Novel constructivist learning environments and novel technologies: Some issues to be concerned. Invited key-note address presented at the EARLI conference, Athens.

Savery, J. R., & Duffy, T. M. (1995). Problem based learning: An instructional model and its constructivistic framework. Educational Technology, 35, 31-38.

Scardamalia, M., Bereiter, C., & Lamon, M. (1994). The CSILE project: Trying to bring the classroom into world 3. In K. McGilly (Ed.), Classroom lessons: Integrating cognitive theory and classroom practice (pp. 201-229). Cambridge, MA: MIT Press.

Suthers, D., Weiner, A., Connelly, J., & Paolucci, M. (1995, August). Belvedere: Engaging students in critical discussion of science and public policy issues. Paper presented at the AI-Ed 95, the 7th World Conference on Artificial Intelligence in Education, Washington, DC.

Suthers, D., & Hundhausen, C. (2001). Learning by constructing collaborative representations: An empirical comparison of three alternatives. In P. Dillenbourg, A. Eurelings & K. Hakkarainen (Eds.), European perspectives on computer-supported collaborative learning: Proceedings of thé first european conference on computer-supported collaborative learning (pp.577-584). Maastricht, the Netherlands, University of Maastricht.

Teasley, S. D., & Roschelle, J. (1993). Constructing a joint problem space: The computer as a tool for sharing knowledge. In S. P. Lajoie & S. J. Derry (Eds.), Computers as cognitive tools (pp. 229-257). Hillsdale, NJ: Lawrence Erlbaum.

Van Eemeren, F. H., Grootendorst, R., & Snoeck Henkemans, A. F. (1995). Argumentatie. Groningen: Woltersgroep, The Netherlands.

Veerman, A. L., & Treasure-Jones, T. (1999). Software for problem solving through collaborative argumentation. In P. Coirier & J. E. B. Andriessen (Eds.), Foundations of argumentative text processing (pp. 203-230). Amsterdam: Amsterdam University Press.

Veerman, A. L. (2000). Computer-Supported collaborative learning through argumentation. Doctoral dissertation. Enschede: Print Partners Ipskamp.

Veerman, A. L., & Andriessen, J.E.B. (1997, September, 4-6). Academic learning & writing through the use of educational technology. Presented at the conference on Learning & Teaching Argumentation, Middlesex University, London.

Veerman, A. L., Andriessen, J. E. B., & Kanselaar, G. (2000.) Enhancing learning through synchronous discussion. Computers & Education, 34, (2-3),1-22.

Wampold, B. E., & Margolin, G. (1982). Nonparametric strategies to test the independence of behavioral states in sequential data. Psychological Bulletin, 92, 755-765.

1Concept mapping homepage:

2MEPA was developed as a general program for protocol analysis and is being used in several research projects at Utrecht University, as well as abroad. For further information, please contact G. Erkens (

3Thanks to Floor Scheltens who assisted in the analyses of the data.

Download 370.23 Kb.

Share with your friends:
1   2   3   4

The database is protected by copyright © 2020
send message

    Main page