MAGIC: Multimodality and Graphics in Interactive Communication

An EPSRC and ESRC Joint Programme: People At the Centre of Communication and Information Technologies (PACCIT).

Despite the significance of graphical interaction as a basic mode of communication, and despite the possibilities that new technologies offer for exploiting it, little research has investigated the synchronous, interactive use of graphics in communication. To address this gap, the MAGIC project is analysing the character of graphical communication, identifying the conditions under which it is most effective, and developing and testing tools to analyse and support it. Key questions include the contribution of graphics to multimodal communication, the emergence of graphical styles and conventions in (sub)communities and the influence of interactional constraints on the form of graphical representations. The research embraces: analysis of the procedural organisation of graphical communication; investigation of processes of conventionalisation and abstraction; and development of tools for analysing and supporting graphical interaction.

MobileMAGIC:  Mobile Multimodality And Graphics in Interactive Communication

MobileMAGIC Is an extension of the MAGIC project supported by Hewlett-Packard's Voice Web Initiative

Whiteboard Tool

The MAGIC Project whiteboard software has been released. For more information, please visit this page.

Principal Investigator

Dr. Patrick G.T. Healey Queen Mary, University of London
Department of Computer Science
Interaction, Media & Communication Research Group

Co-investigators

Prof. Simon Garrod Glasgow University
Department of Psychology
Dr. Yasuhiro Katagiri Advanced Telecommunication Research Institute International
Media Information Science Laboratories
VisComm
Dr. John R. Lee Edinburgh University
EdCAAD
Human Communication Research Centre (HCRC)
Dr. Jon R. Oberlander Edinburgh University
Division of Informatics
Human Communication Research Centre (HCRC)

Research Staff

Nick Fay
Nik Swoboda
Ichiro Umata
ATR Media Information Science Laboratories
Charlotte Peters
Mike Thirlwell
Queen Mary, University of London
Department of Computer Science
Interaction, Media & Communication Research Group

Selected Publications

Interactional context in graphical communication
Healey, P.G.T. and Garrod, S. and Fay, N. Lee, J. and Oberlander, J.
Gray, W.D. and Schunn, C.D. (eds) Proceedings of the 24th Annual Conference of the Cognitive Science Society, pp. 441-446, George Mason University, Virginia, August 7th-10th 2002.

A tool for performing and analysing experiments on graphical communication
Healey, P.G.T. and Swoboda, N. and King, J.
Faulkner, X. and Finlay, J. and D'etienne, F. (eds) People and Computers XVI: Proceedings of HCI2002: The 16th British HCI Group Annual Conference, pp. 55-68, Southbank University, London, 2nd-6th September 2002.

Notes on turn-taking and topic in drawing-in-interaction
Healey, P.G.T. and Peters, C.
Presented at the 4th International Workshop on Gesture and Sign Language based Human-Computer Interaction, City University, London, 18th-20th April 2001.

Graphical representation in graphical dialogue
Healey, P.G.T. and Swoboda, N. and Umata, I. and Katagiri, Y.
International Journal of Human Computer Studies (Special Issue on Interactive Graphical Communication), Volume 57, Number 4, pp. 375-395, October 2002.

Representational form and communicative use
Healey, P.G.T. and Swoboda, N. and Umata, I. and Katagiri, Y.
Moore, J.D. and Stenning, K. (eds) Proceedings of the 23rd Annual Conference of the Cognitive Science Society, pp. 411-416, University of Edinburgh, Scotland, 1st-4th August 2001.

Useful Links

Queen Mary, University of London
Department of Computer Science
Interaction, Media & Communication Research Group

Advanced Telecommunication Research Institute International
Media Information Science Laboratories
VisComm

Edinburgh University
EdCAAD
Division of Informatics
Human Communication Research Centre (HCRC)

Glasgow University
Department of Psychology