2。1。2 Multimodal Discourse Analysis

A multimodal approach is one where attention is given to all the culturally shaped resources that are available for making meaning: image, for instance, image, or gesture, or the layout – whether of the wall-display or the furniture of classrooms – and of course writing and speech as talk。 (O'Halloran, KayL, Smith, 2011) Martin’s (2008) extends the notion of genre into analyzing semiotic modes than language through refining it as socially-constructed, staged activity that is not constructed by language alone, but simultaneously by more than one mode (Martin & Rose, 2008: 44) Multimodality has been approached from various perspectives and each has it’s own interest, purpose and research focus。

Research approaches to multimodality includes a social semiotic approach, systemic functional multimodal approach, a multimal interactional analysis approach。 Gunther Kress and Theo van Leeuwen and Michael O‟Toole provided the foundations for multimodality in the 1980s and 1990s, drawing upon Michael Halliday’s social semiotic approach to language to model the potential of word meanings, sounds and images as sets of inter-related systems and structures。 O’Toole (2010) applied Halliday’s systemic functional model to a semiotic analysis of displayed art, paintings, sculpture and architecture。 Halliday (Halliday & Hasan, 1985) concerns with both text and context, instance and potential。 Systemic functional multimodal approach was advocated by O’ Halloran (1999a, 2005, 2007) and a multimodal interactional analysis approach initially来自优Q尔W论E文R网wWw.YouERw.com 加QQ75201.8766

link to Scollon (2003) and Norries (2004) This approach focus on representation to interaction to explore how people employ gestures, gazes, postures, movements, spaces and objects to mediate the interaction in a given context。 (O'Halloran, KayL, Smith, 2011) These approaches provide complementary perspectives。

2。1。3 Previous Studies of Multimodality

Halliday (1978; Halliday & Hasan, 1985) emphasis looking into language from the outside, and to interpret language within a socio-cultural context。 Theo van Leeuwen, T。 (1996; 2001) studied  the relationship between modal and media and the phenomenon of regular expression of a variety of modalities, including visual images, color syntax, newspaper layout and the role of different media。 Kress and van Leeuwen (2006) adopt a contextual approach with a particular orientation to ideology, deriving general principles of visual design which are illustrated via text analysis。 (O' Halloran, KayL, Smith, 2011)

Hu Zhuanglin's "Multi-modality in Social Semiotics" (2007) discusses multi modal reading ability, and the importance of multi modal reading ability。 He pointed out that mankind enters social semantics multimodalization。 The Other researches include Li Zhanzi’s (2003) study of multimodal discourse theory with the theory of functional functional linguistics。 (Wang Yanhua, 2014) Zhang Delu (2009a: 2430) establishes a theoretical framework for multimodal discourse analysis on the basis of systemic functional linguistics。