2.2Multimodality

As a new concept emerging in recent years, multimodality is widely applied to various fields, especially in systemic-functional and social linguistics. Earlier due to the limitation of science and technology, scholars barely analyzed discourse from a multimodal aspect. As Hu Zhuanglin (2007:1-10) mentioned that “now the rapid development of new technology and corpus have made the multimodal study of natural discourse possible”. Kress & Leeuwen thought that "Multimodality is to use several kinds of semiotics modes respectively or comprehensively to strengthen the expression of the same meaning, or to exercise supplementary function, or to sort the meaning in a hierarchical order" (Kress & Leeuwen, 2001:20). While another famous multimodal theory experts O’Halloran, combining essence of various point of views, gave the multimodality a new definition as "a theoretical analysis and practice comprehensively integrated of language, visual images, other symbolic resources, construction paper text, digital media and daily life text, things and events" (O'Halloran,2008:231). It means that in multimodal texts, the receiver needs to use multiple senses to absorb the external symbols in a variety of modal forms, and meanwhile, the information received through these different sensory modes will interact effectively or produce one image as part of the written text and it is also true of the other way around, etc. (Kress, 2001:7). It has become a new issue to discuss how to use this newly-arise way to convey meanings, to construct metaphors, to combine the multimodality with metaphors and explore the metaphors in multimodality.

In terms of multimodal metaphors, in Pictorial Metaphor in Advertising (Forceville, 1996), Charles Forceville analyzed pictorial metaphors in advertisements from a visual aspect. In Multimodal Metaphors-Application of Cognitive Linguistics in 2009, he expounded the multimodal metaphors from various perspectives. In the multimodal metaphor theory, Forceville pided metaphors into 2 categories: one is the mono-modal metaphor and the other is the multimodal one. The mono-modal metaphor means two domains using only one modality to represent the metaphorical meaning while the multimodal metaphor is one choosing different modalities respectively to characterize the hidden meaning in both source domain and target domain (Forceville,1998:384), of which the construction and understanding involve all kinds of modal symbols: images and sounds, demanding the participation of people’s multiple senses: vision and hearing, in order to realize the effective interaction among the symbolic information.

3. Theoretical framework: systemic view to multimodal metaphor 

As an approach of linguistics, systemic functional linguistics regards language as a social semiotic system. The founder Michael Halliday, 'liberated' the dimension of choice from structure in a certain sense, making it the main organizing dimension of the theory. For Halliday, one principal theoretical principle is that “any act of communication involves choices”. Halliday thinks “linguistics is also ‘functional’ because he believes that languages have evolved under the pressure of the particular functions that the language system has to serve”. Systemic functional linguistics holds that language has three metafunctions including “the ideational metafunction, the interpersonal metafunction and the textual metafunction” (Halliday,2010:35). The idea of “context” is important in the study of Halliday and it is created with the help of the construed experience and the enacted social relations.来!自~优尔论-文|网www.youerw.com

The multimodal discourse symbols theory by Kress and Leeuwen is based on Halliday's theory. By introducing this sound theory into this field, Kress and Leeuwen's Reading Images (1996:20) rose attention to discourses that are of not solely verbal words but combinations of various semiotic resources. This framework provides a theoretical basis and analytical method for the visual image’s multimodal discourse analysis. Under the premise of considering the images as social symbols, they extended the ideas of metafunctions to visual patterns, creating the visual grammar centered on the “representational meaning, interactive meaning and compositional meaning”. Since then MDA has become a new sphere of Discourse Analysis and its study objects covers extensive materials, which includes “visual art, painting, sculpture and architecture” (O'Tool, 2010:78). Most of MDA researches later follow this social semiotic approach and analyzes the materials mentioned earlier. 

上一篇:浅析法律英语的词汇特点及其翻译
下一篇:从MTI学生与职业译者的对比实证研究看翻译实践教学

中美英语口语类慕课多模态对比分析

《阿芒提拉多的酒桶》的反讽艺术美

多模态视角下广告语言的性别身份构建

《等待戈多》中反戏剧特征研究

多媒体在小学英语教学中的应用

《荒野的呼唤》之多重主题分析

认知语言学角度浅析多义词的形成

视觉辨识技术的视频监控...

基于DirectX技术的3D游戏Demo设计与实现

微探联通主义观照下慕課...

公立医院财务管理及财务...

企业中女性管理者职业发展的障碍及对策

功率因数校正技术研究现状和发展趋势

FeTiMn尖晶石协同控制燃煤...

大学生网络成瘾与品行问题倾向的关系研究

2023开放三胎政策,中國三...

论《人间喜剧》的“金钱”主题