Multimodality Digitalization And Cognitivity In Communication And Pedagogy

This book positions itself at the intersection of the key areas of the modern humanities. Different authors from a variety of countries take innovative approaches to investigating multimodal communication, adapting pedagogical design to digital environments and enhancing cognitive skills through transformations in teaching and learning practices. The eclectic forms under study require eclectic approaches and methodologies, and the authors cross disciplinary boundaries drawing on philosophy, linguistics, semiotics, computational linguistics, mathematics, cognitive studies and neuroaesthetics. Part I presents methods of analysing multimodal communication in its different displays, covering promotional video in crowdfunding project presentations, multimodal public signs of prohibition and visuals as arguments. Part II explores varied teaching methodologies that have emerged as a result of and in response to modern technological changes and contains some practical hints for educators. It demonstrates the pedagogical potential of video games, virtual worlds, linguistic corpora and online dictionaries. Part III focuses on psychological and cognitive factors influencing success in the classroom, primarily, ways of developing students’ and teachers’ personalities. The volume sits at the intersection between Communication Studies, Digital Humanities, Discourse Analysis, Education Theory and Cognitive Studies and is useful to scholars and students of communication, languages, education and other areas of the humanities. This book should trigger scholarly discussions as well as stimulating practitioners’ interest in these fields.

This collection critically considers the question of how learning and teaching should be conceived, understood, and approached in light of the changing nature of learning scenarios and new pedagogies in this current age of multimodal digital texts, practices, and communities. The book takes the concept of digital artifacts as being composed of multiple meaning-making semiotic resources, such as visuals, music, and design, as its point of departure to explore how diverse communities interact with these tools and develop and explore their understanding of digital practices in learning contexts. The first section of the volume examines different case studies in which involved participants learn to grapple with the introduction of digital tools for learning in children’s early years of schooling. The second section extends the focus to secondary and higher education settings as digital learning tools grow more complex as do students, parents, and teachers’ interactions with them and the subsequent need for new pedagogies to rethink these multimodal artifacts. A final section reflects on the implications of new multimodal tools, technologies, and pedagogies for teachers, such as on teacher training and community building among educators. In its in-depth look at multimodal approaches to learning as meaning-making in a digital world, this book will be of interest to students and scholars in multimodality, English language teaching, digital communication, and education.

This cutting edge book considers how advances in technologies and new media have transformed our perception of education, and focuses on the impact of the privatisation of digital tools as a mean of knowledge production. Arguing that education needs to adapt to the modern learner, the book’s unique approach is based on a disassociation with the deeply ingrained attitude with which people have traditionally viewed education – learning the existing symbolic systems of certain disciplines and then expressing themselves strictly within the operational modes of these systems. The ways of knowledge production – exploring, recording, representing, making meaning of and sharing human experiences – have been fundamentally transformed through the infusion of digital technologies into all aspects of human activity, allowing learners to engage with their immediate natural, social and cultural environments by capitalising on their individual abilities and interests. This book proposes a new approach to teaching and learning termed ‘cinematic bricolage’, which involves generating knowledge from heterogeneous resources in a ‘do-it-yourself’ manner while making meaning through multimodal representations. It shows how cinematic bricolage reconnects ways of knowing with ways of being, empowering the individual with a sense of personal identity and responsibility, helping to shape more aware social citizens.

Negotiating Spaces for Literacy Learning addresses two paradoxical currents that are sweeping through the contemporary educational field. The first is the opening up of possibilities for multimodal communication as a result of developments in digital technologies and the sensitivity to multiliteracies. The second is the increasing pressure from standardised testing, accountability and performance measurement which pull curricular and pedagogical practices out of alignment with the everyday informal practices and interests of teachers and learners and narrow opportunities for diverse expressions of literacy. Bringing together an international team of scholars to examine the tensions and struggles that result from the current educational climate, the book provides a much-needed discussion of the intersection of technologies of literacies, education and self. It does so through diverse approaches, including philosophical, theoretical and methodological treatments of multimodality and governmentality, and a range of literacies - early years, primary school, workplace, digital, middle school, secondary school, indigenous, adult and place. With examples taken from all stages of education and in several countries, the book allows readers to explore a range of multimodal practices and the ways in which governmentality plays out across them.

Dance Data, Cognition, and Multimodal Communication is the result of a collaborative and transdisciplinary effort towards a first definition of "dance data", with its complexities and contradictions, in a time where cognitive science is growing in parallel to the need of a renewed awareness of the body’s agency in our manyfold interactions with the world. It is a reflection on the observation of bodily movements in artistic settings, and one that views human social interactions, multimodal communication, and cognitive processes through a different lens—that of the close collaboration between performing artists, designers, and scholars. This collection focuses simultaneously on methods and technologies for creating, documenting, or representing dance data. The editors highlight works focusing on the dancers’ embodied minds, including research using neural, cognitive, behavioural, and linguistic data in the context of dance composition processes. Each chapter deals with dance data from an interdisciplinary perspective, presenting theoretical and methodological discussions emerging from empirical studies, as well as more experimental ones. The book, which includes digital Support Material on the volume's Routledge website, will be of great interest to students and scholars in contemporary dance, neuro-cognitive science, intangible cultural heritage, performing arts, cognitive linguistics, embodiment, design, new media, and creativity studies.

This edited volume provides research-based knowledge on the use, production and assessment of multimodal texts in the teaching and learning of English as an Additional Language (EAL). The book reflects growing interest in research on EAL, with increasing numbers of learners of English worldwide and the growing relevance of EAL to numerous education systems. The volume examines different aspects of English from a multimodal perspective, showcasing empirical research from across five continents and all three levels of education. Applying frameworks based on Multimodal Social Semiotics and Systemic Functional Linguistics, chapters focus on the use and affordances of multimodal texts in pedagogy, literature, culture, text production, assessment and curriculum development connected to EAL. Directing attention to the significance of modes beyond speech and writing in EAL, the volume provides a wide range of perspectives and experiences that can be applied more widely and inspire other practices in the global and diverse field of EAL teaching, learning and assessment. This collection will be of interest to scholars in multimodality, language education, and teacher education.

This text responds to changing literacy practices in the digital age by developing an interdisciplinary framework for analysis of digital content created by students. Drawing on scholarship that expands traditional understandings of literacy to account for new ways in which students engage with interactive text and media, Aguilera develops a methodological toolkit for formal analysis of multimodal representations. This book frames the central challenges faced by researchers entering the field of digital literacy studies, presents a nuanced discussion of digital mediation, and brings these topics to life in the case study of a Code Club, a library-based computer programming club for elementary, middle, and high school students. The three-dimensional framework, which offers a schema for analysis of multimodal content, computational procedures, and contextual factors involved in the creation and interpretation of digital content, serves as a much-needed framework for the critical analysis of digital multimodal composition. This text will benefit researchers, academics, and educators in the areas of language and literacy, multimodality, and technology and digital innovation in education.

In this lecture Carey Jewitt shows how design and use of technologies has a key role in communication and learning, and how their use can shape practices and potentials and change resources.

Multimodality in Writing attempts to generate and apply new theories, disciplines and methods to account for semiotic processes in texts and during text production. It thus showcases new directions in multimodal research and theorizing writing practices from a multimodal perspective. It explores texts, producers of texts, and readers of texts. It also focuses on teaching multimodal text production and writing pedagogy from different domains and disciplines, such as rhetoric and writing composition, architecture, mathematics, film-making, science and the newsroom. Multimodality in Writing explores the kinds of methodological approaches that can augment social semiotic approaches to analyzing and teaching writing, including rhetoric, Systemic Functional Linguistics, ethnographic approaches, and genre pedagogy. Much of the research shows how the regularities of modes and interest of sign makers are socially shaped to realize convention. Because of this, the approaches are strongly underpinned by social and cultural theories of representation and communication.

This book proposes a relational turn in higher education by conceptualizing knowledge and pedagogy as relational and multimodal, analyzed through three dimensions of relationality: social, technological, and environmental. The volume draws on interdisciplinary approaches that make a case for integrating these interconnected and distinct dimensions in higher education theory and practice. Its novelty lies in combining such a variety of perspectives with Peircean semiotics to explore what it means to learn and live relationally. It emphasizes the importance of critical reflection, rooted in an environmental understanding of knowledge and digital media. This approach integrates materiality, place, and space in higher education, positioning caring, critically reflective and imaginative interactions and interpretations as central for knowledge growth. The volume features practical case studies of relational pedagogy through dialogues with diverse higher education practitioners, which embrace expression and creation through more than one dominant modality of communication and being. The book envisions students and educators as relational agents, with relational awareness and responsibility, aware of their multimodal identities. It highlights how a relational multimodal paradigm can serve as a way forward for universities to address global challenges concerning social, (post)digital, and environmental futures. This innovative book will be of interest to scholars, students, teachers, and policymakers in higher education, semiotics and multimodality, as well as postdigital, sociomaterial and futures studies.