Visually Situated Language Comprehension
Editors: Pia Knoeferle, Pirita Pyykkönen-Klauck, Matthew W. Crocker
Visually Situated Language Comprehension has been compiled as a state-of the-art introduction to real-time language processing in visually-situated contexts. It covers the history of this emergent field, explains key methodological developments and discusses the insights these methods have enabled into how language processing interacts with our knowledge and perception of the immediate environment. Scientists interested in how language users integrate what they know with their perception of objects and events will find the book a rewarding read. The book further covers lexical, sentence, and discourse level processes, as well as active visual context effects in both non-interactive and interactive tasks and thus present a well-balanced view of the field. It is aimed at experienced researchers and students alike in the hopes of attracting new talent to the field. Thanks to its in-depth methodological introduction and broad coverage it constitutes an excellent course book.
© 2016 John Benjamins Publishing Company. These are the accepted manuscripts of chapters published in Knoeferle, P., Pyykkönen-Klauck, P., & Crocker, M. W. (Eds.). (2016). Visually Situated Language Comprehension. Advances in Consciousness Research. John Benjamins Publishing Company. The final version is available at: https://doi.org/10.1075/aicr.93
-
2016-03-10Teil eines BuchesPreface
-
2016-03-10Teil eines BuchesTowards a situated view of language By examining a brief history of psycholinguistics and its various approaches to research on sentence processing, we point to a general convergence toward evidence that multiple different linguistic constraints interact in ...
-
2016-03-10Teil eines BuchesPerception of the visual environment The eyes are the front end to the vast majority of the human behavioural repertoire. The manner in which our eyes sample the environment places fundamental constraints upon the information that is available for subsequent ...
-
2016-03-10Teil eines BuchesAttention and eye movement metrics in visual world eye tracking This chapter introduces the visual world paradigm, with the aim of identifying both the opportunities and challenges researchers are presented with when using overt visual attention as an index of the cognitive processes ...
-
2016-03-10Teil eines BuchesThe role of syntax in sentence and referential processing How language comprehenders process the syntactic structure of sentences and, to a somewhat lesser extent, how sentence structure affects referential processing have been important questions in language comprehension research. ...
-
2016-03-10Teil eines BuchesReaching Sentence and Reference Meaning This chapter focuses on how people establish reference to objects in the external world and the meaning of sentences more broadly. The review proceeds from psychological and computational models of semantic memory up to ...
-
2016-03-10Teil eines BuchesDiscourse level processing This chapter provides an overview of how the visual-world eye-tracking paradigm has been used to investigate the processing and representation of discourse-level information. The chapter starts by reviewing some theoretical ...
-
2016-03-10Teil eines BuchesFigurative language processing This chapter is concerned with visual processing in the context of figurative language. Included is background on research that has used the visual world paradigm to study the processing of fictive motion sentences. These ...
-
2016-03-10Teil eines BuchesThe role of affordances in visually situated language comprehension Affordances are potentiations for bodily action that are routinely evaluated in the course of perception. For example, the physical features of bricks, lamps, and pillows provide salient cues about the actions a perceiver ...
-
2016-03-10Teil eines BuchesCharacterising visual context effects In this chapter, I will review recent research on visually situated language comprehension, and in doing so identify key characteristics of situated language comprehension. More specifically I will argue that both active ...
-
2016-03-10Teil eines BuchesVisual world studies of conversational perspective taking Visual-world eyetracking greatly expanded the potential for insight into how listeners access and use common ground during situated language comprehension. Past reviews of visual world studies on perspective taking have ...
-
2016-03-10Teil eines BuchesVisual environment and interlocutors in situated dialogue Face-to-face conversation is often considered the most basic form of language use, as it was likely a dominant mode of communication as languages evolved, it is often the primary form of language input during children’s ...
-
2016-03-10Teil eines BuchesCoordinating action and language The overarching aim of this chapter is to highlight the strong interfacing between linguistic and motor systems, focusing especially on the degree to which manipulations of a visual context interact with linguistic ...