Gastrophysics and Multisensory Eating: How Sound, Color, and Environment Shape Taste

Overview

The podcast investigates how our senses interact to shape food perception, emphasizing crossmodal and multisensory processes in eating, with examples from lab experiments and real-world dining.

Key takeaways

• Sound can alter taste through sonic seasoning, demonstrated with Pringles experiments that enhanced perceived crunch and freshness.
• Visual cues, packaging color, and room lighting can change flavor perception and expectations.
• Real-world dining experiences, including chef collaborations, reveal emotional and bodily responses that are hard to recreate in the lab.
• AI and trends influence food design and marketing, raising questions about authenticity and perception.

Introduction and framing

The episode features Kim Mills interviewing Dr. Charles Spence, a leading figure in experimental psychology who heads the Crossmodal Research Laboratory at the University of Oxford. The discussion centers on multisensory perception and how sight, sound, taste, smell, and touch converge in everyday experiences, with a focus on food and eating. The host notes Spence’s prolific publication record, his consultancy with global brands, and his popularization of gastrophysics, the science of how the senses interact in food experiences. The overarching aim is to understand how our brains integrate sensory information to form global perceptions of food and how this knowledge can be used to eat healthier, enjoy food more fully, and improve life more broadly.

Crossmodal versus multisensory perception

Early in the conversation, Spence clarifies two terms that researchers distinguish in his field. Multisensory perception describes the integration of sensory signals into a single, unified percept, such as the flavor of a dish emerging from taste, smell, texture, and even visual cues. Crossmodal processing refers to interactions between senses where, for example, a loud clapping can make lights appear brighter, but the effect occurs across senses without creating a unified percept. The guest emphasizes that these two concepts have informed research for decades, with real-world applications expanding beyond the lab into product design, packaging, and culinary experiences. He recounts moving research from controlled environments to real-world settings and then back to laboratory experiments to refine theories and measurements.

Why food is a powerful model for multisensory perception

Spence asserts that eating and drinking offer a uniquely multisensory experience because food naturally engages multiple senses in tandem. Visual appeal can shape expectations, the crunch and crackle of a bite influence auditory perception, oral texture provides haptic feedback, heat or pungency involves trigeminal and olfactory pathways, and basic tastes interact with smell and texture to form the overall flavor. The conversation highlights the distinction between taste as a tongue sensation versus flavor as a multimodal percept shaped by the senses and the brain’s interpretation of the sensory inputs. The discussion also includes a vocabulary note: the term “flavour” can be more descriptive than “taste” in describing the sensory experience of food, aligning with food science terminology that treats flavor as a holistic construct rather than a simple tongue sensation.

Sonic seasoning and the sonic chip

The 2004 Pringles experiment is a centerpiece of the podcast. Hungry undergraduates tasted potato chips in a soundproof booth while researchers altered the crunch sound by boosting or dampening high-frequency content. The result was a measurable increase in perceived crunch, freshness, and liking, demonstrating that enhancing crunch acoustics can positively influence taste perception. The Ig Nobel Prize in Nutrition awarded in 2008 acknowledged this work for its playful yet scientifically rigorous approach. Spence reflects on why crunch, a non-nutritive feature, so strongly impacts perception, and he situates crunch as a potential indicator of produce quality or fat content in different contexts. The broader implication is that “the sound of freshness” or “the crunch” can be treated as an active ingredient in gastrophysical design, actionable for chefs, marketers, and product developers alike.

Beyond lab experiments, researchers have explored crunch and freshness in various foods, including fresh produce signals like a snap in apples or celery, which may signal nutrient density or freshness. There is also speculation about whether the auditory signal is a learned cue that the brain associates with energy-rich foods, given the brain’s appetite for energy-dense signals. The discussion underscores that sound is an underappreciated dimension of flavor, one that can be shaped and harnessed without altering the food's chemical composition.

Expanding the sensory canvas: plates, packaging, and environment

The conversation then expands to environments and artifacts surrounding the food. Spence describes how changes to plate color, packaging color, and even lighting can systematically influence taste perception. A large experiment in London, in which 3,000 participants evaluated red wine under white lighting, red lighting, and green lighting, along with background sonic seasoning, demonstrated how visual and auditory context can shift flavor judgments by around 15 percent. The researchers observed that red lighting can amplify fruit-forward notes, green lighting can emphasize acidity, and sonic seasoning can further modulate taste experiences. The episode also touches on practical examples such as changes in packaging color and the perceived intensity of flavors, suggesting that context is a powerful driver of consumer experience just as much as the product itself.

The host and guest recount the collaboration with renowned chefs, including Heston Blumenthal, whose restaurant experiences were influenced by these multisensory insights. The discussion covers how chefs view sound as an “ingredient” that can be deliberately invoked in the kitchen to modulate perception, and how packaging and environment can amplify or dampen flavor signals. Spence notes that such effects are often easier to observe in real-world settings than in tightly controlled laboratories, where ethics and participant comfort can constrain the sensory manipulations researchers wish to perform.

The seaside dish, rice pudding, and bodily vibrations

A notable real-world example involves a Milanese chef and a dish on an ayahuasca-inspired menu that elicited tears from diners. The dish included low-frequency vibrations and nostalgic audio, with storytelling elements and audio cues that engaged memory and emotion. In a controlled study, the presence or absence of ultra-low-frequency vibrations (0 to 20 Hz) significantly influenced crying responses and perceived taste in a subset of diners. The researchers found that bodily awareness, emotional trajectory, and context combine to shape gustatory experience beyond the mere food itself. Those who cried often rated the dish as tastier, while removing the vibrations reduced the crying rate, supporting the hypothesis that bodily sensations contribute to the perceptual and emotional intensity of multisensory meals.

The researchers emphasize that these effects are difficult to reproduce in laboratory settings due to the need for authentic, immersive, emotionally engaging contexts. Ethics approvals and participant welfare considerations are especially salient in research involving dramatic emotional responses. The discussion also includes anecdotes about experiments at science museums and in live culinary demonstrations where the line between art and science blurs and participants are more willing to engage in higher levels of sensory incongruence for the sake of discovery and delight.

Synesthesia, crossmodal correspondences, and differentiation from synesthetic experiences

The podcast compares crossmodal correspondences with synesthesia. While synesthesia involves idiosyncratic, person-specific associations (for example, a synesthete tasting a color when hearing a word), crossmodal correspondences are more universal mappings believed to be shared across people, possibly rooted in common neural and perceptual heuristics. Spence differentiates the two, arguing that his work focuses on universal crossmodal correspondences that can be measured and manipulated across large populations, whereas synesthesia is highly individualized. He connects these ideas to mediums like color, texture, and timbre that influence taste and texture perception in systematic ways. He also notes early modernist explorations of synesthetic ideas and discusses how contemporary chefs and designers leverage crossmodal correspondences to craft new sensory experiences.

Dinner parties, gastronomy, and the limits of the lab

The host and guest describe dinner parties where sensory researchers and chefs gather to explore multisensory dining. Spence explains the balance between laboratory rigor and the experiential, artistic dimension of dining. He recounts an episode where a chef used a hair-wrapped cutlery concept and a fur-wrapped spoon to heighten tactile sensation, turning the dining table into a workshop for multisensory research. The careful calibration of texture, sound, and ritual demonstrates how researchers test hypotheses while chefs push creative boundaries. The narrative emphasizes that such lab dinners, while highly controlled in some aspects, are not mere experiments but living, evolving explorations that inform lab-based studies with richer, ecologically valid data.

Media, AI, and future trajectories in food design

The podcast shifts to contemporary issues at the intersection of food, media, and technology. Spence discusses the impact of distractions on eating behavior, citing research that shows a 30 percent increase in intake when watching TV, and a 10 to 15 percent rise with mobile devices. He suggests that multisensory framing could be used to make meals more immersive rather than simply distracting, an idea explored in a 2017 collaboration with a UK home delivery company to design meals aligned with show narratives. The conversation then addresses the virality of trends such as Dubai Chocolate, arguing that distinctive visual branding creates strong digital anchors that drive social sharing, independent of taste quality. He also considers AI’s role in culinary creativity, arguing that AI is more likely to augment creative ideation than replace chefs, by generating visual concepts or suggesting sensory pairings while human expertise remains essential for tasting and refinement. The discussion ends with reflections on the risks of AI-generated imagery and its potential to set appearances and expectations that influence consumer perception even before actual tasting occurs.

What lies ahead

In concluding, Spence shares his ongoing curiosity about broader multisensory design, including musical and cinematic strategies that could be translated into culinary contexts. He speculates about counterpoint between mood music and food that goes beyond matching flavor to creating composite sensory experiences. He envisions a future where the “total work of art” in dining engages all senses in a cohesive gestalt, pushing the boundaries of how we understand taste, memory, emotion, and embodiment in the act of eating. The host closes with a light note about appetite and the practical act of choosing what to eat next, leaving listeners with a sense of wonder about the science of flavor and perception.