Skip to content
Digital Bodies Consulting
  • HOME
  • SPEAKING / WORKSHOPS
  • VR EXPERIENCES
    • VR VIDEOS
  • NEW FRONTIER OF LEARNING
  • CONSULTING SERVICES
  • ABOUT

Digital Bodies » VR News » VR Haptics for Your Mouth – From Hot Liquids to Eating Spiders

VR Haptics for Your Mouth – From Hot Liquids to Eating Spiders

May 19, 2022May 18, 2022 by Emory Craig
Fascinating developments in VR Haptics for your mouth and lips from research at Carnegie Mellon University.

Carnegie Melon University’s Future Interfaces Group is working on a fascinating VR haptics project that could revolutionize how – and what – we experience in virtual reality. The device, an add-on to a VR headset, uses haptic ultrasound transducers to create a broad spectrum of sensations around your mouth. According to VRScout,

. . . ultrasonic transducers can be used to simulate various real-world sensations by focusing acoustic energy on the user’s mouth. By combining subtle pulsations, researchers can replicate everything from drinking hot coffee to smoking a cigarette. The same technology can also be applied to your teeth, as shown in the tooth brushing demo . . . In addition to the above-mentioned uses-cases, researchers went into surprising detail explaining how the system could be used to recreate various spider-based interactions. Using a combination of effects including single impulse, pulse trains, swipes in the x, y, and z directions, and persistent vibrations, users feel sticky cobwebs, jumping spiders, spider goo, and venom interact with their mouths in noticeably different ways.

Having the sensation of a spider walking across your mouth . . . now that’s a virtual experience you’ll never forget.

VR Haptics

As we explored in previous articles, VR haptics has a long way to go – and can raise challenging ethical questions. Many haptic vests still have sizing issues, and the available gloves make you feel like you’re auditioning for a sequel to Tim Burton’s Edward Scissorhands (sorry, no sequel’s coming). Some of the best work has been done in advancing the sense of smell in VR – especially at OVR Technology – a different but very related area.

As the Future Interfaces Group notes, the mouth is a fascinating area to explore, given its sensitivity (second only to our fingertips). Their solution takes a Meta Quest 2 headset and adds an array of ultrasonic transducers focused on the wearer’s mouth. It works without the need for additional hardware that would physically contact the user’s lips or tongue:

Virtual and augmented reality (VR/AR) headsets continue to make impressive strides in immersion and realism, particularly in visual and audio content. However, the delivery of rich tactile sensations continues to be a significant and open challenge. Critically, consumers want robust and integrated solutions – ones that do not require any extra devices or limit freedom of movement. For this reason, vibration motors in handheld controllers are the current consumer state of the art. While more sophisticated approaches exist (e.g., exoskeletons, haptic vests, body-cantilevered accessories, in-room air cannons), they have yet to see even modest consumer adoption.

Simultaneously, the mouth has been largely overlooked as a haptic target in VR/AR, despite being second in terms of sensitivity and density of mechanoreceptors, only behind the fingertips. Equally important, the proximity of the mouth to the headset offers a significant opportunity to enable on- and in-mouth haptic effects, without needing to run wires or wear an extra accessory. However, consumers do not want to cover their entire face, let alone put something up against (or into) their mouth. For AR, the industry is trending towards glasses-like form factors, so as to preserve as much facial expression as possible for human-human communication. Even in VR, smaller headsets are the consumer trend, with the mouth exposed and unencumbered.

If you’re interested in the technical details, there’s a paper from the recent CHI Conference on Human Factors in Computing Systems (CHI’ 22), April 29-May 5, 2022, held in New Orleans, LA. For a quicker visual introduction, the following video covers the highlights.

Still in the Experimental Phase

As fascinating as this VR haptics project is, there are currently no plans for a commercial device. This is still in the experimental stage and could face further challenges as our VR headsets shrink down in size. The device works on the Quest, but there would be no room for it on something like the much smaller Vive Flow. Still, it’s a remarkable development, especially since it implements haptics using ultrasound instead of a tactile solution.

It is experiments like this at Carnegie Melon University’s Future Interfaces Group that are paving the way to the future of XR. A future that will not only be visual but incorporate scent and touch in what will truly be fully immersive experiences.

 

Emory Craig

Emory Craig is a writer, speaker, and VR consultant with extensive experience in art, new media, and higher education. He speaks at global conferences on innovation, education, and ethical technology in the future. He has published widely and worked with the US Agency for International Development, the United Nations, and the Organization for Economic Co-operation and Development (OECD). Living at the intersection of learning, games, and immersive storytelling, he is fascinated by AI-based avatars, digital twins, and the ethical implications of blurring the boundaries between the real and the virtual.

Related

The Impact of the Ukraine War on Virtual Reality
Maestro VR: Beat Saber Meets Beethoven in New VR Game

Our Consulting Services

Our consulting services include workshops, demos, keynote talks, and project management on XR, Metaverse, and the latest developments in Conversational AI and ChatGPT. We work with education, nonprofits, NGOs, and business organizations around the world to provide innovative solutions for implementing XR, AI and emerging technologies.

Why not schedule a free discovery call to see how Digital Bodies Consulting can help you?

The Future of Learning in the Metaverse with Maya Georgieva

SXSWedu talk On The Future of Learning, by Maya Georgieva, March 8, 2023

Metaverse Revolution: A Conversation with Maya Georgieva at Skylight Modern Gallery, NYC.

The Metaverse Revolution - a deep-dive conversation with Maya Georgieva at the Species Between Worlds Exhibition at the Skylight Modern Gallery, 537 West 27th Street | New York, NY 10001.

News, Media, and Events

  • Maya Georgieva will be speaking at SXSWedu on Tuesday, March 7th, 3:30 PM, on the The Future of Learning in the Metaverse.

  • Maya Georgieva in EdTech Magazine What Is a Metaversity, and Should You Create One on Your Campus?

  • The Metaverse Revolution with Maya Georgieva and others at Skylight Modern Gallery, in New York City.

  • Emory Craig will be speaking at the GESS Education Global Leadership Summit, Tuesday, March 23rd at 10:30 AM (EDT) on "Learning in Virtual Worlds: How Augmented and Virtual Reality is Transforming Education in a Global Pandemic."

  • Join us at the ShapingEDU Winter Games this week! Lunch Session: Wednesday January 6, 12:30-1:00pm MST for the latest on the Hummersive Learning Project and a breakout session on Thursday, 10:45am MST on "Learning with Embodied Avatars in the Future."

  • Join us at the iLRN Conference where we'll present as co-authors the Executive Summary of the State of XR Report at 1:00pm (EST), June 23rd - immersively in VirBELA.

The EDUCAUSE-ELI Series, “VR/AR: Stepping into the New Frontier of Learning”

Article Series: Stepping into the New Frontier of Learning

Articles from our New Frontier of Learning series for the EDUCAUSE Review (and summaries of the articles):

  • From VR and AR to Our XR Future: Transforming Higher Education
  • VR and AR: The Ethical Challenges Ahead
  • VR and AR: The Art of Immersive Storytelling and Journalism
  • VR and AR: Learners as Creators and World Builders of Our Immersive Future
  • VR and AR: Designing Spaces for Immersive Learning
  • VR and AR: Transforming Learning and Scholarship in the Humanities and Social Sciences
  • VR and AR: Driving a Revolution in Medical Education & Patient Care
  • AR and VR in STEM: The New Frontiers in Science
  • A New World: VR and AR Tech Developments
  • Introducing the VR and AR Series: Stepping Into the New Frontier of Learning Series

Digital Bodies RSS Feed

How Can We Help You?

In a time of disruptive change and profound challenges in education, we can help you engage students and clients through AR, VR, and  innovative developments such as ChatGPT. Take a look at our consulting services and featured talks.

We offer talks highlighting augmented and virtual reality developments, future trends, and how to manage and leverage the power of generative AI platforms such as ChatGPT. We provide innovative workshops for education, nonprofit and corporate clients. 

About Digital Bodies Consulting

The best AR & VR news and analysis of XR in learning, storytelling, the Metaverse, AI and ChatGPT, and future ethical challenges. See our customized consulting services for how we can partner with you.

XR is transforming learning, journalism, art, storytelling, filmmaking, workforce training, and entertainment. The convergence of XR and AI will create deeply immersive virtual worlds and lifelike avatars – and raise profound ethical issues. The rapid adoption of ChatGPT has created new opportunities and profound challenges for education and other organizations. We can help you leverage today’s cutting-edge XR developments and learn how to talk to AI – which will be a critical skill of the 21st century. The future has arrived, and we will need new skills – intuition, creativity, and adaptability – and innovative strategies to make it our own.

Have a tip or a story for us? Working on an innovative project in XR? Want to master how to talk to ChatGPT to revolutionize how you work? Need help managing the use of AI in your organization? Please connect with us here or through our social media channels on Facebook, Twitter, or Instagram, and let us know how we can help you!

© 2023 Digital Bodies
We use cookies to ensure that we give you the best experience on Digital Bodies Consulting. We never store your information or share it with third parties. AcceptRejectPrivacy policy
Revoke cookies