Streaming is available in most browsers,
and in the WWDC app.
-
Expanding the Sensory Experience with Core Haptics
Core Haptics lets you design your own haptics with synchronized audio on iPhone. In this two part session, learn essential sound and haptic design principles and concepts for creating meaningful and delightful experiences that engage a wider range of human senses. Discover how to combine visuals, audio and haptics, using the Taptic Engine, to add a new level of realism and improve feedback in your app or game. Understand how to create and play back content, and where Core Haptics fits in with other audio and haptic APIs.
Resources
- Apple Design Site
- Core Haptics
- HIG - Haptics
- Playing a Custom Haptic Pattern from a File
- Playing Collision-Based Haptic Patterns
- SwiftShot: Creating a Game for Augmented Reality
- Updating Continuous and Transient Haptic Parameters in Real Time
- Presentation Slides (PDF)
Related Videos
WWDC 2020
WWDC 2019
WWDC 2018
WWDC 2017
-
Download
Welcome.
Sound has long been an incredible part of creating a truly great app. Whether that's creating an atmospheric sound bed for your games or drawing attention to an important alert or notification. The addition of haptics adds a whole new dimension to this experience -- touch.
Today's session is a story in two parts, design and development. And first, I'd like to start by introducing Hugo and Camille and ask them to come to the stage for their insights and guidance on designing great haptic experiences for your apps.
I'm sure you're familiar with that sound.
It's been part of our life for years. In 2019 though, I think we can do better. I'm Camille Moussette, interaction designer on the Apple design team. And I'm Hugo Verweij, sound designer on the design team.
This session is about designing great audio haptic experiences. Our goal with this talk is for you to be inspired and leave you with practical ideas about how to design great sound and haptics when used to together in the right way can bring a new dimension to your app.
During the next 30 minutes, we'll talk about three things. First, we'll introduce what is an audio haptic experience.
Then we'll look at three guiding principles to help you design those great experiences.
Lastly, we'll look at different techniques and practical tips to make those experiences great and truly compelling.
So, what is an audio haptic experience? Well, let's start by listening to a sound.
Okay. Now let's lower this sound. What happens if I lower it even further? Whoa. It's so low I can't hear it anymore. You know, our ears just don't register it anymore. But, if you would put your finger on the speaker, you could still feel it move back and forth. We designed a taptic engine specifically to play these low frequencies that you can only feel.
Here it is in the iPhone and next to it the speaker module. The haptic sensations from the taptic engine are synchronized to the sounds coming from the speaker, and the result is what we call an audio haptic experience. But haptic sensations are meant to be felt, so because we are presenting this on stage, and on screen we need your help in imagining what this would feel like. We'll do our best to help you by visualizing the haptics like this or by playing a sound that resembles the haptic, like this.
We will also visualize these experiences on the timeline, and Camille will tell you some more about how that's done in a quick haptics design primer.
IOS 13 introduced a new API