As car screens become more numerous and larger, the chances of drivers being distracted by screens while driving are rising. As many automakers explore safety techniques to reduce or avoid “driver distraction,” Top Design.com takes a look at car swap designs.

Gestures, the combination of hands, hands and arms, are making waves among carmakers around the world as part of a solution to the pain point of “driver distraction”.

You can hang up the phone with a casual wave of your hand. Adjust the volume by moving your finger clockwise or counterclockwise.

The Internet gene: on-screen gesture interaction

The emergence of car gestures, from the operation of the car screen. These actions come from mobile Design standards, such as standard gestures in Apple’s IOS Design Specification or standard gestures in Google’s Mertiral Design.




▽ Common interactive gestures on mobile devices

Common gestures are shown in the picture above, respectively

Click: Activate the control or select a project

Slide: Slide up and down, or left and right to continuously move what you want to see

Hold and drag: Move an element left, right, or up or down on the screen

Double click: Zoom in or out on the content or image and center it

Pinch: outside pinch magnify, inside pinch shrink

Hold down: Enter the text or content editing mode

Designers are also exploring new ways to use on-screen gestures in response to the changing look of mobile screens and the increasing diversity of what is displayed on them.




△ Android bottom navigation bar buttons from left to right: return to the previous level, return to the home page, multi-task

The launch of the iPhoneX in 2017 officially ushered in a full-screen era. In an effort to replace the Home button and android’s bottom navigation bar, phone makers are embracing “full screen gesture interaction.”

Some automakers are also embracing changes in vehicular systems, such as the Ideal One, which uses a “three-finger slide” gesture instead of the “Back to home” button.




Three-finger slide means return to home page

At Google I/O 2019, the new version of Android Q adopted the same gesture logic as IOS, offering a bar at the bottom of the screen where users swipe right at the left edge of the page to “go back to the previous level,” swipe up to “Go home,” and swipe and hover up to “multitask.”




▽ Three full screen gestures in Android

As the full screen gesture has reached a consensus in the operation and interaction of the mobile phone, it is believed that in the near future, the “figure” of the full screen gesture will be seen more and more frequently in the car and the phone.

New gameplay: multi-screen interaction

When the car meets the digital screen, how to make the combination of screen and interior more perfect and highlight the brand characteristics seems to bring interior designers many challenges and opportunities, “one-word screen”, “T-word screen”, “seven-word screen”, “rotating screen” came into being.




△ Byton M-Byte one word screen




Think about the T-screen of the One




△ The 7-character screen of Co-Chong 007




▽ Revolving screen of BYD Dynasty series

At the same time, automakers have had to compromise on screens in production models because of cost and technology constraints. The ideal One compromise is to use a combination of three screens to create a “big screen” look.




In order to make three screens “transform” into one screen, it is obviously not enough to do enough visual efforts, and multi-screen gesture interaction can not be “absent”.

In fact, multi-screen gesture interaction still comes from standard gestures in IOS and Android systems. It combines different gestures and displays them in linkage with the page, forming multi-screen gesture.

In parking mode, users can hold down and swipe left to “swing” information from the passenger’s entertainment screen to the center screen.




Skyrim ME7 not only has three screens combined into the front “one word screen”, there are two rear passenger entertainment screen, 5 screen linkage gesture interaction, Skyrim adopts “gesture + screen display” to solve.




In the control panel, the passenger entertainment screen and rear entertainment screen using five fingers grasping gestures into multiple screen interactive page, such as wanted to do was to share the content on the control panel with the passenger entertainment screen, the first step is to click on the select the passenger entertainment screen, the second step is hold and drag the control panel to the passenger entertainment screen position, the third step in the passenger entertainment screen click on the confirmation.

The future is here: Telekinetic gesture interaction

Answering or hanging up a phone with telekinetic gestures seems like the stuff of science fiction movies. However, as mentioned in the beginning, as the number and size of car screens increase, the probability of “driver distraction” also increases. The appearance of blind gesture and teleportation gesture is an attempt to solve this pain point.

At present, in the mass production of cars, the blind gesture is mainly realized through the combination of standard gesture and sound feedback.

For example, in ideal One, users slide left and right on the air conditioner screen to adjust air volume, slide up and down to adjust temperature, and the system tells users whether the operation is successful or not through sound feedback.

Compared to blind gestures, telekinetic gestures seem to be more technical and favored by automakers, and can be seen not only on concept cars, but also on SEEK.

Junma SEEK offers 8 telekinesis gestures.




Left: Answering the phone right: Hanging up the phone




△ Left: Previous song right: Next song




△ Left: Volume goes up right: volume goes down




Left: Music playing/pausing right: roses

Like SEEK, BMW offers a “left” gesture for the previous track, a “right” gesture for the next track, and a “yeah” gesture for play or pause.

But in many other operations, BMW and Junma gesture operation is different.

Junma SEEK uses the front and back sides of the palm to distinguish between different operations, with the front side indicating answer/volume increase and the other side indicating decline/volume decrease.

For BMW, tap toward the screen to answer the call, wave your palm to the right to reject the call, rotate your finger clockwise to increase volume, and rotate your finger counterclockwise to decrease volume.

In reversing images, a finger wave to the right represents adjusting the Angle of view.




▽ Video of BMW gesture Control in detail

When it comes to gesture interaction, Byton has delivered his own “report card.”

There are five kinds of gesture recognition of Byton, palm down to activate gesture recognition, palm up to start the main page, finger movement on behalf of moving the cursor, OK gesture on behalf of confirm, five fingers kneading can drag content.




▽ “Byton Concept Gesture Sensing System Operation Demonstration”

The technology on the tall look exciting, but in the process of actual use, still exist to identify scope is limited, after the recognition precision is not sensitive, slow response speed and so on, and various manufacturers of gesture recognition did not form a unified standard, and no large-scale in the user, will inevitably increase the cost of the user’s learning.

Gesture recognition is “really sweet” or “chicken ribs” for users, I believe time will tell. Well, more about design content can be on the first-class design network, mass quality design materials.