What is a tongue display unit?

A tongue display unit, often shortened to TDU, is a form of sensory substitution device. It gathers information from one sense, such as sight or the vestibular sense of balance, and presents that information as electrotactile pulses on the surface of the tongue. The BrainPort is one of the better-known commercial examples of a TDU, although the principles can be implemented in many different ways.

The tongue as an electrotactile screen

The tongue is well suited to this role for a few reasons. Its nerve endings are packed densely and sit close to the surface. A typical TDU uses a small flexible electrode array that rests on the front of the tongue, something like a lollipop or a flat intraoral strip. Each electrode can be turned on or off or adjusted in pulse intensity. When a user points a camera at a scene, that visual scene is converted into a spatial pattern of gentle electrical tingling on the tongue.

How a camera becomes touch on the tongue

The process starts with a compact camera worn by the user. In the BrainPort approach, the video signal is sampled and reduced to a low-resolution grid. The brightness of each part of the image is mapped to the strength of the pulse sent to the corresponding electrode. A bright area, such as a lamp or a doorway against a dark wall, produces a stronger sensation. A dark area produces little or no stimulation. The result is a tactile map of the world that a user can learn to interpret.

Two main applications

Vision substitution

For people with profound blindness, a TDU can provide a crude but useful spatial sense. With training, users learn to detect doorways, locate large objects, distinguish a plate from a cup, and read large high-contrast letters. The camera can be held in the hand and scanned across a room in the same way a sighted person might move their eyes.

Balance substitution

The same tongue display idea can be used to help people with bilateral vestibular loss. A small motion sensor is worn on the head, and its signals are routed to the tongue electrode array. When the head tilts forward, the user feels a shift in stimulation toward the front of the tongue. When the head tilts sideways, the pattern shifts to one side. This provides the brain with an artificial sense of head orientation and helps with postural stability.

What the user feels

Most users describe the initial tongue sensation as buzzing, fizzing, or the feeling of carbonated drink. At first it can be difficult to separate signal from noise. With repeated use, the sensation often becomes less distracting and more meaningful. The brain stops treating the stimulation as an object in the mouth and starts treating it as a representation of space.

Why training matters

The device does not create a new retina or repair the inner ear. It creates a new pathway into the nervous system. The brain must learn to decode the pattern, and that requires attention and practice. Early sessions are usually short. Over weeks, users begin to make faster judgments and rely more naturally on the tongue signal. This process is an example of neuroplasticity: the brain reorganising itself to use a form of input it has not used before.

Use case: an adult learning to navigate with the tongue

Consider the example of an adult in their mid-fifties who gradually lost sight because of a progressive retinal condition. The person lived independently but often stayed close to familiar routes. After beginning work with a camera-based TDU, the person followed a simple training schedule. In the first week, they practised locating a white plate on a dark tablecloth and standing safely in a doorway. The most useful moment came when they learned to feel the contrast between an open door and the wall beside it, turning both tasks into one sweeping movement of the hand and head. After several months, the user could identify the shape of a bus stop sign from close range and could distinguish an empty chair from a person standing next to it. The case shows the typical pattern: early frustration, then a sudden recognition that the tingling pattern is not just on the tongue, but about the room.

Limitations and current challenges

Despite the promise of the TDU, there are real constraints. The image resolution is far too low for reading conventional text or recognising faces. The camera view depends on where the user is pointing the device. The electrode array must remain in the mouth, which can interfere with speaking and eating during use. Some users find the tongue sensation uncomfortable, especially at first, and prolonged use can fatigue the mouth tissues. The system also requires the user to keep their head and body still enough to notice subtle changes.

Future directions

Researchers are exploring smaller electrode arrays, better encodings of depth and brightness, and hybrid systems that combine sound with touch. There is also interest in using similar lingual electrotactile interfaces for other purposes, such as relaying signals from robotic prosthetic hands or providing tactile feedback for virtual reality. As the technology shrinks, the tongue display unit may become a common option in the wider toolbox of assistive devices.

Conclusion

The BrainPort and related tongue display units demonstrate a remarkable idea. The brain does not care much about where information arrives; it cares about whether the information has structure. A camera and an electrode array can use the language of touch to carry the scenery of sight. A head tilt sensor can use the tongue to tell the body which way is upright. With patience, the nervous system can turn a buzzing mouth into a window onto the world.