Why spoken audio needs a visual partner
Many exhibits use narration, interviews or recorded sound as a main way of telling a story. A visitor who is deaf or hard of hearing may miss that content unless a visual version is provided alongside it. Captions are the most common solution, and sign language is a second option that serves some visitors better. They are not interchangeable, and a gallery that treats them as a single feature usually ends up supporting neither well.
Captions and sign language are different things
Captions are written text that follows the audio. They are a representation of spoken language, which means they work best for readers who are comfortable with the written form of that language. Many deaf people are, and many use captions every day. But for some people, sign language is the first or preferred language, and written text is a second language. Signed languages also have their own grammar and vocabulary rather than being a word-for-word version of a spoken language, and different countries and regions have different ones.
This is why offering both, where resources allow, can reach more visitors than offering either alone. Where only one is realistic, captions are generally the more practical starting point because they are cheaper to produce, update and translate.
Making captions work in a gallery
Producing good captions is its own craft, and the details are covered in more depth in our look at exhibit captions. For galleries, a few points matter in particular.
- Cover the whole soundtrack. Include speech, but also meaningful sound such as a door slamming, music that changes the mood, or a speaker off screen.
- Name the speakers when they are not visible or when several people talk in turn.
- Keep timing in sync. Captions that lag behind a speaker cause confusion, particularly in video.
- Keep text on screen long enough. Visitors also need to look at the images, so very fast captions compete with the visuals.
- Make them readable. Use high contrast, a plain typeface and a position that does not cover important parts of the picture.
- Do not hide them behind a menu. If captions must be switched on, make the control easy to find, or show them by default in noisy spaces. In a busy gallery, many hearing visitors also find them helpful.
A transcript is a useful companion for longer audio, though it is not a replacement for synchronized captions in a video exhibit.
Options for sign language
There are several ways to offer signed content, with different costs and levels of effort.
- Signed video on the exhibit screen. A signer appears in a window, usually in a corner or on a separate panel, with the content interpreted or presented in sign language. The window needs to be large enough for hand shapes and facial expressions to be clear, and the signer should be well lit against a plain background.
- Signed content on visitors’ own devices. Short signed videos can be reached by a code or link on a visitor’s phone, which avoids crowding the screen. This works when the visitor has a device and a usable connection, so it should be treated as an addition rather than the only route.
- Interpreted tours and events. Live interpreters at scheduled tours give a human, flexible experience. They require advance notice and booking, so publicize the dates clearly.
- Original signed content. Content created by deaf signers in the first place often reads better than a translation of a hearing script.
Whichever path you choose, involve deaf people in the planning. A qualified interpreter or signer, preferably someone from the local deaf community, can advise on regional signs, clarity and tone. Machine-generated sign language is generally not a reliable substitute for human signing at this point.
Handling audio that is also a physical experience
Not all exhibit sound is speech. Music, soundscapes and ambient sound often carry mood or meaning. Where this matters, a brief written description can help, and some exhibits add a visual or vibration element. For recorded descriptions of what appears on screen, the related practice of audio description serves blind and low vision visitors, and the two can sit side by side in the same media file.
Think about the whole visit
Access starts before the gallery doors. If signed tours exist, say so on the website and at the ticket desk. Staff should know how to find the signed videos or captions and how to communicate with a deaf visitor, for example by writing or using a tablet. Many visitors also want clear text on arrival, such as a printed map or a floor plan, because spoken welcome messages are easy to miss.
Visitors who do not share the exhibit’s main language also benefit. Captions help multilingual visitors follow along, especially if the captions are offered in more than one language. Audio guides can include a text alternative, and if sound spills between displays, our discussion of sound bleed explains why captions are valuable in noisy spaces for everyone.
Test it with the people it is for
Technical checks catch missing files and timing errors, but they do not tell you if a signed window is too small or if captions move too fast. A short session with deaf and hard of hearing visitors, using real exhibits and real devices, usually reveals problems that are easy to fix. Ask about both captions and signing, and be open to hearing that one matters more than the other for a given audience. Plan to revisit the content when exhibits change, because outdated captions and signed videos are a common reason access falls behind.