Showing posts with label Sign-language. Show all posts
Showing posts with label Sign-language. Show all posts

Apr 8, 2022

Can artificial intelligence reveal why languages change over time?

The way we speak today isn't the way that people talked thousands -- or even hundreds -- of years ago. William Shakespeare's line, "to thine own self be true," is today's "be yourself." New speakers, ideas, and technologies all seem to play a role in shifting the ways we communicate with each other, but linguists don't always agree on how and why languages change. Now, a new study of American Sign Language adds support to one potential reason: sometimes, we just want to make our lives a little easier.

Deaf studies scholar Naomi Caselli and a team of researchers found that American Sign Language (ASL) signs that are challenging to perceive -- those that are rare or have uncommon handshapes -- are made closer to the signer's face, where people often look during sign perception. By contrast, common ones, and those with more routine handshapes, are made further away from the face, in the perceiver's peripheral vision. Caselli, a Boston University Wheelock College of Education & Human Development assistant professor, says the findings suggest that ASL has evolved to be easier for people to recognize signs. The results were published in Cognition.

"Every time we use a word, it changes just a little bit," says Caselli, who's also codirector of the BU Rafik B. Hariri Institute for Computing and Computational Science & Engineering's AI and Education Initiative. "Over long periods of time, words with uncommon handshapes have evolved to be produced closer to the face and, therefore, are easier for the perceiver to see and recognize."

Although studying the evolution of language is complex, says Caselli, "you can make predictions about how languages might change over time, and test those predictions with a current snapshot of the language."

With researchers from Syracuse University and Rochester Institute of Technology, she looked at the evolution of ASL with help from an artificial intelligence (AI) tool that analyzed videos of more than 2,500 signs from ASL-LEX, the world's largest interactive ASL database. Caselli says they began by using the AI algorithm to estimate the position of the signer's body and limbs.

"We feed the video into a machine learning algorithm that uses computer vision to figure out where key points on the body are," says Caselli. "We can then figure out where the hands are relative to the face in each sign." The researchers then match that with data from ASL-LEX -- which was created with help from the Hariri Institute's Software & Application Innovation Lab -- about how often the signs and handshapes are used. They found, for example, that many signs that use common handshapes, such as the sign for children -- which uses a flat, open hand -- are produced further from the face than signs that use rare handshapes, like the one for light (see videos).

This project is part of a new and growing body of work connecting computing and sign language at BU.

"The team behind these projects is dynamic, with signing researchers working in collaboration with computer vision scientists," says Lauren Berger, a Deaf scientist and postdoctoral fellow at BU who works on computational approaches to sign language research. "Our varying perspectives, anchored by the oversight of researchers who are sensitive to Deaf culture, helps prevent cultural and language exploitation just for the sake of pushing forward the cutting edge of technology and science."

Understanding how sign languages work can help improve Deaf education, says Caselli, who hopes the latest findings also bring attention to the diversity in human languages and the extraordinary capabilities of the human mind.

Read more at Science Daily

Apr 9, 2021

Sign-language exposure impacts infants as young as 5 months old

 While it isn't surprising that infants and children love to look at people's movements and faces, recent research from Rochester Institute of Technology's National Technical Institute for the Deaf studies exactly where they look when they see someone using sign language. The research uses eye-tracking technology that offers a non-invasive and powerful tool to study cognition and language learning in pre-verbal infants.

NTID researcher and Assistant Professor Rain Bosworth and alumnus Adam Stone studied early-language knowledge in young infants and children by recording their gaze patterns as they watched a signer. The goal was to learn, just from gaze patterns alone, whether the child was from a family that used spoken language or signed language at home.

They tested two groups of hearing infants and children that differ in their home language. One "control" group had hearing parents who spoke English and never used sign language or baby signs. The other group had deaf parents who only used American Sign Language at home. Both sets of children had normal hearing in this study. The control group saw sign language for the first time in the lab, while the native signing group was familiar with sign language.

The study, published in Developmental Science, showed that the non-signing infants and children looked at areas on the signer called "signing space," in front of the torso. The hands predominantly fall in this area about 80 percent of the time when signing. However, the signing infants and children looked primarily at the face, barely looking at the hands.

According to the findings, the expert sign-watching behavior is already present by about 5 months of age.

"This is the earliest evidence, that we know of, for effects of sign-language exposure," said Bosworth. "At first, it does seem counter-intuitive that the non-signers are looking at the hands and signers are not. We think signers keep their gaze on the face because they are relying on highly developed and efficient peripheral vision. Infants who are not familiar with sign language look at the hands in signing space perhaps because that is what is perceptually salient to them."

Another possible reason why signing babies keep their gaze on the face could be because they already understand that the face is very important for social interactions, added Bosworth.

"We think the reason perceptual gaze control matures so rapidly is because it supports later language learning, which is more gradual," Bosworth said. "In other words, you have to be able to know where to look before you learn the language signal."

Bosworth says more research is needed to understand the gaze behaviors of deaf babies who are or are not exposed to sign language.

Read more at Science Daily