'Smart glove' can boost hand mobility of stroke patients

This month, a group of stroke survivors in B.C. will test a new technology designed to aid their recovery, and ultimately restore use of their limbs and hands.

Participants will wear a new groundbreaking "smart glove" capable of tracking their hand and finger movements during rehabilitation exercises supervised by Dr. Janice Eng, a leading stroke rehabilitation specialist and professor of medicine at UBC.

The glove incorporates a sophisticated network of highly sensitive sensor yarns and pressure sensors that are woven into a comfortable stretchy fabric, enabling it to track, capture and wirelessly transmit even the smallest hand and finger movements.

"With this glove, we can monitor patients' hand and finger movements without the need for cameras. We can then analyze and fine-tune their exercise programs for the best possible results, even remotely," says Dr. Eng.

Precision in a wearable device

UBC electrical and computer engineering professor Dr. Peyman Servati, PhD student Arvin Tashakori and their team at their startup, Texavie, created the smart glove for collaboration on the stroke project.

Dr. Servati highlighted a number of breakthroughs, described in a paper published last week in Nature Machine Intelligence.

"This is the most accurate glove we know of that can track hand and finger movement and grasping force without requiring motion-capture cameras. Thanks to machine learning models we developed, the glove can accurately determine the angles of all finger joints and the wrist as they move. The technology is highly precise and fast, capable of detecting small stretches and pressures and predicting movement with at least 99-per-cent accuracy -- matching the performance of costly motion-capture cameras."

Unlike other products in the market, the glove is wireless and comfortable, and can be easily washed after removing the battery.

Dr. Servati and his team have developed advanced methods to manufacture the smart gloves and related apparel at a relatively low cost locally.

Augmented reality and robotics

Dr. Servati envisions a seamless transition of the glove into the consumer market with ongoing improvements, in collaboration with different industrial partners.

The team also sees potential applications in virtual reality and augmented reality, animation and robotics.

Read more at Science Daily

Shape-changing smart speaker lets users mute different areas of a room

In virtual meetings, it's easy to keep people from talking over each other. Someone just hits mute. But for the most part, this ability doesn't translate easily to recording in-person gatherings. In a bustling cafe, there are no buttons to silence the table beside you.

The ability to locate and control sound -- isolating one person talking from a specific location in a crowded room, for instance -- has challenged researchers, especially without visual cues from cameras.

A team led by researchers at the University of Washington has developed a shape-changing smart speaker, which uses self-deploying microphones to divide rooms into speech zones and track the positions of individual speakers. With the help of the team's deep-learning algorithms, the system lets users mute certain areas or separate simultaneous conversations, even if two adjacent people have similar voices. Like a fleet of Roombas, each about an inch in diameter, the microphones automatically deploy from, and then return to, a charging station. This allows the system to be moved between environments and set up automatically. In a conference room meeting, for instance, such a system might be deployed instead of a central microphone, allowing better control of in-room audio.

The team published its findings Sept. 21 in Nature Communications.

"If I close my eyes and there are 10 people talking in a room, I have no idea who's saying what and where they are in the room exactly. That's extremely hard for the human brain to process. Until now, it's also been difficult for technology," said co-lead author Malek Itani, a UW doctoral student in the Paul G. Allen School of Computer Science & Engineering. "For the first time, using what we're calling a robotic 'acoustic swarm,' we're able to track the positions of multiple people talking in a room and separate their speech."

Previous research on robot swarms has required using overhead or on-device cameras, projectors or special surfaces. The UW team's system is the first to accurately distribute a robot swarm using only sound.

The team's prototype consists of seven small robots that spread themselves across tables of various sizes. As they move from their charger, each robot emits a high frequency sound, like a bat navigating, using this frequency and other sensors to avoid obstacles and move around without falling off the table. The automatic deployment allows the robots to place themselves for maximum accuracy, permitting greater sound control than if a person set them. The robots disperse as far from each other as possible since greater distances make differentiating and locating people speaking easier. Today's consumer smart speakers have multiple microphones, but clustered on the same device, they're too close to allow for this system's mute and active zones.

"If I have one microphone a foot away from me, and another microphone two feet away, my voice will arrive at the microphone that's a foot away first. If someone else is closer to the microphone that's two feet away, their voice will arrive there first," said co-lead authorTuochao Chen, a UW doctoral student in the Allen School. "We developed neural networks that use these time-delayed signals to separate what each person is saying and track their positions in a space. So you can have four people having two conversations and isolate any of the four voices and locate each of the voices in a room."

The team tested the robots in offices, living rooms and kitchens with groups of three to five people speaking. Across all these environments, the system could discern different voices within 1.6 feet (50 centimeters) of each other 90% of the time, without prior information about the number of speakers. The system was able to process three seconds of audio in 1.82 seconds on average -- fast enough for live streaming, though a bit too long for real-time communications such as video calls.

As the technology progresses, researchers say, acoustic swarms might be deployed in smart homes to better differentiate people talking with smart speakers. That could potentially allow only people sitting on a couch, in an "active zone," to vocally control a TV, for example.

Researchers plan to eventually make microphone robots that can move around rooms, instead of being limited to tables. The team is also investigating whether the speakers can emit sounds that allow for real-world mute and active zones, so people in different parts of a room can hear different audio. The current study is another step toward science fiction technologies, such as the "cone of silence" in "Get Smart" and"Dune," the authors write.

Of course, any technology that evokes comparison to fictional spy tools will raise questions of privacy. Researchers acknowledge the potential for misuse, so they have included guards against this: The microphones navigate with sound, not an onboard camera like other similar systems. The robots are easily visible and their lights blink when they're active. Instead of processing the audio in the cloud, as most smart speakers do, the acoustic swarms process all the audio locally, as a privacy constraint. And even though some people's first thoughts may be about surveillance, the system can be used for the opposite, the team says.

Read more at Science Daily

Scientists invent micrometers-thin battery charged by saline solution that could power smart contact lenses

Scientists from Nanyang Technological University, Singapore (NTU Singapore) have developed a flexible battery as thin as a human cornea, which stores electricity when it is immersed in saline solution, and which could one day power smart contact lenses.

Smart contact lenses are high-tech contact lenses capable of displaying visible information on our corneas and can be used to access augmented reality. Current uses include helping to correct vision, monitoring wearers' health, and flagging and treating diseases for people with chronic health conditions such as diabetes and glaucoma. In the future, smart contact lenses could be developed to record and transmit everything a wearer sees and hears to cloud-based data storage.

However, to reach this future potential a safe and suitable battery needs to be developed to power them. Existing rechargeable batteries rely on wires or induction coils that contain metal and are unsuitable for use in the human eye, as they are uncomfortable and present risks to the user.

The NTU-developed battery is made of biocompatible materials and does not contain wires or toxic heavy metals, such as those in lithium-ion batteries or wireless charging systems. It has a glucose-based coating that reacts with the sodium and chloride ions in the saline solution surrounding it, while the water the battery contains serves as the 'wire' or 'circuitry' for electricity to be generated.

The battery could also be powered by human tears as they contain sodium and potassium ions, at a lower concentration. Testing the current battery with a simulated tear solution, the researchers showed that the battery's life would be extended an additional hour for every twelve-hour wearing cycle it is used. The battery can also be charged conventionally by an external power supply.

Associate Professor Lee Seok Woo, from NTU's School of Electrical and Electronic Engineering (EEE), who led the study, said: "This research began with a simple question: could contact lens batteries be recharged with our tears? There were similar examples for self-charging batteries, such as those for wearable technology that are powered by human perspiration.

"However, previous techniques for lens batteries were not perfect as one side of the battery electrode was charged and the other was not. Our approach can charge both electrodes of a battery through a unique combination of enzymatic reaction and self-reduction reaction. Besides the charging mechanism, it relies on just glucose and water to generate electricity, both of which are safe to humans and would be less harmful to the environment when disposed, compared to conventional batteries."

Co-first author Dr Yun Jeonghun, a research fellow from NTU's EEE said: "The most common battery charging system for smart contact lenses requires metal electrodes in the lens, which are harmful if they are exposed to the naked human eye. Meanwhile, another mode of powering lenses, induction charging, requires a coil to be in the lens to transmit power, much like wireless charging pad for a smartphone. Our tear-based battery eliminates the two potential concerns that these two methods pose, while also freeing up space for further innovation in the development smart contact lenses."

Highlighting the significance of the work done by the research team, NTU School of Mechanical & Aerospace Engineering Associate Professor Murukeshan Vadakke Matham, who specialises in biomedical and nanoscale optics and was not involved in the study, said: "As this battery is based on glucose oxidase, which occurs naturally in humans and powered by chloride and sodium ions, such as those in our tears, they should be compatible and suitable for human usage. Besides that, the smart contact lenses industry has been looking for a thin, biocompatible battery that does not contain heavy metals, and this invention could help further their development to meet some unmet needs of the industry."

The research team has filed for a patent through NTUitive, NTU's innovation and enterprise company. They are also working towards commercialising their invention.

The findings were published in the scientific journal Nano Energy in June.

Cry me a current

The team demonstrated their invention using a simulated human eye. The battery, which is about 0.5 millimetres-thin generates electrical power by reacting with the basal tears -- the constant tears that create a thin film over our eyeballs -- for the devices embedded within the lenses to function.

The flexible and flat battery discharges electricity through a process called reduction when its glucose oxidase coating reacts with the sodium and chloride ions in the tears, generating power and current within the contact lenses.

The team demonstrated that the battery could produce a current of 45 microamperes and a maximum power of 201 microwatts, which would be sufficient to power a smart contact lens.

Laboratory tests showed that the battery could be charged and discharged up to 200 times. Typical lithium-ion batteries have a lifespan of 300 to 500 charging cycles.

The team recommends that the battery should be placed for at least eight hours in a suitable solution that contains a high quantity of glucose, sodium and potassium ions, to be charged while the user is asleep.

Co-first author Miss Li Zongkang, a PhD student from NTU's EEE said: "Although wireless power transmission and supercapacitors supply high power, their integration presents a significant challenge due to the limited amount of space in the lens. By combining the battery and biofuel cell into a single component, the battery can charge itself without the need for additional space for wired or wireless components. Furthermore, the electrodes placed at the outer side of the contact lens ensures that the vision of the eye cannot be obstructed."

Read more at Science Daily

'Smart' walking stick could help visually impaired with groceries, finding a seat

Engineers at the University of Colorado Boulder are tapping into advances in artificial intelligence to develop a new kind of walking stick for people who are blind or visually impaired.

Think of it as assistive technology meets Silicon Valley.

The researchers say that their "smart" walking stick could one day help blind people navigate tasks in a world designed for sighted people -- from shopping for a box of cereal at the grocery store to picking a private place to sit in a crowded cafeteria.

"I really enjoy grocery shopping and spend a significant amount of time in the store," said Shivendra Agrawal, a doctoral student in the Department of Computer Science. "A lot of people can't do that, however, and it can be really restrictive. We think this is a solvable problem."

In a study published in October, Agrawal and his colleagues in the Collaborative Artificial Intelligence and Robotics Lab got one step closer to solving it.

The team's walking stick resembles the white-and-red canes that you can buy at Walmart. But it also includes a few add-ons: Using a camera and computer vision technology, the walking stick maps and catalogs the world around it. It then guides users by using vibrations in the handle and with spoken directions, such as "reach a little bit to your right."

The device isn't supposed to be a substitute for designing places like grocery stores to be more accessible, Agrawal said. But he hopes his team's prototype will show that, in some cases, AI can help millions of Americans become more independent.

"AI and computer vision are improving, and people are using them to build self-driving cars and similar inventions," Agrawal said. "But these technologies also have the potential to improve quality of life for many people."

Take a seat

Agrawal and his colleagues first explored that potential by tackling a familiar problem: Where do I sit?

"Imagine you're in a café," he said. "You don't want to sit just anywhere. You usually take a seat close to the walls to preserve your privacy, and you usually don't like to sit face-to-face with a stranger."

Previous research has suggested that making these kinds of decisions is a priority for people who are blind or visually impaired. To see if their smart walking stick could help, the researchers set up a café of sorts in their lab -- complete with several chairs, patrons and a few obstacles.

Study subjects strapped on a backpack with a laptop in it and picked up the smart walking stick. They swiveled to survey the room with a camera attached near the cane handle. Like a self-driving car, algorithms running inside the laptop identified the various features in the room then calculated the route to an ideal seat.

The team reported its findings this fall at the International Conference on Intelligent Robots and Systems in Kyoto, Japan. Researchers on the study included Bradley Hayes, assistant professor of computer science, and doctoral student Mary Etta West.

The study showed promising results: Subjects were able to find the right chair in 10 out of 12 trials with varying levels of difficulty. So far, the subjects have all been sighted people wearing blindfolds. But the researchers plan to evaluate and improve their device by working people who are blind or visually impaired once the technology is more dependable.

"Shivendra's work is the perfect combination of technical innovation and impactful application, going beyond navigation to bring advancements in underexplored areas, such as assisting people with visual impairment with social convention adherence or finding and grasping objects," Hayes said.

Let's go shopping

Next up for the group: grocery shopping.

In new research, which the team hasn't yet published, Agrawal and his colleagues adapted their device for a task that can be daunting for anyone: finding and grasping products in aisles filled with dozens of similar-looking and similar-feeling choices.

Again, the team set up a makeshift environment in their lab: this time, a grocery shelf stocked with several different kinds of cereal. The researchers created a database of product photos, such as boxes of Honey Nut Cheerios or Apple Jacks, into their software. Study subjects then used the walking stick to scan the shelf, searching for the product they wanted.

"It assigns a score to the objects present, selecting what is the most likely product," Agrawal said. "Then the system issues commands like 'move a little bit to your left.'"

He added that it will be a while before the team's walking stick makes it into the hands of real shoppers. The group, for example, wants to make the system more compact, designing it so that it can run off a standard smartphone attached to a cane.

But the human-robot interaction researchers also hope that their preliminary results will inspire other engineers to rethink what robotics and AI are capable of.

Read more at Science Daily

Multi-tasking wearable continuously monitors glucose, alcohol, and lactate

Imagine being able to measure your blood sugar levels, know if you've had too much to drink, and track your muscle fatigue during a workout, all in one small device worn on your skin. Engineers at the University of California San Diego have developed a prototype of such a wearable that can continuously monitor several health stats -- glucose, alcohol, and lactate levels -- simultaneously in real-time.

The device is about the size of a stack of six quarters. It is applied to the skin through a Velcro-like patch of microscopic needles, or microneedles, that are each about one-fifth the width of a human hair. Wearing the device is not painful -- the microneedles barely penetrate the surface of the skin to sense biomolecules in interstitial fluid, which is the fluid surrounding the cells beneath the skin. The device can be worn on the upper arm and sends data wirelessly to a custom smartphone app.

Researchers at the UC San Diego Center for Wearable Sensors describe their device in a paper published May 9 in Nature Biomedical Engineering.

"This is like a complete lab on the skin," said center director Joseph Wang, a professor of nanoengineering at UC San Diego and co-corresponding author of the paper. "It is capable of continuously measuring multiple biomarkers at the same time, allowing users to monitor their health and wellness as they perform their daily activities."

Most commercial health monitors, such as continuous glucose monitors for patients with diabetes, only measure one signal. The problem with that, the researchers said, is that it leaves out information that could help people with diabetes, for example, manage their disease more effectively. Monitoring alcohol levels is useful because drinking alcohol can lower glucose levels. Knowing both levels can help people with diabetes prevent their blood sugar from dropping too low after having a drink. Combining information about lactate, which can be monitored during exercise as a biomarker for muscle fatigue, is also useful because physical activity influences the body's ability to regulate glucose.

"With our wearable, people can see the interplay between their glucose spikes or dips with their diet, exercise and drinking of alcoholic beverages. That could add to their quality of life as well," said Farshad Tehrani, a nanoengineering Ph.D. student in Wang's lab and one of the co-first authors of the study.

Microneedles merged with electronics

The wearable consists of a microneedle patch connected to a case of electronics. Different enzymes on the tips of the microneedles react with glucose, alcohol and lactate in interstitial fluid. These reactions generate small electric currents, which are analyzed by electronic sensors and communicated wirelessly to an app that the researchers developed. The results are displayed in real time on a smartphone.

An advantage of using microneedles is that they directly sample the interstitial fluid, and research has shown that biochemical levels measured in that fluid correlate well with levels in blood.

"We're starting at a really good place with this technology in terms of clinical validity and relevance," said Patrick Mercier, a professor of electrical and computer engineering at UC San Diego and co-corresponding author of the paper. "That lowers the barriers to clinical translation."

The microneedle patch, which is disposable, can be detached from the electronic case for easy replacement. The electronic case, which is reusable, houses the battery, electronic sensors, wireless transmitter and other electronic components. The device can be recharged on any wireless charging pad used for phones and smartwatches.

Integrating all these components together into one small, wireless wearable was one of the team's biggest challenges. It also required some clever design and engineering to combine the reusable electronics, which must stay dry, with the microneedle patch, which gets exposed to biological fluid.

"The beauty of this is that it is a fully integrated system that someone can wear without being tethered to benchtop equipment," said Mercier, who is also the co-director of the UC San Diego Center for Wearable Sensors.

Testing

The wearable was tested on five volunteers, who wore the device on their upper arm, while exercising, eating a meal, and drinking a glass of wine. The device was used to continuously monitor the volunteers' glucose levels simultaneously with either their alcohol or lactate levels. The glucose, alcohol and lactate measurements taken by the device closely matched the measurements taken respectively by a commercial blood glucose monitor, Breathalyzer, and blood lactate measurements performed in the lab.

Read more at Science Daily