flexiblefullpage
billboard
interstitial1
catfish1
Currently Reading

HoloLens used as wayfinding device to guide blind people through complex buildings

Augmented Reality

HoloLens used as wayfinding device to guide blind people through complex buildings

Neither training nor modification of the physical environment are required to use the system.


By David Malone, Associate Editor | May 30, 2018

Large, complex buildings can be difficult for anyone to navigate, but take away the benefit of sight and they can be downright impossible. But a solution may be on the horizon.

Recent prosthetic approaches to restore vision for the blind have attempted to convey raw images to the brain. These attempts have all suffered from the same problems, however: a lack of bandwidth and the extensive training required to interpret unusual stimuli.

This new approach, created by Researchers at the California Institute of Technology, takes an alternate approach that uses the Microsoft HoloLens mixed reality headset to restore vision at the cognitive level, bypassing the need to convey sensory data. The HoloLens is used to capture video and other data, extract the important scene knowledge, and convey that knowledge through auditory augmented reality.

The researchers say their design principle was to give sounds to all relevant objects in the environment. Each object in the scene can “talk” to the user with a voice that comes from the object’s location. As the object gets closer to the user, it’s pitch increases. The user has several modes of control to select which objects speak: Scan, Spotlight, and Target.

 

See Also: Altered reality showdown

 

In Scan mode the objects call out their names in sequence from left to right to provide a quick overview of the scene. In Spotlight mode, the object directly in front of the user speaks, allowing the user to explore the scene by moving their head. In Target mode, the user selects one object that calls repeatedly at the press of a clicker. Obstacles and walls emit a hissing sound as the user gets too close.

For long range navigation, the system becomes a “virtual guide.” The guide follows a precomputed path through a building that has been pre-scanned with the HoloLens. The guide will repeatedly call out “follow me,” staying one meter ahead of the user, and will offer warnings about any upcoming turns or flights of stairs.

The researchers say neither training nor modification of the physical environment are required to use any of the system’s modes and blind subjects will be able to navigate an unfamiliar multi-story building on their first attempt.

You can watch a video of one of the test subjects using the system here.

 

Related Stories

Augmented Reality | Nov 2, 2018

Savannah College of Art and Design offers new four-year degree in Immersive Reality

The program began its first year with the fall 2018 semester.

Augmented Reality | Oct 29, 2018

AR is indispensable to design and construction

Using AR, vital construction data can be transferred instantaneously from the design model to the augmented reality overlay.

Accelerate Live! | Jun 24, 2018

Watch all 19 Accelerate Live! talks on demand

BD+C’s second annual Accelerate Live! AEC innovation conference (May 10, 2018, Chicago) featured talks on AI for construction scheduling, regenerative design, the micro-buildings movement, post-occupancy evaluation, predictive visual data analytics, digital fabrication, and more. Take in all 19 talks on demand.

| May 30, 2018

Accelerate Live! talk: Seven technologies that restore glory to the master builder

In this 15-minute talk at BD+C’s Accelerate Live! conference (May 10, 2018, Chicago), AEC technophile Rohit Arora outlines emerging innovations that are poised to transform how we design and build structures in the near future.

| May 24, 2018

Accelerate Live! talk: The rise of multi-user virtual reality

In this 15-minute talk at BD+C’s Accelerate Live! conference (May 10, 2018, Chicago), two of CannonDesign's tech leaders present their early findings from pilot testing multi-user VR technology for AEC project coordination.

Augmented Reality | Jan 18, 2018

With a new type of stadium comes a new type of premium seat

Populous is exploring biometric seating technology that utilizes a combination of displays and AR/VR technologies to place fans in the action.

Augmented Reality | Nov 13, 2017

New iPhone app uses augmented reality to digitize the home dimensioning process

The app requires iOS 11 and is compatible with iPhone 6S and newer models.

Augmented Reality | Nov 6, 2017

Three VR + AR innovations to watch

From heat mapping to VR-based meetings, check out this trio of virtual and augmented reality applications for AEC teams.

Augmented Reality | Jul 19, 2017

Mortenson develops AR app for community engagement during construction of UW computer science building

The $105 million project in Seattle is the latest example of the firm’s commitment to virtual and augmented reality tools.

Virtual Reality | Jun 28, 2017

Virtually real design

Viewing a building design in virtual reality (VR) allows contributors to better relate to the experience of viewing a detailed physical model, rather than two-dimensional renderings or animations. 

boombox1
boombox2
native1

More In Category




halfpage1

Most Popular Content

  1. 2021 Giants 400 Report
  2. Top 150 Architecture Firms for 2019
  3. 13 projects that represent the future of affordable housing
  4. Sagrada Familia completion date pushed back due to coronavirus
  5. Top 160 Architecture Firms 2021