New Technique Could Help Self-Driving Cars See Their Surroundings Better

Thanks to a technique developed by researchers at NC State University, autonomous vehicles might one day be able to navigate the roadways much better. The technique allows artificial intelligence programs to more accurately map three-dimensional spaces using two-dimensional images.

“Most autonomous vehicles use powerful AI programs called vision transformers to take 2D images from multiple cameras and create a representation of the 3D space around the vehicle,” says Tianfu Wu, an associate professor of electrical and computer engineering at NC State and corresponding author of a paper on the new technique… While these AI programs use different approaches, Wu and his collaborators’ new technique holds the potential to substantially improve them all. “Our technique, called Multi-View Attentive Contextualization (MvACon), is a plug-and-play supplement that can be used in conjunction with these existing vision transformer AIs to improve their ability to map 3D spaces,” Wu says. “The vision transformers aren’t getting any additional data from their cameras, they’re just able to make better use of the data.”

Receive Our Newsletter

Get the latest Safety21 news sent to your inbox.