Technical Details
MIT researchers have developed a method to use LiDAR sensors in iPhone Pro and iPad Pro devices for non-line-of-sight (NLOS) visualization. The technology allows mobile devices to 'see through walls' by analyzing reflected laser signals. Unlike previous expensive systems requiring $50,000+ equipment, this solution works with consumer-grade hardware.
Context and History
NLOS visualization has existed in laboratory conditions but required complex optical systems and high-cost lasers. MIT adapted it for mass use with affordable components and a 'motion-induced aperture sampling' algorithm inspired by satellite radar and macrophotography techniques. The algorithm stitches noisy, weak signals into coherent 3D models.
Industry Impact
The technology could revolutionize autonomous vehicle safety by detecting pedestrians and obstacles around blind corners. MIT demonstrated four scenarios: tracking hidden objects, reconstructing 3D geometry, multi-target tracking, and camera self-localization using invisible landmarks. While smartphone integration requires manufacturers to open raw LiDAR data access, researchers have published open-source code and $50–100 DIY sensor components.
