Google Beam: Lifesize AI Agent Sophie Tested by Google Labs

Google Labs is developing a life-sized AI video agent named Sophie. This agent is being tested in the Mountain View Beam Lab in California. Sophie can speak multiple languages, recognize people and objects, and read text from phones or paper. It can also perform tasks like checking the weather. The system uses Google Beam teleconferencing hardware, which features six cameras and server-side AI to create a volumetric 3D projection. Instead of streaming traditional video, the system sends sensor data to AI servers that generate a lifelike 3D rendering. While Sophie is visually detailed, its expressions and movements are described as artificial. It can pull up maps effectively, but it's also noted for being curt, taking long pauses, and occasionally speaking over itself. This technology could change how we interact with AI in a physical space.