The new feature builds upon Amazon's existing Lens tool by adding instant product recognition as users point their cameras at items in the physical world. "Lens Live instantly scans products and shows real-time matches in a swipeable carousel to make finding the right item easier," said Trishul Chilimbi, Vice President and Distinguished Scientist, Stores Foundational AI at Amazon. The tool operates through AWS-managed Amazon OpenSearch and Amazon SageMaker services, deploying machine learning models at scale for immediate product identification.
This feature, which is only rolling out to the Amazon Shopping app on iOS for now, lets you pan your camera around a room or focus on a specific product. Amazon says Lens Live will use an object detection model to identify the products shown on your camera in real-time, and then compare them against the billions of products on its marketplace.
Amazon is further investing in AI-powered shopping experiences with Tuesday's launch of Lens Live, a new AI-powered upgrade to its Amazon Lens shopping feature that allows consumers to discover new products through visual search, similar to competitors like Google Lens and Pinterest Lens. The tool will also integrate with Amazon's AI shopping assistant, Rufus, for product insights, the retailer notes.