Snapchat Lens Turns Real-World Objects Into AR Instruments

Start a virtual band using this clever Snapchat Lens from smart musical instruments creator Artiphon.

Artiphon, creator of smart musical instruments such as the Orba and INSTRUMENT 1, this week unveiled its first Snapchat Lens, Scan Band.

Available now via the Snapchat app, Scan Band uses a combination of augmented reality (AR) and machine learning to convert everyday objects into interactive virtual instruments. Powered by Snap’s Scan objection recognition technology, the Lens works by scanning and identifying real-world objects and transforming them into what the company describes as “origami-inspired” stickers. According to Artiphon, scannable objects include everything from plants and pets to pieces of food and other random objects.

“You can scan an orange and play it like a guitar,” stated the company in an official release. “Punch a balloon that sounds like a synth. Set a bunch of banana drums on the floor for your friend to trip over. Or just add a splash of notes while out for a walk. Scan Band isn’t about traditional music-making, it’s about creating musical videos throughout the moments of your day.”

Image Credit: Snap Inc.

These digital instruments can be interacted with in a variety of ways, from simply tapping on the screen to choreographing your own interpretive dance routine. Scan Band is also one of the first Snap Lenses to make use of Snap’s new AudioML technology, which allowed the company to include its own professionally-trained musical ML model.

Artiphon’s Scan Band Lens was featured earlier this week at the 2021 Snap Partner Summit, during which Snap unveiled several exciting updates to its growing multimedia messaging app. In addition to its new Connected Lenses, a new type of Lens that allows you to interact with other users in real-time either locally or remotely, the company also unveiled the latest iteration of its Snap Spectacles, which feature AR functionality powered by the Snap Spatial Engine.

Image Credit: Snap Inc.

“We’ve been designing AR Music technology for the past few years in secret, so we’re jazzed to finally show the world what we’ve been up to,” said Artiphon founder/CEO Dr. Mike Butera to Snap Summit Partner audience members.

“For us, AR Music represents the possibility to go beyond the traditional notion that only musicians can make music. With Scan Band, people are collaborating with a smart virtual instrument right in the video. It’s such a new experience. We just want to inspire people to be sonically creative in the nooks and crannies of their day.”

Scan Band is available now for free via the Snapchat app. All you have to do is scan the QR code provided above.

Feature Image Credit: Artiphon

About the Scout

Former Writer (Kyle Melnick)

Send this to a friend