How does Google Arts and Culture find your look-alike?

The latest craze taking over social media is the Google Arts and Culture app. You may have seen your friends posting side-by-side photos comparing their faces to famous artworks— some of which are better matches than others. It’s pretty easy to use the Google Arts and Culture app. But how does it actually find your artistic doppelganger?

According to the online tech magazine Inverse, the app’s museum selfie feature works by scanning users’ selfies to create a “faceprint” of features. Examples of characteristics included in the faceprint might be the distance between your eyes or the shape of your nose. After a bit of resizing and reorienting, the app then scans a database of paintings in famous museums, searching for similar features to what it discovered in your selfie. Google has a collection of more than 70,000 paintings to choose from.

For those concerned about Google using your selfies to create the next Big Brother, don’t fret: Google told CNNMoney that the app only stores information about your face until it finds a match in its database. The company also said it won’t use any of your selfies for other purposes.

But Google does get some benefits from users enjoying the app. Like most Artificial Intelligence systems, the more Google’s facial recognition software is used, the better it gets. Google currently claims that its software, FaceNet, is the best in the world. In 2015, FaceNet was able to correctly identify faces in a 13,000-photo collection nearly 100 percent of the time. FaceNet can even recognize your pets.

But while Google’s facial recognition software may be amazing, Google Arts and Culture matches don’t always hit the mark.



No matter how accurate it is, the Google Arts and Culture app is a fun way to see yourself painted in a new light (pun intended). And since taking selfies can even help combat stress, we’re going to continue searching for that portrait that really captures our essence — or at least, comes sort of close.

Filed Under