With memes becoming a staple element over social media, understanding one is not everyone’s cup of tea. Perhaps, Facebook is one such platform who needs to put an extra effort in understanding the text on the brilliant creations making rounds on its platform and Instagram.
The Social media giant in a recent announcement said that it has built a machine learning system called Rosetta which extracts texts from billion of public image posts and videos on Facebook and Instagram to understand the context of the text and images together.
How does it work? Well, the system first scans the image for text and then uses text recognition to identify what it actually says. It then interprets the text based on transcription.
According to Mashable, Rosetta is not dedicated to memes and can have a lot of other practical use cases. For instance, it can help read the text in menus, street signs, clothing labels, and so on. It can also make Facebook accessible to the visually impaired.
Rosetta is also aimed at helping Facebook automatically detect and remove hate speech from the site. The system is capable of processing over a billion images a day.