Actions

Automatic Content Recognition (ACR)

Revision as of 21:07, 27 October 2021 by User (talk | contribs)

Automatic content recognition (ACR) refers to the ability of a client application (typically a smartphone or media tablet app) to identify a content element within its proximity _ audio, video or digital image _ based on sampling a portion of the audio or video (or image), processing the sample and comparing it with a source service that identifies content by its unique characteristics such as audio or video fingerprints or watermarks.[1]


How Automatic Content Recognition Works[2]
ACR works across a wide variety of media platforms, such as CTV systems, linear cable television, and even video games. The technology works by comparing the small in-the-moment snippet to a vast library of properly cataloged data to find exactly what the snippet is. In greater detail:

  • Media companies create a reference library of content. This is the archive of everything on television that future snippets will be compared to. Data centers catalog each moment, adding in all the metadata about when the media plays (on linear television), what video game, movie, or television show the snippet comes from, and any other useful information. Managing companies expend a lot of time and effort cleaning the data to create a refined, reliable library of listening posts.
  • ACR pulls a snippet from a viewer's current media and compares it to the library.
  • The content is matched with the right file full of metadata. These images or sound elements can happen once every 10 seconds or multiple times a second; as more snippets are compared in the library, the library continues to grow.

"To create the reference library, you need 'listening posts,'" explains Jane Clarke, CEO and managing director of CIMM. "Computers in data centers 'watch' TV and catalog what they see. Then, that reference library is matched against a schedule of what ran, so the computer can match the image and audio to a 9 p.m. prime-time episode, for example."


Uses of Automatic Content Recognition[3]
There are several uses of ACR technology. Some of the more prominent ones are –

  • Detection of copyright infringement: Copyrighted material such as video and audio are often used indiscriminately without attributing or paying royalties to the original content creators. If a database of copyrighted content exists, then large UGC platforms such as YouTube, TikTok, Vimeo, etc. could check to see if user-uploaded content contains copyrighted material or not.
  • Ad-tracking: ACR has found a lot of use in the advertising industry and for good reason. Here’s why –
    • Unless you have the ability to determine if an ad was played and watched by the end-user (instead of being buried at the end of a long landing page), then your metrics don’t make a lot of sense and it could lead to inflated data with respect to ad impressions, plays, and completion rates. This requires SDKs and changes to the players that can consume a lot of effort and development cycles.
    • However, ACR has the ability to recognize the content that is being played by sampling certain pixels of video, or by recognizing the audio. This enables ACR to provide a better picture to the advertisers and publishers on the ad delivery and engagement.
  • Collating information from different sources: This is a very interesting use-case of ACR. In most homes, there is one big TV in the living room where people gather to watch movies. However, the content streaming to the TV could come from an STB, Chromecast, Roku, FireStick, or an Xbox. Instead of embedding code inside all these devices, SmartTVs with ACR can recognize the content being played (from the “glass”) and report on it. This allows for content attribution and normalization across a variety of sources.
  • Understanding Audiences and their preferences: Similar to other methods of gathering usage analytics, ACR allows broadcasters and content providers to know how their audience is responding to their content, marketing, strategies, etc. By having fine-grained information about their audience and their usage patterns, broadcasters can better invest their dollars and get a much higher ROI.
  • Ad Retargeting by OEMs: Samsung includes ACR technology in their SmartTVs and sells ad inventory and provides ad-retargeting services. According to their website, “Samsung Ads offers TV Ad Retargeting that empowers brands to identify audiences who saw or missed their TV spots and reconnect with them via mobile, tablet, desktop or OTT.” And, “Samsung Smart TVs have built-in Automated Content Recognition (ACR) technology that can understand viewing behavior and usage including programs, movies, ads, gaming content and OTT apps in real-time”. You can read more about Samsung’s Privacy Policy here where they are pretty open about recording your video and audio to understand “you” better!
  1. Definition - What Does Automatic Content Recognition (ACR) Mean? Gartner
  2. How Automatic Content Recognition Works Strategus
  3. What are the different uses of ACR? OTTVerse