Constructing a Media Understanding Platform for ML Improvements | by Netflix Know-how Weblog | Mar, 2023

An instance of utilizing Machine Studying to seek out pictures of Eleven in Stranger Things and surfacing the ends in studio utility for the consumption of Netflix video editors.

Use case #1: Dialogue search

Use case #2: Visible search

Screenshot from an internal application where user is shown thumbnail preview of “red race car” results from different titles.
Person trying to find “purple race automobile”

Use case #3: Reverse shot search

Input image on left side of food on a decorative plate and output images on right side of different food items that look similar to input image.
Person gives a question shot to seek out different related pictures.

Strategy #1: on-demand batch processing

Sequence diagram showing how different entities interact with each other in case of batch processing system.
On-demand batch processing system movement

Strategy #2: enabling on-line request with pre-computation

Sequence diagram showing how different entities interact with each other for online interactive system.
Interactive system with pre-computed information movement
Architecture diagram showing different sub-modules involved in the system.
System Structure

Interfaces – API & Question

Search Gateway

Searchers

Algo Execution & Ingestion