Katkat
Back

Design a Multimodal Training Data Pipeline

FigureSoftware Engineer · Technical Screen
EasySoftware EngineerTechnical ScreenML System Design

Last updated

This question evaluates a candidate's ability to design scalable, reliable backend systems for ingesting and processing multimodal training data, testing competencies in distributed system architecture, API and storage design, large-media handling, data validation, duplicate detection, quality control, observability, and awareness of data bias.

Design a backend system for collecting, filtering, and storing training data sent by many clients.

Clients upload records that may include large media files such as images or videos, action sequences, labels, and metadata. The backend must run a series of validation and filtering steps, including:

  • Detect whether an image or video frame is upside down or otherwise invalid.
  • Detect duplicate or near-duplicate actions or sequences.
  • Detect spam, junk, or low-quality submissions.
  • Store accepted data for downstream machine learning training.

Discuss the end-to-end system design, including APIs, ingestion flow, storage, asynchronous processing, scalability, reliability, handling large media files, observability, and how you would detect and mitigate data bias in the collected training data.