Design a Real-Time Feature Store
CognitivMachine Learning Engineer · Technical ScreenLast updated
This question evaluates a candidate's ability to design real-time feature store architectures, encompassing competencies in low-latency serving, point-in-time correctness for offline training, streaming ingestion, consistency between online and offline features, handling backfills and late events, and scalable monitoring of data quality and reliability. It is commonly asked to assess systems-design and data-engineering judgment for production-grade ML infrastructure, falls under the ML system design and data engineering domain, and tests both conceptual understanding of trade-offs (consistency, latency) and practical application skills for APIs, storage, and operational design.
Design a real-time feature store for machine learning systems used in ads or recommendation ranking.
Your design should support both:
- Online inference: low-latency feature lookup during request serving
- Offline training: generating historical training datasets with point-in-time correctness
Discuss the following:
- what APIs and abstractions the feature store should expose
- how features are ingested, computed, stored, and served
- how to keep online and offline features consistent
- how to handle fresh streaming features, backfills, and late events
- how to scale the system and monitor data quality and reliability
Solution walkthrough is for members
Get the full walkthrough with reference code and complexity analysis, plus Kitty Coach at 300 messages a day. Hints, the code runner and community answers stay free.