RejectedTechnical Screen

A Web Crawler Question Derailed by a Concurrency Stumble

AnthropicSoftware Engineer · Technical Screen · Oct 2025

Classic interview question: web crawler. You can also find this one on the usual practice-problem site. First single-threaded, then the follow-up was multi-threaded. Only need to consider pages under a single hostname. The extra piece compared to the practice-site version is that you need to handle the fragment — the #... part of the URL needs to be stripped. No need to worry about URL normalizat…

Shared by a candidate · reported Oct 2025. Interview formats change; use it as a guide, not a script.