Question bank

4,310 interview questions, answered.

Reference answers, what the interviewer is really testing, how it is graded, and the follow-ups that come next.

Easy 6Medium 24Hard 33
Filters · onDifficulty, topic, company
Clear all

65 questions

  1. 1Implement a BPE tokenizer from scratchMediumCodingSystem design· OpenAI
  2. 2Implement an async task queue with a concurrency limitMediumCodingSystem design· Neon
  3. 3Implement beam search decodingMediumCodingSystem design· PAPerplexity AI
  4. 4Implement FlashAttention-style tiled attentionHardCodingSystem design· Mistral AI
  5. 5Debug a transformer with 4 failing tests, then train a classifier (OpenAI)HardCodingSystem design· OpenAI
  6. 6Debug an actual LLM inference step in a 20–30 line Colab skeleton (Anthropic)HardCodingSystem design· Anthropic
  7. 7Design a centralized ML training and management platformHardCodingSystem design· MEMeta engineer mock
  8. 8Design a distributed training pipeline for an LLM with fault toleranceHardCodingSystem design· Anthropic
  9. 9Design a fine-tuning platform (instruction / PEFT / RLHF)HardCodingSystem design· OpenAI
  10. 10Design a RAG system with evaluationHardCodingSystem design· OpenAI
  11. 11Design a system for safe deployment of AI models in productionHardCodingSystem design· Anthropic
  12. 12Design an AI gateway/proxy for org-wide LLM accessHardCodingSystem design· APAI Platform / MLOps roles
  13. 13Design an LLM evaluation platformHardCodingSystem design· EEEval Engineer / MLE roles
  14. 14Design an on-device AI assistantHardCodingSystem design· AGApple, Google
  15. 15Design ChatGPT to handle 100 million usersHardCodingSystem design· OpenAI
  16. 16Design memory for a personal AI assistantHardCodingSystem design· OpenAI
  17. 17Generate outputs for images and pipelines (Anthropic)MediumCodingSystem design· Anthropic
  18. 18Implement multi-head self-attention correctlyHardCodingSystem design· Apple
  19. 19Optimize a Python-simulated TPU kernel to beat 1487 cycles (Anthropic performance take-home)HardCodingSystem design· Anthropic
  20. 20Build a rate-limited async LLM API clientMediumCodingSystem design· Cohere
  21. 21Cohere infrastructure utilities (5-in-1 take-home)MediumCodingSystem design· Cohere
  22. 22Compute entropy and implement 1-NN (OpenAI)MediumCodingSystem design· OpenAI
  23. 23Cursor 8-hour paid take-home build sessionMediumCodingSystem design· Cursor
  24. 24Design an AI-powered email assistantHardCodingSystem design· Google