Question bank

4,310 interview questions, answered.

Reference answers, what the interviewer is really testing, how it is graded, and the follow-ups that come next.

Easy 6Medium 24Hard 33
Filters · onDifficulty, topic, company
Clear all

33 questions

  1. 1Implement FlashAttention-style tiled attentionHardCodingSystem design· Mistral AI
  2. 2Debug a transformer with 4 failing tests, then train a classifier (OpenAI)HardCodingSystem design· OpenAI
  3. 3Debug an actual LLM inference step in a 20–30 line Colab skeleton (Anthropic)HardCodingSystem design· Anthropic
  4. 4Design a centralized ML training and management platformHardCodingSystem design· MEMeta engineer mock
  5. 5Design a distributed training pipeline for an LLM with fault toleranceHardCodingSystem design· Anthropic
  6. 6Design a fine-tuning platform (instruction / PEFT / RLHF)HardCodingSystem design· OpenAI
  7. 7Design a RAG system with evaluationHardCodingSystem design· OpenAI
  8. 8Design a system for safe deployment of AI models in productionHardCodingSystem design· Anthropic
  9. 9Design an AI gateway/proxy for org-wide LLM accessHardCodingSystem design· APAI Platform / MLOps roles
  10. 10Design an LLM evaluation platformHardCodingSystem design· EEEval Engineer / MLE roles
  11. 11Design an on-device AI assistantHardCodingSystem design· AGApple, Google
  12. 12Design ChatGPT to handle 100 million usersHardCodingSystem design· OpenAI
  13. 13Design memory for a personal AI assistantHardCodingSystem design· OpenAI
  14. 14Implement multi-head self-attention correctlyHardCodingSystem design· Apple
  15. 15Optimize a Python-simulated TPU kernel to beat 1487 cycles (Anthropic performance take-home)HardCodingSystem design· Anthropic
  16. 16Design an AI-powered email assistantHardCodingSystem design· Google
  17. 17Implement a Transformer block from scratchHardCodingSystem design
  18. 18Implement backprop for a tiny network (OpenAI)HardCodingSystem design· OpenAI
  19. 19Design a content moderation system using AIHardCodingSystem design
  20. 20Design a Deep Research agentHardCodingSystem design
  21. 21Design a feed-ranking systemHardCodingSystem design
  22. 22Design a multi-agent customer support systemHardCodingSystem design
  23. 23Design a multimodal search system (text + image + video)HardCodingSystem design
  24. 24Design a real-time fraud / abuse-detection ML systemHardCodingSystem design