Question bank

4,310 interview questions, answered.

Reference answers, what the interviewer is really testing, how it is graded, and the follow-ups that come next.

Easy 1Medium 2Hard 6
Filters · onDifficulty, topic, company
Clear all

9 questions

  1. 1Implement a BPE tokenizer from scratchMediumCodingSystem design· OpenAI
  2. 2Debug a transformer with 4 failing tests, then train a classifier (OpenAI)HardCodingSystem design· OpenAI
  3. 3Design a fine-tuning platform (instruction / PEFT / RLHF)HardCodingSystem design· OpenAI
  4. 4Design a RAG system with evaluationHardCodingSystem design· OpenAI
  5. 5Design ChatGPT to handle 100 million usersHardCodingSystem design· OpenAI
  6. 6Design memory for a personal AI assistantHardCodingSystem design· OpenAI
  7. 7Compute entropy and implement 1-NN (OpenAI)MediumCodingSystem design· OpenAI
  8. 8Implement backprop for a tiny network (OpenAI)HardCodingSystem design· OpenAI
  9. 9LRU cache implementation (OpenAI onsite)EasyCodingSystem design· OpenAI