← All questions
MediumAI MLTechnical
A model's live scores change with the composition of each request batch. The estimator weights are identical to training. What transformation bug would you test?
1Give yourself 5 minutes
2Answer out loud, not in your head
3Then compare with the answer below
0
Reference answer
Then expect these follow-ups
What if average scores look similar but individual vectors differ?
Hiring now
Machine learning engineer roles are open right now
landed applies to roles like these for you, on each company’s own site, with answers written for the role.
Get 5x interviews10 free auto-applies. No card.
AI/ML Engineer
Kaizen Labs · New York, NY
Senior ML Engineer, Perception
Clera · San Francisco
Machine Learning Engineer
Endava · Córdoba, Cordoba, Argentina
Next question
- An AI system regressed after a prompt change. How would you debug it?
- How would you debug an AI deployment using a customer’s private data?
- What causes GPU out-of-memory errors during inference, and how do you respond?
- A booking worker crashes after a provider commits but before the local result is stored. The provider's idempotency record expires tomorrow. Write a recovery plan for today and for next week.
- Precision falls after a new region launches, while latency and feature missingness remain stable. Mature labels show the old region unchanged. What is the next diagnosis?
- A reproduction matches sample IDs and logits, but loss and gradient norms are exactly three times larger for a three-example batch. What do you inspect before another full run?