← All questions
HardDataAI ML
You have 600 predictions from six independently trained models. The claim concerns variability across trained models. What is the resampling unit?
1Give yourself 5 minutes
2Answer out loud, not in your head
3Then compare with the answer below
0
Reference answer
Then expect these follow-ups
What changes if the estimand concerns new users rather than new training runs?
Free to read · better with Enzo
Practice this out loud with Enzo
Enzo runs it as a mock interview, pushes back with follow-ups, and grades you on the rubric.
Next question
- How do you know whether an apparent model improvement is statistically meaningful?
- A result estimates +0.3 points with an interval from -2 to +2.6, and useful improvement means at least +1. What can you conclude?
- A model is better within easy and hard groups but worse overall. What data do you request and how do you analyze it?