← All questions
HardDataAI ML
You have 600 predictions from six independently trained models. The claim concerns variability across trained models. What is the resampling unit?
1Give yourself 5 minutes
2Answer out loud, not in your head
3Then compare with the answer below
0
Reference answer
Then expect these follow-ups
What changes if the estimand concerns new users rather than new training runs?
Hiring now
Get the interview, not just the prep
landed applies to roles like these for you, on each company’s own site, with answers written for the role.
Get 5x interviews10 free auto-applies. No card.
Next question
- How do you know whether an apparent model improvement is statistically meaningful?
- A result estimates +0.3 points with an interval from -2 to +2.6, and useful improvement means at least +1. What can you conclude?
- A model is better within easy and hard groups but worse overall. What data do you request and how do you analyze it?