Calculate probability for coin flips
Last updated: September 17, 2025
Quick Overview
Given the following scenario about revenue per session, calculate the the p-value.
Notion
Statistics & Math
Data Scientist
Notion
September 17, 2025Data Scientist
Onsite
Statistics & Math
Medium
0
6
627 solved
Given the following scenario about revenue per session, calculate the the p-value.
Notion values data-driven decision making. This Onsite question assesses whether you can design experiments, interpret results correctly, and avoid common statistical pitfalls like p-hacking or Simpson's paradox.
What the Interviewer Expects
- Set up the problem formally with proper notation
- Apply the correct statistical test with clear justification
- Interpret results with appropriate caveats and confidence levels
- Discuss practical significance vs statistical significance
- Identify potential confounders and how to address them
Key Topics to Cover
Causal inference basics
Multiple testing correction (Bonferroni, FDR)
Bayesian vs frequentist inference
Regression analysis
Central Limit Theorem
Probability distributions
How to Approach This
- Define your hypotheses (H0 and H1) clearly before performing any test.
- Calculate required sample size BEFORE running an experiment, using power analysis.
- Remember the Central Limit Theorem: sample means become approximately normal with large n.
- Watch for Simpson's paradox. Always segment data by key dimensions.
- Distinguish between statistical significance and practical significance.
Possible Follow-up Questions
- How would you design a follow-up experiment based on these results?
- What if the sample size is very small?
- What assumptions does this test make, and how would you validate them?
Sharpen Your Skills on Codemia
Practice similar problems with our interactive workspace, get AI feedback, and track your progress.
Browse Statistics QuestionsSample Answer
Problem Formulation
We are tasked with determining the p-value associated with the revenue per session from coin flips in a randomized experiment. Let's denote the revenue from sessions where users engaged with the new f...
Solution Approach
- Collect Data: Gather revenue data from both treatment (coin flips resulting in new feature engagement) and control groups (standard sessions).
- **Calculate Sample Means and Standard Deviati...
Submit Your Answer
Markdown supported