Aliens School
Cinematic Knowledge Experience
0%
Aliens School
Now Playing
Aliens School ยท HIEN
โŒจ๏ธ Keyboard Shortcuts
โ†’Next slide โ†Previous slide SpacePlay / Pause MNarration on/off FFullscreen ?Show/hide this
Press any key to close
Skill Topic ยท Cinematic

๐Ÿ…ฐ๏ธ๐Ÿ…ฑ๏ธ A/B Testing

๐Ÿ“˜ Course: Data Science | ๐Ÿ“‘ Topic #20 | ๐Ÿท๏ธ Section 3: Statistics & Probability โฌ…๏ธโ€ฆ

Overview
๐ŸŒŸ

๐Ÿ…ฐ๏ธ๐Ÿ…ฑ๏ธ A/B Testing โ€” Quick Facts

๐Ÿ“Œ

๐Ÿ“‘ Topic #20: ๐Ÿท๏ธ Section 3: Statistics &โ€ฆ

๐ŸŽฏ

> โฌ…๏ธ [19-Hypothesis-Testing](19-Hypothesis-Testing.md): โžก๏ธ 21-Correlation-Causation

Topic 1
๐Ÿ“ฅ โš™๏ธ ๐Ÿ”ฌ ๐Ÿ’ก

๐ŸŽฏ Is Topic Me Kya Seekhoge?

๐Ÿ’ก

A/B Testing kya hai โ€” goldโ€ฆ

๐Ÿ”‘

Complete A/B test design โ€”โ€ฆ

โšก

Sample size calculation โ€” kitneโ€ฆ

๐ŸŽฏ

Statistical significance โ€” realโ€ฆ

Topic 2
๐Ÿ’ก

๐Ÿ“ A/B Testing โ€” Big Picture

๐Ÿ’ก ` โ•”โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•— โ•‘ ๐Ÿ…ฐ๏ธ๐Ÿ…ฑ๏ธ A/Bโ€ฆ
Topic 3
โœจ

๐Ÿ”‘ Complete A/B Test Process

๐ŸŽฏ ` โ•”โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•— โ•‘ ๐Ÿ“‹ A/B TEST DESIGN โ€”โ€ฆ
Topic 4
โญ

๐Ÿ“ Sample Size Calculation

โญ ` โ•”โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•— โ•‘ ๐Ÿ“ SAMPLE SIZE โ€” KITNEโ€ฆ
Topic 5
๐Ÿ“ฅ ๐Ÿ“ฅ ๐Ÿง  ๐Ÿ”ฌ ๐Ÿ’ก ๐ŸŽฏ

โš ๏ธ Common Pitfalls

๐Ÿ”‘ ` โ•”โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•— โ•‘ โš ๏ธ A/B TESTING PITFALLSโ€ฆ
Topic 6
โœจ

๐Ÿ“Š Beyond A/B

โœจ ` โ•”โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•— โ•‘ ๐Ÿ“Š BEYOND BASIC A/B โ•‘โ€ฆ
Topic 7
โœจ

๐Ÿ“Š Comparison Table

๐ŸŒŸ | Aspect | A/B Test | A/B/n Test | MVT | Bandit |โ€ฆ
Topic 8
๐Ÿš€

๐ŸŒ Real-World Example

๐Ÿš€ ` โ•”โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•— โ•‘ ๐ŸŒ REAL EXAMPLE:โ€ฆ
Topic 9
โœจ

๐Ÿ Python Code โ€” ABTestEngine

๐Ÿ’ก

Sample size calculator

๐Ÿ”‘

Proportion test (conversion rates)

โšก

Continuous metric test (revenue,โ€ฆ

๐ŸŽฏ

SRM check (sample ratio mismatch)

Topic 10
โœจ

โ“ Quiz โ€” 5 MCQs

๐Ÿ’ก

A) New version wala group

๐Ÿ”‘

B) Original/current version walaโ€ฆ

โšก

C) Random users

๐ŸŽฏ

D) Best performing group

Topic 11
๐Ÿ”’

๐Ÿง  Key Takeaways

๐ŸŽฏ ` โ•”โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•โ•— โ•‘ ๐Ÿง  YAAD RAKHNE WALIโ€ฆ
Comparison
โœจ

๐Ÿ“Š Comparison Table

โš–๏ธ

Variants: 2

โš–๏ธ

Traffic needed: Medium

โš–๏ธ

Interactions?: No

Quick Quiz
๐Ÿง  QUIZ TIME

Quiz โ€” Question 1

๐Ÿ…ฐ๏ธ๐Ÿ…ฑ๏ธ A/B Testing ka sabse sahi definition kya hai?

Complete! ๐ŸŽ‰
COMPLETE

๐Ÿ…ฐ๏ธ๐Ÿ…ฑ๏ธ A/B Testing Complete!

Aliens School ยท HIEN ยท Cinematic Knowledge

โœ…

๐Ÿ…ฐ๏ธ๐Ÿ…ฑ๏ธ A/B Testing Complete

1/16
0:00
REC 00:00ESC=Cancel
Aliens School
3
Recording shuru hone wali hai...
โœ…
Recording Complete
Video process ho rahi hai...
Live Class
Slide 1 / 7
Timer
00:00
๐Ÿ“ Speaker Notes
โ€”
โญ๏ธ Up Next
โ€”
โ€”
๐Ÿ—‚๏ธ All Slides