Goals
A/B Test : Identify the best experience , isolate variables and learn influence
Multivariate Test : Learn the influce of "all" elements and the best predicted winner
Benefits
A/B Test : Versatile and Strategic - good for 95% of tests , isolate variables, test with less traffic, get answers quickly
Multivariate Test : Avoid multiple sequential a/b tests, see interaction of elements
Negatives
A/B Test : Strategically , intense , planning , requred
Multivariate Test : Testing more variables ,requires more variations and traffic
Use Cases
A/B Test : Very flexible , good for small and large tests
Multivariate Test : Refine valuable elements with smaller changes
Hypothesis
A/B Test : Requires rigor in defining what you are testing, solving and learning
Multivariate Test : Lazily tweaking existing elements
결론은 두개를 같이 써라
A/B 테스트 와 Multivariate 테스트를
출처 : youtu.be/PPmZKd-hl-g
'AI월드 > ⚙️AI BOOTCAMP_Section 1' 카테고리의 다른 글
student.t.distribution/스튜던트t검정_Day6(4) (0) | 2021.01.17 |
---|---|
A/B 테스트의 기본개념_Day6(3) (0) | 2021.01.17 |
콜모고로프-스미르노브 검정_Day7(5) (0) | 2021.01.17 |
Empirical Analysis. 경험적 분석(실증적 분석)_Day7(4) (0) | 2021.01.17 |
1sample vs 2sample chisquare 코드_Day7(3) (0) | 2021.01.17 |
댓글