Why A/B tests and randomized controlled trials work

Sdílet
Vložit
  • čas přidán 12. 09. 2024
  • To try Shortform for a free trial, visit shortform.com/..., and you'll receive an additional 20% discounted annual subscription.
    How to deal with the unobserved and the unknown: randomness
    More context here: • What haunts statistici...
    Stay updated with the channel and some stuff I make!
    👉 verynormal.sub...
    👉 very-normal.se...
    FTC Disclaimer: This video was sponsored by Shortform.

Komentáře • 34

  • @very-normal
    @very-normal  Před 3 měsíci +1

    To try Shortform for a free trial, visit shortform.com/verynormal, and you'll receive an additional 20% discounted annual subscription.

  • @Moe5Tavern
    @Moe5Tavern Před 3 měsíci +2

    Somehow your videos are so well structured and therefore good to follow, the red line throughout is very clear. Thank you!

  • @olipito
    @olipito Před 3 měsíci +2

    Your videos are amazing, please keep going!

  • @anthonymoore3246
    @anthonymoore3246 Před 3 měsíci +2

    Lovely video as always

  • @gonzalodiazamor5494
    @gonzalodiazamor5494 Před 3 měsíci

    after a clinical trial is great to use propensity score to match the patients. great video! thank you very much!
    Cheers and thanks for the content!
    PS. Here I am too with my 'Ventolin

  • @yashagrahari
    @yashagrahari Před 3 měsíci

    3:58 Lol! you got me.

  • @MrUCTeja
    @MrUCTeja Před 3 měsíci

    Amazing explanation..! Thanks a lot..!

  • @iamjinse
    @iamjinse Před 3 měsíci

    Can u make video about difference between confounder mediator and moderator?

  • @galenseilis5971
    @galenseilis5971 Před 3 měsíci +2

    I've half of Taleb's Incerto. So far so interesting!

    • @AustinFragomen-wy8sy
      @AustinFragomen-wy8sy Před 3 měsíci

      Check out Daniel khaneman he presents taleb’s idea but somehow better

    • @very-normal
      @very-normal  Před 3 měsíci

      Which ones have you read so far?

    • @AustinFragomen-wy8sy
      @AustinFragomen-wy8sy Před 3 měsíci

      @@very-normalBlack swan and fooled by randomness

    • @galenseilis5971
      @galenseilis5971 Před 3 měsíci +1

      @@very-normal I've read The Black Swan, Fooled by Randomness, and I am partway through Antifragile. I've also read his "technical incerto": Statistical Consequences of Fat Tails. I actually got interested in the technical analysis of extreme value theory and some of his other technical work before moving onto the pop' books.

    • @galenseilis5971
      @galenseilis5971 Před 3 měsíci

      @@AustinFragomen-wy8sy I've read Thinking Fast and Slow, and also his book Noise. I really enjoyed the former when I read it back in summer 2018. I could see Noise being a good book for someone that really has never thought about the statistical concepts like the variance-bias tradeoff, but I'll confess I found it repetitive. His books aside, I felt some sadness when I heard he passed away.

  • @Another_option
    @Another_option Před 3 měsíci +1

    Great video!

  • @chemistrycapital
    @chemistrycapital Před 3 měsíci +1

    Great content!

  • @theraizor1629
    @theraizor1629 Před 3 měsíci

    Amazing as always, keep going

  • @youteubakount4449
    @youteubakount4449 Před 3 měsíci +1

    Yeah chapter 2 deserves more than 1 minute bro.

  • @wanfuse
    @wanfuse Před 3 měsíci

    don't many confounders, confound the relationships? That is if there is enough confounders with overlapping effects, doesn't this break the statistics?

    • @very-normal
      @very-normal  Před 3 měsíci

      That’s the great thing about randomization! When it works, it doesn’t care about the number of confounders or how these confounders interrelate, the cause-effect relationship gets isolated

  • @robertwilsoniii2048
    @robertwilsoniii2048 Před 3 měsíci +1

    I didn't know randomization breaks confounders. I'm skeptical of that... how do we know the samples themselves are good enough? I guess it's "unlikely" to get a sample that isn't good enough.
    I'd feel more comfortable first prooortionately stratifying samples, and then randomly sampling them while holding the stratification sizes proportional to get a proportionately allocated stratified simple random sample.
    I also don't see the difference between statistical controls applied to simple random samples and experimental trials. They seem to be logically equivalent.

    • @very-normal
      @very-normal  Před 3 měsíci +2

      Yes! Stratified randomization is definitely another common strategy. I didn’t cover it here, but you’re right

    • @guitarflori
      @guitarflori Před 3 měsíci

      There is one difference. If I use statistical controls on a simple random sample, I rely on measuring all disjunctive pre-treatment causes+Proxies of Confounders (VanderWeele 2019).
      Some of those variables might not be measurable, or might be unknown and are therefore not measured. We can only find the exact effect if it is true that all necessary variables (according to above criterion) are measured.
      Randomized Controlled Trials do not rely on measuring all the necessary variables for random assigment, because the assignment to the Treatment is being done by the researchers directly in the simple random sample. They do(x) on the subjects of the study.
      Edit note: Of course both have the common problem of selection bias.

  • @lorenzoplaserrano8734
    @lorenzoplaserrano8734 Před 3 měsíci

    love love your channel ❤

  • @joelbeeby866
    @joelbeeby866 Před 3 měsíci

    Great vid!!

  • @synchro-dentally1965
    @synchro-dentally1965 Před 3 měsíci

    Do you have seasonal allergies? Consider consuming more vitamin C if you haven't already. It is a natural anti-histamine.

    • @very-normal
      @very-normal  Před 3 měsíci +1

      lol yeah sometimes my allergies get bad and it comes through on voiceovers unfortunately. I’ll try to add some more vitamin C in my routine

    • @synchro-dentally1965
      @synchro-dentally1965 Před 3 měsíci

      @@very-normal If they're particularly bad there was also a 2020 study from Thailand on Ginger extract versus Loratadine in the treatment of allergic rhinitis. The only difference found were the side effects from taking the Loratadine.

  • @orangedrink-r6f
    @orangedrink-r6f Před 3 měsíci

    Great vid🎉🎉🎉❤❤❤😊😊😊

  • @thomasconnor8117
    @thomasconnor8117 Před 3 měsíci +1

    😮

  • @matteogirelli1023
    @matteogirelli1023 Před 3 měsíci +3

    Econometrics people likes here😏 ⬇️