Very Normal
Very Normal
  • 43
  • 1 076 388
Explaining the Chi-squared test
migraines suck
Stay updated with the channel and some stuff I make!
👉 verynormal.substack.com
👉 very-normal.sellfy.store
To try Shortform for a free trial, visit shortform.com/verynormal, and you'll receive an additional 20% discounted annual subscription.
zhlédnutí: 7 318

Video

The algorithm that (eventually) revolutionized statistics - #SoMEpi
zhlédnutí 63KPřed měsícem
My submission to the Summer of Math Exposition, community edition: a video on the Metropolis algorithm and how it works Stay updated with the channel and some stuff I make! (Newsletter) 👉 verynormal.substack.com (Store) 👉 very-normal.sellfy.store (Code) 👉 github.com/very-normal/explained To try Shortform for a free trial, visit shortform.com/verynormal, and you'll receive an additional 20% disc...
Explaining the ANOVA and F-test
zhlédnutí 13KPřed měsícem
When 3 is greater than 2 To try Shortform for a free trial, visit shortform.com/verynormal, and you'll receive an additional 20% discounted annual subscription. Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store
What does it take to win the biggest prize in statistics?
zhlédnutí 28KPřed měsícem
its huge Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store Try Shortform for free and get 20% off an annual subscription! 👉 shortform.com/verynormal
Explaining nonparametric statistics, part 2
zhlédnutí 6KPřed 2 měsíci
Three guys, one test Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store Try Shortform for free and get 20% off an annual subscription! 👉 shortform.com/verynormal
Why A/B tests and randomized controlled trials work
zhlédnutí 8KPřed 2 měsíci
To try Shortform for a free trial, visit shortform.com/verynormal, and you'll receive an additional 20% discounted annual subscription. How to deal with the unobserved and the unknown: randomness More context here: czcams.com/video/SGGLkrJa9_w/video.html Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store FTC Disclaimer: This video was spons...
Explaining nonparametric statistics, part 1
zhlédnutí 20KPřed 3 měsíci
The only thing statisticians know how to relax is their assumptions. Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store
5 tips for getting better at statistics
zhlédnutí 22KPřed 3 měsíci
To try everything Brilliant has to offer-free-for a 7 day trial, visit brilliant.org/VeryNormal. You’ll also get 20% off an annual premium subscription. (07/11/2024 Note: someone has notified me that the offer has been changed. It used to be 30 days free, but I was told that its now 7 days) Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store...
An easier way to do sample size calculations
zhlédnutí 16KPřed 4 měsíci
You just got to know a little bit of code. The code shown in this video can be found at: github.com/very-normal/explained Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store
The better way to do statistics
zhlédnutí 206KPřed 4 měsíci
To try everything Brilliant has to offer-free-for a 7 day trial, visit brilliant.org/VeryNormal. You’ll also get 20% off an annual premium subscription. (07/11/2024 Note: someone has notified me that the offer has been changed. It used to be 30 days free, but I was told that its now 7 days) Non-clickbait title: A gentle, but progressively rough introduction to Bayesian statistics Stay updated w...
Explaining Power
zhlédnutí 12KPřed 5 měsíci
A visual guide to power Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store
What haunts statisticians at night
zhlédnutí 74KPřed 5 měsíci
To try everything Brilliant has to offer-free-for a 7 day trial, visit brilliant.org/VeryNormal. You’ll also get 20% off an annual premium subscription. (07/11/2024 Note: someone has notified me that the offer has been changed. It used to be 30 days free, but I was told that its now 7 days) Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store...
Explaining Confidence Intervals and The Critical Region
zhlédnutí 9KPřed 6 měsíci
Video contains some mistakes! Please refer to the errata in my pinned comment for reference. A breakdown of where the confidence interval comes from and how to use it Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store
The most important skill in statistics
zhlédnutí 315KPřed 6 měsíci
No, it's not gambling Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store
How to do a t-test in R
zhlédnutí 3KPřed 7 měsíci
An explanation of the t.test() function and how to use it Stay updated with the channel and some stuff I make! 👉 verynormal.substack.com 👉 very-normal.sellfy.store
Explaining The Two-Sample t-Test
zhlédnutí 4,3KPřed 7 měsíci
Explaining The Two-Sample t-Test
Essential R to learn for statistics and data science in 2024
zhlédnutí 4,7KPřed 7 měsíci
Essential R to learn for statistics and data science in 2024
Explaining The One-Sample t-Test
zhlédnutí 10KPřed 8 měsíci
Explaining The One-Sample t-Test
What do statisticians research?
zhlédnutí 15KPřed 8 měsíci
What do statisticians research?
Understand The Normal Distribution and Central Limit Theorem
zhlédnutí 7KPřed 9 měsíci
Understand The Normal Distribution and Central Limit Theorem
Explaining Parametric Families
zhlédnutí 9KPřed 9 měsíci
Explaining Parametric Families
The most important ideas in modern statistics
zhlédnutí 108KPřed 9 měsíci
The most important ideas in modern statistics
What is functional data analysis?
zhlédnutí 4,2KPřed 10 měsíci
What is functional data analysis?
Explaining Probability Distributions
zhlédnutí 19KPřed 10 měsíci
Explaining Probability Distributions
What is an N-of-1 trial?
zhlédnutí 1,7KPřed 10 měsíci
What is an N-of-1 trial?
A Roadmap For Biostatistics Self-Study
zhlédnutí 2,9KPřed 10 měsíci
A Roadmap For Biostatistics Self-Study
Manuscript Rejection 2: The Runback // Biostatistics Ph.D Log 4
zhlédnutí 388Před 11 měsíci
Manuscript Rejection 2: The Runback // Biostatistics Ph.D Log 4
A Biostatistics Masters Degree Explained In 15 Minutes
zhlédnutí 3,7KPřed 11 měsíci
A Biostatistics Masters Degree Explained In 15 Minutes
Statistical Inception: The Bootstrap (#SoME3)
zhlédnutí 29KPřed rokem
Statistical Inception: The Bootstrap (#SoME3)
What is a basket trial?
zhlédnutí 1,4KPřed rokem
What is a basket trial?

Komentáře

  • @kef103
    @kef103 Před 3 hodinami

    The probability of a 185 foot yacht named Bayseian sinking at anchor in some freak combination of circumstances ? I think some quantum entanglement double slit craziness had to happen .

  • @laitinlok1
    @laitinlok1 Před 10 hodinami

    10:43 this is essentially the total probability theorem in a continuous probability density function, for discrete probability functions, it should use summation.

  • @laitinlok1
    @laitinlok1 Před 10 hodinami

    I think in some ways the Bayesian method for testing vaccines make sense, it is a typical way to say the probability of getting covid given they have taken the vaccine is often used as a metric of how effective the vaccine instead of the probability of getting covid.

  • @laitinlok1
    @laitinlok1 Před 10 hodinami

    I have learned both ways in uni, it is interesting

  • @ivarorno
    @ivarorno Před 17 hodinami

    It's χ not kai you god damned Statians.

  • @ulamss5
    @ulamss5 Před 22 hodinami

    far too many (hyper-)parameters to work IRL. overfitting nightmare.

    • @very-normal
      @very-normal Před 18 hodinami

      lol how many parameters would you recommend

  • @duckymomo7935
    @duckymomo7935 Před dnem

    What about chi Square goodness of fit

    • @very-normal
      @very-normal Před 16 hodinami

      it kinda follows the same logic. The null hypothesis is that your data comes from some specific distribution. Your data would actually be a contingency table with one row because a goodness of fit test looks at whether or not your data conceivably comes from a given distribution. Based on this specific distribution, you can calculate expected counts. From there you calculate the statistic in the same way.

  • @eschares
    @eschares Před dnem

    At 4:08, you say A is the prior probability of watching this video. Shouldn't that be the prior of subscribing instead?

  • @sajanator3
    @sajanator3 Před 2 dny

    How do you choose between using 2 sampled t-test and chi squared test? Are there any examples where one would be suitable and one wouldn't?

    • @very-normal
      @very-normal Před 2 dny

      I think you mean the two-sample proportion test, the t-test is technically for continuous outcomes. The chi-squared test (in this video) is actually equivalent to the two sample proportion test, assuming everything I did in the video. The conclusions would be the same, no matter which you use. If you run the proportion test in R, you’ll actually see it uses the chi-squared test to calculate a p-value. You would want to use something else if your sample size is small or isn’t mutually exclusive. A usual substitution is Fisher’s test for small sample sizes. For paired data, there’s also McNemar’s test.

    • @sajanator3
      @sajanator3 Před 2 dny

      @@very-normal Sorry yes, I did mean the 2 sample proportion test. Thank you for the reply.

  • @HesderOleh
    @HesderOleh Před 2 dny

    I liked this video. I just would have felt very confused by what "expected" means in this context had I not already known it. I think that a good place to quickly explain it would have been when you were explaining why a 2x2 table has one degree of freedom. On the other hand it might get someone still confused to research it more themselves. On the other other hand, I am not sure where they should go to find something like that out, as most resources are not easy for a beginner to approach for math.

  • @sotirisbekiaris3580

    Awesome content! You should definitely do a video about survival analysis

    • @very-normal
      @very-normal Před 3 dny

      Thanks! I do have a small bit of survival in another video about the “biggest award in statistics” but it’s definitely worth it’s own video

  • @axscs1178
    @axscs1178 Před 3 dny

    It would ‘ve been great if you had shown how the expected frequencies under the independence assumption are calculated.

  • @user-td4ii9px4s
    @user-td4ii9px4s Před 3 dny

    One of my favorite channels thanks a lot.

  • @AER9095
    @AER9095 Před 3 dny

    I came here for the math. Disappoint.

  • @fibonacci112358steve

    This is a great video, but I'd like to make two comments for everybody: - "Chi Squared test" is an awful name, because there are many, many different statistical tests that have Chi-squared(n) as its null-distribution. As a group, let's all try to phase out the use of this terminology. - The test presented in this video is increasingly replaced by the G-test. The test statistic in this video is an asymptotic approximation of the G-test statistic. The asymptotic distribution of the G-test is Chi-squared (which comes back to the first point).

  • @komethtauch5151
    @komethtauch5151 Před 4 dny

    you have no idea how long I've waited for this

  • @pfizerpflanze
    @pfizerpflanze Před 4 dny

    The degree of freedom for the same test statistics for bigger contingency tables with I rows and J columns should be (I-1)×(J-1), for those wondering

  • @bilal_ali
    @bilal_ali Před 4 dny

    Just one question At the end when the p value is less than 5% we fail to reject the null hypothesis. Means our drug is not effective. Right?

    • @very-normal
      @very-normal Před 4 dny

      😔 yeah you’re right, my company is going to need to fictionally downsize

    • @pfizerpflanze
      @pfizerpflanze Před 4 dny

      The p-value is actually 15%, namely greater than 5%. And yes, we don't reject the null.

  • @Matthew-eb3di
    @Matthew-eb3di Před 4 dny

    😩😩😩 10/10 training without even having to apply to the job

  • @braineaterzombie3981

    Thanks!

  • @Abhishek-bz5is
    @Abhishek-bz5is Před 4 dny

    best youtuber

  • @wolfzbyte
    @wolfzbyte Před 4 dny

    Interesting. As it turns out, my undergrad was heavier into Bayesian probability.

  • @pipertripp
    @pipertripp Před 4 dny

    Shit just got real.

  • @fg786
    @fg786 Před 4 dny

    Wake up babe. Very Normal uploaded a new video!

  • @billfrug
    @billfrug Před 5 dny

    whats a stationary distribution

    • @very-normal
      @very-normal Před 5 dny

      a distribution that doesn’t change over time. For example, if I’m losing weight, the mean weight I’d see on my scale would change over time, so it wouldn’t be stationary. If I’m maintaining, then it would be stationary

  • @user-fj9hf4bu9f
    @user-fj9hf4bu9f Před 5 dny

    I heard Portland is pretty nice this time of year. I even think they did a show about Portland called Portlandia. Also based on what I've heard the "drinking craft brew" percentage should be increased by roughly 50 points.

  • @isbestlizard
    @isbestlizard Před 6 dny

    How are the population units initialised? You couldn't have every single person you ask have an identical preference, so how does the algorithm decide some people prefer coffee to hiking, wheras aothers prefer hiking to coffee?

    • @very-normal
      @very-normal Před 5 dny

      My population is Portland locals, but I also I made a pretty strong assumption that all Portland locals would have the same preference distribution. If I assume this, then any local I ask would generally give me the same type of answers. Of course this isn’t really a reasonable assumption, just something to further the metaphor

  • @andrews9719
    @andrews9719 Před 6 dny

    I just took a stats course in my Data Science Masters, and this video was a perfect summation of it. We also used R to visualize the distributions, albeit we didn't use ggplot (which looks nicer and is better IMO). Great job!

  • @paulg444
    @paulg444 Před 7 dny

    i dont understand how you can ask your model to have as many pis as yis....hmm...

  • @Yahweh42069
    @Yahweh42069 Před 7 dny

    majority of doctors fail simple questions on bayes theorem. hence the widespread misinterpretation of pcr testing that led to massively overstated case numbers

  • @TheEVEInspiration
    @TheEVEInspiration Před 8 dny

    Don't ask the bartender!

  • @bin4ry_d3struct0r
    @bin4ry_d3struct0r Před 8 dny

    Do you need a background in biology to get a degree in biostats?

    • @very-normal
      @very-normal Před 8 dny

      nah for most programs you’ll see the prerequisites are usually math classes. Most of the relevant biology you pick up once you start writing on applied problems, but not needed to get a degree

  • @danielerdody160
    @danielerdody160 Před 9 dny

    I took a class on stochastic models which relied heavily on Bayesian methods. This video is helping me better understand my old notes. Thank you!!

  • @Lorenzo-ri2vz
    @Lorenzo-ri2vz Před 9 dny

    What if i don't know how much the null and alternative distribution differ. Is 0.5 important? Sorry for not understanding

    • @very-normal
      @very-normal Před 9 dny

      No need to apologize! It’s usually the case that we don’t know the precise alternative hypothesis. To account for this, you usually repeat this sample size calculation for different specific alternative hypotheses. 0.5 was a specific alternative hypothesis I used, but it’s not particularly special

  • @itwasthesame1100
    @itwasthesame1100 Před 9 dny

    I am still training to prepare to apply in Very Normal Company, this video really helps

  • @postblitz
    @postblitz Před 9 dny

    This video is fairly difficult because of the maintenance of jargon. I got the sense that the Conjugate or the property of Conjugacy is when the prior distribution has the same shape as the posterior distribution i.e. the new observation doesn't change the prior distribution which means the chosen prior is stable despite the new evidence i.e. you've chosen a particular belief/set of parameters and they fit the data processed so far. I may be wrong on this but that's the gist. Arbitrarily choosing a prior distribution is still a fanciful and mysterious thing given the information of this video.

  • @qayomivlog43
    @qayomivlog43 Před 10 dny

    Thank you 1:31

  • @Impatient_Ape
    @Impatient_Ape Před 10 dny

    I hope you got a chance to go to Powell's!

  • @erinomani9105
    @erinomani9105 Před 11 dny

    Actally the economics prize is not a Nobel. It's officially the Sveriges Riksbank Prize in Economic Sciences and was not part of the will of Alfred Nobel Just so the economist could sneak their beak in. Curiously enough The Nobel Foundation threatened legal action for a proposed "Michael Nobel Energy Award" " To the Nobel Foundation the 'Dr. Michael Nobel Award' represents a clear misuse of the reputation and goodwill of the Nobel Prize and the associations of integrity and eminence that has been created over time and through the efforts of the Nobel Committees"

  • @kventinho
    @kventinho Před 11 dny

    Okay idk why but this is so cute hahahaha

  • @mohammedfarhaan9410
    @mohammedfarhaan9410 Před 13 dny

    its sort of like the way u can break down signals into sin and cos waves u can break samples into well behaved distributions

  • @mujtabaalam5907
    @mujtabaalam5907 Před 14 dny

    What does lowercase yi represent?

  • @rafaelcalderon5272
    @rafaelcalderon5272 Před 15 dny

    so good thank u for inspiring students to learn this

  • @Xylos144
    @Xylos144 Před 15 dny

    There's a cool application of this underlying principle with markov chains in that you can coordinate uncoordinated agents without having to track or communicate with them in real time. Taking your Portland Example, you would get your 100 people stationed at each activity in roughly the correct proportions by giving them a list of the other activities and the probability that they should stay put or go to each other place. They'll all shuffle around each hour, but they'll adhere closely to the target. This has applications for things like, say, a swarm of Drones spelling out a word in the sky. Sure, you could calculate a specific 3d coordinate for each specific drone and transmit that info to each of them 1 by 1 every time you want to change the word. Or you could just broadcast the 'pixel' locations you want the drones to occupy, and how densely filled each pixel is, and let them individually, randomly pick which space to occupy. Especially if you let them constantly cycle their positions, it'll do a good job with the task.

  • @sjpbrooklyn7699
    @sjpbrooklyn7699 Před 15 dny

    Thank you for a stimulating video on an important statistical method. The hand-written equation appearing on-screen from 0:10 to 0:22 and briefly captioned “Despite how it looks, this is just an average,” is a fundamental building block of thermodynamics. It was at the core of my doctoral dissertation project in polymer physical chemistry in the 1960s. A generation earlier the average geometric properties of a polymer such as its end-to-end distance or radius of gyration (average distance of component atoms from center of mass) were simulated with pencil and paper as a Brownian motion type random walk with a fixed step length representing the distance between atoms along the connected chain, often constrained to a 2- or 3-dimensional spatial lattice. Their mathematical properties were delineated by Einstein and others. However, a Brownian particle can visit the same lattice point indefinitely, while two real atoms cannot occupy the same point in space. This gave rise to the concept of the self-avoiding random walk, a much more difficult mathematical problem. The 1950s saw the proliferation of electronic computers like the Illiac, that made it possible to simulate more realistic average polymer properties with self-avoiding walks, but it was quickly found that the proportion of walks without self-intersections decreased rapidly as the chain length (no. of steps) increased. A few clever biasing techniques involving re-starting a self-intersecting walk improved things slightly but these were only minor tweaks. In the 1960s Moti Lal, a chemist at Unilever Labs in the UK, became aware of Metropolis’s paper and applied it to the polymer problem. However, his available computing power (IBM 360/50) confined his polymers to 30 monomer units on a 2-dimensional spatial lattice. As a graduate student at NYU in 1968 I had access to a Control Data Corp. CDC 6600 Cray Supercomputer at the Courant Institute of Mathematical Sciences (they let us chemists use their facilities). I used the Metropolis-Lal method to generate polymers with free rotation about their backbone bonds, i.e., not restricted to an artificial lattice. I used your hand-written equation with Boltzmann weighting exp(-E/kT) to generate average geometric and thermodynamic properties from thousands of Monte Carlo samples. The Metropolis importance sampling algorithm generated samples from more “important” regions of polymer conformation space so it took fewer samples and far less computer time to get stable averages. I could even generate numerical distributions of end-to-end distances of polymers with sufficient accuracy to discriminate among several distribution functions proposed by theoreticians.

  • @bin4ry_d3struct0r
    @bin4ry_d3struct0r Před 17 dny

    The implementational concept sounds so simple at first, but the underlying math ... 😬💀😱

  • @Gary23000
    @Gary23000 Před 17 dny

    Thank you so much for making this video! I'm getting ready to apply to some masters programs in Canada but I have a mathematical physics undergrad degree, not a statistics degree. So hearing that you also had a non-statistics degree is encouraging. By the time I apply, I'll have about 5 statistics courses under my belt and I'm hoping that is sufficient.

    • @very-normal
      @very-normal Před 17 dny

      Yeah you have more stats courses under your belt at that the time of entering the program, so it should ease you into it. Grad-level probability might be a sticking point, it was definitely the first major hurdle I ran into

  • @ResearchStatisticsCorrectly

    Wonderful presentation, definitely better than I have been able to do so far. However, (maybe its somewhere down there in the comments). Bayes did it in 1763, not '1963.'

  • @jkzero
    @jkzero Před 17 dny

    This is brilliant, as a physicist turned pseudo-statistician, the physics-motivated approach of MCMC makes more sense to me than the statistical approach. Fun story: despite bearing his name, Nicholas Metropolis didn't contribute at all to the algorithm. The concept was originally developed by physicist Marshall Rosenbluth at Los Alamos for studying thermonuclear explosions. His wife Arianna Rosenbluth (also a physicist) turned the concept into code. The Rosenbluths are the true pioneers. They struggled with a consistent way to pick an appropriate acceptance function. One day having dinner with Edward Teller and his wife Augusta Teller, they described the problem, the implementation, and the challenge. The Tellers being a couple of physicist+mathematician suggested the obvious choice for a physicist: simply use the Boltzmann distribution. And the first MCMC algorithm was born. What did Metropolis do? He had the keys of the computer lab, and the alphabetical order used for naming authors made his last name the name of the algorithm. I personally call it the Rosenbluth algorithm.

  • @mickaiba71
    @mickaiba71 Před 18 dny

    I hate/love you so much for the mid-term thing XD