I absolutely love the way you present your tutorials, in a non-nonsense manner - providing all the salient points without unnecessary info! A fantastic style and very impactful/memorable - thanks and keep it up!
The timing of this video is perfect! I was starting to consider parallelizing my code at work, but wasn't sure where to start. Now I can get started *and* not get bitten by a data-race right away 😌 Thanks! 🙏
Very nice video. One of the best tutorials in parallel computing. This is the video that I was looking for. I really appreciate your tutorial. Many many thanks .🙇♂ Moreover to compare the timing of parallel programme, I used the "Happy-birthday" problem as in the youtube video "Parallel Computing on Your Own Machine", where I used the threading inside "birthday_distribution()" function. This, I add just to help the people who is new to parallel programming.
Thanks for the kind word! For anyone interested in watching "Parallel Computing on Your Own Machine", here a link to Prof. Edelman's video: czcams.com/video/dczkYlOM2sg/video.html
For those of you wondering why the speedup of the parallel sum was so little (despite the high number of inputs) - this is due to false sharing. This happens when you have threads frequently reading and writing to adjacent elements of memory (like in an array) as it can cause performance issues due to cache invalidation.
BTW: On my computer the multithreaded abxy-function was slightly faster (about 5%) than the builtin BLAS-function, when using the @inbounds-macro (on a M1-Pro processor).
I have 3 videos on GPGPU using CUDA.jl (06x10, 06x11 & 06x12): [06x10] czcams.com/video/VpbMiCG2Tz0/video.html [06x11] czcams.com/video/YwHGnHI5UxA/video.html [06x12] czcams.com/video/4PmcxUKSRww/video.html
Thank you for the great video! Could you please cover the package Distributed as well in the future? Personally, I think multi-processing is much more interesting than multi-threads. I used 6 to 10 threads to solve 4 similar optimization problems with Ipopt. The speedup from multi-threading is only about 20%. In contrast, using 4 cores with the package Distributed, it becomes almost 3 times faster.
You must be a mind-reader! The next video will be on Multi-Processing. It's available now for channel members, but it will be released to the public tomorrow (Sunday, February 12th). That's interesting to hear about your experience. Thanks for sharing!
In VS Code Settings, search for "Julia Execution Result Type". There's a drop-down menu where you can choose to view the results, either in the REPL, inline or both. I'm using "both" as my option. After selecting an option, place your cursor at the end of the line of code and then hit Shift+Enter to execute that line. Hope that helps!
I've been watching needle felting and embroidery videos, so when I got this one recommended I thought it was also some DIY craft, especially because of the thumbnail. Turns out it really is not lmao
![[08x04] Intro to Julia Multi-Processing (It's not the same as Multi-Threading!)](http://i.ytimg.com/vi/uKdpY6Je6Oc/mqdefault.jpg)
![[08x04] Intro to Julia Multi-Processing (It's not the same as Multi-Threading!)](/img/tr.png)
![[08x02] Julia Performance Tips and Tools | How to use @time, @profile, @profview, @profview_allocs](http://i.ytimg.com/vi/gzvn-hdlkUg/mqdefault.jpg)
I absolutely love the way you present your tutorials, in a non-nonsense manner - providing all the salient points without unnecessary info! A fantastic style and very impactful/memorable - thanks and keep it up!
Thanks for the kind words and thanks for watching!
With your channel i leanned almost all i needed to know to get starded on julia. You will be on the greetings of my master thesis
That's amazing! I'm honored!
I love your videos! I always recommend them to my friends in the JuliaBrasil group.
I'm very grateful! Much love to JuliaBrasil!
I know it was just meant to be a toy example but for simple reductions like summing a bunch of elements foldxt from the Transducers library is great.
The timing of this video is perfect! I was starting to consider parallelizing my code at work, but wasn't sure where to start.
Now I can get started *and* not get bitten by a data-race right away 😌
Thanks! 🙏
Cool! Good luck!
Very nice video. One of the best tutorials in parallel computing. This is the video that I was looking for. I really appreciate your tutorial. Many many thanks .🙇♂
Moreover to compare the timing of parallel programme, I used the "Happy-birthday" problem as in the youtube video "Parallel Computing on Your Own Machine", where I used the threading inside "birthday_distribution()" function. This, I add just to help the people who is new to parallel programming.
Thanks for the kind word! For anyone interested in watching "Parallel Computing on Your Own Machine", here a link to Prof. Edelman's video: czcams.com/video/dczkYlOM2sg/video.html
Dude I am soooo glad I found your channel! Your way of teaching is entertaining and informative!
Welcome to the channel! Enjoy exploring the content!
Great tutorial! Very well explained 👍
Thanks!
This is a great video. Thank you for making it!
You're welcome!
I was able to understand about threads and how to use them
Thank you
You're welcome!
For those of you wondering why the speedup of the parallel sum was so little (despite the high number of inputs) - this is due to false sharing. This happens when you have threads frequently reading and writing to adjacent elements of memory (like in an array) as it can cause performance issues due to cache invalidation.
Thanks!
Thank YOU! I really appreciate it!
Really nice video
Thank you! And thanks for being a channel member!
BTW: On my computer the multithreaded abxy-function was slightly faster (about 5%) than the builtin BLAS-function, when using the @inbounds-macro (on a M1-Pro processor).
Very interesting. Thanks for sharing your results!
Great video!! Do/Will you have a tutorial on GPU computing or heterogeneous (CPU+GPU) computing?
I have 3 videos on GPGPU using CUDA.jl (06x10, 06x11 & 06x12): [06x10] czcams.com/video/VpbMiCG2Tz0/video.html [06x11] czcams.com/video/YwHGnHI5UxA/video.html [06x12] czcams.com/video/4PmcxUKSRww/video.html
Thank you for the great video! Could you please cover the package Distributed as well in the future? Personally, I think multi-processing is much more interesting than multi-threads. I used 6 to 10 threads to solve 4 similar optimization problems with Ipopt. The speedup from multi-threading is only about 20%. In contrast, using 4 cores with the package Distributed, it becomes almost 3 times faster.
You must be a mind-reader! The next video will be on Multi-Processing. It's available now for channel members, but it will be released to the public tomorrow (Sunday, February 12th). That's interesting to hear about your experience. Thanks for sharing!
@@doggodotjl That is great! Looking forwards to the video
my right ear enjoyed this video
10:25 How do you get julia output directly in the vscode editor? Sorry I haven't been following your videos for quite some time.
In VS Code Settings, search for "Julia Execution Result Type". There's a drop-down menu where you can choose to view the results, either in the REPL, inline or both. I'm using "both" as my option. After selecting an option, place your cursor at the end of the line of code and then hit Shift+Enter to execute that line. Hope that helps!
Much cores with this one
LOL! Ah, the classic Doge meme...
what irritates me is to run both serial and parallel at least 3 time, then running it again at least 3 more times to be able to compare it fairly
On the first run Julia compiles the code. So this run takes usually longer.
I've been watching needle felting and embroidery videos, so when I got this one recommended I thought it was also some DIY craft, especially because of the thumbnail. Turns out it really is not lmao
lol! The CZcams algorithm strikes again!
Thanks!
Thank YOU!