Daniel Bourke
Daniel Bourke
  • 308
  • 9 906 833
A Day in the Life of a Machine Learning Engineer (at a *small* startup)
A day in the life of a machine learning engineer at a small startup from Brisbane, Australia called Nutrify.
Nutrify uses computer vision to make learning about and tracking whole foods fun.
Links from video:
Download Nutrify on the App Store - apple.co/4ahM7Wc
Nutrify website - www.nutrify.app
What we learned from year of building LLMs part II - www.oreilly.com/radar/what-we-learned-from-a-year-of-building-with-llms-part-ii/
Apple Overton System for Machine Learning - machinelearning.apple.com/research/overton
Copying Tesla’s Data Engine for Food Images - czcams.com/video/02b-1spzLzc/video.htmlsi=p7HBZ3dLaq6NGC57
My ML recommended resources - www.mrdbourke.com/ml-resources/
2020 Deep Learning PC Part List - au.pcpartpicker.com/list/8KXXjp
2024 Deep Learning PC Part List - au.pcpartpicker.com/list/xBvRdH
Other links:
Download Nutrify (my startup) - nutrify.app
Learn AI/ML (beginner-friendly course) - dbourke.link/ZTMMLcourse
Learn TensorFlow - dbourke.link/ZTMTFcourse
Learn PyTorch - dbourke.link/ZTMPyTorch
Read my novel Charlie Walks - www.charliewalks.com
Connect elsewhere:
Web - dbourke.link/web
X/Twitter - mrdbourke
Twitch - www.twitch.tv/mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter
Timestamps:
0:00 - intro
1:08 - morning session/breakfast
1:41 - reading
2:15 - data labelling
2:40 - model training
4:19 - bug fixing
4:34 - lunchtime
6:09 - afternoon session
6:51 - what we've been working on (for the day)
8:36 - ideas for the future
9:28 - Nutrify compute cluster in a closet
11:00 - Nvidia GPU speed comparison
12:00 - Nutrify's data flywheel
13:14 - end of day
14:34 - bloopers
zhlédnutí: 360 630

Video

4 MLOps Lessons Learned from Bootstrapping an AI Startup (talk)
zhlédnutí 8KPřed 3 měsíci
I gave a talk about MLOps lessoned learned from building my brother and I's startup Nutrify (a computer vision powered app to help people learn about food). The talk originally happened in the MLOps Learners Discord and was livestreamed to CZcams. I'm reposting my section here. MLOps stands for "Machine Learning Operations" and includes all of the parts around a machine learning model. For exam...
Your NVIDIA GPU can power a free ChatGPT (Chat with RTX)
zhlédnutí 12KPřed 5 měsíci
Chat with RTX is a ChatGPT-style application that uses Retrieval Augmented Generation (RAG) to allow you to chat with your own data on your own local NVIDIA GPU/PC. Links mentioned: Download Chat with RTX - www.nvidia.com/en-au/ai-on-rtx/chat-with-rtx-generative-ai/ NVIDIA RAG blog post - developer.nvidia.com/blog/rag-101-demystifying-retrieval-augmented-generation-pipelines/ My RAG tutorial (c...
Local Retrieval Augmented Generation (RAG) from Scratch (step by step tutorial)
zhlédnutí 93KPřed 5 měsíci
In this video we'll build a Retrieval Augmented Generation (RAG) pipeline to run locally from scratch. There are frameworks to do this such as LangChain and LlamaIndex, however, building from scratch means that you'll know all the parts of the puzzle. Specifically, we'll build NutriChat, a RAG pipeline that allows someone to ask questions of a 1200 page Nutrition Textbook PDF. Code on GitHub - ...
Two brothers build Shazam for food | Introducing Nutrify
zhlédnutí 10KPřed 6 měsíci
Nutrify allows you to take a photo of food and learn about it. Consider it a Pokédex for food or Shazam for food. Download Nutrify on the App Store - apple.co/4ahM7Wc Nutrify website - www.nutrify.app Nutrify Instagram - nutrifyfoodapp Questions? - support@nutrify.app Other links: Learn AI/ML (beginner-friendly course) - dbourke.link/ZTMMLcourse Learn TensorFlow - dbourke.link/ZTM...
Apple M3 Machine Learning Speed Test (M1 Pro vs M3, M3 Pro, M3 Max)
zhlédnutí 179KPřed 8 měsíci
I put the latest Apple Silicon Macs (M3, M3 Pro, M3 Max) M3 series Macs through a series of machine learning speed tests with PyTorch and TensorFlow. Code on GitHub - github.com/mrdbourke/mac-ml-speed-test Blog post write up - www.mrdbourke.com/apple-m3-machine-learning-test/ Learn ML (taught by me) - www.mrdbourke.com/ml-courses/ Links mentioned: MLX framework by Apple - github.com/ml-explore/...
5 free resources to help you get a machine learning job
zhlédnutí 60KPřed rokem
This video goes through five of my favourite resources for getting a machine learning job. Blog post version of this video (with all links) - www.mrdbourke.com/get-a-machine-learning-job Links mentioned (in order): 1. Learn in Public by Swyx - www.swyx.io/learn-in-public 2. You Don't Really Need Another MOOC by Eugene Yan - eugeneyan.com/writing/you-dont-need-another-mooc/ 3. Start the job befo...
PyTorch 2.0 is here! Quick tutorial + NVIDIA RTX 4080 giveaway
zhlédnutí 15KPřed rokem
The official version PyTorch 2.0 just launched! In this video, I break down some of the updates and how you can use them in your PyTorch code. Sign up for NVIDIA GTC March 2023 - nvda.ws/3GUZygQ Details for giveaway - www.mrdbourke.com/pytorch-2 NVIDIA GTC sessions I'm going to: Compile and train with 43% speedup using PyTorch 2.0 - dbourke.link/nvidia-gtc-2023-pytorch-2 Fireside Chat with Ilya...
the day ai went everywhere (GPT-4 & Google PaLM API release)
zhlédnutí 9KPřed rokem
GPT-4 came out today along with new generative AI APIs from Google! And I think it's the momentum step to AI being in everything. Soon every app will be an AI app. This video dAIry (dAIry = AI diary) was recorded live with no edits/takes. Just raw thoughts and ideas for future Dan to look back on and laugh. Links: • See a fantastic technical report read through from @aiexplained-official - czca...
Copying Tesla's data engine, but with food images | nutrify #1
zhlédnutí 17KPřed rokem
Nutrify is an upcoming iOS app my brother and I are building to take a photo of food and learn about it. This video is the first in a series of videos documenting how it's getting built with a focus on the machine learning component. Links: Sign up for more - forms.gle/8ye134pvgEKWJQHd6 Nutrify website - nutrify.app Nutrify GitHub - github.com/mrdbourke/nutrify Blog post with more details - www...
Machine Learning Engineer Writes a Novel (without using AI)
zhlédnutí 4,9KPřed rokem
Buy Charlie Walks: A Novel - www.charliewalks.com Other links: Learn ML (beginner-friendly courses I teach) - www.mrdbourke.com/ml-courses/ ML courses/books I recommend - www.mrdbourke.com/ml-resources/ Read my novel Charlie Walks - www.charliewalks.com Connect elsewhere: Web - dbourke.link/web Twitter - mrdbourke Twitch - www.twitch.tv/mrdbourke ArXiv channel (past streams) - dbour...
Learn PyTorch for deep learning in a day. Literally.
zhlédnutí 1,5MPřed 2 lety
Welcome to the most beginner-friendly place on the internet to learn PyTorch for deep learning. All code on GitHub - dbourke.link/pt-github Ask a question - dbourke.link/pt-github-discussions Read the course materials online - learnpytorch.io Sign up for the full course on Zero to Mastery (20 hours more video) - dbourke.link/ZTMPyTorch Below are the timestamps/outline of the video. The video yo...
Setup Mac for Machine Learning with PyTorch in 11 minutes (works for all M1, M2)
zhlédnutí 75KPřed 2 lety
Setup Mac for Machine Learning with PyTorch in 11 minutes (works for all M1, M2)
The Unofficial PyTorch Optimization Loop Song
zhlédnutí 25KPřed 2 lety
The Unofficial PyTorch Optimization Loop Song
How to learn data science with Coursera in 2022 (beginner-friendly)
zhlédnutí 134KPřed 2 lety
How to learn data science with Coursera in 2022 (beginner-friendly)
The most important article on programming you’ll ever read
zhlédnutí 13KPřed 2 lety
The most important article on programming you’ll ever read
Apple's M1 Pro and M1 Max are faster than Google Colab (machine learning speed test)
zhlédnutí 62KPřed 2 lety
Apple's M1 Pro and M1 Max are faster than Google Colab (machine learning speed test)
Setup Mac for Machine Learning with TensorFlow in 13 minutes (works for all M1, M2)
zhlédnutí 113KPřed 2 lety
Setup Mac for Machine Learning with TensorFlow in 13 minutes (works for all M1, M2)
How to code neural networks without math*
zhlédnutí 8KPřed 2 lety
How to code neural networks without math*
6 Techniques That Help Me Study Machine Learning Five Days Per Week
zhlédnutí 85KPřed 2 lety
6 Techniques That Help Me Study Machine Learning Five Days Per Week
AI makes you an artist + Tesla's self-driving car updates | Machine Learning Monthly August 2021
zhlédnutí 7KPřed 2 lety
AI makes you an artist Tesla's self-driving car updates | Machine Learning Monthly August 2021
Reading the first 42 pages of my first novel (Charlie Walks) out loud
zhlédnutí 3,9KPřed 2 lety
Reading the first 42 pages of my first novel (Charlie Walks) out loud
I didn't eat food for 3 days, here's what happened
zhlédnutí 17KPřed 3 lety
I didn't eat food for 3 days, here's what happened
Demo your ML models + learn NLP from the best (Hugging Face 🤗) | Machine Learning Monthly July 2021
zhlédnutí 15KPřed 3 lety
Demo your ML models learn NLP from the best (Hugging Face 🤗) | Machine Learning Monthly July 2021
This book will help you get a job in machine learning (ML Interviews Book) | ML Monthly June 2021
zhlédnutí 32KPřed 3 lety
This book will help you get a job in machine learning (ML Interviews Book) | ML Monthly June 2021
These TensorFlow updates are huuuuuuuuge! [Google I/O 2021] | Machine Learning Monthly May 2021
zhlédnutí 7KPřed 3 lety
These TensorFlow updates are huuuuuuuuge! [Google I/O 2021] | Machine Learning Monthly May 2021
How the World's Biggest Companies Design Machine Learning Applications | ML Monthly April 2021
zhlédnutí 13KPřed 3 lety
How the World's Biggest Companies Design Machine Learning Applications | ML Monthly April 2021
ResNets are back baby!!! ...and they're gone | Machine Learning Monthly March 2021
zhlédnutí 7KPřed 3 lety
ResNets are back baby!!! ...and they're gone | Machine Learning Monthly March 2021
Learn TensorFlow and Deep Learning fundamentals with Python (code-first introduction) Part 2/2
zhlédnutí 476KPřed 3 lety
Learn TensorFlow and Deep Learning fundamentals with Python (code-first introduction) Part 2/2
Learn TensorFlow and Deep Learning fundamentals with Python (code-first introduction) Part 1/2
zhlédnutí 829KPřed 3 lety
Learn TensorFlow and Deep Learning fundamentals with Python (code-first introduction) Part 1/2

Komentáře

  • @AlMuhimen
    @AlMuhimen Před 54 minutami

    Shoul i buy air m3 8/256 or windows i7 gpu gtx 4050 for Artificial intelligence??

  • @KevinCherif-lq6vw
    @KevinCherif-lq6vw Před 5 hodinami

    hey man I hate that kind of videos but yours are something else and I really love it but I am really struggling with the setup I keep using google Collab for not being able to use local vs or jupyter so can you please help me thanks

  • @Hackcastq
    @Hackcastq Před 15 hodinami

    Hi, really very detailed and useful roadmap, should we learn tensorflow in part 3 and then learn python in part 5, am I misunderstanding?

  • @christobongende893
    @christobongende893 Před 22 hodinami

    thanks for your video, it gave le an overview of the field, and make me more confident about where to look for and work on that

  • @afkhoso
    @afkhoso Před 23 hodinami

    This video was helpful to me as an mle myself. Nice to see your models training in real time. Cool stuff. I need to brush up, but hire me in six months 😊

  • @Exiide89
    @Exiide89 Před dnem

    I would be hungry all the time just by looking at all those pics. 😂😂😂😂

  • @mahaalabduljalil6596

    Thaaaaank you ! worked beautifully with my M2 macbook air

  • @mathlounge7432
    @mathlounge7432 Před dnem

    Man you are a life saver , thank you for your effort, time and your generosity. I hope you find peace in your life and even afterlife❤❤❤

  • @damarss7504
    @damarss7504 Před dnem

    sir i wanna ask something, did tensorflow and python still useable for machine learning?? or in 2024 there is more popular programming language or library better than 2 of it?? im still new in this programing world and i wanna be a machine learning engineer like you

  • @TheRajdeo
    @TheRajdeo Před 2 dny

    Hi Daniel transformer attention you you need. Please please

  • @RakshithML-vo1tr
    @RakshithML-vo1tr Před 2 dny

    Should i follow this course so how different is it from your udemy course can you just describe???

  • @pro_moe
    @pro_moe Před 2 dny

    When I try to upload a pdf chat with rtx cannot find it. The file is in .pdf. Any tips to get this working?

  • @dav-ops
    @dav-ops Před 3 dny

    As a future ml engineer I find this video inspiring 😌

  • @m_codes
    @m_codes Před 3 dny

    Bought Nvidia RTX 4070 Ti Super.This video was very helpful.

  • @טלזמיר
    @טלזמיר Před 4 dny

    The best tutorial I have ever watched! So enspiring!

  • @farazsyed.2898
    @farazsyed.2898 Před 4 dny

    hey Daniel, can you make a video on steps required for making an end to end research project in machine learning / AI with some real life examples!!

  • @jifengzhang3863
    @jifengzhang3863 Před 4 dny

    when try to practice through lines of code, Colab always wanted to help me auto-complete the lines prompting exactly the same content Daniel was typing in the video. I guess that is bcs too many people had learned your tut, thank you Daniel.

  • @umangpatel5704
    @umangpatel5704 Před 5 dny

    gday, mate good to see you, thanks for this from fellow brissy #mrdbourke

  • @amitsingha1637
    @amitsingha1637 Před 5 dny

    Superb (Recommended)

  • @imadudin2489
    @imadudin2489 Před 5 dny

    I am majoring in chemical engineering and now stepping into learn machine learning. Thank you for the video..!!!!

  • @ceaselessvibing5997

    Dont usually leave comments but... My mate sent me this early this year, only now 2 weeks straight about 4hrs a day I've come on top and want to treat myself to a snack before i pickup where i left off on the online materials 05-09

  • @RSingh-t6f
    @RSingh-t6f Před 5 dny

    Transformer attention all you need please

  • @RSingh-t6f
    @RSingh-t6f Před 5 dny

    Hi Daniel could you please code transformer attention all you need same way as you doing for PyTorch please please please

  • @RSingh-t6f
    @RSingh-t6f Před 5 dny

    Hi could you please code transformer self attention or multihead attention.

  • @user-cq4zk8mw6r
    @user-cq4zk8mw6r Před 6 dny

    Hello Hello man, welcome to you.

  • @amanPatel-mw7ly
    @amanPatel-mw7ly Před 6 dny

    get this error, import tensorflow as tf Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/Users/aman/LLM/env/lib/python3.8/site-packages/tensorflow/__init__.py", line 439, in <module> _ll.load_library(_plugin_dir) File "/Users/aman/LLM/env/lib/python3.8/site-packages/tensorflow/python/framework/load_library.py", line 151, in load_library py_tf.TF_LoadLibrary(lib) tensorflow.python.framework.errors_impl.NotFoundError: dlopen(/Users/aman/LLM/env/lib/python3.8/site-packages/tensorflow-plugins/libmetal_plugin.dylib, 0x0006): Symbol not found: _OBJC_CLASS_$_MPSGraphRandomOpDescriptor Referenced from: /Users/aman/LLM/env/lib/python3.8/site-packages/tensorflow-plugins/libmetal_plugin.dylib Expected in: /System/Library/Frameworks/MetalPerformanceShadersGraph.framework/Versions/A/MetalPerformanceShadersGraph

  • @RSingh-t6f
    @RSingh-t6f Před 6 dny

    Hello Daniel, really great video on PyTorch, thanks for sharing , if you have any video or toturials on text/nlp it would be great. Looking forward to to watch.

  • @Vishal-go2mo
    @Vishal-go2mo Před 7 dny

    when the android version is rolling up

  • @yahard42
    @yahard42 Před 8 dny

    as a former music producer/musician I was looking for inspiration for coding cause i'm currently learning it. this video is awesome in this aspect. it feels like if you maintain the vibe, the curiosity and all the progress is a really exciting way of living

  • @lovedietfood
    @lovedietfood Před 8 dny

    29:11

  • @lovedietfood
    @lovedietfood Před 8 dny

    22:03

  • @EatDrinkCook
    @EatDrinkCook Před 8 dny

    1:33:58 You missunderstood what tensor is. 3-dimensional tensor is several matrixes in 3D space, but you have written only 1 matrix, that's why TENSOR[0] shows you this first matrix, but other two are absent. You had to write something like this for better explanation: Tensor = torch.tensor([[[1,2,3], [4,5,6], [7,8,9]], [[3,2,1], [6,5,4], [9,8,7]], [[1,1,1], [2,2,2], [3,3,3]]])

  • @lovedietfood
    @lovedietfood Před 8 dny

    17:02

  • @lovedietfood
    @lovedietfood Před 8 dny

    5:19❤😂❤❤❤😂

  • @junaidjaved5109
    @junaidjaved5109 Před 8 dny

    Hi Daniel, I am quite new to AI. I am trying to sign up to hugging face but am getting 418 error on signup. I found a reddit thread too related to that error on signup but without any solutions to that question posted. Is there any other way around to do so? I am trying to use Gemma-2b-it.

  • @dmitriykoltunov4261

    Getting a weird feeling your teammates are not that enthusiastic. They don't seem to believe in whatever you decided to start.

  • @shingshing825
    @shingshing825 Před 9 dny

    Hi Daniel in PymuPDF I get an error failed to open file when i do fitz.open(pdf_path) thought it was originally because of the for-loop any idea what could be causing it. code=7 no objects found. (Great content either way)

    • @shingshing825
      @shingshing825 Před 9 dny

      So if you use the requests to download it the file somehow became corrupt

  • @darshankd10
    @darshankd10 Před 9 dny

    Ohh! the style of teaching . Daniel you are the best tutor for ML

  • @SilentAI69
    @SilentAI69 Před 9 dny

    This is Banger Even After 2yrs 😀

  • @disveildev
    @disveildev Před 9 dny

    Any tips on getting large datasets??

  • @disveildev
    @disveildev Před 9 dny

    the most tedious task is annotations!!!!

  • @Dominicmagana11
    @Dominicmagana11 Před 10 dny

    I know nothing about this im not sure this even popped up had it playing in the background 😂 good video man

  • @WillFlores1
    @WillFlores1 Před 10 dny

    you’re the casey neistat of tech

  • @fluffsquirrel
    @fluffsquirrel Před 10 dny

    40:00 Man, sorry to hear about the accident. Hope the guy got/gets caught since this.

  • @adml003
    @adml003 Před 10 dny

    5:08:16 reshaping X tensor was required. its strange the your worked but mine did not without reshaping. again may be because of the version difference. right now mine is 2.17 and yours was 2.2 i guess @mrdbourke

  • @adml003
    @adml003 Před 10 dny

    @mrdbourke there seems to be an update in tensorflow i guess. the model.predict() function is not accepting a python list as the input refer to 4:47:14 i spent around half an hour figuring out whats wrong with my code then chatgpt came to my rescue. it said, the input has to be a tensor or a numpy array. if you receive this comment then please care to clarify this doubt. BTW great content. i am already halfway done for this tutorial.

  • @andresuchitra
    @andresuchitra Před 10 dny

    Thank you Daniel, a thorough research for ML engineers. This research is worth a conference session 💪

  • @joeshef
    @joeshef Před 10 dny

    Sick idea. Good on you for seeing this vision and keeping at it.

  • @samyogdhital
    @samyogdhital Před 10 dny

    When is new video coming?

  • @Prav_verma
    @Prav_verma Před 10 dny

    How can i join your startup bro i am a front end developer