End To End Machine Learning Project Implementation With Dockers,Github Actions And Deployment

Sdílet
Vložit
  • čas přidán 20. 07. 2024
  • guthub code link:github.com/krishnaik06/boston...
    Visit krishnaik.in for data science blogs
    In this video we will be implementing an end to end ML project implementation with Dockers And Github Action
    Time stamps:
    Understanding the dataset 00:00:00
    Preparing Dataset And Basic Analysis 00:08:14
    Preparing Dataset For Model Training 00:22:10
    Training The Model 00:36:54
    Performance Metrics 00:52:41
    Prediction Of New Data 00:55:33
    Pickling the model file 00:59:45
    Setting Up Github And VS Code 01:04:40
    Tools And Software Required 01:12:00
    Creating A New Environment 01:18:35
    Setting up Git 01:26:07
    Creating A FLASK Web Application 01:39:04
    Running An Testing our application 01:53:14
    Prediction From Front End Application 02:01:08
    Procfile for Heroku Deployment 02:11:35
    Deploying The App To Heroku 02:16:39
    Deploying The App Using Dockers 02:23:20
    -------------------------------------------------------------------------------------------------------------
    All Playlist in my channel
    Github Tutorials : • Part 1-Git And Github ...
    Live NLP Playlist: • Announcing NLP Live co...
    Live Deep LEarning Playlist: • 5 Days Live Deep Learn...
    Live EDA Playlist: • Prerequisites To Atten...
    Live ML Playlist: • Announcing 7 Days Live...
    Live Stats Playlist: • Live Day 1- Introducti...
    My SQL Playlist: • Tutorial 1- MySQL With...
    ---------------------------------------------------------------------------------------------------------------
    Please donate if you want to support the channel through GPay UPID,
    Gpay: krishnaik06@okicici
    Telegram link: t.me/joinchat/N77M7xRvYUd403D...
    -------------------------------------------------------------------------------------------------------------
    Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more
    / @krishnaik06
    -----------------------------------------------------------------------------------------------------------
    Please do subscribe my other channel too
    / @krishnaikhindi
    ---------------------------------------------------------------------------------------------------------
    Connect with me here:
    Twitter: / krishnaik06
    Facebook: / krishnaik06
    instagram: / krishnaik06

Komentáře • 247

  • @manelaloui7069
    @manelaloui7069 Před rokem +8

    Hi from Tunisia, I love this tuto so much, In the same time I was coding with you not just watching the video and I understand a lot of things, and I got my projects deployed , thank you so much I hope there will be a lot of similar projects in the future.

  • @bradfordmutemi8041
    @bradfordmutemi8041 Před rokem +1

    Your tutorials are great! Thanks to you I am transitioning seamlessly. So happy that I can do something I actually love doing!

  • @sajjadhussain-tx4if
    @sajjadhussain-tx4if Před rokem +5

    I LOVE YOU, Man. You are a superstar. I am a Ph.D. researcher who has developed many ML models that just remained on Notebooks. Now, I will be deploying all these models. Hats off.

  • @ObhiReads
    @ObhiReads Před rokem

    Excellent E2E video. Would love to see more of these sessions.Thanks a ton!

  • @mohitkumar2531
    @mohitkumar2531 Před rokem

    Apart from the api and flask app building everything was super easy. Thanku @krish for the amazing video

  • @amarchanotiya5558
    @amarchanotiya5558 Před rokem +2

    Thank you so much Sir for always providing content of high value. I wish there could be an option to like again every time one visits the video, I guess most of us would like to like these videos again and again. 😁🙏

  • @adityadeepak98
    @adityadeepak98 Před rokem

    I was actually expecting to get this notification of an end-to-end ML project from you. Thanks, Krish.

  • @ayeshavlogsfun
    @ayeshavlogsfun Před rokem +4

    Thanks a Lot.....
    Your explanation is just waoo
    Please continue this series for other Algorithms of ML and possibly to advance projects . 🙏

  • @utkarshashinde9167
    @utkarshashinde9167 Před rokem

    Thanks a lot from bottom of my heart , I cant express how happy I am to implement this end to end project in my early stage of career , Have tried many tutorials and have git heaps and heaps of error due to which i quit for moment
    But as u said Error is part of process ....
    Duely Noted and Once Again Thanks....

  • @ntsikeleloyalezo1524
    @ntsikeleloyalezo1524 Před 10 měsíci

    One of the greatest videos I ever watched on the internet. Continue to do the great work man

  • @ananthalakshmi2109
    @ananthalakshmi2109 Před rokem +1

    Very nice and helpful video sir, for data science learners. Kudos to your service and knowledge.

  • @mattjoe182
    @mattjoe182 Před rokem

    Thanks Krish - I learned so much about deployment from this video!

  • @webtechbysuraj5942
    @webtechbysuraj5942 Před rokem +4

    dear sir, it was a nice project with lot of learnings, i would like to request you for few more projects on different algorithms. thank you so much!!

  • @Xnshau
    @Xnshau Před rokem

    Brilliant sir.... Never seen such a detailed and exceptional tutorial

  • @out-of-sight
    @out-of-sight Před rokem

    This content is really good. I will be waiting for videos like this. Thank you.

  • @balakrishnay07
    @balakrishnay07 Před 5 měsíci

    This video was very useful and informative for me. I learned a lot of new things from it. I appreciate your effort and time that went into making this video. Thank you Krish for sharing your knowledge and experience with us. I look forward to watching more of your videos.

  • @anandhuded3647
    @anandhuded3647 Před rokem

    Amazing Sir. Thanks alot for providing the knowledge.

  • @nshettys
    @nshettys Před 11 měsíci

    It was very insightful! Thanks a lot Krish for your brilliant explanation

  • @ckpratibha9956
    @ckpratibha9956 Před 2 měsíci

    You're great Krish, thank you soo much for helping us🙏🙏🙏

  • @abhisekdatta8887
    @abhisekdatta8887 Před rokem

    One of the best video in youtube right now

  • @michelchaghoury9629
    @michelchaghoury9629 Před rokem

    Please we need more of these king of projects

  • @studywithme5296
    @studywithme5296 Před 2 měsíci

    Thank you so much Krish for these amazing tutorials

  • @najiibrashiidabdi5014

    Thank You Very Much krish naik for you hard work🥰

  • @codewitharya
    @codewitharya Před rokem +1

    Thank you Sir for the awesome video. Kindly upload CI/CD pipeline with AWS instance.

  • @vijaymitta6608
    @vijaymitta6608 Před rokem

    Great job sir, I attended Yadav avnish class but very confused, but somehow now I am clear

  • @gargibhattdance7956
    @gargibhattdance7956 Před rokem +3

    Happy Teacher's Day Sir, I am So glad that I am learning from you. You are such a gem for Data Science industry. I wish you all the Happiness 😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊

  • @kirankoshy209
    @kirankoshy209 Před rokem

    Thank you so much for your enlightening and helpful videos. Can you explain how to write code in modular fashion?

  • @sandipdeb6550
    @sandipdeb6550 Před rokem

    Really well explained and it is helping me to learn in better way

  • @devanshumishra6430
    @devanshumishra6430 Před rokem

    A Very Informative Content Thank You Sir.👍

  • @johnhillescobar
    @johnhillescobar Před rokem +1

    I finally completed the video! I had a blast at following along. I already have some ideas to work with on this! Yay! Will follow you other one of 4 hours long.

    • @sarangshasen7295
      @sarangshasen7295 Před rokem

      what is the alternative of boston_load? I'm getting an error

    • @johnhillescobar
      @johnhillescobar Před rokem

      @@sarangshasen7295 I just looked for the csv file and used it instead. I gave it a similar shape when compared to how data was modeled for his video

    • @johnhillescobar
      @johnhillescobar Před rokem

      @@sarangshasen7295 you'll find csv files of this data set in the internet.

    • @sarangshasen7295
      @sarangshasen7295 Před rokem

      @@johnhillescobar did you change any commands further in the code?

    • @johnhillescobar
      @johnhillescobar Před rokem

      @@sarangshasen7295 not really. I just downloaded the csv file from the internet and split the dataset into target and data

  • @randyluong6275
    @randyluong6275 Před rokem

    Thank you from 2020 to 2022 forward ^^

  • @vipulpatil7687
    @vipulpatil7687 Před rokem +3

    Amazing sir, you just made it look so easy ;thanks alot

    • @ganesh.mane18
      @ganesh.mane18 Před rokem

      Can I select it as my final year project for diploma ??

  • @AdityaVarma-og3tu
    @AdityaVarma-og3tu Před rokem +16

    You might face error at 1:57:23 in sending request as (error message: Unknown key value pair -X does not have valid feature names, but StandardScaler was fitted with feature names)
    To overcome above error :
    In ipynb file train test split type --> X_train,X_test,y_train,y_test=train_test_split(X.values,y,test_size=0.3,random_state=42)
    instead of X_train,X_test,y_train,y_test=train_test_split(X.,y,test_size=0.3,random_state=42)
    Issue is resolved

    • @joaothomazlemos13
      @joaothomazlemos13 Před rokem +2

      I just ignored the warning, as when training data pass the data to the scaler, is has the features names, but form the scaler to the model it Is just a numpy matrix, no feature names preserved. At least was that my experience.

    • @Lily-up5nh
      @Lily-up5nh Před 2 měsíci

      I am facing an error in postman app. On clicking send, I am getting an error "TypeError: 'dict' object is not callable. Can you help me

  • @francksaounde5598
    @francksaounde5598 Před rokem

    Thank you for this amazing video

  • @aditya169
    @aditya169 Před rokem

    Very descriptive sir...👍👍👍 Respect

  • @gossichan6364
    @gossichan6364 Před rokem

    Hi Krish..Great Video.. Have learnt lots of things today..

  • @Anurag-st7wl
    @Anurag-st7wl Před rokem +1

    Very lucidly explained💯

  • @Pearlymathew2127
    @Pearlymathew2127 Před rokem

    Sir you are awesome , I love your videos thank you

  • @ratnak1058
    @ratnak1058 Před rokem

    Amazing session thank you sir

  • @suvraneelsaha8973
    @suvraneelsaha8973 Před rokem +5

    Did the Whole Project except the dockers and cicd portion , man Thank you soo much .
    Spent 5 days Learning the topics and minute details , tbh
    I am a Beginner i dont know much , but going through the course and solving many many errors made me learn a thing or two .
    Learnt about Regression Model , Performance Metrics , EDA , Deployment , Python Environment and alot of other things .
    For now
    Continuing on this path with full focus and learning everything in between .
    PS : For anyone who is doing a project for the first time , you will face a lot of problems even if you copy paste ,
    better to know What you are doing rather than just Blindly copying
    and once again Thank you

    • @qammaruzzamman9621
      @qammaruzzamman9621 Před 9 měsíci

      how did you get the boston dataset?

    • @suvraneelsaha7857
      @suvraneelsaha7857 Před 8 měsíci

      Hey Mate , I actually im not into ml and data science , now , But to answer your question you may just search Boston dataset , You will get it @@qammaruzzamman9621

  • @qaimraza3598
    @qaimraza3598 Před rokem

    best end to end implementation.

  • @arantosanchez7966
    @arantosanchez7966 Před rokem

    thanks. immensely helpful.

  • @AmericanChauhan
    @AmericanChauhan Před rokem

    Thank you sir for this video

  • @satishkumar-ci7rr
    @satishkumar-ci7rr Před rokem

    you are amazing krish.

  • @ARIHANTKUMARJAIN-di3ge
    @ARIHANTKUMARJAIN-di3ge Před měsícem

    I don't comment on videos but this one is just amazing like yesterday I was very confused after learning ML and DL by Coursera what next and after watching this now i m feeling very confident

  • @kundankumarroy8352
    @kundankumarroy8352 Před rokem

    Amazing tutorial man.

  • @talibdaryabi9434
    @talibdaryabi9434 Před rokem

    Thank you so much, I learned alot about deployment process.

    • @ganesh.mane18
      @ganesh.mane18 Před rokem

      Can I select it as Final Year project for Diploma ??

  • @niorpa653
    @niorpa653 Před rokem

    Cloud you please add more Cron Job process to schedule training model? e.g. the data is updated monthly so we use Cron Job to train model every month.

  • @susanca8443
    @susanca8443 Před 11 měsíci

    I have clicked 'like' and also shared. You are a very good teacher. Do you also have any research papers in researchgate?

  • @umeshsamal165
    @umeshsamal165 Před rokem

    Really Awesome

  • @rakeshkumarsharma2250

    Man this is awesome man , I learned a lot from this ,want to learn more of eCommerce site project in ML ,any suggestions ??

  • @theanonymous92
    @theanonymous92 Před 11 měsíci

    That's what we call an actual end to end project ❤🎉🎉 thanku for this ...

  • @aarizmobin4487
    @aarizmobin4487 Před rokem +1

    Superb krishh

  • @DhirajPatra
    @DhirajPatra Před rokem

    Nice thanks for your effort

  • @raj-nq8ke
    @raj-nq8ke Před rokem

    Everytime I think of learning new tech Krish comes up with project on that tech. Talk about being lucky 🤣

  • @mmnsmhshwr6170
    @mmnsmhshwr6170 Před rokem

    This is wholesome😍

  • @gudiatoka
    @gudiatoka Před rokem

    54:58 my r square score is 66%. look like bad ..is not it? should i remove outliners that affect the accuracy score

  • @shivangigaureichandra2136
    @shivangigaureichandra2136 Před 6 měsíci

    Hi, what should be the pre-requisites for this amazing video

  • @shubhamkamble8875
    @shubhamkamble8875 Před rokem

    Thank you sir

  • @harish00784
    @harish00784 Před rokem

    Expecting this one

  • @abdoulazizmahamadouhamidou2244

    NIce video.
    I want to follow the same steps but deploy on AWS and access the flask app from a streamlit dashboard.
    How can i achieve that?

  • @prabhashmishra5602
    @prabhashmishra5602 Před rokem

    just amazin sir

  • @abhishekgalagali5968
    @abhishekgalagali5968 Před rokem

    Thank you sir!! This tutorial is very helpful. I have been following along and getting many things cleared. Anybody completed till Heroku deployment. I am not able to add my credit card otherwise it won't let me create app

  • @P_pareek
    @P_pareek Před rokem +1

    Sir on pip install -r requirements.txt it shows error no such directory file what should i do for that sir?

  • @bharathbn9225
    @bharathbn9225 Před rokem

    sir.....Thank you 3000

  • @Mskirrrr
    @Mskirrrr Před 9 měsíci

    Hi Krish,
    can you explain why you choose Linear regression model while it it has so many independentndent feature which can be multi class regression model can be used?

  • @_ShrutiRawat
    @_ShrutiRawat Před rokem

    Sir I'm from ML/DL batch it's my request to create more end to end project based on KNN algo following the MLOPS Pipeline the way you teach in ineuron live lecture

  • @yashnilla6516
    @yashnilla6516 Před rokem

    data1=np.array(data1).reshape(1,-1)
    Even after applying the reshape in predict api , i am getting the error as
    Found array with 0 feature(s) (shape=(1, 0)) while a minimum of 1 is required by StandardScaler
    please see this
    what i have to do ?

  • @sumeetkumarsingh9377
    @sumeetkumarsingh9377 Před rokem +1

    "ImportError: The crypt module is not supported on Windows"
    I am getting this error while running the flask file app.py. Anyone know how to fix it.

  • @kaustubhgupta12
    @kaustubhgupta12 Před rokem +31

    Sad to share that Heroku is stopping the free dynos, after November, this video Heroku deployment will be obsolete :(

  • @rising_star_2712
    @rising_star_2712 Před rokem

    I am having one doubt , my regression coefficients are being displayed in the form of an 2d array whereas urs are displayed in 1d form , what is the mistake I did can u tell me ?

  • @shahabasmuhammed7523
    @shahabasmuhammed7523 Před rokem

    As we are randomly spliting tarin and test data, the regression and correlation value will differ right. So , if we a calculation r2_score and it shows -2.0215 can we say that my calculations are wrong with respect to yours sir ?

  • @tom-shellby
    @tom-shellby Před rokem

    Finally, after 2 days, I was able to do it by myself !! itni khushi 😂😂

  • @subhajitdutta9983
    @subhajitdutta9983 Před rokem

    Can you please help us to know what will be the substitute of Heroku? Because as you know that after 28th November we won't be able to deploy our applications over Heroku for free. Please suggest us some alternatives and if possible please make a video on this topic

  • @convolutionalnn2582
    @convolutionalnn2582 Před rokem +1

    Can you make roadmap for computer vision?

  • @kidsandtoys2940
    @kidsandtoys2940 Před rokem

    Nice video sir

  • @user-eg6ou5cy2f
    @user-eg6ou5cy2f Před 9 měsíci

    Wow❤

  • @satyanarayanadty2798
    @satyanarayanadty2798 Před rokem +1

    Thank you Krish for this amazing course. Can we get the JSON data that you passed in postman. Where can we get that?

    • @mainakdey3893
      @mainakdey3893 Před rokem

      create one , its easy thing

    • @Lovely_Pihu
      @Lovely_Pihu Před rokem

      You can create JSON data by taking reference from x_train or x_test & just validate your JSON data by any json validator.

  • @dikshantgupta5539
    @dikshantgupta5539 Před rokem +1

    Can you please continue the NLP playlist please

  • @Spideykegyn
    @Spideykegyn Před 3 měsíci

    hey, when i click on create app then It is asking for adding a credit card for verification for deployment on heroku? what to do?

  • @tanushreemistry8149
    @tanushreemistry8149 Před 11 měsíci

    can some one please suggest from where to get the main.yaml content shown in this video

  • @IN-fg7ly
    @IN-fg7ly Před rokem +1

    when reading the dataset: "FutureWarning: Function load_boston is deprecated; `load_boston` is deprecated in 1.0 and will be removed in 1.2"

  • @adityakishan589
    @adityakishan589 Před rokem

    Let's say you are building a neural network to predict whether the cancer is stage 1, stage 2 and stage 3?
    You are given 5 input features and the model that you have built is a fully-connected feedforward network having 2 hidden layer with 4 neurons each. The output layer uses softmax activation function.
    How many parameters needed in the output layer (second hidden layer to output layer) ?
    options: 12,15,16,20
    Can anyone help out with explanation?

  • @Quest_adventure
    @Quest_adventure Před rokem

    When and how he created that linear regression file??? can anyone tell me....

  • @luismisanmartin98
    @luismisanmartin98 Před 4 měsíci

    27:37 "Usually when we have this kind of features that are hardly correlated, it _reduces the error_ of the regression model".
    You meant that it reduces the accuracy (or increases the error) of the model, right?

  • @user-jo5jm2nv5v
    @user-jo5jm2nv5v Před 11 měsíci

    How to move from base to deployment environmentl in command prompt

  • @aishwaryapattnaik3082

    I am getting this error 'import could not be resolved pylance report missing imports'. I have installed requirements.txt, and even after that stuck in here. Can someone help me please

  • @akshita6478
    @akshita6478 Před 8 měsíci

    Getting error in the postman part. Although I followed all the steps accurately, still getting errors? What could the reason be? Please help

  • @maneeshmm8105
    @maneeshmm8105 Před rokem

    😍👍

  • @ravencode5505
    @ravencode5505 Před rokem +2

    Heroku is now paid, which is the best alternative?

  • @sanjuladissanayake5295
    @sanjuladissanayake5295 Před 4 měsíci

  • @abdelghafourelgharbaoui3886

    Thank you for this rich project, the best thing I can thank you with, is telling you that you and the dear followers need to learn the message of ISLAM, hope you all the best (there is a big Indian scholar named Zakir Naik you can listen to)

  • @TarunKumar-vx3dm
    @TarunKumar-vx3dm Před rokem

    Sir please help me out to create virtual env because iam facing erro that conda is not recognised internal or external package iam unable to solve this please make a video on this so begginers like me can understand that

  • @Deep_photographer
    @Deep_photographer Před rokem

    I have downloaded git cli and installed but clone file not been generated please help sir

  • @ashwinidahiphale1924
    @ashwinidahiphale1924 Před 9 měsíci

    Can anyone tell me the alternative of heroku for this project

  • @sambitsubhasishsahu3696

    Kindly Make a video on - End To End Machine Learning Project Implementation With Azure, Dockers, Github Actions And Deployment, please

  • @savitak1169
    @savitak1169 Před rokem

    I have done in same method and i am getting different coefficients and c value

  • @user-xt7zx8wk6c
    @user-xt7zx8wk6c Před 9 měsíci

    Hi sir, When I tried to load this dataset, there is a warning thats pops stating that this dataset is not available. what can do? I tried to use similar dataset but those have completely different features. I am a beginner. and I also tried to download the dame dataset in kaggele, but that dataset dont have price feature in it. please help me. I am struck here.

  • @anuragmaripudi3
    @anuragmaripudi3 Před rokem

    Hello Krish do you have sessions from the beginning, would like to join the sessions

  • @palandeharsh8294
    @palandeharsh8294 Před 11 hodinami

    did i ever said this? Sir in that black and white photo of yours with glasses you look very similar to Anurag Kashyap