Fine-tune ConvNeXT for image classification [end-to-end tutorial]

Hi guys!
In this video, I show how to fine-tune ConvNeXT, a state-of-the-art model by Facebook AI for image classification on a custom dataset. I leverage the new 🤗 ImageFolder feature, and train the model in native PyTorch.
Timestamps:
0:55 Intro to ConvNeXT
1:35 Loading a custom dataset using ImageFolder
6:40 Push dataset to the 🤗 hub
8:57 Process dataset
18:10 Define model
21:20 Prepare training of the model
34:30 Start training!
36:46 Push model to the hub
38:15 Performing inference (with widget)
44:20 Pipeline API
Colab notebook: github.com/Nie...

[@robosergTV]

awesome, thanks Niels!

[@satpalsinghrathore2665]

Would love to see more videos!

[@pillaideepakb]

Great video. Thank you Niels

[@fthdev1]

Thanks 😎

[@MerveNoyan]

Thanks for the great tutorial!

[@nandinisarker6123]

Hi Niels, this video helped me a lot in my master's degree study. I have been trying to implement an idea to use PSO in a pre-trained model as you showed, but not sure how to start. Could you please make a guideline video?

[@omarboukadoum8294]

Thank you for clarifying this course. Could you please share the code project related to ConvNext? I appreciate it greatly.

[@nandinisarker6123]

Very nice tutorial on image classification, thank you for your contribution in huggingface team. Can you please show how to plot accuracy matric while using pre-trained model like this?

[@LoretoParisiLabs]

Well done!

[@krishnabhagavan9621]

Great job buddy

[@martinsfolefac1820]

Great job

[@nikdab]

Great work. Can you please upload the colab notebook? Also, is there a way of uploading data from local device?

[@NielsRogge]

Hi, you can upload from local folder(s) by providing the data_dir argument instead of data_files when using ImageFolder. Details here: huggingface.co/docs/datasets/image_process

[@syedmujtabahassanrizvi2129]

How can we find validation accuracy, test accuracy, and f1 scores?

[@ronancadmielcastro2200]

Hello, thank you so much for the tutorial. Just a question: can ConvNeXt be used in MATLAB? And if yes, any ideas on these?

[@NielsRogge]

Hi, Matlab isn't really used in AI, everything is in Python

[@ronancadmielcastro2200]

Thank you for the response. Can I ask if for you, what are the most cutting edge state of the art image classifier in 2024? thank you very much, this is very helpful for my PhD dissertation.

[@syedmujtabahassanrizvi2129]

please upload the colab notebook on git and share the link in description or in comment section. secondly How can we find validation accuracy, test accuracy, and f1 scores?

[@bousejin]

Thank you so much! Zoom a little bit into your code for your next videos, please!

[@SyedMujtabaHassanRizvi]

can you please share this notebook with me? How can we find validation accuracy, test accuracy, and f1 scores?

[@NielsRogge]

Hi, I've added a link to the notebook at the end of the description.