Day-18 | AWS Cost Optimization | Most Popular Cloud and DevOps project| Event Driven Serverless
Vložit
- čas přidán 24. 07. 2023
- Support my work
www.buymeacoffee.com/abhishekprd Hi Everyone, My Name is Abhishek and my channel is focused on delivering Free content on DevOps and Cloud. Follow my channel for practical learning of DevOps and Cloud. Don't miss the FREE DEVOPS COURSE in Playlists.
In this video, We will learn how to implement the cost optimization project on AWS using lambda functions and event driven serverless architecture.
Private Telegram Channel For Doubts Clearing
www.youtube.com/@AbhishekVeer...
Instagram: / abhishekveeramalla_off...
GitHub Repo for this video
github.com/iam-veeramalla/aws...
Book 1:1 with me on TopMate for career guidance
topmate.io/abhishek_veeramalla
Public Telegram Channel For Notes and Updates
t.me/abhishekveeramalla
About me:
========
LinkedIn: / abhishek-veeramalla-77...
GitHub: github.com/iam-veeramalla
Medium: / abhishekveeramalla-av
#devops #futureofdevops #kubernetes #sre #aws #azure
DEVOPS FAQ
DEVOPS
WHAT IS DEVOPS ?
WHY DEVOPS ?
HOW TO LEARN DEVOPS ?
LEARN DEVOPS IN 60 DAYS ?
NON IT TO IT BACKGROUND ?
IS DEVOPS EASY TO LEARN ?
BEST DEVOPS COURSE
FREE DEVOPS COURSE
#AbhishekVeeramalla
BEST DEVOPS VIDEOS
DEVOPS INTERVIEW QUESTIONS
EASY DEVOPS VIDEOS
BEST WAY TO LEARN DEVOPS
PYTHON FOR DEVOPS
PYTHON PROJECTS FOR DEVOPS
LEARN PYTHON
PYTHON PROJECTS FOR AWS
AWS PYTHON PROJECTS
AWS LAMBDA FUNCTIONS
WHAT IS GITOPS ?
WHY GITOPS ?
LEARN GITOPS ?
GITOPS FREE COURSE
What is AWS ?
LEARN AWS FOR FREE
AWS COURSE
AWS COURSE FOR DEVOPS
AWS CLI Deep Dive .
.
Disclaimer: Unauthorized copying, reproduction, or distribution of this video content, in whole or in part, is strictly prohibited. Any attempt to upload, share, or use this content for commercial or non-commercial purposes without explicit permission from the owner will be subject to legal action. All rights reserved.
Thanks!
Thanks alot for supporting the channel
00:07 Cloud cost optimization
05:46 Stale resources on AWS can lead to higher cloud costs
11:35 Create a Lambda function to delete unused EBS volume snapshots
17:38 A Lambda function is used to delete snapshots that are not associated with any volume.
23:21 Increase default invocation time for Lambda to 10 seconds
28:59 Learn how to manage cloud cost optimization in AWS accounts
34:47 Demonstration of creating and deleting snapshots
40:01 Lambda functions can be scheduled to run automatically using CloudWatch events.
Demo performed and executed as you have done and got the exact .. output..Thanks sir for the wonderful explanation and teaching and demos as well❤
It is a wonderful project. Thank you very much.
thanks for giving wonderfull session for cost optimization.
Wonderful person
Wonderful attitude
Wonderful teaching
The world needs more people like you
I'm not exaggerating
God bless you 🙏
Thanks alot
thank u so much abhishek sir for sharing the knowledge
For some reason I didn’t find the describe volume permission before and when tried to run the lambda test it didn’t give any errors about it - but when I finally found it and added it it worked like magic thank you very much !
Thank You Sir.
Requesting you not to delete any course of yours as they are going to be helpful to recall everything watching your videos in future.
Huge respect to you Sir.
😍
Great!!
Thanks Abhishek for the best explanation on cost optimisation and lambda functions...i have no words to thank you.....and thanks for this good work as you are providing this top notch content for free ....thanks a lot bro❤
Each and every word in the python script understood how it is going to fetch the running instances , after fetching it will check for snapshot. If that snapshot doesn't belong to any running instances or EBS, directly delete it. After deleting, again using try block once again checks the volume of snapshot if it is present or not. Really impressed with the code Abhi Bro
Ur explanation and execution is on point, very simple and engaging. Thanks for contributing your knowledge to the Devops community and the fellow Learners.
Thanks bro
Well explained
Excellent explanation in simple way from beginner point of view with detail step by step information. Waiting for such type of real time projects which can be added to resume for fresher & experienced one. Completed hands on from day 1 to day 18. Thanks a lot.
Amazing
bro your content is really good many paid courses fail to deliver this type of content
Thank you so much Abhishek for AWS Cost Optimaization demo......I was working on AWS Cost Optimaization from 1-1.5 years but this approach is very efficient / time saver / chances of making mistakes are very less and able to save AWS resources cost drastically.
Thanks again🙏 and waiting for another such content🤩🤩🤩
You are welcome 🤗
Absolutely detailed and crystal clear! Thanks, Abhishek! You're a maestro!!!!!
My pleasure 😊
Thank you for bringing a such cool Projects.❤
😍
This is super useful! Thank you Abhishek :)
Thank you
best youtube channel for devops. i am developer and enjoy your teaching keep it up bro
Hi Abhishek, Well-explained in a friendly manner that is easily to grasp the logic, you showed here. Thankyou so much.
Thanks a lot
Very helpful video . Thank you Abhishek for sharing the knowledge with clear explanations of the concepts along with a neat demo . Well done and keep up such good work !
My pleasure
Thanks for the video anna i will add this into resume
I just came across your shot video on zero to hero aws,wanted to watch all the previous videos and want to practice too
Subscribed to your channel,Thanks
Amazing
Awesome project brother, I did it and gained insights about CloudWatch and Lambda Function!
Great to hear!
Thanks abhishek successfully executed and understood everything crystal clear👍🙂
Thank You ❤
Thanks man. such a fantastic help. God bless you.
Welcome
Excellent information, Sir kindly make more videos explaining the concepts and applications of Terraform in AWS in details and how to configure AWS NETWORKING Networking with details steps explained
Noted
Thanks, Abhi
Welcome
Thanks Abhishek Sir. Keep teaching like this but you deserve more subscribers.
Successfully completed the demo.
This is the concept which i was asked in the multiple interviews and i just said i haven't worked on it and we look for instance utilizes alone something like that
Thanks for the explanations 😮😊
😍🚀
We can apply the same for s3 as well right
Wow what a quick response 🎉
Thank you Abhishek sir for such content nice and briefly explain the lambda function and project thank you again
It's my pleasure
Thanks anna.. Performed the demo.. everything worked and learned all good stuff. Thank you
You are welcome
So simple language , easy to understand . Thank u so much 😊
You are welcome 😊
thankyu helpfl
Awesome explanation for cost optimization
Thanks a lot
Most welcome!
thanks lot for helping in learning aws lambda function topics
All the best
successfully implemented the project and also integrated with sns
done
Amazing Video🔥
Implemented the cost optimization demo Abhishek it was good getting errors and rectifying those and setting up the policies with ec2 and snapshots and creating ec2 from volume creating snapshot with the help of your code I was able to implement removing stale snapshot which is not associated to the volume " This is the final response Deleted EBS snapshot snap-0c443b848464 as its associated volume was not found." Thanks a bunch Abhishek.
🚀🚀
Wonderful project 👏
Thanks
Thank you.
Welcome 🙏
Thank You !
You're welcome!
Words are less to express my gratitude 🥰
Thank you so much 😀
Thank you🙏
Welcome
very well explain
Thanks
Tq
Superb teaching
welcome
Gained lot of knowledge by this video thank you sir :)
Most welcome!
Thanks for the video! ✨
You're so welcome!
@@AbhishekVeeramalla Also, please make a video on AWS Solutions Architect Certification. And how to prepare for it!
Thank you 😍
My pleasure 😊
To good explanation sir
Thanks and welcome
Videos are great! Could you kindly make same zero. To hero series for sre role
thank you
Thank you so much 😀
Hi Abhishek, Thanks for such wonderful videos and series. Your teaching skills are awesome. Can you please make video on AWS CDK also?
Sure
Hi Abhishek, hope you are doing well. You are closer to the completion of AWS course. I would like to request you to please announce the Azure 30 day course ASAP. Thank you 🙏
🥳
Thanks for this tutorial 👍....One Request After this aws series If its possible for you then please start a Open-shift tutorial and mainly Python tutorial with practical implementations for devops ...
I will take a note
I appreciate all your helpful information. I would like you to please make a video explaining how to set up a production grade eks cluster with the help of other services...it must have high security. We know how to set up eks clusters, but do not know the best practices.
I made video couple of days back about kubernetes security and same applies for eks as well
Love you Abhi...my best bro !!!
😍
abhishek I get the concept but what I am worried about is the code, like how will i be able to write the code of other kinds of scenarios. What can be the solution here?
We are doing python playlist
I wait today video ❤
Thanks 🙏
@@AbhishekVeeramalla Please sir I have been on the ultimate cicd implementation with argo cd but the pipeline always failed at the stage of building the docker image. it is giving me "docker command not found " although I have docker up and running and also I have created the credentials to let jenkins connect to my dockerhub registry. Please could you guide me?
Thank you for providing such an informative session and creating these helpful videos. Do you plan to cover topics related to determining the overall cost of resources before building anything on AWS?
Noted
thanks bro.....and please make a vido on how to create multi master eks production cluster with high security
Please watch videos that I posted a couple of days back of kubernetes security.. it applies for eks as well
❤❤❤
Thanks 🙏
Hi Abhishek quick question why have you created role which has ec2 as principal and given snapshot read write access to it , I thought you keeping lambda as principle and given it snapshot read delete policy to it will work
what the architecture role in cost optimization ? can you give me some insight of how the architecture involved
Bundle of thanks for such content. Can we schedule the script to run only once a month?
Yes
🎉❤
Thanks
please make a complete video on prometheus architecture including jobs, exporter ,all metric type and one project on that only .It will be very helpful as i can't see any complete video on that in youtube also
Noted
Abhishek in industry we take snapshots either manually or by some script for backup, how can we incorporate the same in this project where it will delete or note only the snapshots which has been taken manually only..
Brother best explanation. We stopped at event bridge scheduler, how we will explain this step in Interview. I want to know it looks critical since aws is event driven function. Please continue on aws lambda in some other project.
Hey, its very simple, just select the required API action (for example when EBS is created) and Cloud watch will trigger the lambda function you provided whenever the EBS is created. That's it.
Sir after completion of AWS, we need Azure masterclass because company is demanding knowledge of Microsoft Azure nowadays.
I will try
Hi can you please make vdo on AWS console-to-code ( New feature )
😊
It took me 3 daays to realize that you have to create the policies in the policies tab on the left-side of the iam dashboard in order to attach the policy to the role lol
Haha
1st Like❤
Thanks 🙏
Please make an video for AWS KMS
Yes
But sir when organization has minimum snapshot
In this case they can delete it manually.
.....
@abhishek Could you please send me the python code am not able to find in above github repo
Super Content...So useful.....Thanks Dude..
Dude, How much python learn need for Devops????
Watch day 1 in python playlist .. I explained in detail
Project is filtering and deleting the stale resources.
We will use lambda function to write python code. By using module boto3.
Boto3 will talk to aws API and give information about stale ebs snapshots.
Since lambda function is event written you can trigger it using cloud watch.
Hi Abhishek, Suppose there are so many resources which we want to remove which is going to take more than 15 min (max execution time for lambda) then will lambda will scale out for more container to finish that job in max time or it will just fail as timeout , pls clarify
You can split your code and invoke other lambda function from this one
But better to keep your execution time short by writing effective code .. if its not an option your split the code and invoke another lambda
Hi @abhishek how we perform health check in ec2 instances can you share info here
Ok sure
Sir can you make BillOps poc and put video
Does devops engineer need to write coding in python
Cost optimization
People move to cloud because
1. Overhead of infrastructure
2. Cost of infrastructure management
Cloud cost is down only if you use it efficiently.
Taking snapshot of volume means taking backup of volume.
Even after deleting ec2, and volume aws will keep charging for snapshot of volume.
The resources you have forgotten and are being charged are called stale resources.
Cloud cost will go high.
So we as devops engineer have to look for stale resources. Eg, Snapshot that are not attached to ec2 or any volume, send notification or delete the snapshot
You will soon touch 100K Subscribers. Advanced Congratulations Abhishek Sir
Thanks 🙏
thanks bro. I tried with this hands-on but shapshit isnt getting deleted.wht can be the problem
Check the cloud watch logs
snapshot life time with in 30 days?
Once we will add the Cloudwatch schedule. We will be notified or something like that?
U need to add sns
Anna, please SNS integrate chesi chupinchandi asalki ardham avvateldh nenu chala sarlu try chesa
hi abhishek, can i put this COST OPTIMIZATION project in my resume, even if i don't know python as a language.????
😶😶
Yes, you can
Love From Pakistan
👍
after aws which topic are you cover
Stay tuned for updates.
Hii Abhishek where to start aws zero to hero or DevOps zero to hero
Devops
Make video on boto3
Noted
Just one word Awesome!!!! Felt very happy after understanding the concept and able to successfully execute it without looking into the code....Kudos Abhishek
Kudo to you 🚀
if i am try to create lambda functions..it will showing unknown error..! any solution?
Check cloud watch logs for error