Video

Thank you for watching my videos. Glad that it helped you.

Thank you for watching my videos. Glad that it helped you.

Thank you for watching my videos. Check out the path where this log is stored and then that should be configured log scrapers.

Thank you for wat have my videos. Glad that it helped you.

Thank you for watching my videos. Glad that it helped you.

@@cloudquicklabs These commands are same on linux systems.? . Before I have done with with old version on linux.

Thank you for watching my videos. There could be multiple reasons like below. 1. Check if vpc endpoints for rds 2. Check if inbound security group has required ports enabled here. 3. Check if credentials are correctly provided.

This seems to be serious issue may be good raise GCP support case here

Thank you for watching my videos. Glad that it helped you.

i noticed that for your service resource you dont have spec section, and the svc wasnt created.

Thank you for watching my videos. Looks like data ingestion has not started into Elasticsearch. Did you use the command file share videos description.

Thank you for watching my videos. Glad that it helped you.

Able to upload text file via lambda but getting error with postman :( Please suggest

Thank you for watching my videos. Check if your API url is correct and API keys are correct.

Invoking via postman is about selecting right options. docs.aws.amazon.com/apigateway/latest/developerguide/call-api-with-api-gateway-lambda-authorization.html

@@cloudquicklabs Thanks! But i have checked everything multiple time from your video still facing the issue though I can upload the file using Lambda itself using Test option for Lambda. Any suggestion?

Thank you for watching my videos. Currently I am not doing this.

Thank you for watching my videos here. Here you are binary encoding image file and passing that value to API via parameters. We need to make sure that multipart/form-data is intact.

Thank you for watching my videos. It's built on capability for Glue that I have used. But I am happy to explore more about it.

Yes.. it will send logs continuously.

Thank you for watching my videos. Apologies here. It was just for your reference in the video for parquet file mention.

Thank you for watching my videos. You can still do that via an interface (app interface) and convert the image back to binary and call the api here.

@@cloudquicklabs thing is that i am doing some image processing and when i send image through binary its taking extremely long time. but when i do with multipart/form-data which usual way to send files its taking nominal time. also with python conversion from multipart to normal data is giving errors i tried that too. whats your suggestion on this.

Thank you for watching my videos. Glue is PaaS there is versions here but feature options can be explored.

Indeed , I shall create more in this context of Data engineering.

Thank you for watching my videos. Please check czcams.com/video/RGSKeK9xow0/video.html

You can agrant access to external service via multiple options. 1. IAM users. 2. Federated Access (which supports) 3. API gateway as application for tasks

Thank you for watching my videos. It should not be the case here , I believe only columns should disordered while row data should be intact. Please watch this video again.

Thank you for watching my videos. Indeed I try my best make it clear content ahead.

Thank you for watching my videos. It should be possible until your private network does not block Sonar Clou endpoints.

Thank you for watching my videos. I don't take classes but help through my videos , let me know if you have any topic to cover in videos.

Thank you for watching my videos. Glad that it helped you.

Thank you for watching my videos. The issue you're encountering could be due to permissions or the way the AWS S3 bucket policy is configured. When accessing an S3 object directly via its URL. Did you check this.

Thank you for watching my videos. I am a new video on incremental data load here. Please wait for the same.

Thank you for watching my videos. Glad that it helped you.

Thank you for watching my videos. Glad that it helped you.

Thank you for watching my videos. It's to load the data from s3 to aws glue data catalog and then to Amazon Redshift services. Did you watch the second version of this video czcams.com/video/RGSKeK9xow0/video.htmlsi=FB_1BXVQp-SnfUtq

Thank you for watching my videos. Glad that it helped you.

Thank you for watching my videos. Please find the link czcams.com/video/5G0i5uQVGIw/video.html I have one more video on this but using csv file.

Thank you for watching my videos. Glad that it helped you.

❤​@@cloudquicklabs

Thank you for watching my videos. You can use terraform null_resource something like below and call AWS CLI to invoke the AWS SSM document resource "null_resource" "example" { provisioner "local-exec" { command = "echo This command will execute whenever the configuration changes" } }

Thank you for watching my videos. We migrating data from source s3 to Amazon redshift which is destination here. Crawlers can be scheduled or invoked on demand.

Thank you for watching my videos.

Thank you for watching my videos.

Thank you for watching my videos. Glad that it helped you.

Thank you for watching my videos. Glad that it helped you.

@@cloudquicklabs I have doubt on how it provisions the new VM. Is it based on provisioner file configurations where we give instance types. Or just dyanamically any instance type and instance size

Thank you for watching my videos. Please check the video at 5:23 minute you see that I am executing a powershell script which gives the output and stored in results.json.

Thank you for watching my videos. EMR : is Elastic Map Reduce which is managed big data processing and analytics service. EKS: is Elastic Kubernetes Service which is basically managed Kubernetes (container orchestration) Service. Both are different.

@@cloudquicklabs Okay, hum yahan kah sakte hain ki EMR jo hai, wo Spark aur PySpark ke jobs run karta hai aur EKS jo hai, wo Python ke jobs run karta hai.

Thank you for watching my videos. We have solutions for it I shall creat a videos on this soon.

Thank you for watching my videos. Glad that it helped you

Thank you for watching my videos. Glad that it helped you.

Thank you for watching my videos. Indeed I shall create video on this scenario as well soon. It's quite interesting scenario.

Thank you for watching my videos. Cost of EKS cluster depends on multiple choices 1. Size of Node 2.Disk usage 3.Networking Resources. etc. Did you AWS calculator for this. And also explore my CZcams channel to find correct videos for your use case (as there are many here)

Let me know when you find the answer to this.

Thank you for watching my videos. Indeed you can do it and it's workable solution. I would create new video on this topic which mimic your scenario, keep watching my channel.

I would sharing a video on this requirements soon.

@@cloudquicklabs thank you so much. This means a lot🙏🏽