Pull data from API using Python

How to pull data from rest api and push it to sql server
JSON data to database using python
#python #data #dataanalytics #datavisualization #restapi #api #dataengineering #pipeline

[@WadieGamer]

Thank you, you made the process very easy!

[@thebihub]

Glad it helped

[@PrincePazol]

Super helpful video. Thanks mahn🤗

[@thebihub]

Thanks Prince, Glad you liked it ☺

[@nikhilchakrapani3542]

Very helpful! Thank you.

[@thebihub]

Thanks Nikhil!

[@Charanpro007]

Very helpful 👍

[@thebihub]

Thanks Charan !

[@madhusudhanachary1310]

Excellent man

[@thebihub]

Thanks Madhusudan!

[@lakshminarasimhannarasimha1338]

very useful :) thank you

[@thebihub]

Thanks Narasimha

[@Skd833]

For all 3 imports, can you please help with the error :: Import 'requests' could not be resolved by Pylance???

[@aakashmittal8598]

How we can automate the process of data fetching from a live data API and data dumping without running the code again and again?

[@thebihub]

Hi Aakash, use any job scheduler like Apache airflow, SQL server agent,...

[@signedturnip6442]

Did you find a way? Im kinda of a noob and i need my code to run daily without fail in order for it to retrieve data from rest api’s and load it to our local database. I tried uploading my code to an app function in azure but since it has a dynamic ip address I haven’t been able to make it work (permission errors). Theres always task scheduler on a local computer but i can’t always trust it’ll be on. Any ideas?

[@tejaswibhargava8745]

Hi, Do i need to create a DB structure in MSSQL first and then write code to fetch data? Or will it create the table automatic??

[@thebihub]

Hi Tejaswi, just create database , table will be created automatically with the name you provide

[@abigailsarpong3494]

Did you already create the 'FactCrypto' table in MSSQL before connecting or you just gave a table name.
I am trying to write to SQL but I always get error.

[@thebihub]

Just gave a table name

[@user-gn9rf2dl8o]

I am trying to connect to Sql workbench but always get error, I dont know exact code for engine. Any help is appreciated.

[@VitaminProtein_official]

Hi, I have a key for api (trial version) of printfriendly website.. is this video meant for the purpose of "How to extract that api & use it forever for free" ?

[@thebihub]

Hi, yes boss

[@samhudaya7549]

In that suppose same data came again how it will load for example yesterday one row it's ram next day also we get same data how to it will load this Data this means duplicate data.

[@thebihub]

Hi Samhudaya, In 'if_exists' parameter use 'append' as value so that it'll load only new rows to the table.

[@vamshiv2498]

Can you please provide website or resource where can we find such free APIs

[@deepanshudas3190]

In which tool you are creating this phython code?

[@thebihub]

PyCharm

[@kotamrajusurya9185]

Can you please share API link

[@thebihub]

api.coincap.io/v2/assets

[@user-py3hh7zr5o]

sql not connect

[@thebihub]

SQL Server is connected

[@user-py3hh7zr5o]

@@thebihub engine.connect show error

[@Coolbitch_Su]

In every video there is a different way of fetching data
Its very confusing, which to remember

[@thebihub]

Hi Suman , may I know which part is confused for you so that I can clear it