- 184
- 597 359
Gina Sprint
Registrace 7. 04. 2012
How to Subscribe to a GCP PubSub Topic (part 2/2): Using Functions, BigQuery, Compute Engine
This video is the second part of a project setting up a text streaming project using Google Cloud Platform (GCP) PubSub. Specifically, it covers:
-Completing the project we started in the previous video: czcams.com/video/RSsM4RPYdKM/video.html
-Setting up a Cloud PubSub subscriber that is triggered when a new tweet is published to a certain topic
--The subscriber is a Cloud Function
--The Cloud Function inserts the tweet as a row in a BigQuery table
-Setting up a GCP Compute Engine free instance (e2-micro instance) to run our tweet streaming code
--Connect to the instance via SSH
--Upload tweet streaming project files
--Install all Python dependencies
This video is the 23rd video in a multi-part series on getting started with the Python programming language. Previous video introducing Google PubSub and setting up the publisher: czcams.com/video/RSsM4RPYdKM/video.html
Source code on Github: github.com/gsprint23/Python-Data-Science-Crash-Course
-Completing the project we started in the previous video: czcams.com/video/RSsM4RPYdKM/video.html
-Setting up a Cloud PubSub subscriber that is triggered when a new tweet is published to a certain topic
--The subscriber is a Cloud Function
--The Cloud Function inserts the tweet as a row in a BigQuery table
-Setting up a GCP Compute Engine free instance (e2-micro instance) to run our tweet streaming code
--Connect to the instance via SSH
--Upload tweet streaming project files
--Install all Python dependencies
This video is the 23rd video in a multi-part series on getting started with the Python programming language. Previous video introducing Google PubSub and setting up the publisher: czcams.com/video/RSsM4RPYdKM/video.html
Source code on Github: github.com/gsprint23/Python-Data-Science-Crash-Course
zhlédnutí: 48
Video
How to Publish Text to Google Cloud PubSub (part 1/2): A Use Case for Streaming Tweets
zhlédnutí 100Před 3 měsíci
This video introduces setting up a text streaming project using Google Cloud Platform (GCP) PubSub. Specifically, it covers: -An overview of Cloud PubSub features and use cases: cloud.google.com/pubsub/docs/overview -Streaming Tweets using the Twitter/X API and the Python TweePy library (including setting up filter rules): docs.tweepy.org/en/stable/streamingclient.html -Setting up a Cloud PubSu...
How to use Google Cloud Scheduler to Trigger a Cloud Function that Inserts Data into BigQuery
zhlédnutí 796Před 4 měsíci
This video provides an introduction to scheduling Google Cloud Platform (GCP) Cloud Functions with GCP Cloud Scheduler. Specifically, it covers: -An overview of Cloud Scheduler features and use cases -Setting up a Cloud Scheduler job to trigger a Cloud Function to run: cloud.google.com/scheduler Generating an appropriate cron expression for your schedule Every minute for testing Every 24 hours ...
How to Setup and Test a Google Cloud Function (with a Twitter/X Use Case)
zhlédnutí 375Před 5 měsíci
This video provides an introduction to setting up and testing a Google Cloud Platform (GCP) Cloud Function with Python and a Twitter (X) tweet use case. Specifically, it covers: -Fetching the most recent tweets in the last 24 hours from a Twitter account using the Twitter API Endpoint: developer. en/docs/twitter-api/tweets/timelines/api-reference/get-users-id-tweets Tweepy function: ...
How to Access Data from the Twitter (X) API Using Tweepy
zhlédnutí 14KPřed 6 měsíci
This video provides an introduction to accessing data from the Twitter API using the Tweepy Python library. Specifically, it covers: -Uses cases for the Twitter API -Getting a Twitter bearer token for API access (and how to add it to the .gitignore file) -Reading Twitter and Tweepy API documentation -Making requests for account info by username Endpoint: developer. en/docs/twitter-ap...
How to Web Scrape using Python and Beautiful Soup
zhlédnutí 436Před 8 měsíci
This video provides an introduction to web scraping with Python and the Beautiful Soup library. Specifically, it covers: -What is web scraping and examples of projects using it -An example of web scraping Twitter handles from a college basketball webpage -How to view page source, inspect, and read basic HTML elements to find the data you are looking for -Using the requests and beautifulsoup4 li...
Introduction to Programming with Python: Lambda Functions and Map, Filter, Reduce
zhlédnutí 111Před 10 měsíci
This video provides an introduction to lambda functions in Python. Specifically, it covers: -Reviewing what a function and how a function refers to an object -What a lambda function is and why you would use one -Lambda function syntax -Several examples of lambda functions, including map, filter, and reduce -Practice problems!! This video is the seventeenth video in a multi-part series on gettin...
Introduction to Algorithm Analysis and Big O Notation
zhlédnutí 353Před rokem
This video introduces algorithm analysis and big O notation. It starts where a previous video leaves off talking about counting operations (czcams.com/video/pgMjh_G7ejw/video.html) in order to derive a growth rate function T(n). Then we discuss extracting the worst case time complexity of the algorithm O(n) from the growth rate function. Finally, we draw a chart to introduce the most common fam...
Introduction to Programming with Python: Import Statements and __name__
zhlédnutí 243Před rokem
This video provides an introduction to how to run Python files (modules) and how import statements work. Specifically, it covers: -Running a Python module directly versus indirectly -How the if name " main ": code works and why programmers use it in their .py files -Multiple Python files in a project (using utility Python modules and organizing them into subfolders) -Different variations of imp...
Introduction to Programming with Python: Assert and Unit Testing with Pytest
zhlédnutí 661Před rokem
This video provides an introduction to using the assert statement for unit testing with PyTest in Python. Specifically, the following topics are covered: -How the assert statement works and what it used for -Definitions of unit testing, test case, and test-driven development (TDD) -An example using TDD to test a numeric computation function (calculating the Euclidean distance between two points...
Introduction to Programming with Python: Classes and Object Oriented Programming
zhlédnutí 120Před rokem
This video provides an introduction to classes and object oriented programming in Python. Specifically, the following topics are covered: -Definitions of class, state/attributes, behavior/methods, object -Docstrings to describe a class -Instance-level vs class-level attributes -The self reference, methods, and method invocation syntax -Special methods like init () for constructing an object and...
Introduction to Programming with Python: Writing Data to a File
zhlédnutí 138Před rokem
This video provides examples of writing data to a file in Python. Specifically, it shows how to open a file for writing, write the contents of a 2D list into the CSV (comma separated value) file format, and close the file. This is done from scratch without using any libraries, though the csv module is shown at the end of the video. This video is the thirteenth video in a multi-part series on ge...
Introduction to Programming with Python: Reading Data from a File
zhlédnutí 272Před 2 lety
This video provides examples of reading data from a file in Python. Specifically, it shows how to open a CSV (comma separated value) file, process its contents, and close the file. The following topics are covered when processing the file contents: -Read all lines from a file -Iterate through the file lines -Split each line into its individual values by using string split() with the comma delim...
Introduction to Programming with Python: Strings (Operators, Comparisons, Methods, etc.)
zhlédnutí 90Před 2 lety
This video provides examples of working with strings in Python by demoing and explaining string examples in VS code. The following string topics are covered: -Indexing -Immutability -Operators like concatenation ( ) and repetition (*) -Comparison operators and ASCII values -Common string methods like strip() and find() This video is the eleventh video in a multi-part series on getting started w...
Introduction to Programming with Python: List Aliasing, Pass by Object Reference, Shallow/Deep Copy
zhlédnutí 147Před 2 lety
This video provides more details on working with lists in Python by demoing and explaining list examples in VS code. The following list topics are covered: -Common list methods -List aliasing -Pass by object reference -Shallow vs deep copies This video is the tenth video in a multi-part series on getting started with the Python programming language. Next video in the series on strings: czcams.c...
Introduction to Programming with Python: 2D List Practice Problems
zhlédnutí 448Před 2 lety
Introduction to Programming with Python: 2D List Practice Problems
Introduction to Programming with Python: Lists/Strings and 1D List Practice Problems
zhlédnutí 195Před 2 lety
Introduction to Programming with Python: Lists/Strings and 1D List Practice Problems
Introduction to Programming with Python: Random Module (seeding, numbers, shuffling, etc.)
zhlédnutí 201Před 2 lety
Introduction to Programming with Python: Random Module (seeding, numbers, shuffling, etc.)
Introduction to Programming with Python: Functions (keyword/default args, multiple returns, etc.)
zhlédnutí 129Před 2 lety
Introduction to Programming with Python: Functions (keyword/default args, multiple returns, etc.)
Introduction to Data Preparation and Cleaning with Python and Pandas
zhlédnutí 2,3KPřed 2 lety
Introduction to Data Preparation and Cleaning with Python and Pandas
Introduction to Programming with Python: Loops (iteration with for and while statements)
zhlédnutí 209Před 2 lety
Introduction to Programming with Python: Loops (iteration with for and while statements)
Introduction to Programming with Python: Conditionals (if elif else statements)
zhlédnutí 121Před 2 lety
Introduction to Programming with Python: Conditionals (if elif else statements)
Introduction to Programming with Python: Output with print() and input from the user with input()
zhlédnutí 158Před 2 lety
Introduction to Programming with Python: Output with print() and input from the user with input()
Introduction to Programming with Python: Running code, Comments, Variables, Operators
zhlédnutí 314Před 2 lety
Introduction to Programming with Python: Running code, Comments, Variables, Operators
Introduction to Web Services in Android using the Flickr API (Part 2/2)
zhlédnutí 838Před 2 lety
Introduction to Web Services in Android using the Flickr API (Part 2/2)
Introduction to Web Services in Android using the Flickr API (Part 1/2)
zhlédnutí 1,5KPřed 2 lety
Introduction to Web Services in Android using the Flickr API (Part 1/2)
How to Programmatically Setup a Android ConstraintLayout Chains and Chain Styles
zhlédnutí 1,6KPřed 2 lety
How to Programmatically Setup a Android ConstraintLayout Chains and Chain Styles
How to Programmatically Setup a ConstraintLayout with ConstraintLayout.LayoutParams
zhlédnutí 3,4KPřed 2 lety
How to Programmatically Setup a ConstraintLayout with ConstraintLayout.LayoutParams
How to Programmatically Setup an Android ConstraintLayout at Runtime with ConstraintSet
zhlédnutí 4,2KPřed 2 lety
How to Programmatically Setup an Android ConstraintLayout at Runtime with ConstraintSet
Introduction to Android ConstraintLayout and Dynamic View Sizes
zhlédnutí 2,2KPřed 2 lety
Introduction to Android ConstraintLayout and Dynamic View Sizes
Full of useless info. If we are looking for a video about Libreoffice wouldn't you think we already know what it is and how to open it? And do we really need to know all the details of the data you are using?
Hallo Gina, which developer subscriber do you have? Basic?
I paid 100 but still gets 403
Could you cancel and move to free? and if yes how did you that?
Thank you so much! Just what I needed :)
Thanks for the explanation. It's very clear
Hi can I contact you
Do you have contact? I want to buy a program from you
Thank you so much, you are the best. My lines weren't visually matching the Y axis values, just with your way to build it now it's working perfectly. TYSM, TYSM!
Can tweepy make posts and likes 0?
Thank you so much for helping me understand multiple calls.
hi, i bought basic version of twitter developer. can i retrieve data for one month January 2024?
You are an incredible teacher. Thank you so much for this!
where can I have the source code for this project?
Unofficially you can access it here for now: github.com/GonzagaCPSC322/Flask-App-Demo
@GinaSprint i want to access such data now, is there any possibities available, or any alternative method to get the data. I need it for a Project.
I really like the sounds your keyboard makes. What switches do you use?
Haha really most people complain about the key board tap tap tap. I like it too !
Thank you so much Gina, nice video !
Hello Gina I need help please, i was wondering if it's possible to build something like controlling the comment section of your tweets.
Hey Gina, first I would like to appreciate the effort you are putting into these videos. They have been really helpful to me although i dont understand everything right away, i can follow it through your explanation. I know it sucks seeing your content not getting the reach/attention it deserves but keep up the good work it will payoff. I also wanted to know which version of the API I need for this entire project? Would the free version be enough? Or do I need to purchase the basic or pro version? The basic is 100$ which i could consider but the pro is out of question. Thank you
Thank you ! Nowadays you will need to purchase basic access though that wasn't the case when I made the video back in 2023 :(
Gina, from bottom of my heart I truly appreciate.
When you're losing an argument online. meme
Super. Thanks. Simple and nice explanation..
you didnt exactly make it clear what you were doing or why and bringing in a pre made set of data doesnt show how to format it.
Thank you!
Bruh 2 year old video and i need just in time for a project am about to do soon. Thanks a lot for making so useful videos!
I'm looking for a user to follow that gives me an error 403 and has been unauthorized what should I do?
i also get 403 error
excellent tutorial, very clear explanations. Thanks for posting
i have basic plan of x api . i am getting 403 status code .
same, did you fix it?
@@zairalaraibneed upgrade the version.
Remote - Containers is renamed to Dev Containers [26:27] extension in VS Code. Love your content! please don't stop publishing.
Thank you! You helped me finished my homework
Hello Gina. Your video is really good, thanks for sharing. I just watched your video because I have to make a project using Swing, and I wonder where the initialization of the variables is located, as in the source code I see the identifiers for the JPanel and JButton, but not the "new" for the initialization.
bochu nuvu chaalaa slow akka due date ki inko 5 mins undi
Did you use the free plan or Basic?
Sadly the free plan at Twitter/X has been greatly reduced since I made the video. You will now need to sign up for a paid plan to access most endpoints :(
@GinaSprint Thanks for the video! I just want to ask if I can use X API free tier to get/pull/read tweet data for market sentiment analysis? I primarily need the tweet content to aggregate into counts of positive, neutral, and negative tweets by state and metropolitan area.
@@ntran04299 you need to pay, same as me
@@GinaSprint @GinaSprint Hi Gina Do you know if it's possible now with a free plan to monitor an account and get notified when it tweets? I find the licensing and endpoints a bit complicated.
thank you, this is a clear and detailed explanation!
You can't even imagine how much you help me to understand recursion properly. Hats off ❤
Your explanation was great!
I love you lol. This helped me a lot really. Thanks ^^
Its not working. Is the API basic version. I am using free version.
very good and clear
This is so cool! Thank you so much! I am setting up my home server to self-host various tools and servers for data analysis / data engineering. I will try this out.
Recommended to everyone!!! Best explanation I have ever found, how the recursive functions actually works. Great job and thank you!
I get this error: Forbidden: 403 Forbidden When authenticating requests to the Twitter API v2 endpoints, you must use keys and tokens from a Twitter developer App that is attached to a Project. You can create a project via the developer portal. I made a twitter project and app... you can't access X tweets from your python IDE anymore? You need to make a legit website?
did you do this with the free version of the api? is it possible to get the entire follower list of a user who is not me?
did you do with free version? I can't access with that
Sadly the free plan at Twitter/X has been greatly reduced since I made the video. You will now need to sign up for a paid plan to access most endpoints :(
@@GinaSprint Naughty Elon
@@GinaSprint Thanks for the video! I just want to ask if I can use X API free tier to get/pull/read tweet data for market sentiment analysis? I primarily need the tweet content to aggregate into counts of positive, neutral, and negative tweets.
@@harish77720same here
Is it free?
Sadly the free plan at Twitter/X has been greatly reduced since I made the video. You will now need to sign up for a paid plan to access most endpoints :(
Thanks Gina! This is the video I was looking for!
OMG YOU ARE A GOD.
Hey, what if in the fun function we replace the cout line with a return to the main function or a program exit statement. What would happen to the stack then? Will it still run fun(n-2) and fun(n-3)?
fun more fun looks like more depression to me . i really like the explanation though
Can Spyder IDE be ran with Docker in Ubuntu so that GPUs can be accessed?
ahhh light mode! Still helped me out so thanks.
Thank you for this. This is such a wonderful explanation