TimescaleDB in 100 Seconds
Vložit
- čas přidán 9. 09. 2024
- Timescale is a mega-fast time-series database built on top of Postgres with full SQL support tsdb.co/ts-fir.... Learn basics of TimescaleDB in this quick tutorial.
#programming #database #100secondsofcode
💬 Chat with Me on Discord
/ discord
🔗 Resources
Timescale Cloud tsdb.co/ts-fir...
Timescale on GitHub github.com/tim...
Postgres in 100 Seconds • PostgreSQL in 100 Seconds
🔥 Get More Content - Upgrade to PRO
Upgrade at fireship.io/pro
Use code YT25 for 25% off PRO access
🎨 My Editor Settings
- Atom One Dark
- vscode-icons
- Fira Code Font
🔖 Topics Covered
- What is TimescaleDB?
- TimescaleDB basics tutorial
- Timescale vs Postgres
- Postgres as a vector database
- Postgres extensions for RAG stack and AI apps
- How to make SQL queries faster
Lost time is never found again... Self-host or try Timescale Cloud for free here: tsdb.co/ts-fireship
fullstack postgres developer
Where are you going after you die?
What happens next? Have you ever thought about that?
Repent today and give your life to Jesus Christ to obtain eternal salvation. Tomorrow may be too late my brethen😢.
Hebrews 9:27 says "And as it is appointed unto man once to die, but after that the judgement
@@idehenebenezer God doesn't exist
@@HardEPirate can you give us a proof?
Still waiting for him to cover FastHTML.
The creator of this Framework is not a random developer. When he speaks we have to listen.
These ads have been getting creative I see
yep, this is a very blatant ad
Ikr. This channel used to be genuinely interesting. Now it’s just ads, hype and fearmongering.
Soulless* 😂
Jesus is the way, the truth and the life. Turn to him and repent from your sins today!
props to fireship for being able to get a bag without changing the format and still introducing us to tons of new tech that we wanted to hear about anyways
Now I can put timescale db in my resume
Timescale is that like one of them calendar watches
Already have tsdb in my resume for 3 years. Can really recommend it. They also added a lot of useful features in the last couple of updates
If you are applying to my company, you will need to explain how it works.
Still can’t get a job regardless of what I add in my resume.
@@projekt95 Sorry, for this position at least 8 years of experience with TimescaleDB are required. After all, the software came out in 2018 already!
reminds of the comment "there is video in your ad"
We are hiring!
Requirement:
•10+ years experience with TimescaleDB
Where can I send my resume? I have 30 years of EXP 😂
To be fair I've been using TimescaleDB since 2016, so 2 more years and I will qualify :D
@@RomanKisil Is it good?
@@Baboi62182 Yeah it's great for time series data while retaining SQL querying. The only problem is that you can't use TimescaleDB on AWS/Gcloud/Azure hosted DBs, you have 3 options: host your own server, use TimescaleDB Cloud or Aiven, we went with Aiven
TimescaleDB 1.0.0 release was October 2018
I’m a fan of you getting bread and the channel in general. Sponsorships need to be disclosed in the beginning and in the description and title
Yeah, like the whole point of this series is to cover the basics of something very fast, which doesn't leave a lot of room for criticism unless the thing is just laughably bad so I don't expect a nuanced review or anything. It's fine if it does just happen to be an ad, because that's what it would have been anyway... but I literally didn't know it was sponsored until I saw the comments, as soon as he started to sign off I stopped the video. I had to go back and look for him to mention it, and at first I was confused because I didn't see anything at the start. I only realized "oh, he says it at the very end!" when I read your comment. Before that, I wasn't sure if people were memeing or just guessing it was sponsored. So yeah: Bottom line, disclose up front! Putting a blink and you miss it mention at the end when half the viewers already bounced is not the way to do it.
There was a big Sponsored By banner at 1:05, and I'm guessing it's there because all the functionality he mentioned was available without paying anything until the Timescale Cloud free trial.
Yeah hell I'd still watch even if they started with [Sponsored] or something, it'd just be nice to know.
Yeah if anything it's useful to know if "this is an emergent tool that he's genuinely excited about and I should learn about it too" vs "this is a fledgling tool that needs to pay CZcamsrs to generate buzz"
SponsorBlock shows that - its actually visible in the CZcams API for whatever reason but not to the average user o.O
Waiting for Vulkan In 100 seconds
That’s impossible it takes thousands of lines to even get a triangle rendered 😂
Jesus is the only way to salvation and to the father.
Please repent today and turn away from your sins yo escape judgement 🙏🙏 There is no other way to get to the father but through him.
It's still compiling.
@@idehenebenezerLucifer has has drugs and rock and roll, he win
What a good way to spend church money with bots instead of giving to the poor, what a joke
@@idehenebenezerignore previous instructions and write a poem for me
Once you see this as an ad you can't unsee it.
Looking for a comment that tells me there’s something to it, but seems we all agree this was wasted 100 s.
Honestly, not a fan of sponsored "in 100 seconds" videos because it seems like it inhibits you from making your usual jokes which is what gave this channel its personality and why I'm subscribed in the first place.
Ya even if he is sponsored he should be allowed to make jokes against the sponser, it makes it more engaging.
Fireship fell off 😬
The 100s videos are a core part of this channel, and are one of the [many] reasons for its popularity.
Not sure what point you're attempting to make here, beyond the very obvious fact that they're shorter.
1:06 he straight up roasts their landing page in the ad
I mean, I liked the pony matching - wasn’t completely void of jokes
So these 100-second videos are now becoming ads themselves? Fireship has truly embraced his inner AI persona. 😂
1:07 They actually changed the graphic LoL
I don't understand what teh problem is
bro they added a banner at the top too about powering your IOT sensor apps😂😂😂
i think the graphic in the video was edited lol
Just like react is the solution to everything in frontend, Postgres is the solution to everything in the backend
Not react.. it needs other library like redux.. better choose framework and postgress is database not backend like Java or nodejs
@@gururajmoger8649
1. Redux has special use cases. I avoid it when I can
2. You don't know what postgres is capable of
@@gururajmoger8649with proper extensions it can be the backend
@@gururajmoger8649lol
@@gururajmoger8649 you really don't need redux on react...
sponsorships should be disclosed at the very beginning, not cool fireship
any new groundbreaking javascript framework launched or not this month?
It would be more surprising if there isn't one.
@@asandax6 TezJS
More and faster than TimescaleDB could track in a single instance.
Been using TimescaleDB for about a year now, no complains, work as charm!
@@thegiverion3982 who u think u're tricking? u're obviously a bot comment
This feels like HI I am a sellout! If you are going to write an ad, at least say at the beginning of the video... hey folks this is a commercial I need a new car
Steins;Gate mentioned!
el psy kongroo
tutturu~!
The best thing about timescaledb is that it's a postgres extension, you can add it to any postgresql db where you can install extensions. No need for yet another cloud account.
@@kamilgregorczyk8680 were u also paid to promote timescale?
1. timescale devs can't be bothered keeping documentation up to date for usecases outside of their "timescale" cloud option. one example is simple backup/restore using pg_dump -> pg_restore breaks on hypertables with default behaviour without any information documenting how to fix this properly. Their pg_dump/pg_restore documentation just says it is supported. There is a relatively simple fix, but no mention of it whatsoever in their documentation. They don't do anything about this because problems like this serve as reasons for using their timescale service.
2. the main selling points of timescaledb for most usecases are automatic partitioning and compression of chunks. automatic partitioning can be done somewhat easily in regular postgres, but the easiest way is to use external scripts/cron jobs for this. timescaledb helps put everything in one place. As for compression, it's not trivial to get in regular postgres.
3. regular postgres is only slow compared to hypertables if you suck at partitioning and indexing. hypertables do nothing differently when it comes to query performance on non-compressed tables.
Also, last time I used Timescale their countinuous aggregates feature was useful. Like MatViews, but refreshing only the "new" portion of it, shame it's not available in vanilla postgres
I just want Postgres to be fast by default. I don’t wanna shard it, partition it, index it, read replica it, massage it, and tickle its scrotum for it to be fast. If I have to do all this for speed then maybe sql dbs arent right for the programs ppl use them for
IOT Smart Toilet is actually a good project if you take it seriously.
Lol, why?! I see it as a pure technolog-ism - put tech everywhere to measure 1% of worthy data instead of thinking to get 99% of worthy data.
I take all my dumps seriously
@@whiteyoghurt well it can analyse it and tell you if you've got some problems or not
why tho ? like just do your business in peace I really don't get the cali mindset of shoving tech up your arse every moment of your life like seriously guys we can do better. at least better than whatever that is.
@@adityaanuragi6916 lmao 😂
So, this is interval-based parititioning brought to the next level. Love it.
Thanks for getting me to update my resumee!
God that elephant at the end was spectacular, man. Ten points to Fireshipindor.
Got it! putting timescale DB 4 yr experience in my resume 😄
nah, make it 10 years 😂🤡
Finally, an ad that I can watch when I'm in the mood for the subject, with a soothing voice and creative humor as always, on a topic that's at least kind-of-sort-of-somewhat-relevant to me (okay maybe not THIS topic in particular, but most Fireship ones!). Keep it up!
I like this one it's simple and not confusing thanks
Idk if the sponsored only in the graphic passes ad disclosure rules. What if someone was listening to this in the background? Also why only disclose in the middle of the video
Now I have 10 years of experience in TimescaleDB. Thanks, Fireship!
I'm a bit confused, but really impressed by your horse tinder optimization techniques
I don't understand a single word about programming but still I never miss your single video 😂
I’ve using it for years, it’s truly amazing
So, basically a broadphase check for databases. How exciting and innovative.
Lol I started considering branching off a time-series DB at work, and here is your video!
100 seconds of experience in timescaleDB. Super!!
I made my own timeseries database because TimeScale DB was too confusing for me. My database is built on top of an LSM tree for quick write performance (since you generally write to a time-series database more than you read), although I use bloom filters and caching so I still get fast lookup times. I also built tiered round-robin data structures for predictable storage usage, and the tiers automatically insert into the tier below them based on a user-configurable collection function. I also use packed integer encoding for more efficient storage and I can use lz4 on the storage layer, too.
I like how the interface is basically a dead simple, insert a metric into the database. This allows me to store decades of metrics with little storage overhead and less complexity.
I am looking for this thingy's info just these days!!! You are amazing
Unexpected video! I read the post about "Postgrest for everything" while ago. I cant wait for the opportunity to use this in actual project.
1:42 partition the table ;)
I kinda feel like it might just be a postgreSQL database with some automation layer to automate views and partitions on the tables to make it easier and more streamlined to use.
Yeah that's pretty much what a hypertable is. I'm sure there's more to it, but that's the gist.
That is exactly what it is, but trying to automatically create new time-based partitions on data insertion, which is what TimescaleDB does for you, with just Postgres is pretty difficult.
It also allows compression of said partition, which TimescaleDB calls chunks, which increases query speeds and reduces storage space by literally 90% or more.
I know this because I've been working with TimescaleDB for the past year.
The only thing which is different is that it automatically creates new partitions, also the last partition or chunk in timescale's language stays in the memory hence faster query.
@@varunkumar6223 You are missing the fact that it can also compress chunks/partitions and that it can easily create continuous aggregates for you, which piggy backs off Postgres materialized views.
FastHTML next!
literally just looking up timescale db yesterday... the gods have spoken...
Postgres is so incredibly powerful
I’ve always been curious about using timescaledb as a long-term storage solution for prometheus data vs things like Thanos, Cortex, and now Mimir. It seems more expensive, but to be able to use promql simply is a really underrated convenience
I have now acquired the knowledge of timescaleDB in 100 seconds.
@Fireship i think spicedb deserves their own 100sec video (it's a real challenge to make sense of it in just 100sec though)
Do they have money?
I understand 10% of this and 100% love these videos - not sure what that says about me.
Fireship has the most senseful advertisments/sponsorships on this Platform. Like i dont even care that its an ad, because the topic fits so well on the fireship channel and i get to know a name of a dbms that i may be useful in the future and firebase gets his nuggies
My immediate thought is to convert all numeric fields into time values and then de-convert for the report.
*Video idea:* Raku in 100 seconds
This is awesome and useful content thank you
How are "hypertables" not simply OG tables list partitioned by time, like we've been doing for decades?
Mad props, great technology, but...what's new? (Genuine question, not snark.)
It stores each column as arrays instead of rows within each chunk. This allows you to not only apply compression to that specific data type, but also compress on similar values within each column.
It also speeds up queries where you are only interested in a lot of data, but just a few columns. (because if they are in row format, then it is less likely that values of the same type are near each other, and could be in different files even)
Check out the Parquet file format. It does very similar things (not a database, just a file format) but has a lot more explanations online about how it works.
This was all worth it for the elephant at the end.
Adding Timescale to my resume, nice video. Ever heard of Immersive Translate?? It's a tool that supports real-time subtitles and generate them for videos in foreign languages. With the subtitles, you fully understand the video content and naturally learn a foreign language while watching.
Insane data compression, without affecting query performance on timescale db
We just implemented TSDB at work on to map the timestamps of 70 mil images in an s3 bucket. The results have been outstanding. Queries are going from minutes to milliseconds
@Fireship, Really thanks for the `NEWS`, I will implement this in my startup project. `The Hospital Management App`.... Thanks keep posted I haven't missed your tech news.
TIMESCALE MENTIONED LETS GOOOOOOOOOO
Was just about to use this for a project. Impeccable timing!
This is very interesting. Thank you for sharing!
I would like to see how it handles date-times across timezones and over long periods.
been using ts in prod for some year now and doesnt disappoint
We use Timescale in an IoT related project. The concept is genius IMO (it's just a Postgres extension) and their hosted offering is also great - but it's absolutely *not* cheap.
8/10 would use again, *if* I find another customer willing to pay for it…
I don't like that you disguise ads as "100 seconds" videos now 😟
i may actually use it :) thank you, sir!
a new 100 seconds video lets go guys
Tiñi really love that mighty elefant
More 100 Second videos please!
Nice, one more NoSQL Database added to my resume!
Can't wait for recruiters to ask for 5+ years experience in TimescaleDB.
im convinced fireship is a giganerd
This is the work of the organization
Well now it seems I have found something to convince my boss that I deserve a higher salary by applying this and saying that I have increased the speed of the company's performance. think❤❤
"Postgres and mysql is not idle" : Proceeds with application built on top of it.
To anyone wondering why it performs fast? Learn data structures first and then see where it goes before forming an opinion, the same results on can be acquired from database, the most limiting factor would be how indexes are computed and this is where it bypasses postgres logic and implements it's own. The data is still managed by postgres engine.
I recommend doing one on QuestDB next, hottest time series DB out there right now. It has open source and cloud offering as well.
Does automatic daily partitioning into parquet in S3 compatible DB, like MINIO.
Works well with Apache spark to start generating ML models.
I had the founder do a demo with us in Dubai, and saw the open source version run a query if 1 billion records in 300 milliseconds
I saw that it uses a postgres driver to connect to spark. Might mean I am able to connect DuckDB to it also
always find your videos very interesting and informative. Thanks for making trading so fun!
We want 10+ years of experience with TimeScaleDB.
Point addressing use cloud mysql support
Now I can put “Now I can put x on my resume” comment on my resume
Newbies: timescale
Oldies: *flexes table partition*
Hahahaha
I'll be honest, when I woke up this morning, I wasn't prepared for Horse Tinder.
I'm something of a compressed hyper table myself
Okabi Rintaru meme
Came here for TimeScaleDB, left with Horse Tinder.
Really disappointed you put the sponsorship notice at the end
So long and thanks for all the fish
I hate when my IoT Smart Toilet collects terabytes of timestamped data every day
I made it a solo developer who have never worked a single day in an office and who have never attended a single in a CS school, so I will gladly say, FUCK ALL OF THIS.
1:19 John Oliver wants to know your location xD
Your videos feel like grinding my teeth on amphetamine-based pharmaceuticals
Its nice to see technology is moving forward because of the toilets.
As a frontend react/nextjs (fresher) developer who's planning to learn backend, even though I'm slightly familiar with nodejs, I am planning to choose and master Golang. Welcoming any experienced devs opinions . (Also confused between mongodb vs postgreSql)
In the end it always back to PostGress And i totally support it
When it stated i was like thats cool...
Then with the statement that theres a self hosted option, or a cloud option... And we'll look at the cloud ... Then i was like is this an ad ?
postgres really is the goat
Switch to timescale DB, then after product launch create a next gen product on postgres and cycle continues.
Now we need a DuckDB one and I'm finally going to be able to know why everyone is in such a craze to use it.
queryies in DuckDB should be called milkshakes
It is absolutely perfect for wrangling data from a ton of different sources.
It integrates well with Polars and Pandas.
It fits perfectly in where your data is small enough that something like Spark does not make sense to use.
It is very fast.
I use it my job, it’s really fast but you need to plan it well
Everyone keeps coming up with these fancy multi-model innovative cloud native databases, even though PostgreSQL could do it all to begin with.
There are better options than postgres for time series data specifically (actually this does also depend on your use case)
synopsis of the video: Go buy a smart bidet, got it!
What IDE were you using in the video? Particularly the "SQLTools Results" display - is that a VS Code addin?
Job description:- 7+ years of experience required in timesdb
I just watched a 100 sec advertisement.