S2024 #17 - Google BigQuery / Dremel (CMU Advanced Database Systems)

Andy Pavlo (www.cs.cmu.edu...)
Slides: 15721.courses....
Notes: 15721.courses....
15-721 Advanced Database Systems (Spring 2024)
Carnegie Mellon University
15721.courses....

[@oz5219]

woud 16th lecture be available?

[@SteveLoughran]

Another little detail: spark can delegate saving of shuffle data to the Hadoop Yarn NodeManager process -which can serve data even after the spark worker process terminates. This allows for more agile spark clusters within a Hadoop cluster. However, with the move to kubernetes container hosting spark serves the data itself and assumes that it won’t terminate. This is potentially a problem with deployment on spot-priced cloud VMs as the “your server is fairly reliable” no longer holds.…

[@cerealpeer]

😂😂😂😂😂😂w
big google
big stinq

[@cerealpeer]

my google is googling

[@cerealpeer]

oh-- FFUCK!
grow my paper