Data Quality Testing in the Medallion Architecture with Pytest and PySpark

[ Lightning talk from Data + AI Summit 2020. Speaker: Carter Kilgour]
Why data quality is especially important in the medallion architecture, and how to ensure it with scheduled testing and reporting. Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. databricks.com/databricks-nam...

[@puneetsharma4391]

@Databricks Thanks for the video, I would like to setup same kind of data quality framework in my project , could you please share a step by step guide to setup the framework.

[@user-hn2os3mu7x]

Great, thanks a lot for share your knowledge

[@mrkstein1]

I would also appreciate a repo link, this is very helpful.

[@Ruined_Pirate]

Hi Team, it's a fantastic demo.. could you please share the bit bucket repo or the code reference. Thank You

[@arturp.6780]

Hi, thanks for the video. I cant find any link to the source code. Can you share it somewhere?

[@orenmeth1884]

Would appreciate a repo link too.

[@chiragbansod4003]

Hi team, can you provide us with the repo link for the code