How to enforce data quality across columns within a table in Databricks

Sdílet
Vložit
  • čas přidán 2. 07. 2024
  • Check out the docs here: docs.databricks.com/en/delta/...
  • Věda a technologie

Komentáře • 5

  • @Cal-e-man
    @Cal-e-man Před 23 dny

    The video is playing back strangely interlaced, like a column was out in the stream or what not.

  • @joyo2122
    @joyo2122 Před 23 dny

    are you hiring?

    • @Databricks
      @Databricks  Před dnem +1

      yes! check out databricks.com/company/careers

  • @TritycParki
    @TritycParki Před 14 dny

    Honestly I did not follow. Too fast and the subjet of data quality is too important for this

    • @Databricks
      @Databricks  Před dnem

      Hi Trity, sorry it wasn't clearer. Generated Columns don't solve all data quality problems everywhere, it's just to make sure data matches between columns. Let's say my employee ID is my initials and the year I started; 'HS2019', and I want a second column that's just the year part. With generated Columns you're guaranteeing that the year part is *always* going to match the employee ID. Does that make more sense? Holly