Vision Transformers Need Registers - Fixing a Bug in DINOv2?

[@xxlvulkann6743]

Great explanation! It is interesting to see how attention matrices aid in interpretability research and in getting better representations! I wonder how this could be applied to other modalities (such as audio).

[@user-st3dx8pd1o]

Thanks a lot!

[@marzi869]

Thanks, but remove the music in background.

[@dhrumil5977]

Thanks ❤