Create an account to use AI

Create a free account to unlock all features:

Ask questions about videos with AI
Use smart search (AI)
Save your favorite videos
Bookmark your favorite categories
Organize your favorite subcategories
Access your personalized favorites page
Access your conversation history
Personalize your homepage with your favorites

Create an account

Already have an account? Log in

Contrastive Learning with SimCLR | Deep Learning Animated

Deepia

To try everything Brilliant has to offer—free—for a full 30 days, visit https://brilliant.org/Deepia .

You’ll also get 20% off an annual premium subscription.

In this video you will learn the basics of contrastive learning, and how these approaches were used successfully in SimCLR.

The code to produce the Manim animations for this video is available here:

https://github.com/ytdeepia/contrastive_learning_simclr

If you want to know more about contrastive learning, you should definitely read the following papers:

- FaceNet: A Unified Embedding for Face Recognition and Clustering https://arxiv.org/abs/1503.03832

- Deep metric learning using Triplet network https://arxiv.org/abs/1412.6622

- A Simple Framework for Contrastive Learning of Visual Representations https://arxiv.org/abs/2002.05709

And for self-supervised learning in general, I strongly recommend this "cookbook":

- A Cookbook of Self-Supervised Learning https://arxiv.org/abs/2304.12210

Chapters:

- 00:00 Intro

- 00:32 Self-supervised Learning

- 02:47 Sponsor

- 03:46 Contrastive Learning

- 05:16 Contrastive Losses

- 10:22 SimCLR

This video features animations created with Manim, inspired by Grant Sanderson's work at @3blue1brown. This video was sponsored by Brilliant.

If you enjoyed the content, please like, comment, and subscribe to support the channel!

Contrastive Learning with SimCLR | Deep Learning Animated | Knoovi