SimCLR is an algorithm which depends on a common operation: augmenting the data.
However, in contrast to traditional methods, we don't use augmentation for pretending that we have more data. To the contrary! (2/4)
If you look at the first picture, you may ask yourself a question - why do we need to treat the projection from h to z separately?
It turns out that it's a side effect of contrastive loss! z vectors contain only the bare minimum info needed to recognize the similarity. (4/4)