ConVIRT - Contrastive Learning Representations of Images and Text pairs

Pytorch implementation of the architecture descibed in the ConVIRT paper: Contrastive Learning of Medical Visual Representations from Paired Images and Text

Yuhao Zhang, Hang Jiang, Yasuhide Miura, Christopher D. Manning, Curtis P. Langlotz

Non-official open source implementation by Eduardo Reis.

Note: This repository was forked and modified from https://github.com/sthalles/SimCLR.

References:

• Yuhao Zhang et al. Contrastive Learning of Medical Visual Representations from Paired Images and Text. https://arxiv.org/pdf/2010.00747.pdf
• Ting Chen et al. A Simple Framework for Contrastive Learning of Visual Representations. https://arxiv.org/abs/2002.05709
• https://github.com/sthalles/SimCLR
• https://github.com/google-research/simclr
• https://github.com/google-research/bert
• https://github.com/hanxiao/bert-as-service#q-what-are-the-available-pooling-strategies