Software

OpenCLIP

An open source implementation of OpenAI's CLIP

Welcome to an open source implementation of OpenAI's CLIP (Contrastive Language-Image Pre-training).

Using this codebase, we have trained several models on a variety of data sources and compute budgets, ranging from small-scale experiments to larger runs including models trained on datasets such as LAION-400M, LAION-2B and DataComp-1B. Many of our models and their scaling properties are studied in detail in the paper reproducible scaling laws for contrastive language-image learning. Some of the best models we've trained and their zero-shot ImageNet-1k accuracy are shown below, along with the ViT-L model trained by OpenAI and other state-of-the-art open source alternatives (all can be loaded via OpenCLIP). We provide more details about our full collection of pretrained models here, and zero-shot results for 38 datasets here.

Visit Resource View Repository

Related Resources

AgML

A centralized framework for agricultural machine learning.

AgricultureMachine Learning

298

AlphaSynthesis

Platform to design molecules, plan synthesis routes, and optimize chemical processes.

ChemistryBiologyMachine Learning

DataComp

First rigorous benchmark for advancing multimodal dataset creation.

Machine LearningLLM

787

ICICLE Services Board

Cyberinfrastructure services for automated data labeling, image segmentation, model serving, and edge deployment, usable across any field.

Machine LearningComputer VisionBiology

Kolmogorov-Arnold Networks

An interpretable neural network that helps scientists discover mathematical and physical laws

Machine LearningPhysics

16.3k

Magpie

Data synthesis pipeline generating high-quality alignment data for LLMs

LLM

874

MutateEverything

MutateEverything predicts the effect of all single and double protein mutations in one forward pass. It is even versatile enough to predict higher-order mutations with minimal computational overhead.

BiologyMachine Learning