Software

OpenFlamingo

An open-source framework for training large multimodal models

Welcome to our open source implementation of DeepMind's Flamingo!

OpenFlamingo is a multimodal language model that can be used for a variety of tasks. It is trained on a large multimodal dataset (e.g. Multimodal C4) and can be used to generate text conditioned on interleaved images/text. For example, OpenFlamingo can be used to generate a caption for an image, or to generate a question given an image and a text passage. The benefit of this approach is that we are able to rapidly adapt to new tasks using in-context learning.

View Repository

Related Resources

AgML

A centralized framework for agricultural machine learning.

AgricultureMachine Learning

298

AlphaSynthesis

Platform to design molecules, plan synthesis routes, and optimize chemical processes.

ChemistryBiologyMachine Learning

DataComp

First rigorous benchmark for advancing multimodal dataset creation.

Machine LearningLLM

787

ICICLE Services Board

Cyberinfrastructure services for automated data labeling, image segmentation, model serving, and edge deployment, usable across any field.

Machine LearningComputer VisionBiology

Kolmogorov-Arnold Networks

An interpretable neural network that helps scientists discover mathematical and physical laws

Machine LearningPhysics

16.3k

Magpie

Data synthesis pipeline generating high-quality alignment data for LLMs

LLM

874

MutateEverything

MutateEverything predicts the effect of all single and double protein mutations in one forward pass. It is even versatile enough to predict higher-order mutations with minimal computational overhead.

BiologyMachine Learning