IP-Adapter is an open-source adapter that lets you guide Stable Diffusion and similar models using image prompts—enabling accurate, controllable image generation without fine-tuning.
DiffusionGPT is an open-source, LLM-driven text-to-image system that intelligently selects and coordinates specialized diffusion models to generate high-fidelity images from diverse, complex prompts.
MetaGPT is an open-source multi-agent framework that simulates human software teams to automate complex coding tasks using role-specialized LLM agents and standardized workflows.
MotionCtrl is an open-source motion controller for video generation models that enables independent, precise control of camera movement and object motion in AI-generated videos.
MMMLU is a large-scale, multilingual, multitask benchmark dataset for rigorously evaluating language models across 14 languages and 57 academic disciplines.
AnimateDiff is an open-source framework that transforms existing text-to-image models into animation generators without retraining, enabling high-fidelity, style-consistent video sequences from text prompts.
SFR-RAG is an open-source, retrieval-augmented language model from Salesforce AI Research that improves factual accuracy, reduces hallucinations, and supports reliable, context-grounded text generation and conversational AI.
V-JEPA is an open-source, self-supervised video foundation model that learns visual representations by predicting masked frame features—enabling robust video understanding without labels.
DiT is an open-source image generation model that replaces convolutional U-Nets with Transformers in diffusion models to produce high-fidelity, scalable, and controllable synthetic images.
Snap Video is a research-grade text-to-video generator developed by Snap Inc. that produces high-fidelity, motion-rich videos using a video-first transformer architecture and extended EDM framework.
UniEdit is a no-fine-tuning, text-driven video editing framework that modifies motion, style, background, and objects in videos using pretrained text-to-video models.
OmniGen is an open-source unified diffusion model that handles text-to-image generation, image editing, subject-driven synthesis, visual conditioning, and even classic CV tasks—all within a single streamlined architecture.
I2VGen is an open-source image-to-video model by Alibaba DAMO Academy that transforms static images into high-resolution, temporally coherent videos using cascaded diffusion.
Loopy is an open-source audio-driven digital human generator that creates realistic, expressive portrait avatars from speech or singing audio—no motion templates required.
EMO is an open-source audio-driven portrait video generator that creates expressive, lip-synced, and pose-aware talking or singing videos from a single image and any audio clip.
OmniParser is a lightweight, open-source screen parsing module that converts UI screenshots into structured, actionable elements to boost visual-language model performance in GUI-based agent tasks.
MaskGCT is an open-source, multilingual text-to-speech model that delivers high-fidelity voice synthesis, real-time voice cloning, cross-lingual conversion, and fine-grained prosodic control.
GameNGen is Google's experimental AI-powered game engine that generates playable video game frames in real time using neural networks—no traditional game code or rendering pipeline required.