AnyText is a diffusion-based open-source tool that generates and edits multilingual text directly into images with high fidelity, supporting curved layouts, multi-line placement, and seamless background fusion.
CogVLM2-LLaMA3-Caption is an open-source multimodal model that analyzes video frames and generates accurate, context-aware textual captions or summaries in real time.
DDColor is an open-source AI image colorization framework that transforms black-and-white photos into vivid, realistic color images using a novel dual-decoder architecture.
Real-ESRGAN is an open-source AI model that dramatically enhances low-resolution images using blind super-resolution and synthetic degradation modeling—no high-res reference needed.
Ovis1.6 is an open-source multimodal large language model designed for joint text and image understanding, excelling in math reasoning, object recognition, and cross-modal analysis.
DemoFusion is an open-source AI framework that generates ultra-high-resolution images (up to 4096×4096+) from low-res inputs using progressive upscaling—no extra training or expensive hardware required.
FineVideo is a large-scale, open multimodal video dataset designed to advance AI models’ understanding of spatial-temporal scenes, emotions, narratives, and cross-modal relationships in video.
Vary-toy is a compact, open-source visual language model enabling document OCR, image description, visual question answering, and multimodal dialogue on consumer-grade hardware.
OLMo is a fully open, high-performance language model framework offering transparent training data, reproducible code, and standardized evaluation tools for researchers and developers.
MMMLU is a large-scale, multilingual, multitask benchmark dataset for rigorously evaluating language models across 14 languages and 57 academic disciplines.
GOT-OCR2.0 is an open-source, multimodal OCR model that converts complex documents—including math, charts, music scores, and multilingual text—into editable Markdown or LaTeX with interactive region control and long-context understanding.
SFR-RAG is an open-source, retrieval-augmented language model from Salesforce AI Research that improves factual accuracy, reduces hallucinations, and supports reliable, context-grounded text generation and conversational AI.
DiT is an open-source image generation model that replaces convolutional U-Nets with Transformers in diffusion models to produce high-fidelity, scalable, and controllable synthetic images.
ChatMusician is an open-source large language model that understands and generates music using text-based notation—enabling composition, theory Q&A, and stylistic imitation without external multimodal components.
StarCoder 2 is an open-weight, high-performance large language model designed specifically for code generation, understanding, and interactive programming assistance across 600+ languages.
TextDiffuser-2 is an open-source text-to-image diffusion model that generates high-fidelity, resolution-flexible images from natural language descriptions.
OmniGen is an open-source unified diffusion model that handles text-to-image generation, image editing, subject-driven synthesis, visual conditioning, and even classic CV tasks—all within a single streamlined architecture.
I2VGen is an open-source image-to-video model by Alibaba DAMO Academy that transforms static images into high-resolution, temporally coherent videos using cascaded diffusion.
F5-TTS is an open-source, high-performance text-to-speech tool that generates natural, expressive speech using flow matching and diffusion transformer models.
Seed-VC is a zero-shot voice cloning model that converts speech to new voices without needing target speaker recordings, hosted as a free Hugging Face Space.