PDF2Audio is an open-source tool that transforms PDF documents into high-quality audio files using AI-powered text extraction, script generation, and text-to-speech synthesis.
Make-A-Character is an open-source AI framework that generates highly realistic, customizable 3D digital humans from text descriptions, supporting full-body modeling, animation-ready rigging, and production-grade rendering.
MotionCtrl is an open-source motion controller for video generation models that enables independent, precise control of camera movement and object motion in AI-generated videos.
GOT-OCR2.0 is an open-source, multimodal OCR model that converts complex documents—including math, charts, music scores, and multilingual text—into editable Markdown or LaTeX with interactive region control and long-context understanding.
V-JEPA is an open-source, self-supervised video foundation model that learns visual representations by predicting masked frame features—enabling robust video understanding without labels.
DiT is an open-source image generation model that replaces convolutional U-Nets with Transformers in diffusion models to produce high-fidelity, scalable, and controllable synthetic images.
VideoPoet is a multimodal AI video generator developed by Google Research that creates high-fidelity videos from text, images, or video inputs—and synthesizes matching audio.
OpenCodeInterpreter is an open-source AI coding assistant that generates, executes, and iteratively refines code using large language models and real-time execution feedback.
ChatMusician is an open-source large language model that understands and generates music using text-based notation—enabling composition, theory Q&A, and stylistic imitation without external multimodal components.
StarCoder 2 is an open-weight, high-performance large language model designed specifically for code generation, understanding, and interactive programming assistance across 600+ languages.
TextDiffuser-2 is an open-source text-to-image diffusion model that generates high-fidelity, resolution-flexible images from natural language descriptions.
UniEdit is a no-fine-tuning, text-driven video editing framework that modifies motion, style, background, and objects in videos using pretrained text-to-video models.
OmniGen is an open-source unified diffusion model that handles text-to-image generation, image editing, subject-driven synthesis, visual conditioning, and even classic CV tasks—all within a single streamlined architecture.
I2VGen is an open-source image-to-video model by Alibaba DAMO Academy that transforms static images into high-resolution, temporally coherent videos using cascaded diffusion.
Loopy is an open-source audio-driven digital human generator that creates realistic, expressive portrait avatars from speech or singing audio—no motion templates required.
SUPIR is an open-source, text-guided AI model for high-fidelity image restoration, enhancing detail, clarity, and realism across photos, films, games, and archival imagery.
HivisionIDPhotos is a lightweight, open-source AI tool that generates professional ID photos with automatic matting, background replacement, layout printing, and optional beautification — all running locally on CPU.
EMO is an open-source audio-driven portrait video generator that creates expressive, lip-synced, and pose-aware talking or singing videos from a single image and any audio clip.
MinerU is an open-source AI tool that intelligently extracts and structures text, formulas, tables, and images from PDFs into clean Markdown and JSON formats for developers and researchers.
F5-TTS is an open-source, high-performance text-to-speech tool that generates natural, expressive speech using flow matching and diffusion transformer models.