Draw an Audio is a research-grade AI system that automatically generates contextually accurate, temporally aligned sound effects from silent videos using multimodal conditioning.
ActAnywhere is a research video generation model that automatically creates temporally consistent, motion-aware backgrounds for foreground subjects—enabling seamless background replacement and visual effects without manual keyframing or green screens.
Vary-toy is a compact, open-source visual language model enabling document OCR, image description, visual question answering, and multimodal dialogue on consumer-grade hardware.
Follow Your Pose is an open research framework that generates highly controllable, temporally coherent videos from text prompts and user-specified human pose sequences.
IP-Adapter is an open-source adapter that lets you guide Stable Diffusion and similar models using image prompts—enabling accurate, controllable image generation without fine-tuning.
OLMo is a fully open, high-performance language model framework offering transparent training data, reproducible code, and standardized evaluation tools for researchers and developers.
DiffusionGPT is an open-source, LLM-driven text-to-image system that intelligently selects and coordinates specialized diffusion models to generate high-fidelity images from diverse, complex prompts.
MetaGPT is an open-source multi-agent framework that simulates human software teams to automate complex coding tasks using role-specialized LLM agents and standardized workflows.
PDF2Audio is an open-source tool that transforms PDF documents into high-quality audio files using AI-powered text extraction, script generation, and text-to-speech synthesis.
Make-A-Character is an open-source AI framework that generates highly realistic, customizable 3D digital humans from text descriptions, supporting full-body modeling, animation-ready rigging, and production-grade rendering.
MotionCtrl is an open-source motion controller for video generation models that enables independent, precise control of camera movement and object motion in AI-generated videos.
AnimateDiff is an open-source framework that transforms existing text-to-image models into animation generators without retraining, enabling high-fidelity, style-consistent video sequences from text prompts.
PortraitGen is an open-source AI video editing tool that enables high-fidelity, temporally consistent editing of human portrait videos using 3D Gaussian splatting and neural texture modeling.
GOT-OCR2.0 is an open-source, multimodal OCR model that converts complex documents—including math, charts, music scores, and multilingual text—into editable Markdown or LaTeX with interactive region control and long-context understanding.
SFR-RAG is an open-source, retrieval-augmented language model from Salesforce AI Research that improves factual accuracy, reduces hallucinations, and supports reliable, context-grounded text generation and conversational AI.
V-JEPA is an open-source, self-supervised video foundation model that learns visual representations by predicting masked frame features—enabling robust video understanding without labels.
Boximator is an open-source video synthesis tool that enables precise object motion control in videos using hardhttps://www.aitopic.com/soft bounding box constraints and self-tracking techniques.
DiT is an open-source image generation model that replaces convolutional U-Nets with Transformers in diffusion models to produce high-fidelity, scalable, and controllable synthetic images.
ScreenAgent is an open-source AI agent that observes real computer screens and autonomously performs complex desktop tasks using vision-language understanding and reinforcement learning.