<aside> 🛠

Unified Text-to-Image, Image Editing & In-Context Generation


One model for three different jobs - generate images from text, edit existing images with simple instructions, or combine multiple reference images into a new scene. All driven by natural-language prompts.

</aside>


What it does

OmniGen2 is a single AI model that can do three creative tasks that usually require three separate tools: turn text prompts into images, edit existing images by typing instructions ("change the sky to sunset", "remove the person on the left"), and create new images that combine elements from multiple reference photos ("put the bird from image 1 onto the desk in image 2"). It is a 7B-parameter unified multimodal model accepted at CVPR 2026, built on top of a Qwen-VL-2.5 visual-understanding backbone so it can read images and prompts together. Instead of stitching multiple specialist models into a pipeline, OmniGen2 handles all of these workflows in one place.

Problem it solves

Input/Output

<aside>

<aside>

<aside>

Accuracy & Speed

Generation time ~15 – 30 seconds per image at default settings
Hardware requirement ~17 GB VRAM (e.g., NVIDIA RTX 3090)
Lower-VRAM options CPU offload reduces VRAM by ~50% with negligible speed impact; sequential offload allows running in <3 GB VRAM at much slower speed
Text-to-image quality Competitive with leading open-source unified models
Image editing State-of-the-art among open-source models on instruction-guided editing benchmarks
In-context generation Strong performance on the OmniContext benc

Technical Details

Architecture 7B-parameter unified multimodal diffusion model
Model Design Two decoding pathways (text + image) with unshared parameters, plus a decoupled image tokenizer
Visual Backbone Qwen-VL-2.5 (inherited visual understanding)
Capabilities Text-to-image generation, instruction-guided image editing, in-context (multi-reference) generation, visual understanding
Key Hyperparameters text_guidance_scale, image_guidance_scale, max_pixels, cfg_range_start / cfg_range_end
Inference Optimizations TeaCache, TaylorSeer, model CPU offload (~50% VRAM saving), sequential CPU offload (<3 GB VRAM), optional flash-attn
Supported Frameworks Hugging Face Diffusers (OmniGen2Pipeline), Safetensors, ComfyUI (official integration), Gradio demo
Training & Benchmarks Training dataset: X2I2 — In-context benchmark: OmniContext — Training & fine-tuning code public
Paper "OmniGen2: Exploration to Advanced Multimodal Generation" — arXiv 2506.18871 (CVPR 2026)

Compliance & Provenance