PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
September 30, 20250 citationsOpen Access

ImgEdit: A Unified Image Editing Dataset and Benchmark

View Full Paper
YYYe YangXHXiaosong HeZLZongjian Li

Key Points

  • ImgEdit comprises 1.2 million high-quality image editing pairs, improving the quality of open-source models.
  • The integration of various models enhances data curation, ensuring superior task novelty and edit quality.
  • ImgEdit-E1 outperforms existing models on multiple tasks, demonstrating the dataset's value for training image editing models.
  • ImgEdit-Bench evaluates editing performance across different suites, revealing insights into model behavior.

Abstract

Recent advancements in generative models have enabled high-fidelity text-to-image generation. However, open-source image-editing models still lag behind their proprietary counterparts, primarily due to limited high-quality data and insufficient benchmarks. To overcome these limitations, we introduce ImgEdit, a large-scale, high-quality image-editing dataset comprising 1.2 million carefully curated edit pairs, which contain both novel and complex single-turn edits, as well as challenging multi-turn tasks. To ensure the data quality, we employ a multi-stage pipeline that integrates a cutting-edge vision-language model, a detection model, a segmentation model, alongside task-specific in-painting procedures and strict post-processing. ImgEdit surpasses existing datasets in both task novelty and data quality. Using ImgEdit, we train ImgEdit-E1, an editing model using Vision Language Model to process the reference image and editing prompt, which outperforms existing open-source models on multiple tasks, highlighting the value of ImgEdit and model design. For comprehensive evaluation, we introduce ImgEdit-Bench, a benchmark designed to evaluate image editing performance in terms of instruction adherence, editing quality, and detail preservation. It includes a basic testsuite, a challenging single-turn suite, and a dedicated multi-turn suite. We evaluate both open-source and proprietary models, as well as ImgEdit-E1, providing deep analysis and actionable insights into the current behavior of image-editing models. The source data are publicly available on https://github.com/PKU-YuanGroup/ImgEdit.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Yang et al. (2025) studied this question.

synapsesocial.com/papers/68dc12cc8a7d58c25ebb0b53https://doi.org/10.48550/arxiv.2505.20275
Ask AI
Helpful
Bookmark
Share
View Full Paper