RepFinder: finding approximately repeated scene elements for image editing

Article English OPEN
Cheng, Ming-Ming ; Zhang, Fang-Lue ; Mitra, Niloy J. ; Huang, Xiaolei ; Hu, Shi-Min (2010)
  • Publisher: ACM
  • Related identifiers: doi: 10.1145/1778765.1778820
  • Subject: QA76 | T1
    acm: ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION

Repeated elements are ubiquitous and abundant in both manmade and natural scenes. Editing such images while preserving the repetitions and their relations is nontrivial due to overlap, missing parts, deformation across instances, illumination variation, etc. Manually enforcing such relations is laborious and error-prone. We propose a novel framework where user scribbles are used to guide detection and extraction of such repeated elements. Our detection process, which is based on a novel boundary band method, robustly extracts the repetitions along with their deformations. The algorithm only considers the shape of the elements, and ignores similarity based on color, texture, etc. We then use topological sorting to establish a partial depth ordering of overlapping repeated instances. Missing parts on occluded instances are completed using information from other instances. The extracted repeated instances can then be seamlessly edited and manipulated for a variety of high level tasks that are otherwise difficult to perform. We demonstrate the versatility of our framework on a large set of inputs of varying complexity, showing applications to image rearrangement, edit transfer, deformation propagation, and instance replacement.
  • References (37)
    37 references, page 1 of 4

    ADAMS, A., GELFAND, N., DOLSON, J., AND LEVOY, M. 2009. Gaussian KD-trees for fast high-dimensional filtering. ACM Trans. Graph. 28, 3, 21:1-12.

    AHUJA, N., AND TODOROVIC, S. 2007. Extracting texels in 2.1D natural textures. In Proc. of ICCV, 1-8.

    AN, X., AND PELLACINI, F. 2008. Appprop: all-pairs appearancespace edit propagation. ACM Trans. Graph. 27, 3, 40: 1-9.

    BAI, X., LI, Q. N., LATECKI, L. J., LIU, W. Y., AND TU, Z. W. 2009. Shape band: A deformable object detection approach. In Proc. of CVPR, 1335-1342.

    BAI, X., WANG, J., SIMONS, D., AND SAPIRO, G. 2009. Video SnapCut: robust video object cutout using localized classifiers. In ACM Trans. Graph., ACM, 70.

    BARNES, C., SHECHTMAN, E., FINKELSTEIN, A., AND GOLDMAN, D. B. 2009. Patchmatch: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28, 3, 24:1-11.

    BAY, H., ESS, A., TUYTELAARS, T., AND GOOL, L. J. V. 2008. Speeded-up robust features (SURF). Computer Vision and Image Understanding 110, 3, 346-359.

    BELONGIE, S., MALIK, J., AND PUZICHA, J. 2002. Shape matching and object recognition using shape contexts. IEEE TPAMI 24, 4, 509-522.

    BERG, A. C., BERG, T. L., AND MALIK, J. 2005. Shape matching and object recognition using low distortion correspondences. In Proc. of CVPR, I: 26-33.

    BOOKSTEIN, F. 1989. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE TPAMI 11, 6, 567-585.

  • Metrics
    0
    views in OpenAIRE
    0
    views in local repository
    55
    downloads in local repository

    The information is available from the following content providers:

    From Number Of Views Number Of Downloads
    Online Research @ Cardiff - IRUS-UK 0 55
Share - Bookmark