Automating Joiners (or Organized Memories)

Lihi Zelnik-Manor and Pietro Perona

Abstract

A single picture cannot always capture the full scene. It has thus become common among artists and amateur photographers to take multiple pictures of the same scene and compose them into image joiners (a term coined by artist David Hockney). Typically, these joiners are constructed by manually positioning and layering the images on a (digital) 2D canvas using software tools like Photoshop. This results in a fragmanted composition of images, where some images occlude others and boundaries across pictures are fully visible. In spite (or maybe due to) their fragmanted look, such representations are attracting a lot of attention and numerous examples are posted online in webpages such as Flickr (taged with joiners, Hockney, photocollage, etc.)

We are interested in automating the construction of such image joiners for two main objectives. The first is providing photgraphers with a good starting point from which they can more easily finalize their joiners. The second is providing a new way for exploring image collections now organized in correspondence with the underlying scene rather than by file names.

Paper
L. Zelnik-Manor and P. Perona, “Automating Joiners“,
The 5th International Conference on Non-Photorealistic Animation and Rendering, NPAR 2007.
PDF

Slides
Slides of a presentation given at Dick Lyon’s photography course

Slides of a newer presentation

Code
Matlab implementation by Ekapol Chuangsuwanich

Our Matlab code for windows

Here are some of our input images, in case you want to create you own joiners.

Cacti Garden
Cacti Garden 1
Cacti Garden 2
Cacti Garden 3
Cacti Garden 4
Long Beach Airport
Michael McMillen 1
Michael McMillen 2
Michael McMillen 3
JetBlue
Anza Borrego

Some Examples of our automatically generated joiners

Cacti Garden
Cacti
Arch
Arch
Pond
Pond
Anza-Borrego
Anza
Long Beach Airport
Long Beach Airport
Uccello
Uccello reconstruction
Tractor
Tractor
Truck
Truck
Southewest
Southwest
Mickael McMillen
McMillen
Stav Zelnik
Stav

Some Examples of semi-automatic joiners

Between 2 and 4 point correspondences had to be provided manually. The rest (i.e., alignment and layering of images) was done automatically.

Family

Family

Bill Freeman

Bill

Impossible Bridge

Japanese Bridge

Homage to David Hockney’s LA Visitors series
Between 4 and 6 point correspondences had to be provided manually. The rest (i.e., alignment and layering of images) was done automatically.

Francois Fleuret

Francois

Marco Ponti

Marco Ponti

Patrick Hughes

Patrick Hughes

Organized Memories

A more intuitive way for browsing image collections     Preliminary demo

Related Links

A similar approach has been developed in parallel by Yoshikuni Nomura, Li Zhang and Shree Nayar

Our previous work  on “squaring the circle in panoramas“.