Abstract:

    Image mosaics are useful for a variety of tasks in vision and computer graphics. A particularly convenient way to generate mosaics is by `stitching' together many ordinary photographs. Existing algorithms focus on capturing static scenes. This paper presents a complete system for creating visually pleasing mosaics in the presence of moving objects. There are three primary contributions. The first component of our system is a registration method that remains unbiased by movement-the Mellin transform is extended to register images related by a projective transform. Second, an efficient method for finding a globally consistent registration of all images is developed. By solving a linear system of equations, derived from many pairwise registration matrices, we find an optimal global registration. Lastly, a new method of compositing images is presented. Blurred areas due to moving objects are avoided by segmenting the mosaic into disjoint regions and sampling pixels in each region from a single source image. 


    Postscript:

    Davis, J., "Mosaics of Scenes with Moving Objects", IEEE Comp. Soc. Conf. on Computer Vision and Pattern Recognition (CVPR98), 1998. [Postscript, 5.5MB] [PDF 2.7MB]

    Slides:

    Slides from CVPR98 presentation [HTML] [Postscript 13.5MB] [PDF 12.2MB]


    Images:

     
    Straightforward compositing of source images can lead to blurred mosaics in regions with moving objects. [Image 102KB]
    Segmenting the final mosaic into regions and drawing image samples from a single source image in each region results in a single focused image. [Image 110KB]
    The initial frames from which the construction site mosaic was computed. [Quicktime 1.4MB]
    Accumulated error can cause noticable artifacts when a sequence of many images is composited into a single mosaic. Images near the end of the sequence are poorly aligned with those near the beginning. [Image 100KB]
    Using a global registration routine to insure that all images are mutually registered results in a much improved mosaic. [Image 73KB]
    The initial frames from which the chapel facade mosaic was computed. [Quicktime 4.9MB]
     A complete panorama outside of the Gates Computer Science Building. [Image 133KB]
    Gates Building as a Quicktime VR file for panormaric viewing. [QTVR 180KB]
    The initial frames from the Gates panorama. [Quicktime 3.9MB]
    A complete panorama in the Roudin sculpture garden. [Image 51KB]
    Roudin Garden as a Quicktime VR file for panormaic viewing. [QTVR 87KB]
    The initial frames from the Roudin panorama. [Quicktime 1.2MB]