Query-by-Sketch Based Image Synthesis

David GAVILAN  Suguru SAITO  Masayuki NAKAJIMA  

IEICE TRANSACTIONS on Information and Systems   Vol.E91-D   No.9   pp.2341-2352
Publication Date: 2008/09/01
Online ISSN: 1745-1361
DOI: 10.1093/ietisy/e91-d.9.2341
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Image Processing and Video Processing
query-by-sketch,  image synthesis,  image compositing,  collage,  relevance feedback,  

Full Text: PDF>>
Buy this Article

Using query-by-sketch we propose an application to efficiently create collages with some user interaction. Using rough color strokes that represent the target collage, images are automatically retrieved and segmented to create a seamless collage. The database is indexed using simple geometrical and color features for each region, and histograms that represent these features for each image. The image collection is then queried by means of a simple paint tool. The individual segments retrieved are added to the collage using Poisson image editing or alpha matting. The user is able to modify the default segmentations interactively, as well as the position, scale, and blending options for each object. The resulting collage can then be used as an input query to find other relevant images from the database.