Real time video stitching by exploring temporal and spatial features

Shaoen Wu, Kelly Blair, Junhong Xu, Hanqing Guo, Kai Wang, Lei Chen, Shangyue Zhu

Research output: Contribution to book or proceedingConference articlepeer-review

Abstract

Although image stitching has been investigated for years, realtime video stitching still lacks of efficient methods to meet the required frame rate for satisfactory human vision experience. This work proposes efficient video stitching solutions by exploiting both temporal and spatial features among video frames. As a result, the stitching speed is significantly improved with two techniques by exploiting: (1) the dimmension of distance (spatial) by focusing only on the region of frame overlap and (2) the dimmension of time (temporal) by reusing homography information across multiple frames. Based on these two techniques, this paper presents three solutions to determine submiages for rapid stitching the video frames from side-by-side cameras. This work implements these solutions into a video stitcher. The evaluation over video streams shows that the proposed solutions can stitch the video at 6.5 frames per second (fps) in contrast to 1.5 fps in conventional imaging stitching approaches, which is over 400% improvement on stitching speed performance, but at the cost of a marginal drop in accuracy.

Original languageEnglish
Title of host publicationMOBIMEDIA 2017 - 10th EAI International Conference on Mobile Multimedia Communications
EditorsHonggang Wang, Qianbin Chen, Yanbing Liu, Dapeng Wu, Nirwan Ansari, Lei Chen, Dalei Wu
PublisherICST
Pages228-233
Number of pages6
ISBN (Print)9781631901560
DOIs
StatePublished - 2017
Event10th EAI International Conference on Mobile Multimedia Communications, MOBIMEDIA 2017 - Chongqing, China
Duration: Jul 13 2017Jul 14 2017

Publication series

NameInternational Conference on Mobile Multimedia Communications (MobiMedia)
Volume2017-July
ISSN (Electronic)2413-094X

Conference

Conference10th EAI International Conference on Mobile Multimedia Communications, MOBIMEDIA 2017
Country/TerritoryChina
CityChongqing
Period07/13/1707/14/17

Scopus Subject Areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Emergency Medicine
  • Media Technology
  • Modeling and Simulation

Keywords

  • Appearance
  • Interest point
  • Matching
  • Salient region detections
  • Texture representations

Fingerprint

Dive into the research topics of 'Real time video stitching by exploring temporal and spatial features'. Together they form a unique fingerprint.

Cite this