UIST 2013
Video Collections in Panoramic Contexts

James Tompkin Fabrizio Pece Rajvi Shah Shahram Izadi Jan Kautz Christian Theobalt
MPI für Informatik University College London Intel VCI IIIT Hyderabad Microsoft Research

Video collections of places show contrasts and changes in our world, but current interfaces to video collections make it hard for users to explore these changes. Recent state-of-the-art interfaces attempt to solve this problem for ‘outside->in’ collections, but cannot connect ‘inside->out’ collections of the same place which do not visually overlap. We extend the focus+context paradigm to create a video-collections+context interface by embedding videos into a panorama. We build a spatio-temporal index and tools for fast exploration of the space and time of the video collection. We demonstrate the flexibility of our representation with interfaces for desktop and mobile flat displays, and for a spherical display with joypad and tablet controllers. We study with users the effect of our video-collection+context system to spatio-temporal localization tasks, and find significant improvements to accuracy and completion time in visual search tasks compared to existing systems. We measure the usability of our interface with System Usability Scale (SUS) and task-specific questionnaires, and find our system scores higher.

author = {Tompkin, James and Pece, Fabrizio and Shah, Rajvi
and Izadi, Shahram and Kautz, Jan and Theobalt, Christian},
title = {Video Collections in Panoramic Contexts},
booktitle = {The 26th Annual ACM Symposium on User Interface Software and Technology, UIST'13},
month = oct,
year = {2013},

PDF (18 MB)
  Supplemental Material
PDF (3 MB)
Includes spherical
display details!
20141027: Errors
fixed in missing
homography estimation.
PPTX (180 MB)

  Supplemental Video
MP4 (80 MB) | YouTube