VideoWhiz: Non-Linear Interactive Overviews for Recipe Videos

Authors

Megha Nawhal, Jacqueline B Lang, Greg Mori, Parmit K Chilana

Research Lab

Parmit Chilana

Research Themes

Video-Based Learning

Abstract

With millions of recipe videos increasingly available online, viewers often face the challenge of browsing through these videos and deciding among different styles of recipe demonstrations and instructions. Although state-of-the-art video summarization techniques using linear presentation formats have been shown to be effective in domains such as surveillance, sports or lecture videos, recipe videos are often more complex and may require a different summarization approach. We first investigated how viewers navigate recipe videos and what information they look for when seeking quick overviews of such videos. Based on our findings, we designed VideoWhiz, a novel interactive video summarization tool that provides a non-linear overview design allowing easy access to the key stages or milestones within the recipe and inter-milestone relationships. VideoWhiz uses a combination of computer vision techniques and an annotation workflow to generate these interactive overviews. Our evaluation showed that viewers found VideoWhiz to be effective and useful in providing quick overviews of recipe videos. We discuss the potential for future work to investigate non-linear overviews for other types of instructional videos and to explore more powerful representations for video summarization.

Citation

Megha Nawhal, Jacqueline B Lang, Greg Mori, Parmit K Chilana. "VideoWhiz: Non-Linear Interactive Overviews for Recipe Videos." In Proceedings of the 45th Graphics Interface Conference on Proceedings of Graphics Interface 2019, pp. 1-8. Canadian Human-Computer Communications Society, 2019.

@inproceedings{nawhal2019videowhiz,
  title={VideoWhiz: Non-Linear Interactive Overviews for Recipe Videos},
  author={Nawhal, Megha and Lang, Jacqueline B and Mori, Greg and Chilana, Parmit K},
  booktitle={Proceedings of the 45th Graphics Interface Conference on Proceedings of Graphics Interface 2019},
  pages={1--8},
  year={2019},
  organization={Canadian Human-Computer Communications Society}
}