https://www.flickr.com/photos/cptcook/

Video Hyperlinking@ICMR2017 Special Session

As technologies for component feature identification and standard ad hoc search mature, a key challenge of multimedia retrieval is to develop mechanisms for richer content analysis and representations and modes of exploration. For example, to enable users to serendipitously create their own personal narratives by seamlessly exploring (multiple) large audiovisual repositories at the segment level, either by following established trails or creating new ones on the fly. The concept of creating networks of linked video segments within video archives that can be traversed is closely related to what some call the emerging “Web of Video” or the “Visual Web”.

Given the sheer quantities of data now becoming available in audiovisual (AV) repositories and the indefinite number of possible segments therein, one of the main challenges for multimedia exploration is to identify significant elements within this data: which AV segments are interesting enough as material for further use, for example to serve as nodes in a network of linked videos. A key research question in this area is thus whether we can automatically identify video segments that viewers would perceive to be interesting taking multiple modalities into account (visual, audio, text). Visual salience, speech, social media streams or combinations of these can be regarded as a source to derive potential video interestingness. The active research interest in this topic, in the context of movies, is demonstrated by the popularity of the “Predicting Media Interestingness” task, and earlier in the context of user-generated videos, in the “Anchoring” task, both in the MediaEval evaluation benchmark campaign.

Having identified the significant elements (e.g. anchors or hotspots) in the data the next step is to target enhanced exploration modes. The “Video Hyperlinking” task, held at TRECVid and MediaEval, focus explicitly on the creation of links between an interesting video segment and relevant target video segments. Relevance is here based on a topical relationship, using information from both the audio and visual channels.

In a special session at ICMR2017 on Identifying and Linking Interesting Content in Large Audiovisual Repositories, we invite contributions that focus on the exploration of large multimedia archives via automatically generated pathways, especially on the topics of predicting interestingness and video hyperlinking. We also strongly encourage submissions covering other relevant perspectives in this area including:

  • Multi/mixed-media hyperlinking 
  • Linking across audiovisual repositories 
  • Alignment of social media posts to video 
  • Video-to-video search
  • Models for multimodal, segment-based retrieval and linking
  • Segment-level recommendation in videos
  • Video segmentation and summarization
  • Multimodal search (explicit combination of features)
  • Query generation from video
  • Video-to-text description
  • Content-driven, social-driven interestingness prediction
  • Object interestingness modeling and prediction
  • Evaluation of interestingness, linking or exploration systems
  • Use cases in video hyperlinking or interestingness prediction
  • Interfaces for linked-video based storytelling

Maximum Length of a Paper

Each full paper should not be longer than 6 pages (ACM proceedings style).

Important Dates

Paper Submission: February 28, 2017

Notification of Acceptance: March 29, 2017

Camera-Ready Papers Due: April 26, 2017

Single-Blind Review

ICMR will use a single-blind review process for special session paper selection. Authors should provide author names and affiliations in their manuscript.

Abstract and Keywords

The abstract and the keywords form the primary source for assigning papers to reviewers. So make sure that they form a concise and complete summary of your paper with sufficient information to let someone who doesn’t read the full paper know what it is about.

Submission Instructions

See the Paper submission section.

Special Session Organisers

Maria Eskevich, Radboud University, The Netherlands (main contact)

Claire-Helene Demarty and Ngoc Q. K. Duong, Technicolor, France

Benoit Huet, EURECOM, France

Gareth Jones, Dublin City University, Ireland

Roeland Ordelman, University of Twente, The Netherlands

Mats Sjöberg, University of Helsinki, Finland

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s