CHI-WEB Archives

ACM SIGCHI WWW Human Factors (Open Discussion)


Options: Use Forum View

Use Monospaced Font
Show Text Part by Default
Show All Mail Headers

Message: [<< First] [< Prev] [Next >] [Last >>]
Topic: [<< First] [< Prev] [Next >] [Last >>]
Author: [<< First] [< Prev] [Next >] [Last >>]

Print Reply
Adam Sobieski <[log in to unmask]>
Reply To:
Adam Sobieski <[log in to unmask]>
Tue, 13 Sep 2011 07:07:36 -0400
text/plain (28 lines)
The Association for Computing Machinery,
Special Interest Group on Computer Human Interaction,

Hello.  I would like to describe, for purposes of discussion, five multimedia user interface ideas.  These ideas can enhance both media player software and web browser software as HTML5 includes both audio and video.

The first idea is the capability to select multimedia content and to have an extensible context menu available for those selections.  Two types of selection possible for video are spatial and temporal.  Spatial selection involves rectangles of video.  Temporal selection involves intervals of the multimedia object.  It is desired to be able to select multimedia and to have a context menu available for those selections on computers, consoles and digital cable boxes.  Example uses of multimedia selections include blogging and otherwise making fair use of clips from television or web video, such as political speeches, news and punditry.

The second idea is bookmarking.  While listening to audio or watching video, users can bookmark, or place visual indicators at the current location of the playhead.  Bookmarked locations can be further interacted with, for example for selecting and context menu use, after watching more of or the entirety of the multimedia object.  Some media player software already include bookmarking capabilities.

The third idea involves that spatial and temporal selections of multimedia can be indicated by means of media fragments URI (  Media players and web browsers can navigate to and play selections of multimedia objects.  For example, a video at could have an interval of it indicated by,200.  The third idea is for users to be able to zoom to larger rectangles and wider intervals of content from multimedia objects described by media fragments URI.

The fourth idea involves that video tracks can describe more structure than a list of chapters.  Video tracks can describe custom structure, for example books, parts, chapters, pages, paragraphs and sentences.  Navigating multimedia objects by means of the enhanced and customizable structure in multimedia tracks is the fourth idea.

The fifth idea pertains to text-based search into multimedia.  As documents can contain audio and video, and as document viewing software includes finding text occurrences in documents, the fifth idea is for client-side text-based search into the audio and video objects in documents using either tracks or audio and natural language processing.

Kind regards,

Adam Sobieski

        Tip of the Day: Email mailto:[log in to unmask]
               with any comments, questions or problems
              MODERATOR: mailto:[log in to unmask]