skip to main content
10.1145/2393347.2396368acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
poster

Client-side backprojection of presentation slides into educational video

Published: 29 October 2012 Publication History
  • Get Citation Alerts
  • Abstract

    A significant part of many videos of lectures is presentation slides that occupy much of the field of view. Further, for a student studying the lecture, having the slides sharply displayed is especially important, compared with the speaker, background, and audience. However, even if the original capture supports it, the bandwidth required for real time viewing is substantive, especially in the context of mobile devices. Here we propose reconstructing the video on the client side by backprojecting high resolution slide images into the video stream with the slide area blacked out. The high resolution slide deck can be sent once, and inserted into the video on the client side based on the transformation (a homography) computed in advance. We further introduce the idea that needed homography transformations can be approximated using affine transformations, which allows it to be done using built-in capabilities of HTML 5. We find that it is possible to significantly reduce bandwidth by compressing the modified video, while improving the slide area quality, but leaving the non-slide area roughly the same.

    References

    [1]
    Academic Earth. http://academicearth.org/.
    [2]
    ffmpeg2theora. http://v2v.cc/~j/ffmpeg2theora/.
    [3]
    Free Online MIT Course Materials. http://ocw.mit.edu/OcwWeb/web/courses/av/}.
    [4]
    Open Yale Courses. http://oyc.yale.edu/courselist.
    [5]
    Semantically Linked Instructional Content (SLIC). http://slic.arizona.edu/.
    [6]
    UC Berkeley Webcasts. http://webcast.berkeley.edu/courses.php.
    [7]
    Video Lectures. http://videolectures.net/.
    [8]
    YouTube EDU. http://www.youtube.com/edu.
    [9]
    E. Altman, Y. Chen, and W. C. Low. Semantic exploration of lecture videos. Proceedings of the tenth ACM international conference on Multimedia - MULTIMEDIA '02, page 416, 2002.
    [10]
    N.-M. Cheung, D. Chen, V. Chandrasekhar, S. S. Tsai, G. Takacs, S. A. Halawa, and B. Girod. Restoration of out-of-focus lecture video by automatic slide matching. In Proceedings of the international conference on Multimedia, MM '10, pages 899--902, New York, NY, USA, 2010. ACM.
    [11]
    Q. Fan, A. Amir, K. Barnard, R. Swaminathan, and A. Efrat. Temporal modeling of slide change in presentation videos. In International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2007.
    [12]
    Q. Fan, K. Barnard, A. Amir, and A. Efrat. Accurate alignment of presentation slides with educational video. In IEEE International Conference on Multimedia & Expo (ICME), 2009.
    [13]
    Q. Fan, K. Barnard, A. Amir, and A. Efrat. Robust spatiotemporal matching of electronic slides to presentation videos. IEEE Transactions on Image Processing, 20(8):2315--2328, 2011.
    [14]
    Q. Fan, K. Barnard, A. Amir, A. Efrat, and M. Lin. Matching slides to presentation videos using sift and scene background matching. In 8th ACM SIGMM International Workshop on Multimedia Information Retrieval, 2006.
    [15]
    G. Gigonzac, F. Pitie, and A. Kokaram. Electronic slide matching and enhancement of a lecture video. IET Conference Publications, 2007(CP534):9--9, 2007.
    [16]
    Q. Tung, R. Swaminathan, A. Efrat, and K. Barnard. Expanding the point: automatic enlargement of presentation video elements. In Proceedings of the 19th ACM international conference on Multimedia, MM '11, pages 961--964, New York, NY, USA, 2011. ACM.
    [17]
    A. Winslow, Q. Tung, Q. Fan, J. Torkkola, R. Swaminathan, K. Barnard, A. Amir, A. Efrat, and C. Gniady. Studying on the move: enriched presentation video for mobile devices. In Proceedings of the 28th IEEE international conference on Computer Communications Workshops, INFOCOM'09, pages 224--229, Piscataway, NJ, USA, 2009. IEEE Press.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '12: Proceedings of the 20th ACM international conference on Multimedia
    October 2012
    1584 pages
    ISBN:9781450310895
    DOI:10.1145/2393347
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. affine transformation
    2. backprojection
    3. homography
    4. lecture video
    5. presentation slides

    Qualifiers

    • Poster

    Conference

    MM '12
    Sponsor:
    MM '12: ACM Multimedia Conference
    October 29 - November 2, 2012
    Nara, Japan

    Acceptance Rates

    Overall Acceptance Rate 995 of 4,171 submissions, 24%

    Upcoming Conference

    MM '24
    The 32nd ACM International Conference on Multimedia
    October 28 - November 1, 2024
    Melbourne , VIC , Australia

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 143
      Total Downloads
    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0

    Other Metrics

    Citations

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media

    -