Export Citations
Publications
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-article
The ToMCAT dataset
- Adarsh Pyarelal,
- Eric Duong,
- Caleb Jones Shibu,
- Paulo Soares,
- Savannah Boyd,
- Payal Khosla,
- Valeria Pfeifer,
- Diheng Zhang,
- Eric Andrews,
- Rick Champlin,
- Vincent Raymond,
- Meghavarshini Krishnaswamy,
- Clayton Morrison,
- Emily Butler,
- Kobus Barnard
NIPS '23: Proceedings of the 37th International Conference on Neural Information Processing Systems•December 2023, Article No.: 1781, pp 40872-40923We present a rich, multimodal dataset consisting of data from 40 teams of three humans conducting simulated urban search-and-rescue (SAR) missions in a Minecraft-based testbed, collected for the Theory of Mind-based Cognitive Architecture for Teams (...
- Article
Modular Procedural Generation for Voxel Maps
Computational Theory of Mind for Human-Machine Teams•November 2021, pp 85-101• https://doi.org/10.1007/978-3-031-21671-8_6AbstractTask environments developed in Minecraft are becoming increasingly popular for artificial intelligence (AI) research. However, most of these are currently constructed manually, thus failing to take advantage of procedural content generation (PCG), ...
- research-article
Fast Approximate Score Computation on Large-Scale Distributed Data for Learning Multinomial Bayesian Networks
ACM Transactions on Knowledge Discovery from Data, Volume 13, Issue 2•April 2019, Article No.: 14, pp 1-40 • https://doi.org/10.1145/3301304In this article, we focus on the problem of learning a Bayesian network over distributed data stored in a commodity cluster. Specifically, we address the challenge of computing the scoring function over distributed data in an efficient and scalable ...
- Article
Multiple-Gaze Geometry: Inferring Novel 3D Locations from Gazes Observed in Monocular Video
Computer Vision – ECCV 2018•September 2018, pp 641-659• https://doi.org/10.1007/978-3-030-01225-0_38AbstractWe develop using person gaze direction for scene understanding. In particular, we use intersecting gazes to learn 3D locations that people tend to look at, which is analogous to having multiple camera views. The 3D locations that we discover need ...
- Article
Moderated and drifting linear dynamical systems
ICML'15: Proceedings of the 32nd International Conference on International Conference on Machine Learning - Volume 37•July 2015, pp 2473-2482We consider linear dynamical systems, particularly coupled linear oscillators, where the parameters represent meaningful values in a domain theory, and thus learning what affects them contributes to explanation. Rather than allow perturbations of latent ...
- Article
Bayesian 3D Tracking from Monocular Video
ICCV '13: Proceedings of the 2013 IEEE International Conference on Computer Vision•December 2013, pp 3368-3375• https://doi.org/10.1109/ICCV.2013.418We develop a Bayesian modeling approach for tracking people in 3D from monocular video with unknown cameras. Modeling in 3D provides natural explanations for occlusions and smoothness discontinuities that result from projection, and allows priors on ...
- Article
A Statistical Model for Recreational Trails in Aerial Images
CVPR '13: Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition•June 2013, pp 337-344• https://doi.org/10.1109/CVPR.2013.50We present a statistical model of aerial images of recreational trails, and a method to infer trail routes in such images. We learn a set of textons describing the images, and use them to divide the image into super-pixels represented by their text on. ...
- Article
Understanding Bayesian Rooms Using Composite 3D Object Models
CVPR '13: Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition•June 2013, pp 153-160• https://doi.org/10.1109/CVPR.2013.27We develop a comprehensive Bayesian generative model for understanding indoor scenes. While it is common in this domain to approximate objects with 3D bounding boxes, we propose using strong representations with finer granularity. For example, we model ...
- poster
Client-side backprojection of presentation slides into educational video
MM '12: Proceedings of the 20th ACM international conference on Multimedia•October 2012, pp 1005-1008• https://doi.org/10.1145/2393347.2396368A significant part of many videos of lectures is presentation slides that occupy much of the field of view. Further, for a student studying the lecture, having the slides sharply displayed is especially important, compared with the speaker, background, ...
- short-paper
Fusing object detection and region appearance for image-text alignment
- Luca Del Pero,
- Philip Lee,
- James Magahern,
- Emily Hartley,
- Kobus Barnard,
- Ping Wang,
- Atul Kanaujia,
- Niels Haering
MM '11: Proceedings of the 19th ACM international conference on Multimedia•November 2011, pp 1113-1116• https://doi.org/10.1145/2072298.2071951We present a method for automatically aligning words to image regions that integrates specific object classifiers (e.g., "car" detectors) with weak models based on appearance features. Previous strategies have largely focused on the latter, and thus ...
- short-paper
Expanding the point: automatic enlargement of presentation video elements
MM '11: Proceedings of the 19th ACM international conference on Multimedia•November 2011, pp 961-964• https://doi.org/10.1145/2072298.2071913We present a system that assists users in viewing videos of lectures on small screen devices, such as cell phones. It automatically identifies semantic units on the slides, such as bullets, groups of bullets, and images. As the participant views the ...
- research-article
Robust Spatiotemporal Matching of Electronic Slides to Presentation Videos
IEEE Transactions on Image Processing, Volume 20, Issue 8•August 2011, pp 2315-2328 • https://doi.org/10.1109/TIP.2011.2109727We describe a robust and efficient method for automatically matching and time-aligning electronic slides to videos of corresponding presentations. Matching electronic slides to videos provides new methods for indexing, searching, and browsing videos in ...
- Article
Sampling bedrooms
CVPR '11: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition•June 2011, pp 2009-2016• https://doi.org/10.1109/CVPR.2011.5995737We propose a top down approach for understanding indoor scenes such as bedrooms and living rooms. These environments typically have the Manhattan world property that many surfaces are parallel to three principle ones. Further, the 3D geometry of the ...
- Article
A generative statistical model for tracking multiple smooth trajectories
CVPR '11: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition•June 2011, pp 1137-1144• https://doi.org/10.1109/CVPR.2011.5995736We present a general model for tracking smooth trajectories of multiple targets in complex data sets, where tracks potentially cross each other many times. As the number of overlapping trajectories grows, exploiting smoothness becomes increasingly ...
- Article
Improving and Aligning Speech with Presentation Slides
ICPR '10: Proceedings of the 2010 20th International Conference on Pattern Recognition•August 2010, pp 3280-3283• https://doi.org/10.1109/ICPR.2010.802We present a novel method to correct automatically generated speech transcripts of talks and lecture videos using text from accompanying presentation slides. The approach finesses the challenges of dealing with technical terms which are often outside ...
- article
A fast connected components labeling algorithm and its application to real-time pupil detection
Machine Vision and Applications, Volume 21, Issue 5•August 2010, pp 779-787 • https://doi.org/10.1007/s00138-009-0183-1We describe a fast connected components labeling algorithm using a region coloring approach. It computes region attributes such as size, moments, and bounding boxes in a single pass through the image. Working in the context of real-time pupil detection ...
- poster
Region-based automatic web image selection
MIR '10: Proceedings of the international conference on Multimedia information retrieval•March 2010, pp 305-312• https://doi.org/10.1145/1743384.1743436We propose a new Web image selection method which employs the region-based bag-of-features representation. The contribution of this work is (1) to introduce the region-based bag-of-features representation into an Web image selection task where training ...
- Article
Learning models of object structure
NIPS'09: Proceedings of the 22nd International Conference on Neural Information Processing Systems•December 2009, pp 1615-1623We present an approach for learning stochastic geometric models of object categories from single view images. We focus here on models expressible as a spatially contiguous assemblage of blocks. Model topologies are learned across groups of images, and ...
- Article
Accurate alignment of presentation slides with educational video
ICME'09: Proceedings of the 2009 IEEE international conference on Multimedia and Expo•June 2009, pp 1198-1201Spatio-temporal alignment of electronic slides with corresponding presentation video opens up a number of possibilities for making the instructional content more accessible and understandable, such as video quality improvement, better content analysis ...
