A video search engine that supports sentential queries over 10 full-length Hollywood movies. Given a sentential query which conforms to a grammar it returns ranked clips which depict the query sentence using the techniques developed in

Daniel P. Barrett, Andrei Barbu, N. Siddharth, Jeffrey Mark Siskind, 'Saying what you're looking for: Linguistics meets video search', Transactions on Pattern Analysis and Machine Intelligence, October 2016.
Haonan Yu, Andrei Barbu, N. Siddharth, Jeffrey Mark Siskind, 'A Compositional Framework for Grounding Language Inference, Generation, and Acquisition in Video', Journal of Artificial Intelligence Research, April 2015.
To use this search engine form sentences from the template below and use the input box at the bottom of this page or click some of the sample sentences.

Template for sentential queries

\[ \textit{The}\; \left\{\begin{array}{l} \textit{person}\\ \textit{horse} \end{array}\right\}\; \left\{\begin{array}{l} \textit{approached}\; \textit{the}\; \left\{\begin{array}{l} \textit{person}\\ \textit{horse} \end{array}\right\}\; \left\{\begin{array}{l} \epsilon\\ \textit{quickly}\\ \textit{slowly} \end{array}\right\}\; \left\{\begin{array}{l} \epsilon\\ \textit{from the left}\\ \textit{from the right} \end{array}\right\}\\ \left\{\begin{array}{l} \textit{lead}\\ \textit{rode} \end{array}\right\}\; \textit{the}\; \left\{\begin{array}{l} \textit{person}\\ \textit{horse} \end{array}\right\}\; \left\{\begin{array}{l} \epsilon\\ \textit{quickly}\\ \textit{slowly} \end{array}\right\}\; \left\{\begin{array}{l} \epsilon\\ \textit{leftward}\\ \textit{rightward}\\ \left\{\begin{array}{l} \textit{towards}\\ \textit{away from} \end{array}\right\}\; \textit{the}\; \left\{\begin{array}{l} \textit{person}\\ \textit{horse} \end{array}\right\} \end{array}\right\} \end{array}\right\} \]

The 10 Hollywood movies
Black Beauty (Warner Brothers, 1994)
The Black Stallion (MGM, 1979)
Blazing Saddles (Warner Brothers, 1974)
Easy Rider (Columbia Pictures, 1969)
The Good the Bad and the Ugly (Columbia Pictures, 1966)
Hidalgo (Touchstone Pictures, 2004)
National Velvet (MGM, 1944)
Once Upon a Time in Mexico (Columbia Pictures, 2003)
Seabiscuit (Universal Pictures, 2003)
Unforgiven (Warner Brothers, 1992)
Sample sentences

No results