University of Minnesota
University of Minnesota
http://www.umn.edu/
IMA Web

IMA Annual Program Year Workshop

Visual Learning and Recognition

May 22-26, 2006

Organizers:

Donald Geman

Department of Applied Mathematics and Statistics
Johns Hopkins University
http://cis.jhu.edu/people/faculty/geman/

Jitendra Malik

Department of Electrical Engineering & Computer Science
University of California - Berkeley
http://www.cs.berkeley.edu/~malik/

Shimon Ullman

Department of Applied Mathematics & Computer Science
The Weizmann Institute of Science
http://www.wisdom.weizmann.ac.il/~shimon/

Schedule Participants Program Application Feedback
IMA Live Streaming and Webcasting
Note: Live streaming for the workshop will not be available and webcasting
will be password restricted. Some sessions may not be webcast.
To request a password, email
Abstracts and Talk Materials Dining Guide Maps
Photo Gallery

Description:

Various mathematical frameworks have been explored for visual learning and visual recognition. Special cases of Bayesian modeling and inference, such as deformable templates and compositional vision, lead to the construction of probability measures on complex structures, such as grammars, graphs and spaces of transformations. Difficult mathematical questions arise in learning these and other representations from training data consisting of labeled examples. Recently, tools from statistical inference and information theory have led to new bounds on generalization error as well as new learning algorithms for classification. Most methods for interpreting complex scenes raise formidable computational challenges, inspiring new strategies for visual search.

Despite stronger theoretical foundations, and despite progress in special cases of learning and recognition (e.g., in finding instances from one object class and in analyzing the limits of inductive learning), the full scene interpretation problem remains out of reach. The purpose of this workshop is to present and contrast differing proposals about central issues such as computation, tradeoffs in learning vs. modeling, connections with natural vision and the roles of classification, bottom-up processing (e.g., segmentation) and hierarchies of parts.

Workshop Strategy: The workshop will be somewhat unorthodox in the sense of departing from the usual n-talk format in favor of extensive discussion. Aside from one poster session and one session on "Neural Representation and Computation," which consists of talks from several people from the neuroscience community, the activities are either: i) Strategy sessions, each about an approach or set of tools for visual recognition and involving "advocates" and "critics", and each of duration about two hours; or ii) Discussion sessions about more general topics, each assigned several "panelists" and of duration one hour. The advocates will describe the general strategy, or their variation on it, in the manner of a mini-tutorial, concentrating on mature work and the big picture. The critics will evaluate the approach, both the specific variations represented by the advocates as well as the general potential — strengths and weaknesses, inherent limitations, etc., everything that makes for constructive criticism; audience participation is encouraged.

Schedule
Monday, May 22
8:00a-8:45a Registration and coffee   EE/CS 3-176
8:45a-9:00a Introductory remarks   EE/CS 3-180
9:00a-10:00a Invariant Local Descriptors
Advocate: Lazebnik
Critic: Huttenlocher
Daniel Huttenlocher (Cornell University), Svetlana Lazebnik (University of Illinois at Urbana-Champaign) EE/CS 3-180
10:00a-11:00a The Limits of Learning
Panelists: Amit, LeCun
Yali Amit (University of Chicago), Yann LeCun (New York University) EE/CS 3-180
11:00a-1:30p Lunch    
1:30p-2:30p Recognizing Actions and People
Panelists: Vidal, Soatto
Stefano Soatto (University of California), Rene Vidal (Johns Hopkins University) EE/CS 3-180
2:30p-3:00p Coffee   EE/CS 3-176
3:00p-5:00p Learning Shared Features
Advocates: Torralba, Ullman
Critics: Bienenstock, Riesenhuber
Elie Bienenstock (Brown University), Max Riesenhuber (Georgetown University), Antonio Torralba (Massachusetts Institute of Technology), Shimon Ullman (Weizmann Institute of Science) EE/CS 3-180
5:00p-6:00p Reception   Lind Hall 400
Tuesday, May 23
8:45a-9:00a Coffee   EE/CS 3-176
9:00a-11:00a Flexible Templates
Advocates: Malik, Felzenzwalb
Critic: Buhmann
Joachim M. Buhmann (Eidgenössische TH Hönggerberg), Pedro F. Felzenszwalb (University of Chicago), Jitendra Malik (University of California) EE/CS 3-180
11:00a-1:30p Lunch    
1:30p-2:30p Recognizing Many Classes
Panelists: Perona, Ullman
Pietro Perona (California Institute of Technology), Shimon Ullman (Weizmann Institute of Science)  
2:30p-3:00p Coffee   EE/CS 3-176
3:00p-5:00p Hierarchical Testing
Advocates: Rehg, Geman
Critics: Hebert, Freeman
William T. Freeman (Massachusetts Institute of Technology), Donald Geman (Johns Hopkins University), Martial Hebert (Carnegie-Mellon University), James Rehg (Georgia Institute of Technology) EE/CS 3-180
Wednesday, May 24
8:45a-9:00a Coffee   EE/CS 3-176
9:00a-11:00a Neural Representation and Computation Kalanit Grill-Spector (Stanford University), Nancy Kanwisher (Massachusetts Institute of Technology), Manabu Tanifuji (The Institute of Physical and Chemical Research (RIKEN)), Simon Thorpe (Université de Toulouse III (Paul Sabatier)) EE/CS 3-180
11:00a-1:30p Lunch    
1:30p-2:30p It's a 3D World
Panelists: Efros,Jacobs
Alyosha Efros (Carnegie-Mellon University), David Jacobs (University of Maryland) EE/CS 3-180
2:30p-3:00p Coffee   EE/CS 3-176
3:00p-5:00p Poster Session (Open)
Lind Hall 400
Motion Recognition with a Convolution Kernel Daniel Boley (University of Minnesota Twin Cities)
Dongwei Cao (University of Minnesota Twin Cities)
Learning Compositional Categorization Models Joachim M. Buhmann (Eidgenössische TH Hönggerberg)
Paley Wiener Theorems and Point Clouds in Scattering and Vision: Announcement of Results Steven Benjamin Damelin (Georgia Southern University)
Local Views of Illuminated Surfaces James Damon (University of North Carolina)
Simultaneous reconstruction and segmentation of images from two-phase fluid flow data using a level set technique Oliver Dorn (Universidad Carlos III de Madrid)
Rossmary Villegas (Universidad Carlos III de Madrid)
Using Multiple Segmentations to Discover Objects and their Extent in Image Collections Alyosha Efros (Carnegie-Mellon University)
William T. Freeman (Massachusetts Institute of Technology)
Hierarchical Statistical Learning of Generic Parts of Object Structure Sanja Fidler (University of Ljubljana)
Pattern Recognition from One Example by Chopping Francois Fleuret (École Polytechnique Fédérale de Lausanne (EPFL))
Bayesian Registration for Anatomical Landmark Detection Camille Izard (Johns Hopkins University)
Bruno Jedynak (Johns Hopkins University)
Deformation-Invariant Image Matching and Plant Species Discovery David Jacobs (University of Maryland)
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories Svetlana Lazebnik (University of Illinois at Urbana-Champaign)
Learning the Features: Supervised versus Unsupervised Yann LeCun (New York University)
Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words
(
Project page)
Juan Carlos Niebles (University of Illinois at Urbana-Champaign)
Pattern Recognition: Rate-Recognition Theory Joseph A. O'Sullivan (Washington University)
Models as tools in neuroscience: Object recognition in cortex at CBCL Tomaso Poggio (Massachusetts Institute of Technology)
Object image representation in area TE of macaque monkeys Manabu Tanifuji (The Institute of Physical and Chemical Research (RIKEN))
Scale-space in Hyperspectral Image Analysis Miguel Velez-Reyes (University of Puerto Rico)
Object recognition: Integrating psychophysics, computer vision and machine learning Christian Wallraven (Max-Planck-Institut für Biologische Kybernetik)
Mapping the Visual Vocabulary—A 'Genome' Project of Vision? Song Chun Zhu (University of California)
Learning novel objects in camouflage ()
Thursday, May 25
8:45a-9:00a Coffee   EE/CS 3-176
9:00a-11:00a Generative Models
Advocates: Zhu, Amit
Critics: Malik, Weiss
Yali Amit (University of Chicago), Jitendra Malik (University of California), Yair Weiss (Hebrew University), Song Chun Zhu (University of California) EE/CS 3-180
11:00a-1:30p Lunch    
1:30p-3:30p Hierarchies of Parts
Advocates: Poggio, Geman
Critics: Perona, Trouve
Stuart Geman (Brown University), Pietro Perona (California Institute of Technology), Tomaso Poggio (Massachusetts Institute of Technology), Alain Trouve (École Normale Supérieure de Cachan) EE/CS 3-180
3:30p-4:00p Coffee   EE/CS 3-176
4:00p-5:00p The Role of Information Theory
Panelists: O'Sullivan, Younes
Joseph A. O'Sullivan (Washington University), Laurent Younes (Johns Hopkins University) EE/CS 3-180
Friday, May 26
8:45a-9:00a Coffee   EE/CS 3-176
9:00a-10:00a Insights from Neuroscience and Psychology
Panelists: Kersten, Valiant
Daniel Kersten (University of Minnesota Twin Cities), (University of Minnesota Twin Cities) EE/CS 3-180
10:00a-11:00a Identification vs. Categorization
Panelists: Bart, Wallraven
Evgeniy Bart (University of Minnesota Twin Cities), Christian Wallraven (Max-Planck-Institut für Biologische Kybernetik) EE/CS 3-180
11:00a-11:15a Coffee   EE/CS 3-176
11:15a-12:15p Tools or Theory?
Panelists: Azencott, Geman
Robert Azencott (École Normale Supérieure de Cachan), Donald Geman (Johns Hopkins University) EE/CS 3-180

LIST OF CONFIRMED PARTICIPANTS

NAMEDEPARTMENTAFFILIATION
Iman AganjDepartment of Electrical and Computer Engineering University of Minnesota, Twin Cities
Amer Agovic University of Minnesota, Twin Cities
Amrudin Agovic University of Minnesota, Twin Cities
Stephen AhearnDepartment of Mathematics and Computer Science Macalester College
In AhnDepartment of Electrical and Computer Engineering Bradley University
Muhammad Al-Qaisi University of Minnesota, Twin Cities
Yali AmitDepartment of Statistics University of Chicago
Jung_Ha AnInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Pablo AriasInstituto de Ingenieria Electrica University of the Republic
Douglas ArnoldInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Donald AronsonInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Stefan Atev University of Minnesota, Twin Cities
Robert Azencott École Normale Supérieure de Cachan
Evgeniy BartInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Peter Battaglia University of Minnesota, Twin Cities
Elie BienenstockDepartment of Neuroscience and Division of Applied Mathematics Brown University
Michael BietermanDepartment of Mathematics and Computing Technology The Boeing Company
Nathaniel Bird University of Minnesota, Twin Cities
Francisco Blanco-SilvaDepartment of Mathematics Purdue University
Daniel BoleyDepartment of Computer Science and Engineering University of Minnesota, Twin Cities
Eran BorensteinDivision of Applied Mathematics Brown University
Huseyin Boyaci University of Minnesota, Twin Cities
Joachim BuhmannInstitute of Computational Science Eidgenössische TH Hönggerberg
Dongwei CaoDepartment of Computer Science and Engineering University of Minnesota, Twin Cities
Stefan CarlssonNumerical Analysis and Computer Science Royal Institute of Technology (KTH)
Albert ChanDepartment of Mathematics and Computer Science Fayetteville State University
Igor ChechelnitskyDepartment of Computer Science University of Minnesota, Twin Cities
Qian-Yong ChenInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Jose CostaCenter for the Mathematics of Information California Institute of Technology
Steven DamelinDepartment of Mathematical Sciences Georgia Southern University
James DamonDepartment of Mathematics University of North Carolina
Brian DiDonnaInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Katja Doerschner New York University
Oliver DornDepartamento de Matemáticas Universidad Carlos III de Madrid
Alyosha EfrosComputer Science Department and The Robotics Institute Carnegie Mellon University
Jinwoo Eo University of Minnesota, Twin Cities
Geon Ae Eom University of Minnesota, Twin Cities
Pedro FelzenszwalbDepartment of Computer Science University of Chicago
Sanja FidlerFaculty of Mathematics and Physics University of Ljubljana
Francois FleuretResearch Department École Polytechnique Fédérale de Lausanne (EPFL)
William FreemanDepartment of Electrical Engineering and Computer Science Massachusetts Institute of Technology
Donald GemanDepartment of Applied Mathematics and Statistics Johns Hopkins University
Stuart GemanDivision of Applied Mathematics Brown University
Maria GiniDepartment of Computer Science and Engineering University of Minnesota, Twin Cities
Alvina GohDepartment of Biomedical Engineering Johns Hopkins University
Kalanit Grill-SpectorDepartment of Psychology Stanford University
Changfeng GuiDepartment of Mathematics University of Connecticut
Jooyoung HahnDivision of Applied Mathematics Korea Advanced Institute of Science and Technology (KAIST)
Hazem HamdanSchool of Mathematics University of Minnesota, Twin Cities
Gloria Haro OrtegaInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Bastian HarrachInstitut für Mathematik Johannes Gutenberg-Universität Mainz
Martial HebertSchool of Computer Science Carnegie Mellon University
Jay Hedge University of Minnesota, Twin Cities
Byung-Woo HongDepartment of Computer Science University of California, Los Angeles
Xiang HuangDepartment of Mathematics University of Connecticut
Daniel HuttenlocherDepartment of Computer Science Cornell University
Victoria InterranteDepartment of Computer Science and Engineering University of Minnesota, Twin Cities
Camille IzardDepartment of Mathematics Johns Hopkins University
Paul Jackway Commonwealth Scientific and Industrial Research Organization (CSIRO)
David JacobsDepartment of Computer Science and UMIACS University of Maryland
Sookyung JooInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Fredrik KahlCenter for Mathematics Lund University
Sung Ha KangDepartment of Mathematics University of Kentucky
Nancy KanwisherDepartment of Brain and Cognitive Science Massachusetts Institute of Technology
Daniel KerstenDepartment of Psychology University of Minnesota, Twin Cities
Matthias KurzkeInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Song-Hwa KwonInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Svetlana LazebnikBeckman Institute for Advanced Science and Technology University of Illinois at Urbana-Champaign
Federico LecumberryInstituto de Ingenieria Electrica University of the Republic
Yann LeCunCourant Institute of Mathematical Sciences New York University
Chang-Ock LeeDepartment of Mathematical Sciences Korea Advanced Institute of Science and Technology (KAIST)
Kevin LeeDepartment of Mathematics and Computer Science Normandale Community College
Stacey LevineDepartment of Mathematics and Computer Science Duquesne University
Debra LewisInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Hstau LiaoInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Bradley LucierDepartment of Mathematics Purdue University
Mona MahmoudiDepartment of Electrical Engineering University of Minnesota, Twin Cities
Kirsi MajavaDepartment of Mathematical Information Technology University of Jyväskylä
Alison MalcolmInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Jitendra MalikDepartment of Electrical Engineering and Computer Science University of California, Berkeley
Osama Masoud University of Minnesota, Twin Cities
Facundo MémoliDepartment of Mathematics Stanford University
Simon MorganDepartment of Mathematics University of Minnesota, Twin Cities
Juan NieblesDepartment of Electrical and Computer Engineering University of Illinois at Urbana-Champaign
Partha NiyogiDepartment of Computer Science University of Chicago
Sharareh NoorbaloochiDepartment of Electrical Engineering University of Minnesota, Twin Cities
David Olsen University of Minnesota, Twin Cities
Peter OlverSchool of Mathematics University of Minnesota, Twin Cities
Joseph O'SullivanElectrical and Systems Engineering Department Washington University
Pietro PeronaDepartment of Electrical Engineering California Institute of Technology
Tomaso PoggioDepartment of Brain and Cognitive Science Massachusetts Institute of Technology
Alexis Protiere École Polytechnique
Gregory RandallInstituto de Ingenieria Electrica University of the Republic
James RehgGVU Center Georgia Institute of Technology
Walter RichardsonDepartment of Mathematical Sciences University of Texas
Max RiesenhuberDepartment of Neuroscience Georgetown University
Stergios RoumeliotisDepartment of Computer Science and Engineering University of Minnesota, Twin Cities
Fadil SantosaSchool of Mathematics University of Minnesota, Twin Cities
Guillermo SapiroDepartment of Electrical and Computer Engineering University of Minnesota, Twin Cities
Arnd ScheelInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Jin SeoDepartment of Mathematics, Computational Science and Engineering Yonsei University
Dheeraj SingarajuDepartment of Electrical and Computer Engineering Johns Hopkins University
Stefano SoattoDepartment of Computer Science University of California, Los Angeles
Tatiana SoleskiInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Pablo SprechmannInstituto de Ingenieria Electrica University of the Republic
Vladimir SverakSchool of Mathematics University of Minnesota, Twin Cities
Manabu TanifujiLaboratory for Integrative Neural Systems The Institute of Physical and Chemical Research (RIKEN)
Evangelos Theodorou University of Minnesota, Twin Cities
Serena Thompson University of Minnesota, Twin Cities
Simon ThorpeFaculty of Medicine Rangueil  Université de Toulouse III (Paul Sabatier)
William Toczyski University of Minnesota, Twin Cities
Carl ToewsInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Antonio TorralbaComputer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology
Alain TrouveCentre de Mathematiques et leurs Applications(CMLA) École Normale Supérieure de Cachan
Shimon UllmanDepartment of Applied Mathematics and Computer Science Weizmann Institute of Science
Leslie ValiantDivision of Engineering and Applied Sciences Harvard University
Miguel Velez-ReyesDepartment of Electrical and Computer Engineering University of Puerto Rico
René VidalVision, Dynamics, and Learning Lab Johns Hopkins University
Michel Vidal-NaquetDepartment of Brain and Cognitive Science The Institute of Physical and Chemical Research (RIKEN)
Rossmary VillegasDepartamento de Matemáticas Universidad Carlos III de Madrid
Christian WallravenDepartment of Cognitive Psychophysics  Max-Planck-Institut für Biologische Kybernetik
Jingyue WangDepartment of Mathematics Purdue University
Xiaoqiang WangInstitute for Mathematics and its Applications University of Minnesota, Twin Cities
Yair WeissSchool of Computer Science and Engineering Hebrew University
Laurent YounesDepartment of Applied Mathematics and Statistics Johns Hopkins University
Ofer ZeitouniSchool of Mathematics University of Minnesota, Twin Cities
Song ZhuDepartment of Statistics and Computer Science University of California, Los Angeles