Fall Research Expo 2020

The Aviary Project: An Analysis of Cowbird Behavior with a focus in Action Classification

View Poster

The Penn Aviary project is one that brings together biologists and engineers in order to study bird behavior with the help of computer science. The lab collects data via a “smart aviary” that is equipped with 10 cameras and 24 microphones. The various branches of the lab are outlined below:

  • Vision: working to automatically detect the location and poses of birds and eventually map the trajectory of each identity in a 3D space
  • Sound: working to automatically isolate the sound of bird songs and eventually map vocal patterns using machine learning
  • Behavior: working to analyze patterns in bird behavior, both individually and pairwise, and eventually combine data sets produced by the aforementioned branches to uncover patterns that go beyond the scope of the human eye

 

PRESENTED BY
Emmanuel (Manny) C Dodson
Team Grants for Interdisciplinary Activities
College of Arts & Sciences 2023
View Profile
Advised By
Marc Schmidt
Dr.
marcschm@sas.upenn.edu
Marc Badger
Dr.
mbadger@seas.upenn.edu
Join Emmanuel (Manny) for a virtual discussion
Virtual Meeting
View Poster(PDF)
PRESENTED BY
Emmanuel (Manny) C Dodson
Team Grants for Interdisciplinary Activities
College of Arts & Sciences 2023
View Profile
Advised By
Marc Schmidt
Dr.
marcschm@sas.upenn.edu
Marc Badger
Dr.
mbadger@seas.upenn.edu

Comments

It was really fascinating to see how your team utilized programming to analyze bird behaviors! Are there any specific applications that this research was conducted for, or a specific reason why cowbirds were chosen? How would you distinguish the motives of the action versus just trying to detect any movements or noises? 

Hi Manny! I think your project is really interesting and I like how inter-disciplinary it is. What further research do you have in mind?  What are the applications of your tracking methods?

Great job Manny! I was very intrigued by the detail that went into the methodology. I am also curious as to what the applications of the work is as well as. what other species you would be interested in analyzing.