HR: 1340h
AN: OS43B-0551    [Abstracts]
TI: Detecting Benthic Megafauna in Underwater Video
AU: * Edgington, D R
EM: duane@mbari.org
AF: Monterey Bay Aquarium Research Institute (MBARI), 7700 Sandholdt Road, Moss Landing, CA 95039 United States
AU: Kerkez, I
EM: ikerkez@mbari.org
AF: Monterey Bay Aquarium Research Institute (MBARI), 7700 Sandholdt Road, Moss Landing, CA 95039 United States
AU: Oliver, D
EM: doliver@mbari.org
AF: Monterey Bay Aquarium Research Institute (MBARI), 7700 Sandholdt Road, Moss Landing, CA 95039 United States
AU: Kuhnz, L
EM: linda@mbari.org
AF: Monterey Bay Aquarium Research Institute (MBARI), 7700 Sandholdt Road, Moss Landing, CA 95039 United States
AU: Cline, D E
EM: dcline@mbari.org
AF: Monterey Bay Aquarium Research Institute (MBARI), 7700 Sandholdt Road, Moss Landing, CA 95039 United States
AU: Walther, D
EM: walther@caltech.edu
AF: California Institute of Technology (Caltech), 1200 East California Blvd., Pasadena, CA 91125 United States
AU: Itti, L
EM: itti@pollux.usc.edu
AF: University of Southern California (USC), University Park Campus, Los Angeles, CA 90089 United States
AB: Remotely operated vehicles (ROVs) have revolutionized oceanographic research, supplementing traditional technologies of acoustics and trawling as tools which assess animal diversity, distribution and abundance. Video equipment deployed on ROVs enable quantitative video transects (QVTs) to be recorded from ocean habitats, providing high-resolution imagery on the scale of individual organisms and their associated habitat. Currently, the manual method employed by trained scientists analyzing QVTs is labor-intensive and costly, limiting the amount of data analyzed from ROV dives. An automated system for detecting organisms and identifying objects visible in video would address these concerns. Automated event detection (scene segmentation) is a step towards an automated analytical system for QVTs. In the work presented here, video frames are processed with a neuromorphic selective-attention algorithm. The candidate locations identified by the attention selection module are subject to a number of parameters. These parameters, combined with successful tracking over several frames, determine whether detected events are deemed "interesting" or "boring". "Interesting" events are marked in the video frames for subsequent identification and processing. As reported previously for mid-water QVTs, the system agrees with professional annotations 80% of the time. Poor contrast of small translucent animals in conjunction with the presence of debris ("marine snow") complicates automated event detection. While the visual characteristics of the seafloor (benthic) habitat are very different from the mid-water environment, the system yields a 92% correlation of detected animals on the seafloor compared with professional annotations. We present results detailing the comparison between a) automated detection and b) professional detection and classification, and we outline plans for future development of automated analysis.
UR: http://www.mbari.org/AVED
DE: 4815 Ecosystems, structure and dynamics
SC: Ocean Sciences [OS]
MN: 2004 AGU Fall Meeting