Attendees
- Mike McCann
- Francisco Chavez
- Reiko Michisaki
- Seth Bushinski
- Rich Schramp
- John Graybeal
- Duane Edginton
- Julien Barde
- Luis Bermudez
Overview of the Data Aggregation Strategy
(Not presented in the meeting, but added here for clarity)
Aggregation strategy image
Status BOG
Mike - Prototype by the end of December. Mike M. showed dapper/dchart, where 50% of BOG data is already available. Process consists of converting BOG projects into NetCDF files and uploading them to Dapper. There are some limitation of Dapper, such as presenting profiles at various depth.
Status Moorings to OGC / SWE
Luis - working on it - plan to finish end of December
Status list of devices and the status for data aggregation
Luis - in progress ...
Status Use case - Mooring AUV and Ship
Julien. Made a presentation containing abstraction strategies from the special use case. Julien presented his tool and how to catalog metadata to be searchable. The group discussed that use case cannot be solved using a metadata catalog system (e.g. SSDS), a data base that has spatial-query capabilities will serve this purpose better. Mike suggested that getting mooring data in a similar format of how the BOG files are being created and upload them to Dapper could address Francisco's use case. Dapper uses MySQL as a back-end to increase the performance on queries.
Status to-friendly-ASCII
Seth - almost done with mooring raw data. Francisco wants the plots to quality controlled them.
Status Big Picture
Getting data to NetCDF holds as the strategy. We will need more metadata about a NetCDF files to be able to wrap this file in other formats and metadata interfaces. Two possible ways: add more metadata in the NetCDF files or use SSDS to get more metadata information. For the later all the NetCDF files created need to be register in SSDS. Mike M. can add to header as needed. To have a one stop shopping center based on SSDS will take about 3 - 6 months of software engineer with Kevin's expertise.
Action items for the next meeting
- Luis will talk to Mike Godin about how did he handle NetCDF files in the MB06 project. If he was using SSDS to register the metadata or other approach.
- Julien and Mike will meet and discuss the Francisco's use case. This will illuminate us about dapper capabilities. Questions to answer for the next meeting: Is Dapper a good end user interface to provide a fast searchable access to MBARI column data ? What needs to be done (e.g. conversion of NetCDF files in special formats (sequence, grid, timeSeries ??) for this to happen ?)
- Seth will not working any more on producing ASCII files. He will work on producing plots to do quality control.
- Luis will continue working on extracting OGC Services from NetCDF files.
- Mike will add "device type" to the header of the NetCDF files. He can illuminate us about the standard way ( or best practice) to do such.
Next steps
- Need to make available ROV/CTD files to outside of MBARI. Need NetCDF files from this data base.
- Discuss how a one stop shopping center will work for MBARI taking into account the different possibles functionalities. (Plot, download, etc..)
