HR: 0830h
AN: U41B-0009    [PDF]
TI: NetCDF-4: Combining netCDF and HDF5 Data
AU: Folk, M J
EM: mfolk@ncsa.uiuc.edu
AF: NCSA/University of Illinois, 605 E. Springfield Ave., Champaign, IL 61820 United States
AU: Rew, R
EM: russ@ucar.edu
AF: Unidata Program Center, Boulder, 605 E. Springfield Ave., Champaign, IL 61820 United States
AU: * Yang, M
EM: ymuqun@ncsa.uiuc.edu
AF: NCSA/University of Illinois, 605 E. Springfield Ave., Champaign, IL 61820 United States
AU: Hartnett, E
EM: ed@unidata.ucar.edu
AF: Unidata Program Center, Boulder, 605 E. Springfield Ave., Champaign, IL 61820 United States
AU: McGrath, R E
EM: mcgrath@ncsa.uiuc.edu
AF: NCSA/University of Illinois, 605 E. Springfield Ave., Champaign, IL 61820 United States
AU: Koziol, Q
EM: koziol@ncsa.uiuc.edu
AF: NCSA/University of Illinois, 605 E. Springfield Ave., Champaign, IL 61820 United States
AB: Unidata's netCDF data model, data access libraries, and machine independent format are used in the creation, access, and sharing of much geoscience data. NCSA's HDF5 data model, libraries, and format have also been used in high-performance computing that require parallel I/O and very large data volumes. HDF5 is used by the NASA Earth Science Enterprise to archive and distribute remote sensing data and is used in many large computational models. In a NASA sponsored project, Unidata and NCSA are collaborating to merge netCDF and HDF5 to achieve gains in performance and interoperability. The project aims to create and deploy software that will preserve the desirable characteristics of netCDF and HDF5 while taking advantage of their separate strengths: the widespread use and simplicity of netCDF and the generality and performance of HDF5. When completed, users of netCDF will benefit from support for packed data, large datasets, and parallel I/O, and users of HDF5 will benefit from the availability of a simple high-level interface suitable for array-oriented scientific data, wider use of the HDF5 data format, and additional software for data management, analysis and visualization. We summarize the current status of the work, including new software that uses the current netCDF interface with the HDF5 format to provide backward compatibility with current data and application software. We also describe how the software under development will make use of advanced features of HDF5 including scalable access to very large datasets, parallel I/O, and compression.
UR: http://my.unidata.ucar.edu/content/software/netcdf/netcdf-4/index.html
DE: 1699 General or miscellaneous
DE: 9820 Techniques applicable in three or more fields
SC: U
MN: 2003 Fall Meeting