HR: 1340h
AN: IN43B-1183    [Abstracts]
TI: Extending Atmospheric Composition Processing to the Community
AU: * Durbin, P
EM: pdurbin@sesda2.com
AF: Adnet Systems, Inc., 7515 Mission Drive, Suite A1C1, Lanham, MD 20706, United States
AU: Tilmes, C
EM: Curt.A.Tilmes@nasa.gov
AF: NASA Goddard Space Flight Center, Mail stop 614.5, Greenbelt, MD 20771, United States
AU: Balsano, R
EM: rbalsano@sesda2.com
AF: Adnet Systems, Inc., 7515 Mission Drive, Suite A1C1, Lanham, MD 20706, United States
AU: Martin, A
EM: amartin@innovim.com
AF: Innovim, 1250 Connecticut Ave, NW, Washington, DC 20036, United States
AU: Soika, V
EM: vsoika@sesda2.com
AF: Adnet Systems, Inc., 7515 Mission Drive, Suite A1C1, Lanham, MD 20706, United States
AU: Inskeep, E
EM: einskeep@sesda2.com
AF: Adnet Systems, Inc., 7515 Mission Drive, Suite A1C1, Lanham, MD 20706, United States
AB: The Ozone Monitoring Instrument Science Investigator-led Processing System (OMI SIPS) has been the central data processing system for OMI since its launch on NASA's Aura spacecraft in July, 2004. As part of NASA's evolution from mission based processing to measurement based processing, we are evolving the system into a community oriented Atmospheric Composition Processing System (ACPS). This involves changing focus from the mission (OMI) to the measurement (total column ozone), and a widening of our focus from the mission science teams to the overall scientific community. The current system dispatches and executes software developed by scientists on a computer cluster; archiving the results and distributing the data to numerous parties. Although this works well for the production environment, access to centralized systems has been naturally limited. Ideally, scientists should be able to easily get the data, run their software, make changes and repeat the process until they are happy with the solution to the problems they are trying to solve. In addition it should be simple to migrate research improvements from the community back into the formal production system. Through NASA's "Advancing Collaborative Connections for Earth-Sun System Science," we have extended publicly accessible interfaces into the production system. The system provides an open API via a set of SOAP/XML and REST based web services, enabling scientists, researchers and operators to interact directly with the data and services offered by the central system. The system includes metadata, archive, and planner subsystems. The metadata server stores metadata about the data products and provides the ability for processing software to evaluate production rules to determine the appropriate input data files for a given data processing job. The archive server stores the data files themselves and makes then available for clients to retrieve the files as needed. The planner plans out the set of jobs to be run in the production system and tracks the work being planned and executed. The RunApp client software executes the software. RunApp may also reside on a remote scientist's workstation and can communicate with the metadata and archive servers to evaluate production rules and retrieve needed data from the central system. It can execute the production versions of certain algorithms as well as locally developed or enhanced research versions. Since the algorithms are identically integrated, they can be very easily migrated into the production environment for large scale bulk processing when appropriate. This system provides the scientific community with flexible data processing capabilities that are scalable for development, research and production environments. This will accelerate the use and validation of the data for science and applications.
DE: 0399 General or miscellaneous
DE: 0525 Data management
DE: 0599 General or miscellaneous
SC: Earth and Space Science Informatics [IN]
MN: 2007 Fall Meeting