Space Physics Research Environment: Meeting the Challenges of Integrating Disparate Data Systems I
Presiding: M Weiss, Applied Physics Laboratory, Johns Hopkins University; P Fox, High Altitude Observatory/NCAR
SH42A-01 INVITED 10:30h
Future Directions in Space Physics Data Management
The past decade has seen a dramatic increase in the availability of space physics data. There are literally hundreds of web sites providing access to data from space physics missions as well as ground based observatories. Space physics clearly has entered an era of open data. Now members of the space physics community are working to coordinate access to these diverse resources and to make sure the data are available beyond the termination of missions or projects. The Space Physics Access Search and Extract (SPASE) program will provide a common data dictionary which will help interconnect the sources while the virtual observatory and resident archive programs will provide continuity. However, all of these efforts will only succeed if the science data are of high quality and useable. The key to understanding data quality and proper use of science data is the metadata. All space science analysis requires that users have adequate information about the data. In this talk we will discuss methods for assuring high quality data and will introduce the concept of the self-organized archive (also see King et al, this meeting) as a means of utilizing high quality metadata.
SH42A-02 10:45h
NASA's Living With a Star Program-Level Initiative to Encourage Interoperability Among Solar and Space Science Resources
A number of novel methods for accessing and using data and services have arisen as grassroots efforts in the solar and space physics communities. These provide very useful resources to researchers--if they know about them. The LWS effort is to provide a means to make these resources more widely known and to enable them to communicate with each other in a way that multiplies their usefulness. We will review our efforts to provide metadata services and other means to assure that community-based efforts will work together as a whole.
http://lwsde.gsfc.nasa.gov
SH42A-03 11:00h
The Space Physics Archive Search and Extract (SPASE) Project: Glue for Interoperability
The Space Physics Archive Search and Extract (SPASE) Project is a NASA-funded, collaborative development effort among multi-institution, international, space physics data holding organizations intended to allow science users to interoperably locate space physics data of interest, intercompare the information about data, and retrieve selected data sets or portions of data sets. Presently this consortium is continuing to update the SPASE Data Model (see http://www.igpp.ucla.edu/spase/) as a common metadata language for searching across the multitude of disparate data archives for data of interest. The model is being applied to data set descriptions for the important data holdings of the participating institutions. Searching via SPASE-compliant interfaces generates a query using the common metadata language. The query is translated into local search terminology at each relevant space physics data center. Search results are then gathered and displayed to the user in a common format. Thus, there is no need to change the software and search procedures used at the individual institutions. The model is intended to support data description at multiple levels of detail.JosephTodd Data set intercomparisons will enable determination of which data are useful for the purposes of the scientist/user. We are working with the Virtual Observatories relevant to space physics to enable data searching, access, and retrieval from these unifying theme portals. An example interface is available at the Virtual Space Physics Observatory (VSPO) through the following URL: http://vspo.gsfc.nasa.gov/websearch/dispatcher Development of an effective Data Model is challenging and requires feedback from all sectors of the community. We welcome new participants and discussion of the SPASE activities with the authors either in the session or in future SPASE teleconferences, presentations, or related meetings.
SH42A-04 11:15h
Straightforward Approaches to Integrating Heterogeneous Data Systems
The explosive growth of virtual observatory (VO) projects shows that there is an untapped need for single systems that make it easy to search for, access, and analyze data and resources from highly disparate data systems. Many current VO projects require either conversion to a unified data format or data model, or mandate an exact metadata matchup. Both of these alternatives can be extremely time consuming, complex, error-prone and expensive, particularly when applied to a wide variety of disparate data and services. In addition, few VO projects address the integration of not only data but also available services such as specialized query interfaces. For these VO projects, the huge effort required for data system integration is a significant barrier to success. To solve these problems, an innovative approach to interoperability must be implemented. By utilizing a 'loosely-coupled' approach we can greatly reduce the effort required for integration of both data and services. Instead of precise one-to-one mapping of the data models, we do loosely coupled matches using commonly understood scientific concepts. This method requires little or no changes to the systems themselves. We then extend our loosely-coupled philosophy into the integration of services, not through an intensive reworking of heritage data system interfaces, but through the use of minimally invasive but very powerful web services. This enables us to leverage existing data system capabilities and integrate remote interfaces into a single system. Because of the relative ease of data system integration in our design, not only data systems, but even the data and services of VOs themselves, can be integrated, making meta-VO systems within the realm of possibility. Additional information and a demonstration of our approach can be found at http://sras.jhuapl.edu.
SH42A-05 11:30h
The Virtual Solar-Terrestrial Observatory
The VSTO comprises a system of data, model, tool and material archives containing items from space- and ground-based instruments, individual and community modeling efforts, taken from NCAR, US universities and international sources, and from NSF- and NASA-funded groups. A key element of the VSTO is the allowance for an integrated data-mining and analysis capability that can be applied both across and within databases, i.e. across disciplines. The capabilities of a VSTO are intended to be available to a wider community of scientists, educators, and the public and thus is intended to be a natural conduit for education and public outreach in solar solar-terrestrial and space physics. This presentation will provide details on the current stage of development of VSTO including use-cases, user requirements, ontology development, project priorities, collaborations and current design and implementations.
SH42A-06 11:45h
From the Sun to You at the Speed of Light: The SDO Data System
The Solar Dynamics Observatory (SDO) is on track to launch in April 2008. Solar images in the extreme ultraviolet, the EUV spectral irradiance, magnetic field maps, and Dopplergrams are the primary data products of this mission. Each primary data product is produced on a rapid cadence. For example, some space weather products, suitable for use in ionosphere-thermosphere models, should be produced every 10--20 seconds with a 5--10 minute delay between observation and appearance in the data system. Derived data products, including helioseismic properties and active region tracked in various wavelengths, will also be available from the data system. As part of NASA's Living With a Star Program, SDO will release data to the public as soon as possible after receipt from the satellite. The science teams will make the data available through Web-oriented interfaces, such as the Virtual Solar Observatory, allowing external people to make inquiries and have data delivered to their site. We will present an overview of the SDO data system and philosophy.