|
The goal of EOL data services is to advance science through delivering high-quality project data and
metadata in ways that are as transparent, secure and accessible as possible -- today and into the
future. In FY2006, EOL completed the integration of the Field Operations and Data Management (FODM)
group of the UOP Joint Office for Science Support (JOSS) into EOL. FODM brought significant computing
infrastructure, both hardware and software, that required integration into EOL's environment. This
was a major undertaking, requiring months of effort due to the long history of service provided by
the group and the complicated legacy of data and web systems that had been built over the span of many
years. The former ATD had a history of experience in data acquisition systems, real-time data streams,
quality control tools and services, and long-standing stewardship of platform data which remain an
integral part of today's data services related to field campaigns. Bringing both of these former
capabilities together has positioned us to meet the needs of data services in the future in a much
more synergistic and comprehensive way. Data services in the EOL now encompass end-to-end data
management and stewardship for project-wide datasets. The metadata library we will build and maintain
for this richer set of data enables us to offer information about our data in a variety of formats
and with new access methods, which are tailored to the evolving needs of our scientific community.
CDS Data Services Presentations
EOL Metadata Database and Cyberinfrastructure (EMDAC)
The EOL Metadata Database and Cyberinfrastructure (EMDAC) is a comprehensive metadata database
and integrated cyberinfrastructure that will be the hub of all EOL data services. Through EMDAC,
CDS will create bridges to multi-agency data portals, creating compatible metadata and data access
infrastructure which connects EOL to the common services of today while allowing us to meet future
needs through a modular and extensible architecture.
The EMDAC services are shown in the figure below. Click on the service in the figure to
get a description of that service.
For other services not a part of EMDAC click on the
"Other Services" oval in the figure or else click here.
ZINC (New CODIAC style User Interface):
Mass Store (MSS) Retrieval Tool:
The Mass Store data retrieval tool is a web-based application that allows public access to EOL data
stored on NCAR's Mass Storage System (MSS).
Further Information:
EOL Contact:
Master Lists:
The Master Lists provide easy, "one-stop shopping" for all data, metadata, imagery,
links, and external archives associated with a project. This single entry point
unifies the projects' data and metadata access.
Further Information:
EOL Contact:
Community Data Portal:
The Community Data Portal (CDP) is a collection of earth science datasets from
NCAR, UCAR, UOP, and participating organizations. It is a collaboration between
UCAR, NCAR, UOP, and the National Science Foundation.
Further Information:
External Contact:
EOL Contact:
Metrics:
As part of overall EOL plans for gathering metrics related to publications, the EOL/CDS
uses EMDAC to track which organizations are accessing our data. These metrics are acquired through
automated mechanisms and then included in EOL metrics reports to provide comprehensive information
about the use and distribution of our datasets.
Further Information:
EOL Contact:
Web Services:
Dataset Tracking:
The Data Tracking System (DTS) is the primary tool used by the CDS Data Management Group (CDS/DMG)
to monitor a dataset's life cycle. This tool is used to manage and maintain detailed information for
hundreds of datasets for past and present projects. Information about a dataset's status such as
ingest, processing, software, metadata, version, and archival are included in the DTS. At any time,
a user can also access this information to determine the status of either a single network dataset
or a multi-network composite.
Further Information:
EOL Contact:
Maintenance (GUImaint):
GUImaint, the primary interface to the EOL's metadata database, frees the user from the command line
and displays the database records in a familiar graphical interface. The user can quickly jump from
table to table within the database and maintain the database by creating, updating and deleting
records. Although powerful, it limits actions to the records being viewed, putting a check on
unintentional changes. It's design will allow interfacing with the data tracking tools at a future time.
Further Information:
EOL Contact:
Metadata Catalog Export:
THREDDS:
The THREDDS (Thematic Realtime Environmental Distributed Data Services) project is developing
middleware to bridge the gap between data providers and data users. The goal is to simplify the
discovery and use of scientific data and to allow scientific publications and educational materials
to reference scientific data. The mission of THREDDS is for students, educators and researchers to
publish, contribute, find, and interact with data relating to the Earth system in a convenient,
effective, and integrated fashion. Just as the World Wide Web and digital-library technologies have
simplified the process of publishing and accessing multimedia documents, THREDDS is building
infrastructure needed for publishing and accessing scientific data in a similarly convenient fashion.
Further Information:
External Contact:
EOL Contact:
ISO 19115:
This work aims to establish a structured set of standards for information concerning objects
or phenomena that are directly or indirectly associated with a location relative to the Earth.
These standards may specify, for geographic information, methods, tools and services for data management
(including definition and description), acquiring, processing, analyzing, accessing, presenting and
transferring such data in digital/electronic form between different users, systems and locations.
Further Information:
External Contact:
EOL Contact:
NASA GCMD:
GCMD's goal is to enable users to locate and obtain access to Earth science data sets and
services relevant to the global change and Earth science research.
The metadata used by the GCMD is considered to be that set of attributes that are instrumental
in helping users to determine if a data set meets their qualifications. The set of attributes (fields)
and its associated syntax is known as the Directory Interchange Format (DIF) . It has evolved over
a twelve year period and serves the user community in the discovery of Earth science data.
Further Information:
External Contact
EOL Contact:
RSS Feeds:
RSS (Really Simple Syndication): Any of various XML file formats suitable for disseminating
real-time information via subscription on the Internet. RSS could be used by the VOC for project
news items or mission changes, new datasets which have arrived in the catalog, etc.
Further Information:
EOL Contact:
Other/XML:
XML( Extensible Markup Language): A metalanguage written in SGML (see below) that allows one to
design a markup language, used to allow for the easy interchange of documents and metadata on the
World Wide Web. Standard Generalized Markup Language is a set of standards, approved by the ISO,
enabling a user to create an appropriate markup scheme for tagging the elements of an electronic
document, as to facilitate the production of multiple versions in various print and electronic formats.
XML will provide linkage to digital libraries, federation of NSF & other agency data portals, and other
uses as development occurs.
Further Information:
EOL Contact:
Browsing and Visualization
Field Catalog:
EOL's field catalog is a web-based tool for collecting, organizing and presenting reports and quick
look data products during the field phases of observational experiments.
Further Information:
EOL Contact:
GIS/Mapserver:
MapServer is an Open Source development environment for building spatially-enabled internet
applications. MapServer can display all types of GIS data such as maps, images and vector data on
the web. Aircraft flight tracks, dropsonde locations, radar sites and other data can also be
displayed with the ability to request additional information on any feature in the map. Timeseries plots
for particular stations or locations can also be displayed.
Further Information:
EOL Contact:
IDV:
The Integrated Data Viewer (IDV) from Unidata is a Java(TM)-based software framework for analyzing
and visualizing geoscience data. The IDV brings together the ability to display and work with
satellite imagery, gridded data, surface observations, balloon soundings, NWS WSR-88D Level II and
Level III RADAR data, and NOAA National Profiler Network data, all within a unified interface.
Further Information:
External Contact:
EOL Contact:
VOC:
The Virtual Operations Center (VOC) is a proposed field project operations center that will encompass
Internet-capable visualization tools, near real time data assimilation, innovative collaboration
technologies, and remote instrument control. The VOC will involve project participants, researchers,
educators, students, and the general public in the field experiment experience and allow remote
interaction from wherever in the world they happen to be.
Further Information:
EOL Contact:
Other Visualization Tools:
Connections from our data to many other visualization tools are facilitated through the EMDAC
architecture. By choosing standard access methods, data formats and compatible metadata, the list
of available tools for visualization of our data can come from the widest range of researchers in
our community. We will continue to add EMDAC modules that evolve with future changes in data access
protocols and metadata and encourage developers to take advantage of these standards.
For information related to EOL observing platform software systems and plans, please see the CDS/SSG
Wiki at http://wiki.eol.ucar.edu/sew/SoftwareProjects.
Further Information:
EOL Contact:
Satellite Data Services:
We provide tools, access and expertise for satellite data processing. CDS has a dedicated server for
satellite data processing. This server provides tools for image display, format conversion and a
wide range of processing functions. Real-time access to GOES-East and -West data is provided along
with near real-time access to MODIS, MTSAT and METEOSAT (via ADDE). Both Terascan and McIDAS software
packages are supported on the server. In addition, all GOES imager data is archived to Mass Store in
Terascan format and is available from mid-1999 to present day. Other satellite data is obtained and
archived, when appropriate, for specific field projects. These tools and services are used by staff
to provide satellite data support for EOL-supported field projects.
Further Information:
EOL Contact:
Personalized Data Services:
The CDS/DMG provides all facets of scientific data management support including data collection,
customized processing, quality assurance/control, archive, and dissemination of information for
national and international field projects. Data management project involvement/support begins well
before and continues well beyond the field phase of a project. Such support may include: questionnaires,
mailing lists, data management plan development, web page development and maintenance, GIS support,
investigation of potential/additional data sources, special media creation and distribution, publication
management, and long term data archival and stewardship.
Further Information:
EOL Contact:
| 
