EOL Metadata Database and Cyberinfrastructure (EMDAC)
The EOL Metadata Database and Cyberinfrastructure (EMDAC) is a comprehensive metadata database and integrated cyberinfrastructure that will be the hub of all EOL data services. Through EMDAC, CDS will create bridges to multi-agency data portals, creating compatible metadata and data access infrastructure which connects EOL to the common services of today while allowing us to meet future needs through a modular and extensible architecture.
The EMDAC services are shown in the figure below. Click on the service in the figure to get a description of that service.
For other services not a part of EMDAC click on the "Other Services" oval in the figure or else click here.
ZINC (New CODIAC style User Interface):
EOL Contact:
John Allison - jja AT ucar.edu
Mass Store (MSS) Retrieval Tool:
The Mass Store data retrieval tool is a web-based application that allows public access to EOL data stored on NCAR's Mass Storage System (MSS).
Further Information:
EOL Contact:
Susan Stringer - snorman AT ucar.edu
The Master Lists provide easy, "one-stop shopping" for all data, metadata, imagery, links, and external archives associated with a project. This single entry point unifies the projects' data and metadata access.
Further Information:
EOL Contact:
Linda Cully - cully AT ucar.edu
The Community Data Portal (CDP) is a collection of earth science datasets from NCAR, UCAR, UOP, and participating organizations. It is a collaboration between UCAR, NCAR, UOP, and the National Science Foundation.
Further Information:
External Contact:
Don Middleton
NCAR/CISL CDP PI
don AT ucar.edu
EOL Contact:
Steve Williams - sfw AT ucar.edu
Internal Tools
As part of overall EOL plans for gathering metrics related to publications, the EOL/CDS uses EMDAC to track which organizations are accessing our data. These metrics are acquired through automated mechanisms and then included in EOL metrics reports to provide comprehensive information about the use and distribution of our datasets.
Further Information:
EOL Contact:
Mike Daniels - daniels AT ucar.edu
Further Information:
EOL Contact:
Mark Bradford - mark AT ucar.edu
The Data Tracking System (DTS) is the primary tool used by the CDS Data Management Group (CDS/DMG) to monitor a dataset's life cycle. This tool is used to manage and maintain detailed information for hundreds of datasets for past and present projects. Information about a dataset's status such as ingest, processing, software, metadata, version, and archival are included in the DTS. At any time, a user can also access this information to determine the status of either a single network dataset or a multi-network composite.
Further Information:
EOL Contact:
Linda Cully - cully AT ucar.edu
GUImaint, the primary interface to the EOL's metadata database, frees the user from the command line and displays the database records in a familiar graphical interface. The user can quickly jump from table to table within the database and maintain the database by creating, updating and deleting records. Although powerful, it limits actions to the records being viewed, putting a check on unintentional changes. It's design will allow interfacing with the data tracking tools at a future time.
Further Information:
EOL Contact:
Don Stott - stott AT ucar.edu
Metadata Catalog Export
Further Information:
EOL Contact:
John Allison - jja AT ucar.edu
The THREDDS (Thematic Realtime Environmental Distributed Data Services) project is developing middleware to bridge the gap between data providers and data users. The goal is to simplify the discovery and use of scientific data and to allow scientific publications and educational materials to reference scientific data. The mission of THREDDS is for students, educators and researchers to publish, contribute, find, and interact with data relating to the Earth system in a convenient, effective, and integrated fashion. Just as the World Wide Web and digital-library technologies have simplified the process of publishing and accessing multimedia documents, THREDDS is building infrastructure needed for publishing and accessing scientific data in a similarly convenient fashion.
Further Information:
External Contact:
Ethan Davis
Unidata
edavis AT ucar.edu
EOL Contact:
John Allison - jja AT ucar.edu
This work aims to establish a structured set of standards for information concerning objects or phenomena that are directly or indirectly associated with a location relative to the Earth.
These standards may specify, for geographic information, methods, tools and services for data management (including definition and description), acquiring, processing, analyzing, accessing, presenting and transferring such data in digital/electronic form between different users, systems and locations.
Further Information:
External Contact:
Olaf Ostensen
Chaiman
olaf.ostensen AT statkart.no
EOL Contact:
Steve Williams - sfw AT ucar.edu
GCMD's goal is to enable users to locate and obtain access to Earth science data sets and services relevant to the global change and Earth science research.
The metadata used by the GCMD is considered to be that set of attributes that are instrumental in helping users to determine if a data set meets their qualifications. The set of attributes (fields) and its associated syntax is known as the Directory Interchange Format (DIF) . It has evolved over a twelve year period and serves the user community in the discovery of Earth science data.
Further Information:
GCMD Home Page
GCMD Metadata Protocols and Standards Directory Interchange Format (DIF) Writer's Guide
External Contact
Lola Olsen
GCMD Project Manager
Lola.M.Olsen AT nasa.gov
EOL Contact:
Steve Williams - sfw AT ucar.edu
RSS (Really Simple Syndication): Any of various XML file formats suitable for disseminating real-time information via subscription on the Internet. RSS could be used by the VOC for project news items or mission changes, new datasets which have arrived in the catalog, etc.
Further Information:
EOL Contact:
Mark Bradford - mark AT ucar.edu
XML( Extensible Markup Language): A metalanguage written in SGML (see below) that allows one to design a markup language, used to allow for the easy interchange of documents and metadata on the World Wide Web. Standard Generalized Markup Language is a set of standards, approved by the ISO, enabling a user to create an appropriate markup scheme for tagging the elements of an electronic document, as to facilitate the production of multiple versions in various print and electronic formats.
XML will provide linkage to digital libraries, federation of NSF & other agency data portals, and other uses as development occurs.
Further Information:
EOL Contact:
Mike Daniels - daniels AT ucar.edu
Browsing and Visualization
EOL's field catalog is a web-based tool for collecting, organizing and presenting reports and quick look data products during the field phases of observational experiments.
Further Information:
EOL Contact:
Susan Stringer - snorman AT ucar.edu
MapServer is an Open Source development environment for building spatially-enabled internet applications. MapServer can display all types of GIS data such as maps, images and vector data on the web. Aircraft flight tracks, dropsonde locations, radar sites and other data can also be displayed with the ability to request additional information on any feature in the map. Timeseries plots for particular stations or locations can also be displayed.
Further Information:
EOL Contact:
Janet Scannell - anstett AT ucar.edu
The Integrated Data Viewer (IDV) from Unidata is a Java(TM)-based software framework for analyzing and visualizing geoscience data. The IDV brings together the ability to display and work with satellite imagery, gridded data, surface observations, balloon soundings, NWS WSR-88D Level II and Level III RADAR data, and NOAA National Profiler Network data, all within a unified interface.
Further Information:
External Contact:
Don Murray
UNIDATA IDV lead
dmurray AT ucar.edu
EOL Contact:
Chris Burghart - burghart AT ucar.edu
The Virtual Operations Center (VOC) is a proposed field project operations center that will encompass Internet-capable visualization tools, near real time data assimilation, innovative collaboration technologies, and remote instrument control. The VOC will involve project participants, researchers, educators, students, and the general public in the field experiment experience and allow remote interaction from wherever in the world they happen to be.
Further Information:
VOC in 2005/06 NCAR Annual Report
UNIDATA Presentation Webcast (Real Media)
UNIDATA Presentation PowerPoint
EOL Contact:
Mike Daniels - daniels AT ucar.edu
Connections from our data to many other visualization tools are facilitated through the EMDAC architecture. By choosing standard access methods, data formats and compatible metadata, the list of available tools for visualization of our data can come from the widest range of researchers in our community. We will continue to add EMDAC modules that evolve with future changes in data access protocols and metadata and encourage developers to take advantage of these standards.
For information related to EOL observing platform software systems and plans, please see the CDS/SSG Wiki at http://wiki.eol.ucar.edu/sew/SoftwareProjects.
Further Information:
EOL Contact:
Mike Daniels - daniels AT ucar.edu
Other EOL Data Services
We provide tools, access and expertise for satellite data processing. CDS has a dedicated server for satellite data processing. This server provides tools for image display, format conversion and a wide range of processing functions. Real-time access to GOES-East and -West data is provided along with near real-time access to MODIS, MTSAT and METEOSAT (via ADDE). Both Terascan and McIDAS software packages are supported on the server. In addition, all GOES imager data is archived to Mass Store in Terascan format and is available from mid-1999 to present day. Other satellite data is obtained and archived, when appropriate, for specific field projects. These tools and services are used by staff to provide satellite data support for EOL-supported field projects.
Further Information:
EOL Contact:
Greg Stossmeister - gstoss AT ucar.edu
The CDS/DMG provides all facets of scientific data management support including data collection, customized processing, quality assurance/control, archive, and dissemination of information for national and international field projects. Data management project involvement/support begins well before and continues well beyond the field phase of a project. Such support may include: questionnaires, mailing lists, data management plan development, web page development and maintenance, GIS support, investigation of potential/additional data sources, special media creation and distribution, publication management, and long term data archival and stewardship.
Further Information:
EOL Contact:
Steve Williams - sfw AT ucar.edu
