Search
WE-CAN Data Submissions Instructions - Post Field Phase
The WE-CAN home page contains relevant links to project and data documentation, distributed data access, and other collaborating projects' data sets.
An initial master list of all WE-CAN international datasets (with links) has been compiled to provide easy access to all operational and research WE-CAN datasets. This list will form the NCAR/EOL WE-CAN Long-term Data Archive where datasets are grouped by category (i.e., radar, satellite, etc.) and platform. Please review this list to verify that your dataset(s) are properly named, with the appropriate authors identified. Email any corrections, additions, or deletions directly to eol-archive@ucar.edu. If you already have your datasets available on-line elsewhere, please email the link(s) or FTP access information.
To submit your dataset(s) and documentation to the WE-CAN Long-term Data Archive, see the anonymous FTP instructions below. For users without Internet access, or if your dataset(s) are too large to FTP (e.g., 250GB or larger), please contact eol-archive@ucar.edu. In these cases, users can submit their data on a USB drive to the shipping address below. If you have a large number of files to FTP, please tar or zip your files by day or what makes sense for your dataset.
It is critical that submitted datasets are accompanied by sufficient documentation. The minimum required metadata is shown below after the FTP instructions. More detailed documentation guidelines can be found here.
Data Submission FTP Instructions for the WE-CAN Long-term Data Archive at NCAR/EOL:
FTP: ftp.eol.ucar.edu
Login: anonymous
cd /pub/data/incoming/wecan (NOTE: This command should be done all in one step.)
It is very important to send an email to eol-archive@ucar.edu once your file(s) have been FTPed. In your email and in your dataset readme file, please include the following minimum required information for your dataset(s):
- Dataset Title - The dataset title that will publicly appear in the data archive. EOL may modify for project consistency.
- Dataset Author(s) - List dataset authors. Indicate lead and corresponding authors. Include contact information.
- Time of Interest - Include begin and end dates (i.e., YYYY/MM/DD hh:mm:ss to YYYY/MM/DD hh:mm:ss).
- Area of Interest - Include GeoLocation information (latitude/longitude box) (e.g., 40.00 to 45.50; -95.37 to -110.00).
- Data Frequency - Frequency of data collection (5 minute, hourly, continuous, etc.).
- Data Spatial Type - ISO metadata SpatialRepresentation (vector, grid, textTable, tin, stereoModel, video, etc.) which describes how the geographic nature of the data is represented.
- General Dataset Description - Short description of this dataset.
- File Names - List names of files transferred.
- Data restrictions - Indicate if dataset needs to be restricted. Password protection is available for a dataset upon request. A dataset will NOT be password protected unless requested at the time of submission or as specified in this project's Data Policy. If password protection is requested, you will receive a project-specific "user ID" and "password." If you require additional security, please contact eol-archive@ucar.edu to request a unique "user ID" and "password" for your data.
- Digital Object Identifier (DOI) - Indicate if you would like for NCAR/EOL to generate a DOI for your dataset. If your dataset already has a DOI, please include that link in your email.
- GCMD Keywords - Please select keywords at least down to the "variable_level_1" level to support search and discovery of your dataset. Select keywords from the list at http://gcmdservices.gsfc.nasa.gov/static/kms/sciencekeywords/sciencekeywords.csv?ed_wiki_keywords_page
- Publications (Optional) - Please include a list of links to publications using this dataset, including "in press" and "submitted" publications, conference proceedings, theses, and reports. Submitted publications will be added to this project's publications list.
Thank you for providing data to the WE-CAN Long-term Data Archive at NCAR/EOL. Feel free to contact us with any questions or issues.
Linda Echo-Hawk and the EOL Data Management Team
NCAR Earth Observing Laboratory (EOL)
Email: eol-archive@ucar.edu
Mailing address:
NCAR Earth Observing Laboratory
Attention: WE-CAN Field Project Data Management
P.O. Box 3000
Boulder, Colorado, USA 80307
Shipping Address:
NCAR Earth Observing Laboratory
Attention: WE-CAN Field Project Data Management
3090 Center Green Drive
Boulder, Colorado, USA 80301
WE-CAN Data Submission Instructions (Post Field)
Dataset Documentation ("Readme") Guidelines
Quick Questions for WE-CAN PIs
WE-CAN Data Policy
WE-CAN DATA POLICY
Updated 20 April 2018
- Instrument teams will provide quicklook data products to the project PIs in ICARTT format for merging with other data sets within 24 hours of a flight to support in field quality control and flight planning. Model output related to the WE-CAN data sets will be similarly made available to the science teams as soon as is practical.
- All instrument teams participating in WE-CAN agree to promptly submit their preliminary quality controlled measurement data in ICARTT format to the WE-CAN Data Archive Center (WDAC) within 2 months after the project data are acquired. For real-time data collected in the field, this is by 15 November 2018. Similarly, model investigators agree to submit appropriate model products by 15 November 2018 to the WDAC. This will facilitate inter-comparison of results, quality control checks and inter-calibrations, and integrated interpretation of the combined data set. The preliminary data submission period for most data is therefore from 15 September 2018 to 15 November 2018. For measurements that require off-line analysis after the field project, including chemical analysis of samples collected, preliminary data should be released within 6 months of analysis, by 15 March 2019.
- All instrument teams and model investigators participating in WE-CAN agree to submit their final quality controlled measurement data and appropriate model products to the WDAC. There are different deadlines for real-time versus off-line datasets. For real-time data, the deadline for final data submission is 15 March 2019. For off-line data, the deadline for final data submission is 15 June 2019. This will facilitate final merging and quality control checks in advance of the initial public release on 15 September 2019.
- Preliminary and final data should be in the ICARTT format and include documentation in the form of a readme file describing the measurement and data processing procedures used to generate the data. Remote sensing data and model output can be provided in other formats, but also must include documentation in the form of a readme file describing the data processing procedures and the relevant model routines. Instrument investigators are encouraged to also submit raw data and all data processing routines used to get from the raw to final data products.
- All data, metadata and model products in the archive will be considered open to the public domain 1 year after the data are acquired; (i.e., 15 September 2019 and thereafter for most data). However, any data, metadata or product within the WDAC at EOL can be opened to the public domain earlier at the discretion of the responsible data/product provider in consultation with the WE-CAN PI Team.
- During the initial data analysis period, defined as from 15 September 2018 to 14 September 2019 (a one-year period following the end of the WE-CAN Field Deployment), WE-CAN Investigators will have exclusive access to the data. This initial analysis period is designed to provide an opportunity to quality control the combined data set as well as to provide the investigators ample time to prepare manuscripts for publication and presentation.
- Quicklook and preliminary data sets and model products will be distributed within the WE-CAN team and may be shared outside the team (with permission of the investigator responsible for the production of the data set) to support early analyses. However, in no case shall quicklook or preliminary data be used in a publication or conference presentation without agreement from the investigator or modeler making the data or product available.
- A list of WE-CAN investigators will be maintained by NCAR/EOL and will include the investigators directly participating in the field experiment as well as collaborating scientists who are members of the WE-CAN Science Team and agencies who have provided guidance and data in the planning and analysis of WE-CAN data. All data shall be promptly provided to other WE-CAN investigators upon request if not available through the archive. All WE-CAN investigators will have equal access to all data. No restricted data will be provided to non- WE-CAN Investigators without the permission of the PI who collected that data.
- During the initial analysis period, the Investigator(s) who collected the data or generated model output must be notified of the intent to use the data or model products in the early phase of the research project and especially before any journal articles, presentations, research proposals are developed. If the PI makes a significant intellectual contribution to the research, or if the data are essential to the work, or if an important result or conclusion depends on the data, co−authorship would normally be expected. This should be discussed at an early stage in the work. Any published use of the data should include an acknowledgment and/or a citation as described below.
- All acknowledgments of WE-CAN data, metadata and model products should identify: (1) the WE-CAN campaign; (2) the crew and support staff at the NCAR Research Aviation Facility; (3) the providers who collected the particular datasets or conducted the model simulations used in the study; (4) the relevant funding agencies associated with the collection of the data or model simulations; (5) the role of EOL or relevant data archive center, and (6) use of any relevant Digital Objective Identifiers (DOIs). A suggested acknowledgment reads “The author(s) wish to acknowledge the WE-CAN Project, [xxx data provider] for the use of the [yyy particular data] funded by zzz [relevant funding agency], the WE-CAN Data Archive Center at NCAR’s Earth Observing Laboratory [and/or any other relevant Archive Center]. In addition, this text could include “This dataset is cited through doi:xx.xxxx/xxxxxxxx”, or preferably use the appropriate dataset citations(s) in the Publications References Section. EOL expects to be assigning DOIs for all final datasets submitted to the main archive at EOL. Further, note that close collaboration and co-authorship with investigators collecting the data or creating the model products is highly encouraged.
- EOL will be responsible for the long-term data stewardship of the WE-CAN archive, but we also plan to add the WE-CAN data to the NASA archive that will be used to host the 2019 FIREX-AQ dataset.
| Event | Deadline |
|---|---|
| End of Field Campaign | 14 Sept 2018 |
| Preliminary Real-Time Data Submission Deadline | 15 Nov 2018 |
| Final Real-time Data Submission Deadline | 15 March 2019 |
| Preliminary Off-Line Data Submission | 15 March 2019 |
| Final Off-Line Data Submission | 15 June 2019 |
| Initial Data Analysis Period (WE-CAN Science Team members have exclusive access to password protected data during this period.) | 15 Sept 2018 - 15 Sept 2019 |
WE-CAN Data Submission Instructions (Post Field)
Dataset Documentation ("Readme") Guidelines
Quick Questions for WE-CAN PIs
Data Documentation
GRAINEX Data Submission Instructions (Post Field)
- Collaborative Research: The Great Plains Irrigation Experiment (GRAINEX) for Understanding the Influence of Irrigation on the Planetary Boundary Layer and Weather Events
- UNL Study confirms irrigation's impact on humidity, yields possible link to rain
- Irrigation applications could play a role in understanding ongoing changes in weather
- UAH Low-Cost Weather Stations to Join Irrigation/Weather Study
- Scientists Study Connection Between Great Plains Precipitation and Agricultural Irrigation
- WKU Scientist, Meteorology Students Part of NSF-funded Project on How Irrigation Affects Precipitation
- Husker-led Research Team to Examine Irrigation's Role in Precipitation
- UAH Low-cost Weather Stations to Join Irrigation/Weather Study
- GRAINEX - Investigating the Impacts of Irrigation on Regional weather
- NSF grant to examine irrigation's role in preciptation
- NSF GRAINEX Award Abstract #1720417
Documents
GRAINEX Data Submission Instructions (Post Field)
- Collaborative Research: The Great Plains Irrigation Experiment (GRAINEX) for Understanding the Influence of Irrigation on the Planetary Boundary Layer and Weather Events
- UNL Study confirms irrigation's impact on humidity, yields possible link to rain
- Irrigation applications could play a role in understanding ongoing changes in weather
- UAH Low-Cost Weather Stations to Join Irrigation/Weather Study
- Scientists Study Connection Between Great Plains Precipitation and Agricultural Irrigation
- WKU Scientist, Meteorology Students Part of NSF-funded Project on How Irrigation Affects Precipitation
- Husker-led Research Team to Examine Irrigation's Role in Precipitation
- UAH Low-cost Weather Stations to Join Irrigation/Weather Study
- GRAINEX - Investigating the Impacts of Irrigation on Regional weather
- NSF grant to examine irrigation's role in preciptation
- NSF GRAINEX Award Abstract #1720417
Field Project VORTEX-SE_2018
Data Documentation
Data Set Documentation Guidelines
Related Links
Data Set Documentation Guidelines
Publication or Paper Observations of ozone-poor air in the tropical tropopause layer
WE-CAN Meetings and Presentations
- August 11, 2018
- WE-CAN Science Team Meeting Agenda
- July 27. 2018
- WE-CAN Science Team Meeting Agenda
- Presentation
- April 3, 2018
- WE-CAN Planning Meeting Agenda
- Presentation
WE-CAN Data Submission Instructions (Post Field)
Dataset Documentation ("Readme") Guidelines
Quick Questions for WE-CAN PIs