Realtime Data Handling at ATD for ISS Field Projects


Table of Contents

Introduction
Remote Access to ISS Sites
Data Transfers to ATD
CGI Upload
Polling the Incoming Directories
Handling Individual Data Files
ISS Project Configuration Directories
Zebra Batch Plotting
Manual Replots
Zebra Display Sesstion
Monitoring ISS Realtime Processing Through Email
Rotating and Cleaning Logs and Mail Folders

Introduction

As the ISS sites transfer their data to ATD, a great deal of background work is done to unpack and process those data before their eventual appearance in the realtime plots or in logbooks on the web site. This document is an overview of all of that background work.

All of the realtime data handling runs under the iss user account. When changing anything, make sure it is done as the iss user to avoid breaking any of the file permissions. Almost all if not all of the scripts and configuration files mentioned here are under CVS control, so any changes made need to be committed back to CVS. To do this while working as the iss user, use remote CVS over ssh. For an existing working directory owned by iss, change the CVS/Root files to point to your account on the remote CVS server cvs.atd.ucar.edu. This can be done with the cvsroot script, for example:

~iss/iss/scripts/cvsroot granger@cvs:/code/cvs

Then make sure CVS_RSH is set to ssh.