MTP File System

MJ Mahoney
Last Revision: Mar 14, 2007

MTP File Extensions

Before listing the MTP file system, we first list default filename extenstions used in the file structure. The columns in the table below are: Extension = filename extension, Type = A if ASCII, B if binary, Comments = comments.

Extension
Type
Comments
BAS
A
A Visual BASic Module (Library)
BIN
B
A binary version of the RAW file in the format of the REF file
CAL
A
CALibration information file
CFG
A
File containing the setup information (ConFiGuration) used to calculate a set of RCs
CLS
A
Visual Basic CLasS module
DIB
B
Windows Device Independent Bitmap
DLL
B
Windows Dynamic Link Library
ERF
B
Editted REF File (ERF)
EXE
B
Windows EXEcutable file / application
FDT
A
Final Delta-T (FDT) ATP fudge file (not used!)
FLA
A
Default RC FLight Altitudes
FRM
A
Visual Basic FoRM file
FRX
A
Visual Basic binary data file used to store binary information for the form (.FRM) file with the same file name.
GIF
B
Graphics Interchange Format (a lossless data compression format introduced by Compuserve in 1987)
HDR
A
HeaDeR information for MP files
INI
A
ASCII version of the flight information (FLTINFO) used for data analysis INIalization.
Has categories like Windows 3.0. Current versions of Windows put this information in the Registry
NUM
A
Flight NUMbers, dates, and objectives
PNG
B
Portable Network Graphics format introduced to replace the (proprietary) GIF format
RAOB
B
File containing many 1 KB radiosonde (RAOB) records, but limited to <70 levels
RAOB2
B
File containing many 1 KB radiosonde (RAOB) records, but limited to <70 levels
RAW
A
RAW MTP data file
RCF
B
Retrieval Coefficient (RC) File
REF
B
Binary Random Everything File (REF) with retrieved profiles as well as all RAW data
REF2
B
Binary Random Everything File (REF) with retrieved profiles as well as all RAW data
RMS
A
File containing the apriori RMS observable errors used in calculating retrieval coefficients (RCcalc)
RSL
A
RadioSonde List file containing an ASCII list of ICAO or WMO names for launch sites
TXT
A
ASCII TeXT file
VBP
A
Visual Basic Project file
VBW
A
Visual Basic Workspace file
WCT
A
Window Correction Table file
XLA
B
An EXceL Add-in file (for examle, the MJMacro.XLA file containing macros for quicklook analysis)
XLS
B
EXceL Spreadsheet workbook used for quicklook and other analysis










MTP File Structure

All MTP data analysis files are located in a single folder named MTP on the root drive. It will be assumed to be the C: drive, althought this need not be the case.

File Path
Purpose
Examples, Comments and Notes
C:\MTP\
Root of MTP file structure
C:\MTP\Data\ All the data analysis files
C:\MTP\Data\DC8\
Files for all DC8 Campaigns/Missions Folder also exist for ER2, WB57, M55, Ground
C:\MTP\Data\DC8\PAVE\ Files for PAVE campaign Folders also exist for all other DC8 campaigns
C:\MTP\Data\DC8\PAVE\20050205\ Files for a specific flight date Files included are:
DC20050205.RAW - Raw ASCII data from instrument
DC20050205.BIN   - Binary version of the RAW file
DC20050205.CAL  - ASCII version of calibration information
DC20050205.INI     - ASCII version of Flight Information
DC20050205.REF   - Binary Random Everything File (REF) with retrieved profiles
DC20050205.ERF   - Editted REF File (ERF)
DC20050205.XLS   - Quicklook Excel workbook
C:\MTP\Data\DC8\PAVE\ MP\ MTP archive files in Gaines-Hipskind format
DC20050205.DC8, etc
C:\MTP\Data\DC8\PAVE\ PNG\ Images
TZS_20050205.PNG  - CTC plot
Track0_20050205.PNG - Flight track
C:\MTP\Data\DC8\PAVE\ RAW\ Raw data files before being renamed
D5020512.041  - Raw instrument data file
AccD5020512.041  - Raw instrument accelerometer file

Note: The raw instrument data file is renamed in the \MISSION\YYYYMMDD\ folder to have the name ACYYYYMMDD.RAW, AC is the 2-letter platform name.
C:\MTP\Data\DC8\PAVE\ Setup\ Campaign software setup files
PAVE_CAL.TXT  - Default ASCII calibration information
PAVE_NUM.TXT - Flight numbers, dates, and objectives
PAVE_HDR.TXT  - Header information for MP files
PAVE_RMS.TXT  - A priori observable errors for RCcalc
PAVE_WCT.TXT  - Window Correction Table
PAVE_FLA.TXT    - Default RC flight altitudes
PAVE_IFB.TXT     - IF Bandpass shape file for DC8 during PAVE (see notes on link)
                              
Note: These files used to be have names like MISSION.CAL (e.g., PAVE.CAL). However as the number of different extensions increased, more and more extension name conflicts occurred with commerically available software filename extensions. To avoid these conflicts, we decided to rename them as shown above so they all have .TXT extensions (appropriate for ASCII text files). They are still referred to as "CAL files", "NUM files", etc, even though they are technically now "TXT files."
C:\MTP\Data\DC8\PAVE\ RC\ Retrieval Coefficient files
DRCNA012.1260 - ASCII RC file for 12.6 km
... for each flight level
DRCNA012.CFG - ASCII RC configuration information for above files.
These are being replace by a single binary file:
DRCNA012.RCF  - Binary RC File
C:\MTP\Data\DC8\PAVE\O3\
Data from other instruments
O320050205.DC8 - FASTOZ ozone data
Other folders like O3 exist for data from other instruments
C:\MTP\Excel\
Excel files
ER2_RetrievalAccuracy.XLS - Excel Workbook
MJMacros.XLA - MJ's Macro Library Add-in for Quicklook Analysis
C:\MTP\GIF\
GIF Images
TavgRms.GIF
C:\MTP\MAPS\
Map images
MAP_N300N420_W1280W1120D.jpg - Map used by MAPget
C:\MTP\Notes\ Miscellaneous notes
SoftwareNotes.txt
C:\MTP\PNG\ Miscellaneous PNG images
MTP_Flt_Hr_Summary.png
C:\MTP\RAOB\

Folder for radiosonde related data
C:\MTP\RAOB\BIN\ Binary RAOB data
MTP_UA.BIN  - Binary RAOB site data base
Pub9volA990614.flatfile  - WMO ASCII of RAOB sites
etc
C:\MTP\RAOB\INFO\ Miscellaneous about RAOBs
VaisalaRS80.PDF
C:\MTP\RAOB\PAVE\ Campaign related RAOB files and folders
DRA___2002011500.RAOB2 - File containing template profiles
C:\MTP\RAOB\PAVE\All\ Individual sounding files from by RAOBget
YJT2002011600.txt - A single sounding
C:\MTP\RAOB\RAOB\
RAOB Archive
EUR_2002_13.RAOB2
C:\MTP\RAOB\RSL\ RadioSonde List Files
PAVE_transit.RSL - Sounding sites for PAVE transit flight
C:\MTP\RAOB\WMO\ Miscellaneous WMO files
WMOSITES.TXT
C:\MTP\RAOB\ZIP\ Zipped version of individual soundings
SOLVE2JAN_MAR_2003.zip
C:\MTP\RTA\

Real Time Analysis files
C:\MTP\RTA\REALTIME\ File with REALTIME flag
REALTIME.TXT - Tells MTPbin if REALTIME analysis
C:\MTP\RTA\RAW\ REALTIME data analysis files D5020512.041        - Raw instrument data file
AccD5020512.041  - Raw instrument accelerometer file
CURRENT.RAW    - Current single scan
RT20041209.RAW - Remote REALTIME RAW file
C:\MTP\RTA\REF\ REALTIME files for each platform
DC20050205.REF
C:\MTP\Setup\
Program setup folder and reference files FLTINFO.REF             - Default flight (binary)
FLTINFO.REF32         - File to restore FLTinfoFormat =32 (binary)
FLTINFO.REF33         - File to restore FLTinfoFormat =33 (binary)
Hardware.INI                - Used to initialize hardware configuration
MTPsetup.INI               - System initialization information
MTPsetup.SAV             - MTPsetup.INI backup
Missions.INI                  - Used to initialize Missions combo boxes

C:\MTP\Setup\Density\ Climatological density profiles for ND form
STD_ATM_DEN.001
- Contains DIAL climatological number density data
        Std_Atm_Den.xxx, where xxx=month number
        NDprofile.txt
C:\MTP\Setup\Pt\ Pt Thermistor Calibration Files
PtDChigh.TXT   - For high range target thermistor
PtDClow.TXT    - For low range target thermistor
PtDCwin.TXT    - For window thermistor
Also files for other platforms
C:\MTP\Temp\
Miscellaneous temporary files
temp3.png
C:\MTP\TXT\
Miscellaneous text files
MissionSummary.txt
C:\MTP\VB6\
Visual Basic Program Folder

C:\MTP\VB6\BAS\ Shared Modules (Libraries)
Calibration.bas
FLTINFO.bas
Format.bas
GlobalParms.bas
Math.bas
modCapture.bas
MTPio.bas
Physics.bas
PNG.bas
RAOBcommon.bas
RetrieveSim.bas
TBcalc.bas
TrackCommon.bas
C:\MTP\VB6\CLS\ Class Modules
cDIBSection.cls
cScrollBars.cls
C:\MTP\VB6\DIB\ DIB files
Bright.DIB
Pastel.DIB
Rainbow.DIB
C:\MTP\VB6\DLL\ Dynamic Link Libraries
janGraphics.dll
Readme_DLL.txt
SSubTmr6.dll
vbphg1.dll
zlib.dll
C:\MTP\VB6\EXE\ Executable Program Files
CACcmd.exe
Capture.exe
CRLF.exe
MAPget.exe
MTPbin.exe
MTPcalc.exe
MTPsim.exe
RAOBget.exe
RAOBman.exe
C:\MTP\VB6\FRM\ Shared Forms
About.frm
Atp.frm
Atpo.frm
CTCoptions.frm
CTCscroll.frm
FLTINFO.frm
frmBatch.frm
frmCaptureForm.frm
frmEditBits.frm
frmFltTrack.frm
frmMap.frm
frmStatus.frm
frmTB.frm
frmTools.frm
frmLimits.frm
Ndp.frm
RAOB.frm
RAOBo.frm
ROABsites.frm
REFview.frm
SerialIO.frm
Plus some frx files
C:\MTP\VB6\VBP\
Visual Basic Project Files

C:\MTP\VB6\VBP\Main\IO\ Programs for IO
CACcmd.vbp
C:\MTP\VB6\VBP\Main\MOAP\ Mother of All Programs
MTPbin.frm
MTPbin.frx
MTPbin.vbp
MTPbin.vbw
Form1.frm
C:\MTP\VB6\VBP\Main\RAOB\ Programs for Processing Radiosondes
frmRAOBget.frm
RAOBget.vbp
RAOBget.vbw
RAOBman.frm
RAOBman.frx
RAOBman.vbp
RAOBman.vbw
C:\MTP\VB6\VBP\Main\RC\
Program for Calculating RCs
RCcalc.vbp
RCcalc.vbw
RCcalc.frm
RCcalc.frx
C:\MTP\VB6\VBP\Main\Sim\ Simulation Program
MTPsim.frm
MTPsim.frx
MTPsim.vbp
MTPsim.vbw
SimCommon.bas
C:\MTP\VB6\VBP\Misc\NavGen\ Program to Generate Nav Data
DECODE.BAS
MTPLITE.BAS
NAVGEN.BAS
NAVPARAM.BAS
NAVPFILE.BAS
NNTRAIN.BAS
for ER2 and DC8
      

File Examples

PAVE_CAL.TXT
The CAL-file contains information about various parameters common to a particular flight. This ASCII version of the CAL-file was replaced by the CFR (Cal File Record)binary data structure in one of the REF-file header records.

1                             'Cal File Format
' This CAL-file follows a few simple but mandatory format requirements.
' Settings are entered into categories which occupy a single line and
' must be bracketed by square brackets (e.g. [PATH]). Variables for which
' settings are assigned must have exactly the same name in the program in
' which they are used and be followed by an equal sign (=). Spaces are
' not allowed. Anything beyond the first space in a line is ignored.
' Blank lines are also ignored, but are required betweeen categories.

[GENERAL]
GenDate=20000721              'Analysis date
FltDate=19991207              'Flight Date
UTstart=37                    'Start UT
UTend=66                      'End UT
Channels=+3                   'Number of frequency channels
Nel=+10                       'Number of elevation angles
Emissivity=+.004              'Emissivity of window
Reflectivity=+.006            'Reflectivity of window
DeltaTmin=+20                 'Minimum OAT-TGT Temperature Difference
PitchMin=+0                   'Minimum allowable Pitch
PitchMax=+3                   'Maximum allowable Pitch
RollLimit=+1.5                'Maximum allowable Roll (+ or -)
Nsamples=+1453                'Maximum allowable Roll (+ or -)

[FIT_INFO]
Nfit=+2                       'Number of Fit coefficients
Offset=Offset                 'Fit Offset
FitVar1=Tifa                  'Fit Variable1
GEC11=11.13                   'Fit coefficient11
GEC12=-0.025                  'Fit coefficient12
GEC21=12.78                   'Fit coefficient21
GEC22=-0.019                  'Fit coefficient22
GEC31=14.89                   'Fit coefficient31
GEC32=-0.017                  'Fit coefficient32
GOF1=42                       'Fit parameter offset
TARGET=+5                     'Target temperature offset in cycles
MIXER=0                       'Mixer temperature offset in cycles

[WINDOW_CORRECTIONS]
WCT101=-4.38                  'Window Correction Table Entry, WCT101
WCT201=-0.05                  'Window Correction Table Entry, WCT201
WCT301=-0.33                  'Window Correction Table Entry, WCT301
WCT102=-2.95                  'Window Correction Table Entry, WCT102
WCT202=-0.11                  'Window Correction Table Entry, WCT202
WCT302=+0.02                  'Window Correction Table Entry, WCT302
WCT103=-2.23                  'Window Correction Table Entry, WCT103
WCT203=-0.29                  'Window Correction Table Entry, WCT203
WCT303=-0.01                  'Window Correction Table Entry, WCT303
WCT104=-0.90                  'Window Correction Table Entry, WCT104
WCT204=-0.16                  'Window Correction Table Entry, WCT204
WCT304=-0.01                  'Window Correction Table Entry, WCT304
WCT105=-0.15                  'Window Correction Table Entry, WCT105
WCT205=-0.06                  'Window Correction Table Entry, WCT205
WCT305=+0.03                  'Window Correction Table Entry, WCT305
WCT106=+0.00                  'Window Correction Table Entry, WCT106
WCT206=+0.00                  'Window Correction Table Entry, WCT206
WCT306=+0.00                  'Window Correction Table Entry, WCT306
WCT107=-0.39                  'Window Correction Table Entry, WCT107
WCT207=-0.04                  'Window Correction Table Entry, WCT207
WCT307=+0.12                  'Window Correction Table Entry, WCT307
WCT108=-0.25                  'Window Correction Table Entry, WCT108
WCT208=-0.21                  'Window Correction Table Entry, WCT208
WCT308=-0.06                  'Window Correction Table Entry, WCT308
WCT109=+0.23                  'Window Correction Table Entry, WCT109
WCT209=-0.26                  'Window Correction Table Entry, WCT209
WCT309=-0.23                  'Window Correction Table Entry, WCT309
WCT110=-0.31                  'Window Correction Table Entry, WCT110
WCT210=-0.89                  'Window Correction Table Entry, WCT210
WCT310=-0.26                  'Window Correction Table Entry, WCT310

[EOF]


PAVE_NUM.TXT
NUM files contain three columns of information:
Column 1 is the flight number (in this example giving the year (05), campaign number in year for the aircraft (01), and the consecutive flight number for the campaign(02). (Flight 01 does not appear in this list because it was a pilot proficiency flight on which the instruments were not operated.)
Column 2 contains the flight date in YYYYMMDD format
Column 3 contains the flight objective
It is used frequently batch processing activities, such as producing a histogram of level flight segments.

050102 20050114 DFRC Test Flight #1
050103 20050118 DFRC Test Flight #2
050104 20050120 DFRC Test Flight #3
050105 20050124 Transit from Dryden FRC to Pease AFB
050106 20050127 1st Local Science Flight - MLS ascending track to Resolute
050107 20050129 2nd Local Science Flight - MLS/TES ascending tracks to north
050108 20050131 3rd Local Science Flight - Deep Vortex Survey
050109 20050203 4th Local Science Flight
050110 20050205 5th Local Science Flight
050111 20050207 6th Local Science Flight
050112 20050209 Transit from Pease AFB to Dryden FRC

PAVE_HDR.TXT
This is the header record template needed to write a Gaines-Hipskind format ASCII file that can be submitted to a data archive for a particular campaign. The MTP archive files have been assigned a prefix "MP," so MP-files are known to the research community as MP-files. An MP file has the filename structure:
MPYYYYMMDD.AC, where AC is an assigned extension for each aircraft (e.g., MP20050131.DC8).

62  2110

MJ MAHONEY (Michael.J.Mahoney@jpl.nasa.gov)
M/S 246-102; Jet Propulsion Laboratory; Pasadena, CA 91109-8099
DC-8 Microwave Temperature Profiler (MTP/DC8)
PAVE
1 1
2001 09 10  2002 03 24  20010413 {FLT DATE, REDUCTION DATE & FLIGHT NUMBER}
0.0  0.0
Remote sensing altitude (meters)
Elapsed UT seconds from 0 hours on day given by DATE
4                         {NV = number of primary variables: temp, SEtemp, Zg, #density}
1.0   1.0    1.0 1E+21    {scale factors for primary variables: temp, SEtemp, Zg, #density}
99999 9999 99999 99999    {missing values for primary variables: temp, SEtemp, Zg, #density}
Retrieved air temperature (K)
Standard error of retrieved air temperture (K)
Geometric altitude (meters).
Molecular air density (number per cubic meter)
13             {number of auxiliary variables}
1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0
99 99.999 99.9 99.9 999.9 99.9 99.9 999.9 999.9 99.999 999.999 999.9 9.99
NX(1) is the number of altitudes in subsequent data records
Pressure altitude of DC-8 (km)
Aircraft pitch (deg)
Aircraft roll (deg)
Horizon brightness temperature (ie, OAT, similar to SAT); avg ch1, ch2 & ch3 (K)
Tropopause #1 (km).
Tropopause #2 (km).
Potential temperature of tropopause #1 (K).
Potential temperature of tropopause #2 (K).
Latitude (deg)
Longitude (deg)
dT/dz (K/km) for 1.0 km layer centered on aircraft flight altitude.
MRI ... a retrieval quality metric ranges 0-2, <1 is excellent
8              {number of special comment lines}
*** FINAL DATA  FINAL DATA  FINAL DATA  FINAL DATA  FINAL DATA  FINAL DATA  
***    
*** If you are using this data, we would appreciate being consulted on it use.
*** More information can be found at http://mtp.jpl.nasa.gov/missions/pave/pave.html
*** If the quality metric (MRI) departs from zero, the retrievals are degraded
*** We will continue to work on improving these data, so the archive should be
*** consulted to ensure you are using the most recent data.
*** FINAL DATA  FINAL DATA  FINAL DATA  FINAL DATA  FINAL DATA  FINAL DATA  
19             {number of normally included comment lines}
Here's a brief free-form tutorial on how to decipher the MTP data: Data groups
   consist of the following group of lines per 15-second observing cycle.
First line is:  UTSEC, number of retrieval levels in following table, Pressure
   Altitude, Pitch, Roll, Outside air temp (K), tropopause altitude #1 (km),
   tropopause altitude #2 (km) [if present], potential temperatures of tropopause
   #1 and #2, latitude, longitude, & lapse rate near flight level. 
   The 1-liners (for each cycle) can be stripped & imported into a spreadsheet
   for convenient plotting of trop altitude, lapse rate, etc. The tropopause
   altitudes are calculated by cubic spline interpolation of the retrieved
   altitudes using the WMO definition (that is, trop #1 is lowest altitude
   where average lapse rate > -2 K/km from initial -2 K/km point to any point
   within 2 km; trop #2 occurs above first trop after lapse rate is < -3K/km
   for >1 km, and then first trop definition applies, possibly from within
   the 1 km region.)
Remaining set of lines for each cycle consist of 5 columns: col#1 is pressure
   altitude (meters), col#2 is temperature from MTP (Kelvin), col#3 is temperature
   error estimate (K), col#4 is geometric altitude (meters), based on ICATS GPS
   altitude (meters), and col#5 is molecular air density [1E+21/m3].


PAVE_RMS.TXT
This file contains the observable errors for the campaign. The data are arranged in the order elevation angle 1 through 10 for channels 1 through 3. These errors are used as the a priori errors when the multiple linear regression is done to calculate retrieval coefficients. It is very important that these errors are realistic; otherwise, the data will be either over- or under-utilized. These errors are estimated when the Window Correction Table is calculated.

0.67
0.67
0.66
0.66
0.66
0.65
0.66
0.67
0.67
0.68
0.34
0.34
0.33
0.33
0.33
0.32
0.34
0.34
0.35
0.37
0.39
0.39
0.39
0.39
0.39
0.38
0.39
0.39
0.40
0.42

PAVE_WCT.TXT
Before brightness temperatures can be used in a retrieval, one final correction must be applied: the window correction table or WCT. When measured brightness temperatures near a radiosonde launch site are compared to the expected brightness temperatures based on the radiosonde temperature and humidity profile, small differences are seen that have a clear and repeatable dependence on elevation angle and frequency. These differences are generally <1 K, but can become larger for high altitude aircraft at high viewing angles because atmospheric transparency becomes important. The window correction appears to be very stable during a campaign, but can change when the instrument is remounted. It is believed that most of the window correction is due to beam sidelobes viewing different thermal structure inside the fairing as the scan mirror moves. There may also be a component due to LO leakage and reflection from the HDPE window, which is why these corrections were named window corrections. On some campaigns the window correction appears to have a pressure altitude dependence, but this is not always the case. The lowest frequency measurements always have a much larger window correction than the higher frequencies, and this has successfully been modelled as being due to waveguide cut-off, which is attenuating the signal at the longest wavelengths.

When window corrections were first calculated, it was a very tedious spreadsheet process, taking a day for just one comparison. The reason for this was that many checks need to be made to minimize errors. Only level flight segments can be used to avoid temperature changes due to the lapse rate of the atmosphere. Also for this reason, tropospheric comparisons need to be avoided if possible because of the high lapse rate there. Implicit in the desire for level flight segments, is the need to avoid pitch and roll changes, which can result in pointing errors and hence measured temperature errors. Changes in the outside air temperature are also monitored to avoid large temperature changes due to flying through fronts or other causes. Several scans are also averaged to minimize retrieval noise, and these scans should be contiguous to avoid the effects of real atmospheric temperature gradients. This means that that the retrieval quality flag must be checked for possible interference, and the process restarted if there is. In addition to checking the quality of the measurements, it is also necessary to check the quality of the radiosondes being used.

Calculating window corrections has been automated by programming the process, rather than doing it manually in a spreadsheet. The spreadsheet phase however was important because it helped identify the precautions that were necessary to achieve reliable results. Although some effort is needed to set up the calculations, dozens of radiosonde comparisons can now be done in seconds. When the window corrections are calculated, there is noise on their estimate. As will be discussed in the following section, this noise is included in the a priori observable error that is needed to calculate retrieval coefficients.

The data in the WCT is arranged by elevation angle and frequency channel. Note that when the WCT is calculated, the horizon value is forced to be zero so that the calibrated horizon temperature is not modified.

Elev   CH1   CH2   CH3
80   -0.91 -0.41 -0.42
55    0.31 -0.12 -0.07
42    0.18 -0.16  0.11
25   -0.30 -0.23  0.14
12   -0.44 -0.08 -0.15
0     0.00  0.00  0.00
-12   0.30  0.39  0.14
-25   0.18  0.57  0.32
-42   0.44  0.67  0.37
-80   0.66  0.92  0.78


PAVE_FLA.TXT
This contains the list of flight altitudes (km) for which retrieval coefficient sets are calculated. For years standard altitudes were used for each aircraft, which could lead to interpolation errors if the levels were not close enough together. There is now a process on the MTPbin Tools forms Run Pgm tab that automatically goes through all the flights for a campaign to identify all the level flight segments. This produces a text file (e.g., PAVE_LevelFlight.txt) which can be imported into a spreadsheet (e.g., PAVE_LevelFlight.xls) to generate a histogram of the level flight segments. This is then used to identify the most commonly flown flight levels, which are then entered into the FLA-file (e.g. PAVE_FLA.txt) for subsequent use.
12.56
12.19
11.89
11.58
11.28
10.97
10.67
10.36
7.62
3.05
1.52
0.61
0.30
0.01


PAVE_IFB.TXT
After January 28, 2006, the sensor unit name (up to 4 letters) would have been included in the filename as well because the ER2-like sensor units fly on multiple platforms. This was not so much an issue early on when the IFB file would have been save in the C:\MTP\Setup\ folder. Now that we have moved the IFB file the the C:\MTP\Data\PLATFORM\MISSION\Setup\ folder, including the sensor unit name avoids possible confusion. There this file would now be named PAVE_DC8_IFB.TXT. The IFB file also used to assume that the IF bandpass was the same for each channel. They are slightly different, so three header lines have been added to specify:
The Number of IFB Channels (1 or 3) - old files have only 1
The Number of sub-channels in the model for each bandpass
The Percent Waveguide Roll-off in each IFB Channel - normally only the LSB of Channel 1 has this correction
The Sub-channel number, Center Frequency LO-Offset (MHz) and Sub-channel strength
Etc.

3
11
4.2 0.0 0.0
 1  227.26  5.214398E-02
 2  258.5657  0.3949173
 3  270.4532  0.7590887
 4  282.9883  0.9569337
 5  305.4079  0.9892924
 6  335.3143  0.9859546
 7  357.7563  0.9464153
 8  370.0427  0.7898291
 9  381.8177  0.5073925
 10  400.0587  0.209665
 11  429.2565  3.027276E-02
 1  226.7443  0.0514636
 2  258.5743  0.3848768
 3  270.4575  0.7426196
 4  282.9982  0.937929
 5  305.4459  0.9813466
 6  335.3518  0.9943666
 7  357.7704  0.9665588
 8  370.0455  0.8121062
 9  381.8246  0.5199779
 10  400.0642  0.2165876
 11  429.3563  3.146888E-02
 1  226.9298  5.064117E-02
 2  258.5706  0.3830992
 3  270.4555  0.7397755
 4  282.9965  0.9340757
 5  305.457  0.9784071
 6  335.3599  0.991603
 7  357.77  0.9651442
 8  370.0428  0.810394
 9  381.8135  0.5205411
 10  400.051  0.215514
 11  429.0829  3.076788E-02

 Missions.INI
[DC8]
PAVE
SOLVE2
CAMEX4
TexAQS
SOLVE
PEMTB
SONEX
SUCCESS
TOTE_VOTE
DC_TEST
REALTIME

[ER2]
EUPLEX
CRYSTAL
CAMEX4
SOLVE
CIREX
POLARIS
TOTEVOTE
STRAT
ER_TEST

[WB57]
AVE
CRYSTAL
ACCENT2
ACCENT
WAM
WB_TEST

[M55]
EUPLEX
ENVISAT

[EOF]


MTPsetup.INI
' C:\MTP\Setup\MTPsetup.INI was last written on 02-05-2005 at 11:26:17
' This INI-file follows a few simple but mandatory format requirements.
' Settings are entered into categories which occupy a single line and
' must be bracketed by square brackets (e.g. [PATH]). Variables for which
' settings are assigned must have exactly the same name in the program in
' which they are used and be followed by an equal sign (=). Spaces are
' not allowed. Anything beyond the first space in a line is ignored.
' Blank lines are also ignored, but are required betweeen categories.

[SYSTEM]
ProgramDrive$=c:              'Default Program hard drive
DataDrive$=c:                 'Default Data hard drive
UID$=mjm                      'Default user ID (initials)
DefaultRTmode=0               'Default Real Time Mode (0=FALSE, 1=TRUE)
AlternateRoot=""              '

[EOF]


Hardware.INI
Note that the [RC_ER2], [RC_DC8], etc. categories in the Hardware.INI file are no longer used as the software now searches the RC folder in the MISSION path to find out the names of the available RCF files. The original RC file format including an CFG file and individual files for each flight altitude are still written in the C:\MTP\RAOB\Missions\MISSION\RC\ folder, but generally not used, and therefore not transferred to the C:\MTP\Data\PLATFORM\MISSION\RC\ folder.

[SU]
DC8
ER2S
ER2T
ER2G
RKW

[PLATFORM]
DC8
ER2
WB57
M55

[OATSRC]
MTP
A/C
MMS

[GSCALE]
EQN
ND
OAT

[REFSRC]
TGT
OAT

[ALGORITHM]
User Selected
MRI
Latitude Blend
Longitude Blend
UT Blend
Retrievable Index
Observable Index

[RC_DC8]
SA012
SB012
SC012

[RC_ER2]
CS077
CS177
CD077

[RC_WB57]
AA012
AB012
AC012

[RC_M55]
EA013
EB013
EC013

[FREQ_DC8]
55.51
56.65
58.80

[FREQ_ER2]
56.65
58.80

[FREQ_WB57]
55.51
56.65
58.80

[FREQ_M55]
55.51
56.65
58.80

[ELEV_DC8]
+80.0
+55.0
+42.0
+25.0
+12.0
+0.0
-12.0
-25.0
-42.0
-80.0

[ELEV_ER2]
+60.0
+44.4
+30.0
+17.5
+8.6
+0.0
-8.6
-20.5
-36.9
-58.2

[ELEV_WB57]
+70.0
+47.0
+32.0
+20.0
+9.5
+0.0
-10.0
-22.0
-39.0
-70.0

[ELEV_M55]
+55
+38
+24
+12
+0
-10
-21
-34
-49
-70

[ALT_WB57]
19
18
17
16
15
14
13
12
10
7
1

[ALT_ER2]
22
21
20
19
18
16
13
10
7
1.0
   
[ALT_DC8]
12.6
11.9
11.3
10.7
9.5
8.2
6.1
3#
1#
0.1

[ALT_M55]
21
20
19
18
16
13
10
7
1.0
0.1

[EOF]

PtDChigh.txt
9
591.01 F3C
566.81 E07
512.08 B46
476.98 97B
465.08 8E8
443.08 7CD
383.68 4CB
350.74 328
309.67 116
12-07-2004 16:44:10
R(Counts) =  c(0) + c(1)*Counts
c(0) = 288.157
c(1) = 0.07764
T(Counts) =  c(0) + c(1)*Counts + c(1)*Counts^2 + c(1)*Counts^3
c(0) = -104.6401
c(1) = 0.037593
c(2) = 3.025E-7
c(3) = -9.209E-12

Configuration Data Structure

Type CFrecord2

' "GENERAL"
  Gendate As String * 8           'Analysis Date
  WCTdates(1 To 10) As String * 8  'Flight used to generate CAL file
  UTstart As Long
  UTend As Long
  Channels As Integer           'Number of frequency channels
  Nel As Integer                'Number of elevation angles
  Emissivity As Single          'Emissivity of window
  Reflectivity As Single        'Reflectivity of window
  DeltaTmin As Single           'Minimum temperature difference between target and sky

' "FIT_INFO"
  Nfit As Integer               'Number of fit parameters (including offset)
  NP(1 To 5) As String * 6      'Alphanumeric fit parameter (eg Tifa, Ttgt)
  GEC(1 To 5, 1 To 5) As Single 'Gain Equation Coefficients (channel, parameter)
  GOF(1 To 5) As Single         'Gain Equation Offsets (Channel)

' "WINDOW_CORRECTIONS"
  WINcor(1 To 3, 1 To 10) As Single  'Window corrections (Channel, El Angle)
  EnableWCT As Boolean
 
' RAW counts editting criteria
  CMAcycles As Integer               'Counts smoothing cycles (slow)
  CMAcycles2 As Integer              'For Sky Counts only (fast), <= CMAcycles
  RFIiterations As Integer           'No of iterations needed to converge (slow)
  RFIiterations2 As Integer          'No of iterations needed to converge (fast)
  BadCycles As Integer               'No of cycles not satisfying RFI threshold (slow)
  Badcycles2 As Integer              'No of cycles not satisfying RFI threshold (fast)
 
  RFIthreshold As Integer            'Maximum counts offset from moving average
  MUXthreshold As Single             'Maximum dT in mux temperatures
  UseMAforCB As Boolean              'Use Moving Average for Base Counts
  UseMAforCS As Boolean              'Use Moving Average for Sky Counts
  UseMAforCN As Boolean              'Use Moving Average for Noise Diode Deflection Counts
  UseMAforTtgt As Boolean            'Use Moving Average for Target Temperature
  UseMAforTifa As Boolean            'Use Moving Average for IF Amp Temperature
 
' Cycle offsets
  aTGToffset(0 To 3) As Integer      'Target Temperature Lead/Lag (+ is lead)
  aMXRoffset(0 To 3) As Integer      'Mixer Temperature Lead/Lag
  aNDoffset(0 To 3) As Integer       'Noise Diode cycle shift
  aNAVoffset(0 To 3) As Single       'OAT cycle shift
  aSpare1(0 To 3) As Single
  aSpare2(0 To 3) As Single

' Gain Thresholds
  GeqnMin(1 To 3) As Single           'Gain Equation Min
  GeqnMax(1 To 3) As Single           'Gain Equation Max
  GnavMin(1 To 3) As Single
  GnavMax(1 To 3) As Single
  GndMin(1 To 3) As Single
  GndMax(1 To 3) As Single

' Channel Weights
  ChInfo(1 To 3) As Single

' Fit Region
  TBfitX1 As Integer
  TBfitX2 As Integer
  TBfitY1 As Integer
  TBfitY2 As Integer
 
  RHS As Boolean                       'TRUE if MTP is on Right Hand Side of a/c
  LocHor As Integer                    'Scan step of horizon (either 5 or 6)
  RAWextension As String * 3           'Extension of file with substituted P/T
  Targets As Integer                   'Number of reference targets
 
' Noise Diode Temperature Fit
  Cnd0(1 To 3) As Single               'Offset
  Cnd1(1 To 3) As Single               'First order coefficient
  Cnd2(1 To 3) As Single               'Second order coefficient
  TrefND As Single                     'Reference temperature (Celcius)
' Instrument Attitude
  MTPyaw As Single
  MTPpitch As Single
  MTProll As Single
  MTPfiduciary As Single               'Scan Mirror Fiduciary Angle
  ElSUI(1 To 10) As Single             'Elevation Angles from SUI file
  fEcCount As Integer                  'Number of scans with Elevation > fEmax
  UseMAforCSgain As Boolean            'Use Moving Average for Sky Counts Based gain

  Expand(1 To 85) As Single           'Room for expansion
 
' FI expansion begins here
  NRC As Integer                      'Number of RC sets
  RCformat(0 To 64) As Integer        'Number indicating RC format (normally = 2 for all sets)
                                      'RCformat = 3, for 10*Nlo observables (ie separate horizon T for each freq)
  Reg(0 To 64) As String * 5          '5 character string for each RC set used
  RCuse(0 To 64) As Single            'Number of times a give RC has been used in retrieval for a flight
' Len(CFR2)=1744
' Len(REF2)=2000
' Could add 256/11 or 23 more sets of RCs
'  Placeholder(0 To 63) As Single      'This makes len(CFR2)=2000
  RCformax(65 To 87) As Integer        'Number indicating RC format (normally = 2 for all sets)
                                       'RCformat = 3, for 10*Nlo observables (ie separate horizon T for each freq)
  Rex(65 To 87) As String * 5          '5 character string for each RC set used
  RCusx(65 To 87) As Single            'Number of times a give RC has been used in retrieval for a flight
  Filler As String * 3
End Type



FLTinfo Data Structure
Type FIrecord2
  Mission As String * 15              'Mission name
  Fileformat As Byte                  'File format (number >=32)
  FltNumber As String * 8             'Flight number
  PI As String * 80                   'Principal investigator
  Yeer As Integer                     'Year
  Doy As Integer                      'Day of Year
  yyyymmdd As String * 8              'Year/Month/Day string
  TotalCycles As Integer              'Number of records in file
  Channels As Integer                 'Number of MTP receiver channels
  Drive As String * 2                 'Data drive
  Rdir As String * 8                  'Platform directory (DC8, ER2 or WB57)
  Path As String * 80                 'Flight Directory
  Pgm As String * 80                  'Program Directory
  USE5 As String * 5                  'USE file name for standard errors on trop
  Algorithm As Integer                'Processing Algorithm (e.g., MRI, LAT)
  MRIavg As Single                    'Average MRI value for flight
  MRIrms As Single                    'Standard Deviation on MRI value for flight
 
  utMTPcor As Single                  'UT Correction to ADD to MTP clock [sec]
  DTavg As Single                     'Average value of UTnav-UTmtp for flight
  DTrms As Single                     'Standard deviation of UTnav-UTmtp for flight
 
  ALTfujCONST As Single               'Altitude offset to be applied to NAV altitude
  ALTfujSLOPE As Single               'Slope of NAV altitude correction
  OATnavCOR As Single                 'OAT correction to ADD to NAV temperature
  CalSource As String * 8             'Obsolete
  UseMMSpALT As Boolean               'If TRUE, use MMS pressure altitude in analysis
 
  LAT1 As Single                      'South side of Tropical-to-Mid-latitude transition region [deg]
  LAT2 As Single                      'North side of Tropical-to-Mid-latitude transition region [deg]
  LAT3 As Single                      'South side of Mid-latitude-to-Polar transition region [deg]
  LAT4 As Single                      'North side of Mid-latitude-to-Polar transition region [deg]
  UserLATs As Boolean                 'If FALSE, use default values for transition regions
 
  DoAll As Boolean                    'If TRUE, perform end-to-end data analysis
  DoAllMask As Integer                'Mask specifying analysis steps
  NFL As Integer                      'Number of levels for which retrieval coefficients are available
  FLA(1 To 25) As Integer             'Array of retrieval levels [10 m]
  SU  As String * 4                   'String specifying Sensor Unit
 
  OATsource As Integer                'Outside Air Temperature source (e.g., MTP, NAV, MMS)
  GainScale As Integer                'Gain Scale (e.g., Gain equation, OAT, Noise Diode)
  REFsource As Integer                'Reference Source (either OAT or Target)
 
  PgmDrive As String * 2              'Program Drive (obsolete, handled in MTPsetup.ini now)
  EnableCalfile As Boolean            'True if Calfile is in header record
 
  EditTropAlt As Single               'If TRUE, edit allowed range of trop altitudes
  TropAltMin As Single                'Minimum allowed trop altitude [km]
  TropAltMax As Single                'Maximum allowed trop altitude [km]
  TropAltPC As Integer                'Number of scans flagged as bad for this reason
 
  EditRetAlt As Single                'If TRUE, edit pressure altitude range of retrievals
  RetAltMin As Single                 'Minimum allowed retrieval altitude [km]
  RetAltMax As Single                 'Maximum allowed retrieval altitude [km]
  RetAltPC As Integer                 'Number of scans flagged as bad for this reason
 
  EditZtOff As Single                 'If TRUE, flag trops that are too far from aircraft
  ZtOffA As Single                    'Allowed offset of trop ABOVE aircraft
  ZtOffB As Single                    'Allowed offset of trop BELOW aircraft
  ZtOffPC As Integer                  'Number of scans flagged as bad for this reason
 
  EditTemperature As Single           'If TRUE, flag scans which violate temperature limits
  TemperatureMin As Single            'Minimum allowed retrieved temperature [K]
  TemperatureMax As Single            'Maximum allowed retrieved temperature [K]
  TemperaturePC As Integer            'Number of scans flagged as bad for this reason
 
  EditPitch As Single                 'If TRUE, flag scans that violate pitch limits
  ePitchMin As Single                 'Minumum allowed pitch [deg]
  ePitchMax As Single                 'Maximum allowed pitch [deg]
  PitchPC As Integer                  'Number of scans flagged as bad for this reason
 
  EditRoll As Single                  'If TRUE, flag scans that violate roll limits
  eRollMin As Single                  'Minumum allowed roll [deg]
  eRollMax As Single                  'Maximum allowed roll [deg]
  RollPC As Integer                   'Number of scans flagged as bad for this reason
 
' The following limits apply to raw data processing and are hard wired in MTPret
  EditNav As Boolean                  'If TRUE, flag scans with bad NAV data
  NavMin As Single                    'Not used
  NavMax As Single                    'Not used
  NavQualPC As Integer                'Number of scans flagged as bad for this reason
 
  EditTA As Boolean                   'If TRUE, flag scans that violate antenna temperature limits
  TAmin As Single                     'Minimum allowed antenna temperature [K]
  TAmax As Single                     'Maximum allowed antenna temperature [K]
  TAqualPC As Integer                 'Number of scans flagged as bad for this reason
' The following is no longer used. Instead we now use the CQV flag in the MA routines
' to set the CtsQual flag, which in turn determines the increments CtsQualPC when
' retrievals are done (see code in Main)
  EditCts As Boolean                  'If TRUE, flag scans with bad Raw Data Counts
  CtsMin As Single                    'Minumum allowed raw counts
  CtsMax As Single                    'Maximum allowed raw counts
  CtsQualPC As Integer                'Number of scans flagged as bad for this reason
 
  EditCycle As Boolean                'If TRUE, raw editting enabled
  CycleQualPC As Integer              'Number of scans flagged as bad for this reason
  
  EditTtgt As Boolean                 'If TRUE, flag scans with bad Target temperatures
  TtgtMin As Single                   'Minumum allowed target temperature [K]
  TtgtMax As Single                   'Maximum allowed target temperature [K]
  TtgtPC As Integer                   'Number of scans flagged as bad for this reason
 
  EditRAWbad As Boolean               'Always TRUE, flag bad Raw tropopause
  RAWbadmin As Single                    '6 km
  RAWbadmax As Single                    '23 km
  RAWbadPC As Integer                 'Number of scans flagged as bad for this reason
 
  EditNlev As Boolean                 'If TRUE, flag scans with too few retrieved levels
  NlevMin As Single                   '8
  NlevMax As Single                   '33
  NlevPC As Integer                   'Number of scans flagged as bad for this reason
 
' OAT Tropopause Substitution Information
  EditOATtrop As Boolean              'If TRUE, use OAT-derived or RAOB tropopause instead of MTP
  OATtropPC As Integer                'Number of scans which have substituted trops
 
  OATzt10 As Single                   'ASCENT trop 1 altitude [km]
  Tzt10 As Single                     'ASCENT trop 1 temperature [K]
  OATzt20 As Single                   'ASCENT trop 2 altitude [km]
  Tzt20 As Single                     'ASCENT trop 2 temperature [K]
  OATks10 As Single                   'UT [ks] to begin substituting trops
  OATks20 As Single                   'UT [ks] to stop substituting trops
 
  OATzt11 As Single                   'DESCENT trop 1 altitude [km]
  Tzt11 As Single                     'DESCENT trop 1 temperature [K]
  OATzt21 As Single                   'DESCENT trop 2 altitude [km]
  Tzt21 As Single                     'DESCENT trop 2 temperature [K]
  OATks11 As Single                   'UT [ks] to begin substituting trops
  OATks21 As Single                   'UT [ks] to stop substituting trops
 
  OATzt12 As Single                   'DIP 1 trop 1 altitude [km]
  Tzt12 As Single                     'DIP 1 trop 1 temperature [K]
  OATzt22 As Single                   'DIP 1 trop 2 altitude [km]
  Tzt22 As Single                     'DIP 1 trop 2 temperature [K]
  OATks12 As Single                   'UT [ks] to begin substituting trops
  OATks22 As Single                   'UT [ks] to stop substituting trops
 
  OATzt13 As Single                   'DIP 2 trop 1 altitude [km]
  Tzt13 As Single                     'DIP 2 trop 1 temperature [K]
  OATzt23 As Single                   'DIP 2 trop 2 altitude [km]
  Tzt23 As Single                     'DIP 2 trop 2 temperature [K]
  OATks13 As Single                   'UT [ks] to begin substituting trops
  OATks23 As Single                   'UT [ks] to stop substituting trops
 
' HISTORY information
  CALversion As Date                  'Date CAL file was last modified
  MAKEversion As Date                 'Date MTPret.exe file was last modified
  EDITversion As Date                 'Date MTPedit.exe file was last modified
  FLTINFOversion As Date              'Date MTPinfo.exe file was last modified
  SP1(1 To 2) As Date                 'Place Holders for expansion
  FIversion As Integer                'FLTinfo version
  spa As Integer                      'Spare
'
  EditRate As Boolean
  RateMin As Single
  RateMax As Single
  RatePC As Integer
'
  OATzt14 As Single                   'Sub trop 1 altitude [km]
  Tzt14 As Single                     'Sub 2 trop 1 temperature [K]
  OATzt24 As Single                   'Sub 2 trop 2 altitude [km]
  Tzt24 As Single                     'Sub 2 trop 2 temperature [K]
 
  Tstamp As Date                      'Timestamp of last analysis
  RAWstamp As Date                    'Timestamp of RAW data file
  MMSstamp As Date                    'Timestamp of MMS file
  REFstamp As Date                    'Timestamp of REF file from MTPret
  ERFstamp As Date                    'Timestamp of ERF file from MTPedit
  CTCstamp As Date                    'Timestamp of BMP file from MTPctc
  SP2(1 To 5) As Date                 'Place Holders for expansion
 
  Ncts As Integer                     'Number of "Counts" channels
  ATPrange As Single

End Type



Limits Record Data Structure
  Type REFlimitsRecord
    UTmin As Long                       'Minimum UT [sec]
    UTmax As Long                       'Maximum UT [sec]
    Mins(1 To 40) As Single             'Array of Min values
    Maxs(1 To 40) As Single             'Array of Max values
    NV As Integer                       'Number of retrieved variables
    VSCAL(0 To 4) As Single             'Scale factors for retrieved variables
    Unused As String * 52               'Place Holder for expansion
    TempArray(1 To 54) As Integer       'Place Holder for expansion
    UTtakeoff As Long                   'Takeoff UT
    UTlanding As Long                   'Landing UT
    Ztgm As Single                      'Altitude of global minimum T
    Tzgm As Single                      'Global minimum T for flight above 5 km
    Thgm As Single                      'Theta at global minimym T
    UTgm As Long                        'UT at time of global minimum T
  End Type