Skip to content. | Skip to navigation

Personal tools
You are here: GES DISC Home Legacy Data TOVS Pathfinder Path A Data Set Guide

TOVS Pathfinder Path A Data Set Guide

Abstract:

The TIROS Operational Vertical Sounder (TOVS) Pathfinder Path A dataset contains atmospheric profiles (primarily temperature and humidity) and surface and cloud parameters derived using one of three conceptually distinct algorithms identified by the TOVS Science Working Group (SWG) in November 1991. The purpose of the Pathfinder Project is to make research-quality global change data sets easily available to the science community in support of the US Global Change Research Program (USGCRP) using long term space-based radiance measurements. The initial set of level 3 geophysical products have been derived for the Pathfinder benchmark period from April 1987 through November 1988.

Table of Contents:

  1. Document Information
  2. Investigator(s)
  3. Dataset Information
  4. Theory of Measurements
  5. Equipment
  6. Procedure
  7. Observations
  8. Data Granularity
  9. Data Description
  10. Data Manipulations
  11. Errors
  12. Notes
  13. Application of the Dataset
  14. Dataset Plans
  15. References
  16. Read Software
  17. Data Access
  18. Output Products and Availability
  19. Glossary of Terms
  20. List of Acronyms

1. Document Information:

Revision Date:

15 NOV 1994

2. Investigators:

Investigator(s) Name and Title:

Name:
Joel Susskind
Addresses:
Satellite Data Utilization Office
Code 910.4
NASA/Goddard Space Flight Center
Greenbelt, Md. 20771
Telephone Numbers:
301-286-7210
Electronic Mail Address:
joel.susskind@gsfc.nasa.gov

Title of Investigation:

TOVS Pathfinder Path A Interactive Retrievals

Contacts (for Data Production Information):

Name:
Paul Piraino
Addresses:
Satellite Data Utilization Office
Code 910.4
NASA/Goddard Space Flight Center
Greenbelt, Md. 20771
Telephone Numbers:
301-286-3147
Electronic Mail Address:
paul.piraino@gsfc.nasa.gov

Name:
Lena Iredell
Addresses:
Satellite Data Utilization Office
Code 910.4
NASA/Goddard Space Flight Center
Greenbelt, Md. 20771
Telephone Numbers:
301-286-9773
Electronic Mail Address:
lena.iredell@gsfc.nasa.gov

3. Dataset Information

Dataset Identification

TOVS Pathfinder Path A

Introduction:

This dataset contains the TIROS Operational Vertical Sounder (TOVS) level 3 geophysical parameters derived using the physical retrieval method of Susskind et al 1984) and processed by the Satellite Data Utilization Office of the Goddard Laboratory for Atmospheres at NASA/GSFC. This method, which is hydrodynamic model- anda priori data-dependent, is designated asthe so-called Path A scheme by the TOVS Pathfinder Science Working Group. The 20 channel High resolution Infrared Radiation Sounder 2 (HIRS2) and the 4 channel Microwave Sounding Unit (MSU) aboard the NOAA-xx series of Polar Orbiting Satellites are used to produce global fields of the three dimensional temperature-moisture structure of the atmosphere. TOVS data is also used to derive surface skin temperature, sea surface temperature, outgoinglongwave radiation, cloud fraction, cloudtop height, total ozone overburden and precipitation estimates. These geophysical parameters are mapped to a 1 degree by 1 degree latitude-longitude grid at 3 different temporal resolutions: daily, 5 day and monthly, separately for the AM and PM periods.

Objectives/Purpose:

The primary goal of Pathfinder is the production of consistently processed, long term datasets for use in global change studies. TOVS Pathfinder is one of several Pathfinder studies initiated by NOAA and NASA, the others being the AVHRR, GOES, and SSM/I Pathfinders. As a first step in the processing, a common benchmark period was selected to facilitate the analysis and intercomparison of geophysical fields derived from the various Pathfinders. The benchmark period covers the time period April, 1987 through November, 1988. Once the products from the benchmark period have been endorsed by the scientific community, the processing of the long-term dataset will commence using a fixed algorithm. The experience gained from the processing of these large datasets will serve to guide the EOSDIS (Earth Observing System Data and Information System) development effort in support of the next generation of remote sensing platforms to be launched in the late 1990's.

Summary of Parameters:

The geophysical parameters derived by the TOVS Path A method relate to the following:
  • 3-dimensional temperature-moisture structure of the atmosphere
  • Surface properties (surface skin temperature, sea surface temperature)
  • Physical cloud properties (cloud fraction, cloudtop height, cloudtop temperature, precipitation)
  • Radiation Budget (outgoing longwave radiation, cloud radiative forcing)

Discussion:

Future Entry.

4. Theory of Measurements:

Future Entry.

5. Equipment:

All of the following material has been extracted from the instrument references given in section 15.1.

Instrument Description:

Collection Environment:
Satellite

Platform:
NOAA-10

Platform Mission Objectives:
The overall mission of the TOVS instruments aboard the NOAA Polar Orbiting Environmental Satellites (POES) is to provide continuous, global measurements of atmospheric temperature and moisture profiles. These profiles are then used to initialize numerical general circulation models for improved, operational weather forecasting capabilities.

Key Variables:

High resolution Infrared Radiation Sounder 2 (HIRS/2)

  • atmospheric emission in seven 15.3 micron CO2 channels
  • atmospheric emission in five 4.3 micron CO2 channels
  • surface and H2O emission in one 11.0 micron window channel
  • surface and O3 emission in one 9.6 micron window channel
  • atmospheric emission in five 6.7 micron H2O channels
  • surface emission & reflected solar radiation in two 3.7 micron window channels
Microwave Sounding Unit (MSU)
  • atmospheric emission in three 56 GHz O2 channels
  • surface emission in one 56 GHz window channel
Stratospheric Sounding Unit (SSU)
  • upper atmospheric emission in three pressure modulated CO2 channels
Principles of Operation:

  • HIRS/2: The HIRS/2 instrument measures radiation emitted by the earth-atmosphere system in 19 regions of the infrared spectrum between 3.7 and 15 microns. A visible channel is also available to measure the albedo of the earth's surface. The central wave numbers of these channels are :
              1)   667.70 cm-1              11)  1363.32 cm-1
              2)   680.23                   12)  1489.42
              3)   691.15                   13)  2191.38
              4)   704.33                   14)  2208.74
              5)   716.30                   15)  2237.49
              6)   733.13                   16)  2269.09
              7)   750.72                   17)  2360.00
              8)   899.50                   18)  2514.58
              9)  1029.01                   19)  2665.38
             10)  1224.07                   20) 14453.14
    

    A 15 cm diameter optical system is used to gather emitted energy from the earth's atmosphere and surface. The instantaneous field-of-view of all the channels is stepped across the satellite track by use of a rotating mirror. The energy received by the telescope is separated by a dichroic beam splitter into longwave (greater than 6.4 microns) and shortwave (less than 6.4 microns) energy, controlled by field stops and passed through bandpass filters and relay optics to the detectors. There are 56 steps per scan, each requiring 100 milliseconds for a total of 6.4 seconds per scan. The analog data output from the HIRS/2 sensor is digitalized onboard the satellite at a rate of 2880 bits per second, implying 288 bits per step. The data is digitized to 13 bit precision.

  • MSU: The MSU instrument is a 4 channel Dicke radiometer making passive microwave radiation measurements in 4 regions of the 50 GHz oxygen emission spectrum. The central frequencies of these channels are:
             1)   50.30 GHz              3)   54.96 GHz
             2)   53.74 GHz              4)   57.05 GHz
    
    
    The channel bandwidths are 200 MHz in each case, with a typical Noise Equivalent Differential Temperature (NEDT) of 0.3 degrees K. The instrument has two 4 inch scanning reflector antenna systems, orthomode transducers, four Dicke superheterodyne receivers, a data programmer and power supplies. The antennas are step scanned through eleven individual 1.84 second earth-viewing steps and require a total of 25.6 seconds to complete. The MSU data output represents an apparent brightness temperature after a 1.84 second integration period per step. The data is quantized to 12 bit precision and combined with telemetry and step position information to produce an effective output rate of 320 bits per second.

  • SSU: The SSU employs the technique of pressure modulation to measure radiation emitted by carbon dioxide in the region from 1 to 20 mb. A cell of CO2 gas in the instrument's optical path has its pressure changed in a cyclic manner. The spectral characteristics of the channel and therefore the height of the weighting function is determined by the pressure in the cell during the integration period. By using 3 cells at different pressures, weighting functions peaking at 3 different heights can be obtained. The instrument is step-scanned perpendicular to the subpoint track, and is composed of 8 individual 4 second steps implying a total of 32 seconds per scan. The integrated output signal level is sampled 8 times during each step, and the output is then digitized to 12 bit precision.
Instrument Measurement Geometry:

The instrument measurement geometry for the TOVS sensors are summarized in the following table:
Instrument parameter         HIRS/2          MSU            SSU
--------------------         ------         ------         ------
Cross track scan angle
(+/- degrees from nadir)      49.5           47.4           40.0
Number of steps                56             11              8
Angular FOV (degrees)         1.25            7.5           10.0
Step Angle (degrees)          1.80            9.5           10.0
Ground IFOV (km)
  - at nadir                  17.4          109.3          147.3
  - at end of scan           59 x 30      323 x 179      244 x 186
Swath width (+/- km)          1120           1174            737
Manufacturer of Instrument:
  • HIRS/2: Aerospace/Optical Division of ITT
  • MSU: Jet Propulsion Laboratory
  • SSU: MSDS, Frimley

Calibration:

Prelaunch calibration of the infrared and microwave channels are carried out by the instrument manufacturers to characterize their performance. The radiometer sequentially views the warm calibrated laboratory blackbody (representing the earth), a blackbody colled to about 77 degrees K (representing the space view), and it's own internal blackbodies. Temperatures of all blackbodies are sensed with thermistors or platinum resistance thermometers (PRTs). Data are collected as the laboratory blackbody is cycled through a sequence of temperature plateaus between 175 and 320 degrees K. This entire procedure is repeated for several instrument operating temperatures to simulate in-orbit variations in instrument temperature. Because of both short- and long-term variations in instrument sensitivity during its period of operation, the radiometers have been designed to view cold space and one or more internal warm blackbodies as part of the normal scan sequence in orbit. Using this information, the signal-to-noise and radiometric calibration coefficients can be monitored during the instrument's lifetime. See Frequency of Calibration for further information regarding in-flight calibration procedures.

Specifications:
Tolerance
Future Entry.
Frequency of Calibration:
  • HIRS/2: During normal operations, calibration of the HIRS/2 instrument is performed once every 256 seconds (every 40 scan lines). In calibration mode, the mirror rapidly slews to a space view and samples all channels for the equivalent time of of one complete scan. The mirror is then moved to a position where it views a cold calibration target for the equivalent of a full scan. Finally, the mirror is stepped to view the internal warm target for an equivalent amount of time. With these measurements and an accurate determination of the warm and cold body temperatures using PRTs, calibration coefficients up to second order are obtained for that calibration sequence. These are then used with ensuing earth-view digital counts to obtain the corresponding radiances for each HIRS/2 channel.

  • MSU: The MSU has no special calibration sequence that interrupts normal scanning. The calibration data is included in a scan line of data. From the last earth-view position, the reflector moves 4 steps to view space, then another 10 steps to view the internal blackbody, before beginning a new scan line. Using these measurements, calibration coefficients up to first order are determined for the scan line.

  • SSU: A calibration sequence is initiated every 256 seconds (equivalent to 8 scans) during which the radiometer is stepped to a position to view cold space, then to an internal blackbody at a know temperature. Using these measurements, calibration coefficients up to first order are determined for that calibration sequence. These are then used with ensuing earth-view digital counts to obtain the corresponding radiances for each SSU channel.
Other Calibration Information:
  • HIRS/2: No correction for non-linear instrument response is required for the HIRS/2 raw data prior to applying the radiometric calibration coefficients. To convert channel radiances to brightness temperatures, the inverse Planck function is used to obtain an "apparent" brightness temperature, which is adjusted using satellite-specific band correction coefficients. See thePolar Orbiter User's guide for more detailed information.

  • MSU: A correction for non-linear instrument response is required for the MSU raw data prior to applying the radiometric calibration coefficients. A set of four coefficients is applied to the raw counts using a third order "normalization" equation. The inverse Planck function is used to convert the resulting channel radiances to brightness temperatures.

  • SSU: No correction for non-linear instrument response is required for the SSU raw data prior to applying the radiometric calibration coefficients. The inverse Planck function is used to convert the resulting channel radiances to brightness temperatures.

6. Procedure:

Data Acquisition Methods:

7. Observations:

Data Notes:

None

Field Notes:

Not Applicable

8. Data Granularity:

A granule for the level 3 TOVS Pathfinder data is defined by the following characteristics:
  • Spatial Coverage:
  • global
  • Temporal Coverage:
    daily, 5-day, or monthly (AM and PM separately)

Files are named using the following convention:

            File Name                      Size    Size (compressed)
            ---------                      ----    -----------------
     TOVS_DAILY_pp_yymmdd.HDF              29 MB         10 MB
     TOVS_5DAYS_pp_Byymmdd.Eyymmdd.HDF     29 MB         22 MB
     TOVS_MONTHLY_pp_yymm.HDF              29 MB         26 MB
where "dd" denotes day of year, "mm" the month number, "yy" the year, and "pp" the AM or PM period. Since the files have been compressed, the extension ".Z" will be appended to the file names.

9. Data Description:

Spatial Characteristics:

Spatial Coverage:
For the daily, 5 day, and monthly gridded data, the spatial coverage is global. However, in the case of the daily maps, there will be orbital data gaps present which will not be apparent in the 5 day and monthly averaged data products. See Spatial Coverage Map below.

Spatial Coverage Map:
Global, rectangular latitude-longitude grid

An example of a typical spatial coverage for a sample monthly (AM only, descending nodes) image of SKIN SURFACE TEMPERATURE is shown below:

TOVS imageClick here to expand image

The inter-orbital data gaps as well as the calibration scan lines (every 40th line for HIRS/2) are clearly visible in this image.

Spatial Resolution:
  • Horizontal Resolution :
  • All parameters : 1 degree latitude by 1 degree longitude

  • Vertical Resolution :
    Temperature profile : 12 levels (surface, 1000, 850, 700, 500, 400, 300, 200, 100, 70, 50, 30 mb)
    Coarse layer temperatures : 4 layers (surface-500, 500-300, 300-100, 100-30 mb)
    Specific humidity profile : 5 levels (1000, 850, 700, 500, 300 mb)

Projection:
Not Applicable

Grid Description:
There are 360 cells in the longitude direction with the first grid cell centered at 179.5W (near the date line), and with a grid spacing of 1 degree. There are 180 cells in the latitude direction with the first grid cell centered at 79.5S (near the South Pole), and with a grid spacing of 1 degree. The vertical levels coincide with mandatory pressure levels in the case of the temperature and humidity profiles.

Each level 2 spot retrieval is assigned to a single gridbox according to which gridbox the spatial coordinates of the center of the level 2 FOV falls within. For individual gridboxes with multiple observations, a simple unweighted average of all points within the box is used when determining the value of the geophysical parameter to assign to that gridbox. No interpolation or data filling is used for gridboxes with missing data; the fill value for missing or suspect data is contained in the metadata file descriptor annotation accompanying each HDF file. Currently, this value is set to -999.99 for the mean and standard deviation arrays, and 0 for the count arrays.

Temporal Characteristics:

Temporal Coverage:
The temporal coverage of this dataset is currently April 1987 through November 1988 inclusive (i.e., the Pathfinder benchmark period). Plans for the future include support for the entire TOVS historical record beginning with TIROS-N in November 1978 and continuing to the present. See list of satellite periods in Temporal Coverage Map.

Temporal Coverage Map:
SATELLITE		AVAILABLE DATA BASE			
------------		-------------------------			
TIROS-N (2:30)		Dec. 1, 1978 - Jan. 20, 1980			
			Dec. 1, 1978 - Jan. 20, 1980			
										
NOAA 6 (7:30)		Nov. 1, 79 - April 16, 1983			
			(13 day gap March 26-April 9, '81)	
			Nov. 1, 1979 - June 11, 1981		
											
NOAA 7 (2:30)		July 1, 1981 - Feb. 5, 1985			
			(6 day gap Sept. 24-29, 1982)		
			July 1, 1983 - July 31, 1983			
											
NOAA 8 (7:30)		April 26, 1983 - June 20, 1984		
											
NOAA 9 (2:30)		Dec. 4, 1984 - Feb. 2, 1987			
											
NOAA 10 (7:30)		Nov. 25, 1986 - May 31, 1991		
			August 2, 1987 - Oct. 4, 1987		
			May 1, 1988 - July 15, 1988		
			Sept. 1, 1988 - Oct. 15, 1988		
											
NOAA 11 (2:30)		Nov. 1, 1988 - Present				
											
NOAA 12 (7:30)		June 1, 1991 - Present			
											
NOAA J (2:30)		scheduled launch 1994

Temporal Resolution:
The level 3 gridded products are created at 3 temporal resolutions:daily, 5 day and monthly. These products are created separately for the AM (descending nodes on morning satellites) and PM (ascending nodes for morning satellites) periods.

Local equator crossing time for even numbered satellites such as NOAA-10 is nominally 7:30 PM for the ascending node and 7:30 AM for the descending node. For gridding purposes, the global AM (PM) map is not created by including data from all descending (ascending) portions of the orbits between 00Z and 24Z. This would result in data from 2 consecutive days being included in either map since the satellite crosses the date line during this 24 hour period. Rather, the gridding is based upon the local date and time of the orbits, e.g., only those ascending orbits with the same local day and time (which is always 7:30 PM) are used in the construction of the PM map. A similar procedure is used in the construction of the AM map.

Data Description:

Parameter/Variable:
Temperature Parameters: Atmospheric temperatures are given at up to 12 pressure levels, including the surface. The surface air temperature is always given. If the model forecast surface pressure is less than a given pressure, the retrieved value for that pressure is given a fill value (-999.99).Average coarse layer temperatures are also derived between four sets of pressure levels.

Water Vapor Profiles: Water vapor profiles are given in terms of specific humidity at 5 mandatory pressure levels. In addition, total precipitable water above the surface and above 4 mandatory pressure levels are also derived and output as additional measures of atmospheric moisture.As in the case of temperature, a fill value (-999.99) is given at mandatory levels if the surface pressure is less than the mandatory level pressure level.

Total Ozone Index: The total ozone index is computed as an experimental parameter using HIRS/2 channel 9 (9.6 microns). The TOMS total ozone is used for tuning the TOVS ozone index on both a latitudinal and seasonal basis. However, unlike TOMS, both daytime and nighttime estimates of the total ozone are obtained using the HIRS/2 measurements.

Surface Parameters: Two surface parameters are provided, namely, the retrieved surface skin temperature (both land and sea) and forecast surface air pressure. The first quantity is derived from the TOVS radiances, and the second is generated by the General Circulation Model.

Cloud Parameters: Ten cloud parameters are derived.These are total effective cloud fraction (for clouds in any layer), effective cloud fraction for clouds with cloud top pressure levels situated in each of seven ISSCP layers, cloud top pressure and cloud top temperature. The cloud top pressure and cloud top temperature are those associated with the total effective cloud fraction. The sum of the cloud fraction in each of the seven layers is equal to the total cloud fraction.

Longwave Radiation Parameters: Longwave radiation parameters are computed from the retrieved cloud parameters and other geophysical parameters.Two quantities are written out: Outgoing Longwave Radiation, defined as the upward longwave flux exiting the top of the atmosphere, and Longwave Cloud Radiative Forcing, defined as the difference between the cloudy sky and clear sky Outgoing Longwave Radiation values.

Precipitation Estimate: The precipitation estimate is an experimental quantity inferred from retrievals of cloud parameters and the relative humidity profile. It is derived over both land and water surfaces.

Other Parameters: There are three other parameters written out in each file. The most important is a quality flag which indicates the degree to which the radiances computed from the retrieval match the observations.The highest quality indicator is 0 and the lowest is 4.By definition, differences between observed and computed radiances for all retrievals included in the data set matched sufficiently closely to be accepted.In addition, the effective HIRS2 observed zenith angle (zenith angles to the right and left of nadir have different signs) and the average local time of day in hours (between 0 and 23.99) are provided to facilitate the interpretation of the retrieval products. The effective zenith angle is defined as the arc-cosine of the average value of the cosines of the individual satellite zenith angles.

Variable Description/Definition:

The TOVS Path A dataset contains the following set of geophysical parameters derived from HIRS/2 and MSU radiance measurements:


Variable	Units		Description
---------	----		------------
TEMPSFC		K	Temperature at surface air 
TEMP1000	K	Temperature at 1000 mb 
TEMP850		K	Temperature at 850 mb 
TEMP700		K	Temperature at 700 mb 
TEMP500		K	Temperature at 500 mb 
TEMP400		K	Temperature at 400 mb 
TEMP300		K	Temperature at 300 mb 
TEMP200		K	Temperature at 200 mb 
TEMP100		K	Temperature at 100 mb 
TEMP70		K	Temperature at 70 mb 
TEMP50		K	Temperature at 50 mb 
TEMP30		K	Temperature at 30 mb 
TEMPGRD     K   Surface Skin Temperature
CLTEMP1		K	Mean temperature surface to 500 mb 
CLTEMP2		K	Mean temperature 500 mb to 300 mb 
CLTEMP3		K	Mean temperature 300 mb to 100 mb 
CLTEMP4		K	Mean temperature 100 mb to 30 mb 
PRWATSFC	cm	Precipitable water vapor above surface 
PRWAT850	cm	Precipitable water vapor above 850 mb 
PRWAT700	cm	Precipitable water vapor above 700 mb 
PRWAT500	cm	Precipitable water vapor above 500 mb 
PRWAT300	cm	Precipitable water vapor above 300 mb
FCLD *		%	Total cloud fraction 
FCLDP1 *	-	Cloud fraction above 180 mb
FCLDP2 *	-	Cloud fraction between 310 and 180 mb
FCLDP3 *	-	Cloud fraction between 440 and 310 mb
FCLDP4 *	-	Cloud fraction between 560 and 440 mb
FCLDP5 *	-	Cloud fraction between 680 and 560 mb
FCLDP6 *	-	Cloud fraction between 800 and 680 mb
FCLDP7 *	-	Cloud fraction below 800 mb
PCLD *		mb	Cloud top pressure for FCLDTOT
TCLD *		K	Cloud top temperature for FCLDTOT 
ZANGLE		deg	HIRS/2 satellite zenith angle 
TIME		hrs	Local time of the day 
QFLAG		N/A	Quality flag (0 is best, 4 is marginal) 
TOZ *		D.U.	Total ozone index 
OLR		W/m^2	Outgoing longwave radiation
LCRF		W/m^2	Longwave cloud radiative forcing 
PRECIP *	mm/day	Precipitation estimate 
SPHUM1000	g/kg	Specific humidity at 1000 mb 
SPHUM850	g/kg	Specific humidity at  850 mb 
SPHUM700	g/kg	Specific humidity at  700 mb 
SPHUM500	g/kg	Specific humidity at  500 mb 
SPHUM300	g/kg	Specific humidity at  300 mb
PSURF       mb      Forecast Surface Pressure
The '*' indicates that these derived parameters were designated as experimental by the TOVS Implementation Team, pending further validation of the results.

Unit of Measurement:

See Variable Description/Definition above

Data Source:

The TOVS Path A methodology makes use of a combination of HIRS/2 and/or MSU channel radiances to infer information pertaining to the following groups of geophysical parameters :

Temp profile      H2O profile       Clouds       Surf temp
------------      -----------     -----------    ---------
HIRS....1,2,4     HIRS....8,10    HIRS....4,5    HIRS...8,18,19
     13,14,15            11,12          6,7,8
MSU.......3,4

Cloud Clearing       Ozone
--------------     ---------
HIRS.....13,14     HIRS....9
MSU..........2

where the HIRS/ and MSU channel designations are listed in section 5.1.5 of this document.

Data Range:

Future Entry.

Sample Data Record:

See Spatial Coverage Map

Data Format:

The TOVS Pathfinder level 3 output consist of binary files containing 2- and 3-dimensional geophysical parameters mapped to a rectangular latitude-longitude grid. For each parameter, each cell in the grid is characterized by a mean value of that parameter, the associated standard deviation, and the number of observations used in computing the first two quantities. All 3 of these statistics are stored as Scientific Data Sets (SDSs) in the Hierarchical Data Format (HDF). Means and standard deviations are stored as 32 bit floating point words, while the number of observations in each gridbox or the " gridbox counts" are represented as 16 bit integers. Version 3.2 release 4 of HDF (HDF3.2r4) was used to create all level 3 files The overall structure of a TOVS HDF file is shown in the schematic below:

FILE diagram

For example, SDS #1 will be the 3 dimensional (360 x 180 x 12) array representing the temperature profiles at 12 pressure levels, while SDS #17 will consist of the 2 dimensional (360 x 180) array containing the forecast surface pressure. SDS's 18 through 34 will be completely analagous to SDS 1 through 17 except that the arrays will represent the standard deviations rather the means of the parameters. Similarly, SDS's 35 through 51 will contain the gridbox count arrays associated with each parameter. The order in which the SDS arrays are written out is as follows :

SDS   SDS Name    SDS Dims     SDS Description
----  ---------   ---------    ---------------
 1    TEMP        360x180x12   Vertical temperature profile at 12 levels
 2    CLTEMP      360x180x4    Mean temperatures for 4 coarse layers
 3    PRWAT       360x180x5    Total precipitable water above 5 levels
 4    TSURF       360x180      Surface skin temperature
 5    FCLD        360x180      Effective total cloud fraction
 6    FCLDP       360x180x7    Effective cloud fraction, 7 ISSCP layers
 7    PCLD        360x180      Effective cloudtop pressure
 8    TCLD        360x180      Effective cloudtop temperature
 9    ZANGLE      360x180      Effective satellite zenith angle
10    TIME        360x180      Time of day
11    QFLAG       360x180      Quality flag
12    TOZ         360x180      Total ozone index
13    OLR         360x180      Outgoing longwave radiation
14    LCRF        360x180      Longwave cloud radiative forcing
15    PRECIP      360x180      Precipitation estimate
16    SPHUM       360x180x5    Specific humidity profile at 5 levels
17    PSURF       360x180      Model forecast surface pressure

SDSs 18 through 34 and 35 through 51 will have the same names as those shown above, except with the suffixes "_STD" and "_CNT" appended, respectively. The individual SDSs are self-documenting in that ASCII labels containing the SDS name, description and units have been attached to each. Further information on the implementation of the data arrays into HDF can be found in the TOVS Path A README file located in the documentation area of the Goddard DAAC IMS.

Related Datasets:

  • TOVS Pathfinder Path B (GSFC DAAC)
  • TOVS Pathfinder Path C1 (MSFC DAAC)
  • TOVS Pathfinder Path C2 (NOAA SAA)
  • TOVS Path P (NSIDC DAAC)
  • DAO 4D Time Series (GSFC DAAC)

10. Data Manipulations:

Formulae:

The fundamental formulae used in the TOVS Path A methodology can be found in a postscript file in the anonymous ftp directory /pub/tovs/pathA/doc/appendixAB.pslocated on eosdata.gsfc.nasa.gov.

Derivation Techniques and Algorithms:

The Path A system steps through an interactive forecast-retrieval-analysis cycle, whereby in each 6 hour synoptic period, the 6 hour forecast fields of temperature, humidity and geopotential thickness generated by the Goddard Laboratory for Atmospheres (GLA) 2nd order GCM (Takacs et al., 1994) are used as the first guess for all soundings occuring within a 3 hour time window centered upon the forecast time. These retrievals are then assimilated with all available insitu measurements (such as radiosonde and ship reports) in the 6 hour interval using an Optimal Interpolation (OI) analysis scheme developed by the GLA Data Assimilation Office. This analysis is then used to specify the initial conditions for the next 6 hour forecast, thus completing the cycle.

The retrieval algorithm itself is a physical method based on the iterative relaxation technique originally proposed by Chahine (1968). The basic approach consists of modifying the temperature profile from the previous iteration by an amount proportional to the difference between the observed brightness temperatures and the brightness temperatures computed from the trial parameters using the full radiative transfer equation applied at the observed satellite zenith angle. For the case of the temperature profile, the updated layer mean temperatures are given as a linear combination of multichannel brightness temperature differences with the coefficients given by the channel weighting functions. Constraints are imposed upon the solution in order to ensure stability and convergence of the iterative process. For more details see Susskind et al (1984).

Two important procedures are necessary for the accurate retrieval of the geophysical parameters using satellite-based radiance measurements. The first involves the reconstruction of the clear sky radiances which would have been observed in the absence of cloud contamination. This is performed using a variation of the N* method applied to adjacent fields-of-view (over an area covering 2 along-track and 2 cross-track HIRS2 spots) using a combination of infrared and microwave channels (see Data Source). The second procedure involves the need for a bias correction stemming from a combination of instrument calibration errors and drifts and errors in the radiance computations. The systematic errors between computed and observed brightness temperatures are modeled as a function of latitude and satellite zenith angle, with the coefficients determined by a least squares fit to the radiance residuals resulting between the observed brightness temperatures and those obtained from the globally unbiased GLA forecast model. These coefficients are updated periodically throughout the day and the resulting radiance corrections are applied to all computed brightness temperatures used in the derivation of the geophysical parameters. See Special Corrections/Adjustments for more details on systematic error corrections used in the TOVS Path A method.

As part of the iterative process for the temperature profile, the surface characteristics such as skin temperature, sea surface temperature and microwave emissivity are determined so as to be consistent with the radiances measured in the window channels that are primarily sensitive to changes in these parameters (see Data Source). Once these are known, the remaining geophysical parameters, namely the humidity profile, total ozone, cloudtop height and cloud amount are derived as described in detail in Susskind et. al. (1984).

Data Processing Sequence:

Processing Steps (and Datasets):
The overall TOVS Path A processing flow can be illustrated by the following schematic:

process flow diagram

The basic methodology used to retrieve geophysical parameters from the TOVS observations involves use of an interactive forecast-retrieval-analysis scheme in which the first guess information for the retrievals (surface pressure, temperature profile, and moisture profile) comes from a 6 hour forecast from a general circulation model initiated at time T (i.e., a forecast is produced at time T+6 hours). This information, together with the observed radiances, and other auxiliary information used for systematic error correction of retrieved quantities, is used to generate retrievals for the 6 hour period centered on the forecast time (i.e., between T+3 and T+9 hours). An analysis is then performed using these retrievals and all available in situ data for that time period.Another 6 hour forecast is made using the analyzed geophysical fields as input and the cycle then repeats.

The steps involved in the retrievals portion of the data processing (designated by the GLA RETRIEVAL PROGRAM box in this diagram) can be summarized as follows:

Calibration and grouping of radiance data : Starting from level 1B data, HIRS2 and MSU data is calibrated according to calibrations coefficients provided by NOAA on the level 1B data. Calibration is performed using the procedures set forth in the NOAA Polar Orbiter User's Guide. A 2 x 2 array of HIRS2 spots is grouped together and colocated with the nearest MSU spot.The HIRS2 radiances are grouped into two fields of views, containing 2 spots each.One sounding is performed on each 2 x 2 array of spots and assigned the latitude and longitude of the center of the four HIRS2 spots, as well as the time of the measurement.Also included are the average satellite zenith angle of the HIRS2 spots and the zenith angle of the MSU spots.

Retrieval first guess : The first guess for the retrieval at that spot comes from a six hour forecast from the General Circulation Model with 4 degree by 5 degree latitude-longitude horizontal resolution and 20 vertical levels, interpolated in space to the satellite location. First guess parameter fields provided by the model forecast are the surface pressure, the temperature profile, and the humidity profile. In addition, the first guess ozone profile is obtained by taking a zonally averaged climatology profile, which is a function of latitude and month, and multiplying its values by the ratio of the zonal mean TOMS total ozone at that latitude for the previous two days to the climatological total ozone. The forecast surface pressure remains fixed in the retrieval. All other retrieved geophysical parameters will be modified via an iterative procedure to be consistent with the channel radiance measurements.

Radiance computation for first guess : Radiances are computed for all channels at the appropriate zenith angle of observation (HIRS2 and MSU angles are different), using the first guess parameters in conjunction with a radiative transfer code. The first guess surface skin temperature is set equal to climatology over ocean and the forecast surface air temperature over land.Computed radiances are corrected for systematic computation errors to yield the clear column radiances expected from the first guess.

Cloud corrected observed radiances : Observed radiances in the two fields of view are cloud-corrected to reconstruct what would have been observed if the fields of view were clear. The cloud clearing depends to a small degree on the estimates of the geophysical parameters and is iterated in the retrieval. Beginning with radiances calculated from the first guess fields, geophysical parameters will be found which minimize the residual between reconstructed clear column radiances and radiances computed from the solution. Under some conditions, the scene is found to be too cloudy to reconstruct clear column radiances.This occurs about 10% of the time, typically with fractional cloudiness of over 80%.

Iterative ground temperature, temperature profile retrievals : Starting from the first guess profile and channel residuals, the ground temperature and temperature profiles are iterated to match the difference between the Nth iterative estimate of the clear column radiances and the radiances computed from the Nth iterative parameters. Retrievals are rejected if a close enough match cannot be found.The moisture profile and ozone profile are fixed at the first guess in these calculations.Channels used in the temperature retrieval are relatively insensitive to moisture and ozone profile. Systematic temperature profile error corrections, based on comparison with radiosonde reports, are added to the retrieved temperature profile. If the temperature retrieval is rejected, no retrieval for moisture profile or ozone retrieval is performed.

Moisture profile retrieval : Using the retrieved ground temperature, temperature profile, and reconstructed clear column radiances obtained from the previous step, the moisture profile is iterated to best match moisture sounding channel radiances computed from the solution with the reconstructed clear column radiances determined in the temperature sounding step.The retrieved moisture profile is modified according to a systematic error correction procedure, as done for the temperature profile.

Total ozone retrieval : The radiance for the ozone channel HIRS2 channel 9 is computed using all previously retrieved quantities and the ozone first guess and compared to the reconstructed clear column radiance.Total ozone is modified to achieve a match.The radiances computed for the ozone channel are adjusted for systematic errors, based on the zonal mean of the difference between retrieved total ozone values and those obtained from the TOMS data used to create the ozone first guess field.

Post retrieval computations : Post retrieval computations are now done for cloud height and cloud top pressure, OLR, longwave cloud radiative forcing, and precipitation estimate. Cloud parameters are always retrieved for all locations, based on matching observed radiances in four channels (HIRS 4-8) and radiances computed using the retrieved values of all parameters (or first guess if a solution could not be found) and the cloud parameters.OLR and Longwave Cloud Radiative Forcing is computed via radiative transfer calculations using the retrieved (or first guess) parameters and cloud products.Precipitation estimate is obtained as a function of retrieved cloud parameters and retrieved (or first guess) relative humidity profile.

Post processing : The retrievals are run for a six hour period.These retrievals are then used, together with all other in-situ measurements in that 6 hour period, to produce an analysis (best estimate of the state of the atmosphere) at time T+6 hours.These initial conditions are used to produce the forecast for T+12 and the cycle repeats. Details of the new forecast analysis system and its use in the interactive retrieved mode are shown in Appendix A. Every 24 hours, retrievals are gridded into daily 1 degree by 1 degree level 3 fields.Every 48 hours, retrievals are compared to colocated radiosondes to test the accuracy of temperature and moisture profiles and generate new temperature and moisture profile systematic error correction coefficients to be used for the next 48 hours of retrievals.In addition, every 48 hours, new zonal mean TOMS total ozone values are read into the program for ozone systematic error removal.

Processing Changes:
There have been many improvements to the old retrieval system, described in Susskind and Pfaendtner (1989), arising from research we have been doing and incorporated in the Pathfinder processing scheme.These include :

  1. coupling the interactive retrieval system with a new higher vertical resolution General Circulation Model and Optimal Interpolation Analysis scheme
  2. developing an improved iterative scheme for both temperature and moisture retrievals
  3. developing improved methodology for systematic error correction for temperature and moisture retrievals
  4. developing an on-line algorithm to compute Outgoing LongwaveRadiation on a retrieval by retrieval basis.

Details of the new forecast analysis system and its use in the interactive retrieved mode can be found in the postscript file /pub/tovs/pathA/doc/appendixAB.pson eosdata.gsfc.nasa.gov. The basic methodology to analyze the satellite data is unchanged from that of the previous retrieval system used to produce earlier versions of the data products, and is described in Susskind and Pfaendtner (1989) and the references therein. The cloud correction algorithm used to obtain the clear column brightness temperatures has not changed from that described in Susskind and Pfaendtner (1989). The computed radiances use exactly the same methodology as in Susskind and Pfaendtner (1989) except for the systematic error correction term, which is an empirical term added to a subset of computed brightness temperatures to account for biases between observed and computed brightness temperatures.Recent research has led to improvements in this term which are described in the file /pub/tovs/pathA/doc/appendixCD.ps on eosdata.gsfc.nasa.gov (also see Special Corrections/Adjustments section).The method of determination of the temperature profile has been simplified and takes advantage of the improved vertical structure of the first guess. In addition, the moisture profile retrievals are now determined in a manner that is analogous to that of the temperature profile retrievals. A more detailed description of these improvements is available in /pub/tovs/pathA/doc/appendixAB.ps.Finally, improved methodology has been developed for computations of OLR, which is described in detail in /pub/tovs/pathA/doc/appendixCD.ps.

Calculations:

Special Corrections/Adjustments:
  • Corrections for radiance biases

    Since the TOVS Path A physical retrieval method makes use of the difference between observed and computed brightness temperatures to iteratively adjust the values of derived geophysical parameters. Thus, inherent biases between computed and observed brightness temperatures (for the case where the derived set of parameter values equals the truth) can be particularly damaging from the point of view of monitoring climate variability and trends, as these biases will differ from satellite to satellite and spurious trends may result. The interactive system plays a critical role in the removal of systematic errors between observed and computed radiances which are accounted for in the GLA system as part of the retrieval process. The interactive retrievals are initialized with the first guess field obtained from a 6 hour forecast from the GLA general circulation model generated from an analysis which has utilized all sounding data and in situ data in the last 6 hour period.The global forecast field is assumed to have local errors but be globally unbiased.This assumption is used to help account for systematic differences between observed brightness temperatures and those computed from the forecast first guess. A detailed description of the steps involved in the brightness temperature systematic error correction can be found in the anonymous ftp directory /pub/tovs/pathA/doc/appendixCD.pslocated on eosdata.gsfc.nasa.gov.

  • Systematic error correction in the retrieved parameters

    In addition to systematic error correction of computed brightness temperatures, a further systematic error correction is applied to retrieved values of both the temperature and moisture profiles based on comparisons of retrieved quantities with colocated radiosonde reports. This procedure is performed every 48 hours using about 1500 colocations to determine altitude-dependent regression coefficients based upon minimization of the rms difference of radiosonde and retrieved temperatures. A high-level schematic of the steps involved in the systematic error correction is shown below:

    process diagram

    The topography dataset is included as an input file since it contains a land/sea indicator, upon which the systematic error corrections for the moisture profile depends. A more detailed description of the steps involved in the removal of systematic errors from the retrieved parameters can be found in the anonymous ftp directory /pub/tovs/pathA/doc/appendixCD.pslocated on eosdata.gsfc.nasa.gov.

Calculated Variables:
Future entry.

Graphs and Plots:

Future Entry.

11. Errors:

Sources of Error:

Future Entry.

Quality Assessment:

Data Validation by Source:
The level 3 Path A parameters have been validated against independently measured data from both insitu and satellite sources. The errors quoted represent the "expected errors" using the RMS differences between the TOVS-derived values and the correlative values (area-weighted by latitude) summed over all gridboxes for a monthly period.

Temperature and humidity parameters have been compared to colocated radiosonde data. In addition, the total precipitable water above oceanic areas has been compared to data derived from the Special Sensor Microwave/Imager (SSM/I).

The surface skin temperature over ocean has been compared to values produced by the NOAA Climate Analysis Center (CAC) based on ship, buoy, and AVHRR data.

The total atmospheric column ozone burden was validated against Total Ozone Mapping Spectrometer (TOMS) data, which was also used in the zonal mean sense as part of the systematic error removal scheme for total ozone retrievals.

OLR has been validated against OLR determined by the ERBE team using the ERBE instruments on NOAA 10 and ERBS.ERBS is a tropical orbiting satellite and this adds a temporal sampling bias in the tropics. Longwave cloud radiative forcing has not been validated at this time.

The precipitation estimate has been compared with rain gauges, which are primarily over land.

In addition to these direct correlative data comparisons, errors between interannual differences computed for the TOVS data and the interannual differences computed from the correlative data have been provided based upon the monthly gridded results from July 1987 and July 1988. These results are shown in the table below:


		MONTHLY MEAN INTERANNUAL DIFFERENCE

	PARAMETER			RMS ERROR	GLOBAL BIAS
	-------------			------------	--------------
Coarse Layer Temperatures		0.7 - 1.0 deg	lt. 0.1 deg
Level Temperatures (excluding 10mb)	1.0 - 2.0 deg	lt. 0.3 deg
Total Precipitable Water		20%			-
Precipitable Water above levels		25 - 40%		-
Specific Humidity			25 - 40%		-
Sea Surface Temperature			0.5 deg			-
Land Surface Temperature		2.0 deg			-
Total Ozone				5%			-
Outgoing Longwave Radiation		5 W/m^2		1 W/m^2
Cloud Fraction				10%			-
Cloudtop Pressure			50 mb			-
Precipitation Estimate			3 mm/day		-

Confidence Level/Accuracy Judgement:

Coarse Layer Temperatures:

  • Bias (monthly mean):less than 0.3 degrees C
  • RMS error (monthly mean):1.0 - 1.2 degrees C
  • Spatial correlation (monthly mean):0.99.

  • Bias (interannual difference):less than 0.l degrees C
  • RMS error (interannual difference):0.9 degrees C
  • Spatial correlation:0.90-0.95.

Note that errors in interannual differences compared to radiosondes are smaller than for monthly mean differences.This is because errors contain a systematic component that cancels out in the interannual sense.A substantial component of this may be due to sampling differences in the satellite and radiosonde, such as local time of day.The high spatial correlation and low bias of coarse layer temperatures with radiosondes show these coarse layer temperatures are potentially accurate climate indicators capable of showing regional and global trends.

Level Temperatures:

  • Bias (monthly mean, for pressures below 400 mb):less than 0.2 deg C
  • Bias (monthly mean, for pressures 300-70 mb):0.3 - 0.4 deg C
  • Bias (monthly mean, for pressures 50-30 mb):0.6 - 0.9 deg C
  • RMS error (monthly mean):2.0 degress (for 1000 mb and 850 mb)
  • RMS error (monthly mean):1.3 degrees (for 700 mb - 400 mb)
  • RMS error (monthly mean):1.5 degrees (for 300 mb - 200 mb)
  • RMS error (monthly mean): 1.8 degrees (for 70 mb - 50 mb)
  • RMS error (monthly mean):2.4 degrees (for 30 mb)

Interannual differences show smaller biases and RMS errors, as with coarse layer temperatures, with spatial correlations in the range .8 - .9. This shows that the level temperatures contain useful interannual difference patterns but are quantitatively less accurate than the coarse layer temperatures.They can be used to explain the detailed differences in coarse layer temperature patterns, however.

Water Vapor: Most radiosondes are over land, though a number of tropical island stations also exist.The precipitable water above the surface has a global mean bias of -.07 cm compared to a radiosonde mean of 1.79 cm (-4% bias) and the standard deviation of the difference from radiosondes is 0.33 cm, which is 19% of the radiosonde standard deviation of 1.67 cm.The bias comes primarily from tropical ocean stations where retrievals tend to be biased dry in moist cases.The spatial correlation is 0.98 between retrieved and radiosonde total precipitable water vapor.

Above other levels, biases are of the order of 15-20% compared to radiosondes and standard deviations of the order of 40%, with spatial correlations on the order of 0.9.Total oceanic precipitable water compared to the SSM/I product for March 1988 gave a bias of 0.23 cm, compared to an SSM/I oceanic mean of 2.87 cm (8% bias) and a standard deviation of 0.51 cm (18%).The TOVS retrievals tended to be drier than SSM/I in moist tropical areas and moister in drier areas.According to radiosondes, July 1988 was moister by 1.7 mm than July 1988 with a spatial standard deviation of the interannual difference of 5.8 mm.This shows considerable interannual variability in moisture between these two years.The colocated retrievals showed July 1988 0.7 mm moister than July 1987.The standard deviation of the difference between retrieved and radiosonde interannual differences was 2.7 mm with a spatial correlation of 0.76.Correlations of higher level interannual difference patterns were the order of 0.7.

Surface Parameters: For March 1988, the mean difference over oceans 60N - 60S between the CAC sea surface temperatures and TOVS-derived sea surface temperatures is -0.12 degrees C (TOVS colder) with a standard deviation of 0.7 degrees C. For the interannual difference July 1988 - July 1987, the patterns agree closely, but the amplitude of the local interannual difference patterns is considerably larger in the CAC analysis.The land surface skin temperature cannot be validated directly.

Total Ozone Index: Daily comparisons between TOMS and TOVS total ozone cannot be done directly because ozone features move rapidly in time and the TOMS data is taken at local noon, compared to 7:30 AM, PM on NOAA 10.Monthly mean comparisons for March 1988 show a global mean difference of 2 Dobson units, a standard deviation of 16 Dobson units, and a correlation of 0.9 when compared to the TOMS data used in the systematic error removal scheme. Unfortunately, all of 1988 was processed using results from an earlier version of the TOMS data than the current official TOMS product, though the correct version of TOMS data was used in processing 1987 TOVS data.For this reason, the TOVS total ozone index for 1988 was deleted from the TOVS benchmark period data set (fill values used at all gridpoints).The total ozone data is labeled as experimental pending further validation studies.

Cloud Parameters: The cloud parameters have not been validated directly but are an important element in the computation of OLR, and are validated indirectly by validation of OLR. Cloud parameters are labelled experimental for the TOVS Path A benchmark data because they have not been validated directly.

Longwave Radiation Parameters: For March 1988, the global mean difference of TOVS OLR and ERBE OLR was 1.8 W/m2 and the spatial standard deviation was 5 W/m2.This excellent agreement serves as a validation for all parameters which enter the OLR calculation, especially the cloud parameters and the surface skin temperature, which are the two most important parameters affecting OLR.The agreement also shows that the TOVS parameters can be used to explain variations in space and time of OLR, which has been used as an important climate indicator.Interannual differences between July 1988 and July 1987 OLR shows a mean difference from ERBE of 0.5 W/m2, a standard deviation of 5.7 W/m2, and a spatial correlation of 0.92.

Precipitation Estimate: For March 1988, the mean rain gauge amount was 2.71 mm/day, with a spatial standard deviation of 3.50 mm/day.The mean TOVS precipitation estimate in colocated areas was low by .53 mm/day, and the standard deviation of the differences from rain gauges was 2.65 mm/day, with a spatial correlation of 0.67.The TOVS precipitation estimate were damped in amplitude compared to the rain guage, but spatial patterns are good. The differences between July 1988 and July 1987 showed good agreement with a bias of -.14 mm/day, standard deviation of 2.94 mm/day, and spatial correlation of 0.52.Again, the amplitude of interannual difference patterns was larger in the rain guages.

Measurement Error for Parameters and Variables:

Additional Quality Assessments:
All retrievals are objectively validated according to the agreement between observed (cloud corrected) brightness temperatures for the temperature sounding channels and those computed from the solution. Two measures are used in this validation: the difference (residual) between observed and computed brightness temperatures for MSU channel 2, and the root mean square difference (rms error) between observed and computed brightness temperatures for the remainder of the temperature sounding channels. If either value is greater than 1 degree, the retrieval is rejected and a fill value is written out for all parameters except those related to cloud properties, which are always computed and written out. If each difference is less than 1 degree, a quality flag indicator is then computed based on the sum of the two measures as follows:

QFLAG = ( | residual |+| rms error | ) * 2.

A quality flag value less than 1.0 indicates that the overall disagreement was rather small and the retrieval is assumed to be of very good quality. Quality flag values between 1.0and 4.0 indicate an increasing difference between the observed and computed MSU channel 2 brightness temperatures and/or a higher RMS error for the remainder of the temperature sounding channels.

Data Verification by Data Center:
A checksum is used prior to data ingest to verify proper file transfer from the data producer to the archive center. Visual inspection of the level 3 data has been performed on a random basis using the IDL and Collage visualization packages to ensure proper HDF implementation and ready access to file contents.

12. Notes:

Limitations of the Data:

Temperatures: Coarse layer temperatures are better defined by the TOVS radiances than point temperatures and therefore the results should be less method dependent provided effects of clouds on the radiances and sources of systematic errors are handled appropriately.The coarse layer temperatures are best determined in the order starting from the lower troposphere, with quantitative accuracy decreasing with increasing height.Interannual differences of monthly mean surface to 500 mb layer mean temperatures have high quantitative accuracy (better than 0.1 degree C) compared to radiosonde reports and spatial correlations greater than 0.95.They are therefore useful for global and regional trend studies as well as climate variability studies, such as spatial and temporal correlations between interannual differences of lower tropospheric temperature with those of other layer mean temperatures, surface skin temperature, water vapor distribution, clouds, and precipitation.Other layer mean temperatures are potentially less precise.They are best used for interannual variability studies and should be used for precise trend studies with care.As in all other parameters, retrievals over polar regions are more difficult for a number of reasons and expected error bars are larger, perhaps by a factor of 2, than elsewhere.

Point temperatures are less quantitative and should not be used for detailed trend studies.They are potentially useful in climate variability studies and also provide the basic information going into the computation of the layer mean temperatures and OLR.

Surface skin temperatures have high precision over ocean but cannot be directly validated over land.They can potentially be used for trend studies.The most important use may be the relationship of interannual differences of surface skin temperature to that of atmospheric quantities, including the effects of El Nio on tropical and extra tropical circulation.We have also found very strong correlation between interannual differences of surface skin temperature with lower tropospheric temperature over extra-tropical land.

Water vapor parameters: Water vapor is difficult to measure quantitatively for a number of reasons, one of the major ones being there is no accurate data source to use to determine and remove systematic errors from the retrieved moisture parameters.Radiosonde colocations were used to remove systematic errors from retrieved water vapor.Radiosondes have poor sampling (most are in extratropical land) and have known moist bias in dry cases.In the methodology used to process the benchmark period, separate systematic error correction coefficients were derived for land and ocean cases. This was deemed to be consistent with different potential sources of error, such as unknown surface emissivity over land.In hindsight, this was an ill conceived idea because the bias correction errors were found to be substantially different in tropical land and ocean areas, giving apparent moisture discontinuities in the tropical fields.Nevertheless, comparisons of interannual differences of monthly mean layer integrated precipitable water with colocated radiosondes showed high spatial correlations of the order of 0.8 for total precipitable water and 0.6 for precipitable water above 500 mb.This means the data should be useful to study interannual variability.Of more significance was the finding that tropical upper tropospheric water vapor was highly correlated in space and time with tropical precipitation.Specific humidities at mandatory levels are even harder to measure quantitatively but are potentially useful in terms of interannual variability.They also are part of the information entering the OLR calculation and can be used to explain some of the variability of OLR.

Total ozone index: Total ozone is determined day and night by IR methods and as such is a useful addition to the NIMBUS 7 TOMS product, which is daytime only at local noon.TOVS ozone can be used to trace the rapid motion of fields of ozone throughout the course of the day and allow for further interpolation in time between the TOVS data (7:30 AM, PM; 2:30 AM, PM) and the TOMS data.TOVS also gives ozone fields in the polar night. It should be cautioned however that polar night values may have large errors due to decreased sensitivity of the TOVS measurements to ozone amount under conditions when the ground temperature differs only slightly from stratospheric temperatures.Under some conditions, the sensitivity of the measurement to total ozone is so low that no ozone retrieval is performed.

A wrong version of the TOMS product was used to remove ozone systematic errors for 1988 data.Because of this, as well as potentially noisy values at high latitudes, total ozone index was labeled experimental.

Cloud products: The main cloud products retrieved are cloud top pressure and effective cloud fraction, given by the product of the fractional cloud cover times the cloud emissivity at 11 mm.Because cloud emissivities are less than 1, especially for cirrus clouds, our global mean effective cloud fraction, which is of the order of 40%, is lower than other commonly quoted values closer to 50%.

The methodology of solution attempts to find a cloud fraction and cloud top pressure most consistent with the observations in five IR channels. There is often a modest range of cloud top pressures and corresponding cloud fractions (the higher the cloud top in altitude, the lower the cloud fraction) which give reasonable solutions to the radiative transfer equations.Therefore, cloud top pressures in individual cases may be uncertain up to 100 mb or more, but monthly mean pressures are probably better than 50 mb.The cloud parameters cannot be directly validated but form an important contribution to the calculations of OLR.

Clouds are most difficult to determine in polar cases with low thermal contrast between clouds and the surface.Under these conditions, the TOVS IR radiances do not depend appreciably on cloud parameters.Path A and Path B clouds were compared to each other and found to differ significantly from each other, especially over polar regions.For this reason, both sets of clouds were labeled as experimental pending further validation studies.

While individual cloud parameters should not be used for quantitative trend studies, they provide valuable quantitative information about interannual variability and response of cloud parameters to sea and land surface temperatures.

Precipitation estimate: Precipitation amounts can be estimated from the cloud parameters and relative humidities retrieved from the TOVS data.The method is based on empirical coefficients derived from colocations with monthly mean rain gauge measurements.While patterns are qualitatively good, the method will tend to underestimate heavy precipitation and potentially give light rain in some cases where no precipitation exists, or it does not reach the ground.The main use of this data should be to study interannual variability of precipitation and its relationship with variability of surface temperature, atmospheric temperature, and water vapor.

Outgoing longwave radiation: OLR is computed from the retrieved products using the radiative transfer equation.Agreement of monthly mean OLR with that derived from ERBE data is very good, with global mean differences of the order of 1 W/m2 and global standard deviations about 5 W/m2 on a 1 degree by 1 degree grid. This tends to validate all the TOVS products, including the cloud products.However, it should be remembered that a smaller (larger) amount of higher (lower) clouds could result in very similar values of OLR.This product is important for understanding interannual variability of OLR in terms of the variability of its key components:temperature, water vapor, and clouds.One important limitation of the data set is that it assumes a constant CO2 mixing ratio of 350 ppm and therefore does not reflect possible small changes due to changes of CO2 (about 3 ppm/year) over the time period.

Longwave cloud radiative forcing (LCRF) is another important indicator of climate variability.Like OLR, LCRF is a calculated quantity, based on the difference of OLR calculated using the retrieved clouds, and clear sky OLR calculated with otherwise the same profiles and ground temperature, but with no clouds present.It should be borne in mind that this is not the quantity determined by the ERBE science team, which determines clear sky OLR by observations under clear conditions.These conditions tend to have warmer temperatures, and possibly drier conditions, than those under cloudy conditions.

Known Problems with the Data:

Please refer to Limitations of the Data for a summary of the known problems.

Usage Guidance:

The products appear to be of sufficient accuracy to study interannual difference patterns and correlations in space and time between differences of surface and atmospheric quantities.Coarse layer temperatures and OLR are of high quantitative accuracy and may be useful for quantitative trend studies as well.The detailed temperature, moisture, and cloud distribution also provide information about the detailed factors entering the coarse layer temperatures and the OLR. See Limitations of the Data for more detailed information on dataset usage.

Any other Relevant Information about the Study:

For long term measurement of trends, or even climate variability studies, it is important to be able to analyze data from different satellites without having appreciable intersatellite biases.There are two potential problems involved:different instrumentation and different time of day.It is expected that the Path A methodology of systematic error correction for temperature, moisture, and ozone will be accurate enough to account for intersatellite instrumentation differences.Differences in time of day are not accounted for directly.It is up to the user to account for time sampling differences in their interpretation of the data.

Data beyond the TOVS benchmark period has been analyzed, comprised of NOAA 10 data (7:30 AM, PM) for December 1986 - December 1988 and NOAA 9 data (2:30 AM, PM) for January 1986 - December 1986.December 1986 is the only month where good TOVS data from both NOAA 9 and NOAA 10 exists.Validation studies of interannual differences between 1987 and 1986 (NOAA 10 and NOAA 9) show comparable accuracy to those between 1988 and 1987 (both NOAA 10).Of particular interest are comparisons of monthly mean values of parameters for December 1986 derived from NOAA 9 and NOAA 10.Comparison statistics are shown in the following table:


                                            Mean         Standard Deviation
          Parameter                    (NOAA9-NOAA10)      1 deg by 1 deg
          ---------                    -------------     ------------------
* Global surface skin temperature (C)       .37                1.58
  Sea surface temperature (C)               .07                0.47
* OLR (W/m2)                                .04                5.23
  Total Ozone (DU)                          .15                9.13
  Surf - 500 mb temp (C)                   -.17                0.89 
  500 mb - 300 mb temp (C)                  .07                0.86
  300 mb - 100 mb temp (C)                  .19                0.87
  100 mb - 30 mb temp (C)                   .06                0.82
  Total precip water (cm)                   .01                0.23
  Precip water above 850 mb (cm)           -.01                0.17
  Precip water above 700 mb (cm)            .00                0.09
  Precip water above 500 mb (cm)            .00                0.03
* Precipitation estimate (mm/day)           .06                0.80
* Cloud fraction (%)                       1.00                7.10
* Cloudtop pressure (mb)                   3.50               72.00

* Most sensitive to sampling difference in local time of day

In interpretation of these comparisons, time of day sampling differences should be borne in mind.This primarily effects land surface skin temperatures and cloud parameters.In the results shown, the AM and PM values have been averaged together for each satellite.The results indicate that intersatellite differences are relatively small.An examination of the patterns shows the largest differences in atmospheric temperatures are generally at high latitudes, poleward of 60 degrees.This indicates the largest uncertainties exist in these area.Also noticeable are small intersatellite biases in water vapor fields which tend to be of opposite sign over land and ocean.This may result from use of different systematic error correction coefficients over land and ocean for each satellite, which in the case of NOAA 9 and 10 were of opposite relative magnitude.The last main difference in the fields was surface skin temperature, which was substantially warmer over land in NOAA 9 than NOAA 10.This is an expected result due to very warm land surface temperatures at 2:30 PM.Over ocean, most differences were less than 0.40 degrees C.

13. Application of the Dataset:

TOVS is the only long-term source of high resolution global information pertaining to the temperature and moisture structure of the atmosphere. Because similar HIRS/2 and MSU instrumentation has flown on operational satellites from 1979 to the present, data from these instruments can make an important contribution to our understanding of the variability of atmospheric and surface parameters as well as the correlations between spatial variations of atmospheric and surface quantities.In addition, the data can potentially be used to identify and monitor trends in temperature, moisture, cloudiness, OLR, and precipitation, provided that quantitative results can be obtained which account for differences in instrumentation on different satellites, as well as sampling differences in local crossing time.A prerequisite for such studies is an algorithm that does not change during the course of the processing.This is required since algorithm changes can introduce spurious "climate changes." The full TOVS Pathfinder dataset, of which the NOAA-10 benchmark period is a subset, will be processed in a consistent manner and as such will be useful for all of the applications listed above.

14. Dataset Plans:

Description of Future Plans:

Future plans involve processing the entire 16 year data set, 1979-1995, using a consistent algorithm, with completion by the end of calendar year1996. Based on what has been learned from the benchmark period, several improvements in the methodology are being considered. If these are made, the benchmark period will be reprocessed. The main improvement is a modification of the water vapor systematic error correction methodology so as to be independent of land or ocean surface.Also available are improved systematic error corrections for temperature profiles and total ozone. These improvements are currently being tested, while also using an improved version of the General Circulation model and data assimilation scheme which provides more accurate first guess water vapor fields.

There are currently three "experimental" products:cloud fields, total ozone index, and precipitation estimate.Extensive validation studies are planned for these parameters and a decision will eventually be made as to their inclusion in the final multi-year data set, which will not include any "experimental" products.

15. References:

Satellite/Instrument/Data Processing Documentation:

Kidwell, K., 1991, NOAA Polar Orbiter Data User's Guide, NCDC/SDSD, National Climate Data Center, Washington, D.C.

Planet, W.G. (ed.), 1988, "Data Extraction and Calibration of TIROS-N/NOAA Radiometers", NOAA Technical Memorandum NESS 107 - Rev.1, NOAA/NESDIS, Washington, D.C., October 1988.

Journal Articles and Study Reports:

Baker, W.E., 1983, "Objective Analysis and Assimilation of Observational Data from FGGE", Mon. Wea. Rev., 111, 328-342.

Chahine, M. T., 1968, Determination of the Temperature Profile in an Atmosphere from its Outgoing Radiances, J. Opt. Soc. Am., 58, 1634-1637.

Chahine, M. T. and J. Susskind, 1989:Fundamentals of the GLA physical retrieval method.Report on the Joint ECMWF/EUMETSAT Workshop on the Use of Satellite Data in Operational Weather Prediction:1989-1993.Vol. 1, 271-300.T. Hollingsworth, Editor.

Reuter, D., J. Susskind, and A. Pursch, 1988:First guess dependence of a physically based set of temperature humidity retrievals from HIRS2/MSU data.J. Atmos. Ocean Tech., 5, 70-83.

Susskind, J., J. Rosenfield, and D. Reuter, 1983:An accurate radiative transfer model for use in the direct physical inversion of HIRS2 and MSU temperature sounding data.J. Geophys. Res., 88, 8550-8568.

Susskind, J., J. Rosenfield, D. Reuter, and M. T. Chahine, 1984:Remote sensing of weather and climate parameters from HIRS2/MSU on TIROS-N. J. Geophys. Res., 89, 4677-4697.

Susskind, J. and D. Reuter, 1985:Retrieval of sea-surface temperatures from HIRS2/MSU.J. Geophys. Res., 90C, 11602-11608.

Susskind, J., D. Reuter and M. T. Chahine, 1987:Cloud fields retrieved from HIRS2/MSU data.J. Geophys. Res., 92D, 4035-4050.

Susskind, J., and J. Pfaendtner, 1989:Impact of interactive physical retrievals on NWP.Report on the Joint ECMWF/EUETSAT Workshop on the Use of Satellite Data in operational weather prediction: 1989 - 1993.Vol. 1, 245-270.T. Hollingsworth, Editor.

Susskind, J., 1993:Water vapor and temperature.Atlas of Satellite Observations Related to Global Change.Edited by R. J. Gurney, J. L. Foster, and C. L. Parkinson.Cambridge University Press, Cambridge, England, pp. 89-128.

Takacs, L., A. Molod, and T. Wang, 1994, "Documentation of the Goddard Earth Observing System (GEOS) General Circulation Model Version 1", NASA Technical Memorandum 104606, April 1994.

Wu, M.-L. C. and J. Susskind, 1990:Outgoing longwave radiation computed from HIRS2/MSU soundings.J. Geophys. Res., 95D, 7579-7602.

Archive/DBMS Usage documentation:

16. Related Software:

Software Description:

There are 2 FORTRAN programs developed by the DAAC, called TOVS_hdflist and TOVS_hdfdump, which can be used to read the data in the TOVS HDF files. These programs were designed and tested on SGI UNIX workstations only, but it should be quite easy to modify the FORTRAN code for use on other UNIX workstations as well as on VAX/VMS machines. The HDF calling interface library must be installed on your machine and linked to these programs during compilation.

A brief description of the routines follows:

TOVS hdflist: This routine allows you to list all of the descriptive information associated with each SDS in the file, then select a particular SDS and extract spatial subsets of the data. The output will be in ASCII tabular format which can be printed either to the user's terminal or to an output file.

TOVS hdfdump: This routine performs a simple dump of all SDS attributes one at a time, displaying the actual science data in ASCII as a spatially subsampled data array (every 30th gridpoint in longitude, every 7th gridpoint in latitude). The output can be directed either to the terminal or a disk file. The full SDS data arrays are nonetheless read into memory, and the user can perform simple modifications to the source code to direct this data to a binary file.

Several image display and analysis tools are available for accessing the TOVS HDF files. These include :

Public domain visualization tools : The National Center for Supercomputing Applications (NCSA) provides several packages which can be used to view HDF SDS data sets. Collage and XCollage for the Macintosh are such packages.

TOVS-specific visualization tool : A visualization package called VISTAS has been designed specifically for use with the level 3 TOVS Pathfinder data. VISTAS allows users to perform basic image processing and animation functions. Enhancements are planned in later releases of VISTAS. Currently, VISTAS will run on a Sun Sparc Station using Sun Operating Systems (OS) 4.1.xand Silicon Graphics Workstations using IRIX 5.1.x.

Commercial tools : Some other public domain and commercial software packages can be used to view HDF data, including EASI/PACE, IDL, and SpyGlass. Thus far only IDL has been tested by the DAAC for reading and visualizing the TOVS Pathfinder files.

Software Access:

The FORTRAN source code is available via FTP from the Goddard DAAC online system by request via the Document/Software List screen under the Options menu. They are distributed as a single tar file. To receive the software, log into the DAAC online system and request the tools from the Document/Software screen. To use the software, consult the documentation file automatically included along with the tar file.

To obtain the Collage and Image software, log into the NCSA anonymous FTP server:

ftp ftp.ncsa.uiuc.eduorftp 128.174.20.50

Log into the Collage directory for Collage or the Mac/Image directory for Image using the command :

cd Collage or cd Mac/Image

and download the files to your workstation using the FTP "get" or "mget" command. Then follow the instructions for installation and unpacking in the README files.

To obtain VISTAS, log into the Goddard DAAC anonymous ftp:

ftp daac.gsfc.nasa.govorftp 192.107.190.139

Then type the command:

cd /pub/tovs/vistas

and obtain the README for VISTAS by typing:

get VISTAS.README_FIRST

After obtaining the README, log out of anonymous ftp and consult the README for a detailed description on obtaining, installing and getting help on VISTAS.

17. Data Access:

Contacts for Archive/Data Access Information:

Name:

GSFC DAAC User Services Office Addresses:

Goddard Distributed Active Archive Center
Code 610.2
NASA/Goddard Space Flight Center
Greenbelt, Md. 20771 Telephone Numbers:

Phone: (301) 614-5224
Fax: (301) 614-5268 Electronic Mail Address:

daacuso@daac.gsfc.nasa.gov

Archive Identification:

Dataset=TOVS PATHFINDER
Dataproduct=GLA DAILY GRIDS (daily files)
Dataproduct=GLA 5 DAY GRIDS(5 day files)
Dataproduct=GLA MONTHLY GRIDS(monthly files)

Procedures for Obtaining Data:

Data can be obtained either by contacting the GSFC DAAC User Services Office listed above, or through the DAAC online IMS user interface. Telnet to :

daac.gsfc.nasa.gov (192.107.190.139)

login : daacims
password: gsfcdaac

Data can be ordered on the following media: 8mm tape (8200 or 8500 format), 4mm tape (60 or 90 meter), 9 track 6250 bpi, or by FTP. Magnetic tape requests can be mailed to the user, or picked up in person at the DAAC. For FTP requests, the user is notified by E-mail when the data have been staged and are ready for downloading.

Data Archive Status/Plans:

The DAAC will assume the role of processing center for the full TOVS Pathfinder dataset using a frozen version of the Path A algorithm delivered by the data producer. Current plans call for this long-term processing to commence in FY95. The full suite of data products including level 2 spot-by-spot retrievals, level 3 gridded data and level 4 analyzed fields will be produced in the HDF format and archived at the Goddard DAAC.

18. Output Products and Availability:

Tape Products:

Not Applicable

Film Products:
Not Applicable

Other Products:
Not Applicable

19. Glossary of Terms:

EOSDIS glossary

20. List of Acronyms:

EOSDIS acronyms
Document Actions
NASA Logo - nasa.gov
NASA Privacy Policy and Important Notices
Last updated: Nov 23, 2009 02:26 PM ET
Top