skip over left navigation links (press 4)

S4PM Banner Image

S4PM 4.2.0 RELEASE NOTES

Release Date

September 18, 2002

Functional Changes

1. Added several buttons to the S4PM TkStat GUI:

Button Function
Start All Starts up all stations.
Stop All Stops all stations. Running jobs are not affected.
S4PM Admin Tool Brings up the S4PM Administration Tool
Kill All Stops all stations and kills any running jobs. Requires a password.

2. Certain PGEs will be run through prespecify_data.pl prior to normal processing in specify_data.pl (all in the Specify Data station). These PGEs will be the AIRS browse PGEs and possibly future PGEs as well.

For such PGEs, running jobs in Specify Data will stay green for a long time depending upon the PGE and how it is configured. Some may run as long as several days. While running, these jobs will be polling the file
system, like Gran Find does, but at much lower frequencies, probably once every several hours. Their job will be to decide when it makes sense to really get started with a job based upon the number of granules
it finds. Once it finds the minimum number of granules within the time allotted, normal Specify Data processing will begin. This will proceed quickly, as it does now for all Specify Data jobs.

While prespecify.pl jobs are running, the sleep message will convey the current timer, when the timer will expire, the current number of granules found and the minimum threshold of granules needed to release
the job.

Operators have several controls for these running jobs. All are initiated by buttons that appear in the TkJob GUI for the Specify Data station:

Button Function
Release Job Now This functions like it does in Gran Find. It will cause the
prespecify_data.pl script to exit and allow the job to move to normal
Specify Data processing.
Modify Timer

This allows an operator to change "on the fly". The wait timer which is the time beyond which the job is released to normal Specify Data processing. A small GUI will prompt the operator for the amount to add or subtract from tthe current timer (which is displayed in the sleep message).
Modify Threshold

This allows an operator to change "on the fly" the minimum granule threshold which is the minimum number of granules beyond which the job is released to normal Specify Data processing. A small GUI will prompt the operator for the amount to add or subtract from the current granule threshold (which is displayed in the sleep message).

Note that changes to the timer or the threshold may take up to 30 seconds to be reflected in the sleep message. This is due to the polling interval for such messages from the operator.

Detailed File Changes

tkS4PMadmin.pl

  • Modified so that Perl files with file names containing the string "baseline" (case insensitive) are also flagged as being unrecognized. Such files indicate that a TE was installed and we want this tool to flag them.

rollup_rusage.pl

  • Replaced generic Perl glob function with KGlob to fix situation where number of files in rollup directories is large. See GSFC Trouble Ticket GSF000000007694.

trigger_pge.pl

  • To accommodate direct broadcast, a minor change was made in the calculation of the period over which to run the PGE.

prespecify_data.pl

  • New script that is run in the Specify Data station. It pre scans the S4PM file system for data granules of a particular data type. Once all or the minimum number of granules are found within a certain amount of time, the job is released to specify_data.pl for normal processing. This script is intended for PGEs that need large numbers of granules as input (e.g. the AIRS summary browse PGEs).

specify_data.pl

  • A few changes were made to specify_data.pl to accommodate the new prespecify_data.pl script from which some work orders will come.
  • To accommodate direct broadcast, a few changes were made to allow the number of output work orders and the processing start and stop times in those work orders to be dynamically determined using the start and stop times in the input NEWDATA work order and the PRODUCT_COVERAGE parameter set in the PGE's Specify Data configuration file.

request_data.pl

  • Added checking for existence of allocdisk.db file and for a disk pool defined in allocdisk.db. This means that if a disk pool isn't defined, the job won't spin forever; it will fail instead.

run_pge.pl

  • Modified to recognize input products with names that start with D4FAX and D4LAX (the new GEOS-4 DAS products) as inputs in the PCF file.
  • Modified to recognize input products with names that start with RMT and RMA (the new Terra and Aqua MODIS direct broadcoast products) as inputs in the PCF file.

granfind.pl

  • Added checking of more desired optional granules even when less desired granules are being looked for. That is, if the timer expires on an OPT1 granule and an OPT2 granule is now being looked for, an OPT1 granule will continue to be checked for.
  • Enhanced the timer code to use the actual system clock rather than an internal counter.
  • Replaced generic Perl glob function with KGlob.

tkstat.pl

  • Added a new option so that user-defined buttons can be added to the bottom of the GUI. It is intended for GUIs and tools that cannot be tied to any one station, /e.g./ tkS4PMadmin.pl.

stringmaster.pl, s4pm_derived.cfg, s4pm_pge_esdt.cfg

  • Completed the migration of PGE integration into String Master so that PGEs can be integrated without reliance on other external scripts.
  • Added the capability for String Master to build the tkb.ksh files.
  • Added the Direct Broadcast PGEs.
  • Several minor modifications to the String Master configuration files.

 



NASA Logo - nasa.gov

  • Last updated: February 15, 2006 01:29:50 GMT