S4PM 5.0.0 RELEASE NOTES

Release Date

February 18, 2004

Functional Changes

1. Support for On-Demand Processing - This is the first release of S4PM with support for on-demand processing. As such, there are many changes. When configured for standard processing, S4PM should behave as it has behaved in Version 4.
   
   
2. New Stations for On-Demand Processing - When configured for on-demand processing, there are several new stations and several missing stations. Refer to training materials and to http://disc.sci.gsfc.nasa.gov/techlab/s4pm/ for information.
   

Detailed File Changes

DCLI.pm

• New module with routines for handling the Distribution Command Line Interface (DCLI) of ECS. Used by the Ship Data station.
  

do_ignore_failure.pl

• New failure handler for the Track Requests station. It allows the order to proceed even when there was a failure resulting in partial order completion.
  

failed_granfind_handler.pl

• New failure handler for the Granule Find station in on-demand processing. It causes an ORDER_FAILURE work order to be submitted to the Track Requests station in on-demand processing.
  

GdMSSDbi.pm

• New module for accessing the ECS MSS database. Used by Ship Data station.
  

gd_ProcIncrementEcAcRequestID.ksh

• New script that contains the query for accessing the MSS database. Used by the Ship Data station in on-demand processing.
  

gd_ProcIncrementOrderId.ksh

• New script that contains the query for accessing the MSS database. Used by the Ship Data station in on-demand processing.
  

GenConfig.pm

• New module. Brought over from the S4P00 source tree.
  

grancentral.pl

• Modified to handle processing of EXPECT work orders. It is backward compatible, and takes effect only if the -e /expect_db/ arguments are specified.
  

granfind.pl

• Added code so that if UR is specified in the input work order, granfind.pl knows not to generate a pattern with which to find the data. Instead it looks for the file as listed. Such is the case for on-demand processing.
  

Lexer.pm

• New module added to the S4P to support on-demand processing.
  

OdlBlock.pm

• New module added to the S4P to support on-demand processing.
  

OdlGroup.pm

• New module added to the S4P to support on-demand processing.
  

OdlObject.pm

• New module added to the S4P to support on-demand processing.
  

OdlTree.pm

• New module added to the S4P to support on-demand processing.

PDR.pm

• FileGroup and FileSpec classes have all had the method checksum() added to them, which computes the checksum and adds it to the FILE_SPEC groups according to the pending ICD. This change should be backward compatible with all S4P applications.
  

PGEConfig.pm

• Added code to read in specialized criteria LUN mappings from the Specify Data configuration files.
  

request_data.pl

• Added code to copy the input workorder (without the DO prefix) on job execution as a downstream workorder if the -t option is used on invocation. The copied workorder can be sent to a downstream station is properly configured (s4pm_static.cfg). The current implementation is for On Demand Processing and job tracking purposes in the Track Request station.
  

run_pge.pl

• Modified to compute checksums for the EXPORT output work order, if the -c option is specified.
• Modified to NOT create a production history/linkage/EXPORT_PH work order, UNLESS the -P option is specified. Note that this change is not backward compatible, and requires reconfiguration for those PGEs that need to keep the production history capability.
• Fix to the QC handling when a data type is configured to be blocked from export but allowed to be used in downstream processing. This was not working correctly.
  

S4P.pm

• Added some convenience functions for the handling of specialized criteria: criteria_value(), criteria_type(), and criteria_names().
  

S4P00util.pm

• New module. Brought over from the S4P00 source tree.
  

S4PM.pm

• Updated get_box_mode_instance_gear() so that it works correctly on non-ECS boxes.
  

s4pm_global.cfg

• Reorganized so that it works for on-demand boxes and others equally well.
  

s4pm_static.cfg

• Fixed problem whereby the link to failedPGE_handler.pl wasn't getting created in the Run PGE station.
  

ship_data.cfg

• New configuration file supporting the ship_data.pl script.
  

ship_data.pl

• New code for the new Ship Data station that is used in on-demand processing.
  

specify_data.cfg

• Updated the documentation is this Specify Data configuration template for the handling of on-demand processing.
  

split_services.cfg

• New configuration file to support the split_services.pl script.
  

split_services.pl

• New script to support the Split Services station when S4PM is configured for on-demand processing.
  

stringmaster.pl

• Minor fix to sub version() which is used to determine the version of S4PM being stringmastered.
  

tkcompreq.pl

• Removed exit confirmation pop-up window.
  

tk_pgeinfo.pl

• Modified so that it looks for the Specify Data configuration files in the Trigger PGE station directory and not the Specify Data station directory. The Trigger PGE station is common across nominal and on-demand strings.
  

tkS4PMadmin.pl

• Made some changes to make it more general as to where S4PM is installed (i.e. removed some references to /vol1).
• Made fix whereby stuff in the PDR and PAN directories weren't getting cleaned out properly.
  

track_requests.pl

• New script to support the Track Requests station when S4PM is configured for on-demand processing.
  

trigger_pge.pl

• Added subroutine add_runtime_parms() to handle the adding of runtime parameters to the PCF.
• Added checking for an input of data type PSPEC. When seen, trigger_pge.pl knows to use the PSPEC ODL file to set runtime parameters in the PCF.
• If in on-demand processing, output file names have process IDs appended to them to guarantee uniqueness.