S4PM 5.3.0 RELEASE NOTES

Release Date

September 2, 2004

Functional Changes

1. Station Naming Refactoring - Many of the station names of changed and these name changes are reflected in what you see in the S4PM Monitor (another change from Tkstat). The old and new station names are shown below:

2. Tool Name Refactoring - In addition to station name changes, some of the tool names have changed as well:

(a) Smart Alloc is now referred to as View Disk and Allocation Usage, available from right clicking on the Allocate Disk station button. The old script tk_smart_alloc.pl is now s4pm_tk_disk_alloc.pl.
(b) Clean Data is now referred to as Delete Data available from right clicking on the Track Data station button. The old script tk_clean_data.pl is now s4pm_tk_delete_data.pl.
(c) Modify Max Children is now referred to as Modify Max Jobs available from the main S4PM Monitor window. The script tk_max_children.pl has been changed to s4pm_tk_max_children.pl.
(d) PGE Info is now referred to as Algorithm Info available from the main S4PM Monitor window. The old script tk_pgeinfo.pl is now s4pm_tk_algorithm_info.pl.
(e) S4PM Admin Tool is still referred to by the same name. But the underlying script name has been changed from tkS4PMadmin.pl to s4pm_tk_admin.pl. The tkS4PMadmin.pl binary has been removed so that it cannot be accidently run.

3. Script Name Refactoring - Most of the station script file names have changed as well. See Detailed File Changes section below. The general approach to the name changes has been:

(a) Prepend 's4pm_' to the script name.
(b) Have the script name match the station directory name (except for the 's4pm_' part.
(c) For example: The Track Data station is mapped to directory track_data whose main script is s4pm_track_data.pl.

4. Configuration File Refactoring - Most of the station configuration files have been changed as well: allocdisk.cfg to s4pm_allocate_disk.cfg, allocdisk.db to s4pm_allocate_disk.db, etc.

5. New Stringmaster and Stringmasterall Scripts - The stringmaster.pl and stringmasterall.pl scripts have been replaced by s4pm_stringmaster.pl and s4pm_stringmasterall.pl, respectively. The old scripts have been removed so that they cannot be
accidently run.

6. New Restart All Failed Jobs Feature - All stations have the added Restart All Failed Jobs interface which is available by right clicking on a station button or by bringing up tkjob on a station. Selecting this option will restart all the failed jobs in that station and remove the old, failed jobs. This is to address Trouble Ticket 11130.

7. Change to Request Data Interface Name - Under Request Data, the interface Request Data has been changed to Compose Data Request. This is available by right-clicking on the station button or via the tkjob window.

8. Compose Single File Request Added to Pull-Down Menu - Also under Request Data, the interface Compose Single File Request has been added. This tool has always been available, but now is available via a right-click on the station button or via the tkjob window.

Detailed File Changes

add_runtime_GdMODL1B.pl

• REMOVED. Replaced by s4pm_add_runtime_GdMODL1B.pl.

add_runtime_GdMOL3SS.pl

• REMOVED. Replaced by s4pm_add_runtime_GdMOL3SS.pl.

airs_L0_check.cfg

• REMOVED. Replaced by s4pm_airs_L0_check.cfg.

airs_L0_check.pl

• REMOVED. Replaced by s4pm_airs_L0_check.pl.

allocdisk.cfg

• REMOVED. Replaced by s4pm_allocate_disk.cfg.

allocdisk_getdisk.pl

• REMOVED. Replaced by s4pm_allocate_disk.pl.

allocdisk_pool.cfg

• REMOVED. Replaced by s4pm_allocate_disk_pool.cfg.

attitude_check.pl

• REMOVED. Replaced by s4pm_attitude_check.pl.

clean_data.pl

• REMOVED. Replaced by s4pm_sweep_data.pl.

clean_expired_data.cfg

• REMOVED. Replaced by s4pm_delete_expired_data.cfg.

clean_expired_data.pl

• REMOVED. Replaced by s4pm_delete_expired_data.pl.

compose_request.cfg

• REMOVED. Replaced by s4pm_compose_request.cfg.

compose_request.pl

• REMOVED. Replaced by s4pm_compose_request.pl.

data_catcher.cfg

• REMOVED. Replaced by s4pm_register_data.cfg.

data_catcher.pl

• REMOVED. Replaced by s4pm_register_data.pl.

dn_insert.pl

• REMOVED. Replaced by s4pm_bootstrap_dprep.pl.

export.pl

• REMOVED. Replaced by s4pm_export.pl.

failed_granfind_handler.pl

• REMOVED. Replaced by s4pm_failed_find_data_handler.pl.

failedPGE_handler.cfg

• REMOVED. Replaced by s4pm_failed_pge_handler.cfg.

failedPGE_handler.pl

• REMOVED. Replaced by s4pm_failed_pge_handler.pl.

GdMSSDbi.pm

• Removed hardwired TS2 mode and replaced it with OPS so that the mode will be set correctly on promotion (GSFC TT 12400).

grancentral.pl

• REMOVED. Replaced by s4pm_track_data.pl.

l0.pl

• REMOVED. Replaced by s4pm_l0.pl.

nise_check.pl

• REMOVED. Replaced by s4pm_nise_check.pl.

pge_stats.pl

• REMOVED. Replaced by s4pm_algorithm_stats.pl.

prespecify_data.pl

• REMOVED. Replaced by s4pm_preselect_data.pl.

purge_bad_data.pl

• REMOVED. Replaced by s4pm_purge_bad_data.pl.

receiveDN.pl

• REMOVED. Replaced by s4pm_receive_dn.pl.

receivePAN.cfg

• REMOVED. Replaced by s4pm_receive_pan.cfg.

receivePAN.pl

• REMOVED. Replaced by s4pm_receive_pan.pl.

regular_block.cfg

• REMOVED. Replaced by s4pm_regular_block.cfg.

regular_block.pl

• REMOVED. Replaced by s4pm_regular_block.pl.

repeat_work_order.pl

• REMOVED. Replaced by s4p_repeat_work_order.pl.

request_data.pl

• REMOVED. Replaced by s4pm_request_data.pl.

reseq_l0_files.pl

• REMOVED. Replaced by s4pm_reseq_l0_files.pl.

resubmit_PDR.cfg

• REMOVED. Replaced by s4pm_resubmit_pdr.cfg.

resubmit_PDR.pl

• REMOVED. Replaced by s4pm_resubmit_pdr.pl.

resubmit_request.pl

• REMOVED. Replaced by s4pm_resubmit_data_request.pl.

rollup_rusage.pl

• REMOVED. Replaced by s4pm_rollup_rusage.pl.

run_DCLI.ksh

• REMOVED. Replaced by s4pm_run_DCLI.ksh.

run_pge.pl

• REMOVED. Replaced by s4pm_run_algorithm.pl.

s4p_repeat_work_order.pl

• New name for repeat_work_order.pl.

s4pm_add_runtime_GdMODL1B.pl

• New name for add_runtime_GdMODL1B.pl.

s4pm_add_runtime_GdMOL3SS.pl

• New name for add_runtime_GdMOL3SS.pl.

s4pm_airs_L0_check.cfg

• New name for airs_L0_check.cfg.

s4pm_airs_L0_check.pl

• New name for airs_L0_check.pl.

s4pm_algorithm_stats.pl

• New name for pge_stats.pl.
• Modified to use the %proxy_esdt_map hash.

s4pm_allocate_disk.cfg

• New name for allocdisk.cfg.

s4pm_allocate_disk.pl

• New name for allocdisk_getdisk.pl.
• Changed name of Allocate Disk database from allocdisk.db to s4pm_allocate_disk.db.

s4pm_allocate_disk_pool.cfg

• New name for allocdisk_pool.cfg.

s4pm_attitude_check.pl

• New name for attitude_check.pl.

s4pm_bootstrap_dprep.pl

• New name for dn_insert.pl.

s4pm_compose_request.cfg

• New name for compose_request.cfg.

s4pm_compose_request.pl

• New name for compose_request.pl.

s4pm_delete_expired_data.cfg

• New name for clean_expired_data.cfg.

s4pm_delete_expired_data.pl

• New name for clean_expired_data.pl.
• Modified so that the its configuration file name and the Allocate Disk configuration file name are passed in as arguments on the command line.

s4pm_derived.cfg

• Modified all station names to be more generic and correspond to the new names of the station scripts.
• Modified for the new names of station scripts and configuration files.
• Added job to Repeat Daily in on-demand processing strings to clean out PSPEC files from the INPUT data directory after 4 days.
• Minor fix so that all Run Algorithm stations (/e.g./ Run Algorithm71) have the *QC Continuefailure handler.
• Modified so that in on-demand processing strings, the logs from Request Data go into the ARCHIVE/REQUESTS directory (similar to what happens in standard processing strings).
• Added $cfg_ignore_duplicates to the Track Requests station.
• Added s4pm_tk_compose_single_request.pl to what is available from Request Data's interfaces.
• Added s4pm_tk_trmon.pl to the %cfg_interfaces hash for the Track Requests station.
• Modified to use the new string-specific parameters $make_ph and $export_ph.
• Modified the Split Services portion for the new s4pm_split_order.pl script.
• Modified to add $cfg_host to the Insert Datapool station, setting this variable to 'g0dps01'.

s4pm_export.pl

• New name for export.pl.
• Added capability to split incoming workorder into multiple PDRs based on data type or user defined criteria associated with data type (see $pdr->split( $attribute) in S4P::PDR.pm. The polling directory to where output PDRs are directed can be specified using the (-d) option to maintain backward compatibility with previous versions of S4PM or by using an export configuration file (-c) that contains the criteria on which the input work order will be split along with the polling directory(s) to where the output PDRs will be directed.
• If DEFAULT is listed as the splitting criteria in the s4pm_export.cfg file, then output PDRs will appear unchanged from previous versions of S4PM (originating_system.jobid.PDR). If any other criteria used to split the work order (/e.g./ DP) then this string will be appended to the originating system in the PDR name.
• Note: Either a default directory (-d) for outgoing PDRs must be specifed or an export configuration file (-c) can be used, but not both.

s4pm_failed_find_data_handler.pl

• New name for failed_granfind_handler.pl.

s4pm_failed_pge_handler.cfg

• New name for failedPGE_handler.cfg.

s4pm_failed_pge_handler.pl

• New name for failedPGE_handler.pl.

s4pm_insert_datapool.pl

• New name for s4pm_nonecs_dp_insert.pl.

s4pm_is_night.pl

• QC script for use with AIRS PGEs. It checks whether or not the granule is a nighttime granule and returns failure if it is. This prevents nighttime granules from being archived which is the goal of this script.

s4pm_l0.pl

• New name for l0.pl.

s4pm_nise_check.pl

• New name for nise_check.pl.

s4pm_nonecs_dp_insert.pl

• New name for s4pm_insert_datapool.pl.

s4pm_prepare_run.cfg

• New name for trigger_pge.cfg.

s4pm_prepare_run.pl

• New name for trigger_pge.pl.

s4pm_preselect_data.pl

• New name for prespecify_data.pl.
• Modified so that the name of the Allocate Disk configuration file is passed as a command line argument rather than being hardwired.

s4pm_purge_bad_data.pl

• New name for purge_bad_data.pl.

s4pm_receive_dn.pl

• New name for receiveDN.pl.

s4pm_receive_pan.cfg

• New name for receivePAN.cfg.

s4pm_receive_pan.pl

• New name for receivePAN.pl.

s4pm_register_data.pl

• New name for data_catcher.pl.

s4pm_register_data.cfg

• New name for data_catcher.cfg.

s4pm_regular_block.cfg

• New name for regular_block.cfg.

s4pm_regular_block.pl

• New name for regular_block.pl.

s4pm_request_data.pl

• New name for request_data.pl.

s4pm_reseq_l0_files.pl

• New name for reseq_l0_files.pl.

s4pm_resubmit_pdr.cfg

• New name for resubmit_PDR.cfg.

s4pm_resubmit_pdr.pl

• New name for resubmit_PDR.pl.

s4pm_resubmit_data_request.pl

• New name for resubmit_request.pl.

s4pm_rollup_rusage.pl

• New name for rollup_rusage.pl.

s4pm_run_algorithm.pl

• New name for run_pge.pl.

s4pm_run_DCLI.ksh

• New name for run_DCLI.ksh.

s4pm_select_data.cfg

• New name for specify_data.cfg.

s4pm_select_data.pl

• New name for specify_data.pl.

s4pm_ship_data.cfg

• New name for ship_data.cfg.

s4pm_ship_data.pl

• New name for ship_data.pl.

s4pm_show_pge.pl

• New name for show_pge.pl.

s4pm_split_order.pl

• New script that allows the Split Services station to split up orders that exceed a configurable number of granules. Currently, it is set to 40 in OPS and 2 and the other test modes.

s4pm_split_services.cfg

• New name for split_services.cfg.
• Added $max_item_count that contains the maximum number of items in an ODL beyond which the ODL is split.

s4pm_split_services.pl

• New name for split_services.pl.

s4pm_static.cfg

• Modified all station names to be more generic and correspond to the new names of the station scripts.
• Modified for the new names of station scripts and configuration files.
• Modified so that the priority in the ACQParmfile in On-Demand processing would be HIGH rather than VHIGH.
• Added environment variable PERLLIB to list of variables defined in the Run Algorithm station. PERL_LIB is already defined there.

s4pm_string.pl

• Added two parameters to the string-specific configuration file: $make_ph sets whether or not to generate a PH file in the Run Algorithm station and $export_ph sets whether or not to export any PH files generated.

s4pm_stringmaster.pl

• New name for stringmaster.pl.
• Modified for new name of Allocate Disk database file and some station names.

s4pm_sub_notify.pl

• New name for subnot2request.pl.

s4pm_sweep_data.pl

• New name for clean_data.pl.
• Modified so that the Allocate Disk database name is passed in as a command line argument rather than being hardwired.

s4pm_tk_admin.pl

• New name for tkS4PMadmin.pl.
• Modified for new names of station directories.

s4pm_tk_algorithm_info.pl

• New name for tk_pgeinfo.pl.

s4pm_tk_delete_data.pl

• New name for tk_clean_data.pl.

s4pm_tk_compose_request.pl

• New name for tkcompreq.pl.
• In GUI, changed 'ESDT' to 'Data Type'. Also, added window title.

s4pm_tk_compose_single_request.pl

• New name for tkreq1.pl.
• In GUI, added window title.

s4pm_tk_disk_alloc.pl

• New name for tk_smart_alloc.pl.
• Changed 'Grans' to 'Files' as the latter is more generic.
• Changed name appearing in title bar to *View Disk Allocation and Usagefrom Smart Alloc.

s4pm_tk_max_children.pl

• New name for tk_max_children.pl.

s4pm_tk_modify_pcf.pl

• New name for tk_modify_pcf.pl.

s4pm_tk_pwbox.pl

• New name for tk_pwbox.pl.

s4pm_tk_trmon.pl

• New Tk GUI for monitoring activity in the Track Requests station in on-demand processing strings.

s4pm_track_data.pl

• New name for grancentral.pl.

s4pm_track_requests.cfg

• New name for track_requests.cfg.
• Updated default email address.

s4pm_track_requests.pl

• New name for track_requests.pl.
• Minor fix for failures when the job ID was 0.

ship_data.pl

• REMOVED. Relaced by s4pm_ship_data.pl.

show_pge.pl

• REMOVED. Relaced by s4pm_show_pge.pl.

specify_data.pl

• REMOVED. Relaced by s4pm_select_data.pl.

split_services.cfg

• REMOVED. Relaced by s4pm_split_services.cfg.

split_services.pl

• REMOVED. Relaced by s4pm_split_services.pl.

stringmaster.pl

• REMOVED. Relaced by s4pm_stringmaster.pl.

subnot2request.pl

• REMOVED. Relaced by s4pm_sub_notify.pl.

tk_clean_data.pl

• REMOVED. Relaced by s4pm_tk_delete_data.pl.

tkcompreq.pl

• REMOVED. Relaced by s4pm_tk_compose_request.pl.

tk_max_children.pl

• REMOVED. Relaced by s4pm_tk_max_children.pl.

tk_modify_pcf.pl

• REMOVED. Relaced by s4pm_tk_modify_pcf.pl.

tk_pgeinfo.pl

• REMOVED. Relaced by s4pm_tk_algorithm_info.pl.

tk_pwbox.pl

• REMOVED. Relaced by s4pm_tk_pwbox.pl.

tkreq1.pl

• REMOVED. Relaced by s4pm_tk_compose_single_request.pl.

tkS4PMadmin.pl

• REMOVED. Relaced by s4pm_tk_admin.pl.

tk_smart_alloc.pl

• REMOVED. Relaced by s4pm_tk_disk_alloc.pl.

track_requests.cfg

• REMOVED. Relaced by s4pm_track_requests.cfg.

track_requests.pl

• REMOVED. Relaced by s4pm_track_requests.pl.

trigger_pge.cfg

• REMOVED. Relaced by s4pm_prepare_run.cfg.

trigger_pge.pl

• REMOVED. Relaced by s4pm_prepare_run.pl.