S4PM 5.2.0 RELEASE NOTES

Release Date

April 21, 2004

Functional Changes

1. New Directory Name for Granule Find Station - The directory name of the granfind station has changed to find_data. The name as it appears in the GUI is still 'Granule Find', but this will change in the very near future to: Find Data.
   
   
2. Full Support for On-Demand Processing - There should now be full support for on-demand processing and the old ODS should be allowed to retire (the date of the cut-over is TBD).
   
   
3. Support for Inserts To Datapool - There is support for insert of non ECS data into the datapool.
   

Detailed File Changes

clean_data.pl

• Modified to make use of S4PM::parse_url_file().
• Modified to delete XML files associated with data if they exist.
  

data_catcher.pl

• Modified to convert XML (.xml) files to ODL (.met) files.
  

FileGroup.pm

• Added ftp_get() method.
  

FileSpec.pm

• Modified to recognize XML files (.xml) as metadata files.
  

MetFile.pm

• Added xml2odl() subroutine to convert XML formatted metadata files into ODL formatted metadata files.
  

MetXML.pm

• New module under S4PM to support XML metadata handling.
  

request_data.pl

• Added a command line switch (-a) to skip pattern matching when examining stub files for duplicate input granules (same data type and data time). With this switch invoked, all fields in the stub file are used when checking to see if a stub file exists. This capability is for use in on-demand processing.
  

run_pge.pl

• Modified to recognize XML files as metadata files.
  

S4P.pm

• Added subroutine criteria_hash() to output a full hash of the specialized criteria from the PSPEC file. Used to support trigger_pge.pl.
  

S4PM.pm

• Made fix to get_datatype_if_proxy().
• Added parse_url_file() to retrieve the data type, version and dbID from the contents of a .ur file.
  

s4pm_derived.cfg

• Completely refactored moving in some components which are not common across all S4PM strings.
• Modified to place the Split Services station under the home directory (like Request Data and Receive DN).
• Added support for Datapool Insert station and related changes in Receive PAN and Export stations (if so configured).
  

s4pm_find_data.pl

• Replaces the previous granfind.pl.
  

s4pm_global.cfg

• Reconfigured to support g0dug03 as a S4PM platform.
  

s4pm_nonecs_dp_insert.pl

• New script that handles the insertion of non ECS data into the datapool.

s4pm_static.cfg

• Completely refactored so that the only items it contains are those common to all S4PM strings.
• Modified so that the Split Services station is placed under the home directory and then linked to where the other stations were (a la Request Data, Receive DN).
  

s4pm_string.cfg

• Added @datapool_insert_pges array and $datapool_staging_dir and examples to support inserts to datapool.
  

split_services.pl

• Modified where it looks for the Specify Data configuration files, now that they're link in the split_services directory rather than having to point to the trigger_pge directory.
  

tkS4PMadmin.pl

• Minor change where it looks for find_data.log files rather than granfind.log files.
  

trigger_pge.pl

• Modified to handle the new form of PSPEC files which include the input files as well as the specialized criteria.