Skip to content. | Skip to navigation

 Back to Classic
Personal tools
You are here: GES DISC Home Additional Features Science Team Portal AURA AURA EDOS INTERFACE TEST

AURA EDOS INTERFACE TEST

1. Purpose

The purpose of this test is the demonstrate nominal data flow and archiving of OMI, MLS and HIRDLS Level 0 data from EDOS to GES DISC S4PA facilities. This document describes following test cases:

  • S4PA ingest of L0 data copied from ECS
  • ECS ingest of L0 data from S4PA
  • EDOS ECS to S4PA transition scenario

2. S4PA Ingest of L0 Data Copied From ECS

2.1 Features to be Tested

Ingest of L0 data from S4PA EDOS push directory into S4PA TS1 instance

2.2 Test Environment Preparation

  • Prepare S4PA instance in TS1 environment on auraraw1, pointing Poller Station to /ftp/private/push/TS1/EDOS/DATA/<DataSet>
  • Copy MLS, OMI and HIRDLS PDR, XFER and data files from ECS g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollEDOS into auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet>
  • In copied PDRs, change DIRECTORY_ID from /usr/ecs/OPS/CUSTOM/icl/a/data/pollEDOS to /ftp/private/push/TS1/EDOS/DATA/<DataSet>
  • In copied PDRs, change NODE_NAME from g0icg01.gsfcb.gesdisc.eosdis.nasa.gov to auraraw1.gsfcb.gesdisc.eosdis.nasa.gov

2.3 Expected Test Results

  • Copy PDRs, XFER and data files for certain data types of certain data sets (OMI, MLS or HIRDLS) from g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollEDOS into auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet>
  • Count PDRs and granules at auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet>
  • Start S4PA TS1 poll, download and archive data from auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet>
  • Check ftp://auraraw1u.gesdisc.eosdis.nasa.gov/data/s4pats1/<DataSet>_L0 for proper granule storage
  • Reconcile granule counts in auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet> and auraraw1:/ftp/.aura/.test/001/<DataType> directories

2.4 Test Report

The test was conducted on November 21 and 22. OMI, MLS and HIRDLS granules were copied to corresponding auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet> directories. S4PA TS1 instances were configured and started. All granules were successfully ingested into S4PA: ftp://auraraw1u.gesdisc.eosdis.nasa.gov/data/s4pats1/MLS_L0

  • ftp://auraraw1u.gesdisc.eosdis.nasa.gov/data/s4pats1/MLS_L0
  • ftp://auraraw1u.gesdisc.eosdis.nasa.gov/data/s4pats1/HIRDLS_L0
  • ftp://auraraw1u.gesdisc.eosdis.nasa.gov/data/s4pats1/OMI_L0

3. ECS Ingest of L0 Data From S4PA

3.1 Features To Be Tested

  • Ingest of L0 data from S4PA EDOS TS1 push directory into ECS TS2 mode

3.2 Test Environment Preparation

  1. S4PA
    1. Copy MLS, HIRDLS and OMI PDR, XFER and data files from ECS g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollEDOS into auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet> and verify that all those data can be ingested into S4PA (conduct test in the previous section).
    2. Verify that auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet> are pushable and pullable by anonymous FTP
  2. ECS
    1. Create g0icg01:/usr/ecs/TS2/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>
    2. Configure ECS TS2 mode to poll from auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet> into g0icg01:/usr/ecs/TS2/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>
    3. Configure ECS TS2 mode to ingest L0 data from g0icg01:/usr/ecs/TS2/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>

3.3 Expected Test Results

  • PDR, XFER and data files are copied to auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet>
  • ECS polls auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet> and stores data into g0icg01:/usr/ecs/TS2/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>
  • ECS ingests data from g0icg01:/usr/ecs/TS2/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>
  • ECS reconciles ingested granules with S4PA

3.4 Test Report

  • The test was conducted on November 21. ECS has successfully ingested granules from auraraw1:/ftp/private/push/TS1/EDOS/DATA/<DataSet> directories into ECS TS2 mode.

4. EDOS ECS to S4PA Transition Scenario

4.1 Features to be Tested

  • Ingest of L0 data from EDOS into S4PA OPS
  • Ingest of L0 data from S4PA into ECS OPS

4.2 Test Environment Preparation

  1. S4PA
    1. erify that auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet> are pushable and pullable by anonymous FTP and edosops user
    2. Verify that S4PA OPS Poller station points to both auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet> and auraraw1:/ftp/private/push/OPS/ECS/DATA/<DataSet>
  2. ECS
    1. Verify that g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollAURA_L0_<DataSet> exists
    2. Verify that ECS OPS can ingest simultaneously from g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollAURA_L0_<DataSet> and g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollEDOS

4.3 Data Flows

  • For a short period of time (in the order of 6 hours) the following data flows will take place
    • EDOS OPS pushes to ECS g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollEDOS
    • EDOS TEST pushes to S4PA auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
    • ECS pulls data from S4PA auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet> into g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>
    • ECS ingests data from g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollEDOS
    • ECS ingests data from g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>
    • ECS pushes PANs to auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
    • S4PA ingests data from auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
    • S4PA pushes Error PANs into auraraw1:/ftp/private/push/OPS/EDOS/DATA/PAN
    • EDOS TEST pulls PANs from auraraw1:/ftp/private/push/OPS/EDOS/DATA/PAN
  • After all data flows listed above are verified, only the following flows will take place for longer period of time (up to 2 month):
    • EDOS OPS pushes data to S4PA auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
    • ECS pulls data from S4PA auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet> into g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>
    • ECS ingests data from g0icg01:/usr/ecs/OPS/CUSTOM/icl/a/data/pollAURA_L0_<DataSet>
    • ECS pushes PANs to auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
    • S4PA ingests data from auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
    • S4PA pushes PANs into auraraw1:/ftp/private/push/OPS/EDOS/DATA/PAN
    • EDOS OPS pulls PANs from auraraw1:/ftp/private/push/OPS/EDOS/DATA/PAN
  • After 2 months period, ECS ingest from S4PA will be turned off and only the following data flows will take place:
    • EDOS pushes data to S4PA auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
    • S4PA ingests data from auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
    • S4PA pushes PANs into auraraw1:/ftp/private/push/OPS/EDOS/DATA/PAN
    • EDOS pulls PANs from auraraw1:/ftp/private/push/OPS/EDOS/DATA/PAN

4.4 Expected Test Results

  1. EDOS delivers XFER, PDR and data files to auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet>
  2. S4PA polls XFER, PDR and data files from auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet> and ingests it
  3. ECS polls XFER, PDR and data files from auraraw1:/ftp/private/push/OPS/EDOS/DATA/<DataSet> and ingest data
  4. EDOS pulls PANs from auraraw1:/ftp/private/push/OPS/EDOS/DATA and processes them

4.5 Test Report

 

 

 

 

 

 

 

 

Document Actions
NASA Logo - nasa.gov
NASA Privacy Policy and Important Notices
Last updated: Aug 31, 2012 03:24 PM ET
Top