EPA Regional and state data entry professionals can batch into ICIS-NPDES using the Exchange Network Service Center website. These professionals can also use XML spreadsheet generators to more efficiently generate XML files for NPDES program data. EPA provided webinar training on this batch data entry method for NPDES program data on June 10, 2021. The presentation and recording are provided below:
- Training presentation on NPDES program batch data entry via Exchange Network Service Center
- Training webinar recording (June 10, 2021) [Note: ECHO Gov login required.]
Please note that these spreadsheets may be helpful if you are an EPA Regional data entry professional or a state without a state NPDES data system (i.e., a direct user of ICIS-NPDES). Use of these spreadsheets can save considerable time as you can upload data to ICIS-NPDES without using the ICIS-NPDES data entry web screens. For states with their own NPDES data system, EPA recommends that they first try to automatically flow data from the state system to ICIS-NPDES before they consider using this manual method.
Guide to Exchange Network Service Center
EPA Regional and state data entry professionals who want to batch data to ICIS-NPDES via the EN Service Center must have a test account and request access to the specific dataflow and node.
You will then need to successfully complete a test transaction using that account before you can request a Production account.
"A screenshot of the 'Request an Exchange Network Account' page."
Flowing Data to ICIS
The ICIS-NPDES Dataflow and ICIS-Air Dataflow documentation can be found on the Exchange Network: ICIS Data Submission, including the Example XML Instance Documents, User's Guides, Flow Configuration Document (covers both NPDES and Air), XML Schema (validates both ICIS-NPDES and ICIS-Air), etc.
EDT Technical Specifications: ICIS.Zendesk.com - ICIS ELECTRONIC DATA TRANSFER (EDT). The EDT tech spec for a particular XML submission type will list all rejection and warning error codes and messages (The ICIS-NPDES Batch User Guide and ICIS-Air EDT User Guide will also contain the error codes, but the tech specs are more thorough and up-to-date). You can search for a given error message from a response PDF that is returned after your submission to ICIS has a status of COMPLETED.
To submit XMLs to ICIS Production, use the ICIS-NPDES Dataflow on the NGNProd2.0 Node. This can be found on the Production Exchange Network Services Center: enservices.epa.gov. Refer to the following instructions for sending data to ICIS Production:
Step 0. From home page, click on “Go” in the middle tile, which is labeled “EXCHANGE NETWORK SERVICES”
Step 1. Use the default selection “Send information to a system on the Exchange Network” and click on “Continue”
Step 2. Type “ICIS-NPDES” in the search and click on “Search”. On the Next Screen click on “Send Info” (for “NGNProd2.0”). On the next screen select “Continue”
Step 3. Use the “Choose File” button to identify the zip file you want to send and click on “Continue”
Step 4. Add Document Metadata about your zip file and data (optional)
Step 5. Create Notification List. Add the one or more emails that will receive notifications when the file is received and processed. (optional but recommended)
"A screenshot of the 'Services Directory' highlighting the 'Filter By: Keywords, ICIS-NPDES' selection as well as the ICIS-NPDES specification under 'Dataflow' and 'NGNProd2.0' node."
To submit XMLs to ICIS Test, use the ICIS-AIR Dataflow on the NGNTest2.0 Node ('ICIS-AIR' is all caps; avoid the other 'ICIS-Air' dataflow. NPDES and Air data are flowed to the same ICIS Test database using ICIS-AIR/NGNTest2.0). This can be found on the Test Exchange Network Services Center: enservicestest.epacdxnode.net, NOT the production ENSC. Below are the instructions for sending data to ICIS Test:
- Step 0. From home page, click on “Go” in the middle tile, which is labeled “EXCHANGE NETWORK SERVICES”
- Step 1. Use the default selection “Send information to a system on the Exchange Network” and click on “Continue”
- Step 2. Type “ICIS-AIR” in the search and click on “Search”. On the Next Screen click on “Send Info” (for “NGNTest2.0”). On the next screen select “Continue”
- Step 3. Use the “Choose File” button to identify the zip file you want to send and click on “Continue”
- Step 4. Add Document Metadata about your zip file and data (optional)
- Step 5. Create Notification List. Add the one or more emails that will receive notifications when the file is received and processed. (optional but recommended)
"A screenshot of the 'Services Directory' this time highlighting the 'NGNTest2.0' node."
To submit XMLs to ICIS Stage, use the ICIS-NPDES Dataflow on the NGNTest2.0 Node (Not NGNDev2.0). This can be found on the Test Exchange Network Services Center: enservicestest.epacdxnode.net.
Additional Helpful Information
How to download EDT Batch Audit Reports from BI Reports: How To Download EDT Batch Audit Reports From BI Reports.
How to download EDT Batch Audit Reports from the Exchange Network Services Center Website: How To Download EDT Batch Audit Reports From The CDX Exchange Network Services Center Website.
The Exchange Network Services Center has a method of validating your XML. After logging into enservicestest.epacdxnode.net (registration and test site links above), select the Exchange Network Services tab, select Validate files synchronously on the Exchange Network (the asynchronously option allows you to have the validation report emailed to your specified email address). In the subsequent page shown below, choose ICIS v5.9 under Validation Type, XML or Zip for Document Type, and upload your XML or Zip file. After submitting this request, you will receive a response. If you receive a 'Congratulations!' message, your XML is ready for submission to a Node.
"A screenshot of the Exchange Network Services Center highlighting the 'Congratulations' message."
Use the ICIS Data Access (ICISDA) Dataflow to retrieve ICIS data (reverse of EDT submissions): Download XMLs From ICISDA Dataflow To Correct ICIS Data.
Please note that EPA provides EDT Support For State And Local Agencies from Windsor Solutions: Electronic Data Transfer (EDT) Support For State And Local Agencies.
Node endpoint URLs: EPA CDX Node Endpoints
Response PDF hint:
In order to include the details of the accepted and rejected transaction error messages in the Response PDF file that is returned after a transaction completes, you must include the <Property> block in the XML Header with the values 'Source' and 'FullBatch' in the <name> and <value> tags. This is detailed in the XML Instance Document: exchangenetwork.net/schema/ICIS/5/ICIS-NPDES_Example_XML_Instance_Document_v5.9.docx.
<Id>Your EDT User ID</Id>
If the Source/FullBatch <Property> block is not included in your XML, the Response PDF returned will state that you must login to ICIS to retrieve these accepted and rejected messages (Batch Audit Report in BusinessObjects).
Article revised on 10/22/2021.