Mapping a Fixed File with Non-Standard Delimiters

Objective:

To evaluate the feasibility of using Adeptia to map and process a data file containing a mix of fixed-width elements and sub-fields separated by control characters.

Problem Statement: 

We are working with a text file that contains a combination of fixed-width fields and dynamically sized sub-fields, separated using non-standard delimiters. The goal is to assess whether Adeptia has the capability to process such a structure effectively.

The file includes start and end markers enclosing fixed-width data, followed by records that do not have fixed-width formatting. It also includes the RS and FS segments.

Sample File Data:

Approach to processing the Data:

1. We analyzed the structure of the file and, based on our findings, created a ‘Text’ Layout within Adeptia.
2. The hexadecimal values for RS and FS were used to define record and field delimiters:
   1. RS: 0x1E
   2. FS: 0x1C

Note: In some cases, records in the sample data were observed using both RS and FS as record separators. The layout was configured accordingly to handle this variation.

3. A total of 15 fields were defined manually in the layout, and the “Allow Less Fields” option was enabled under Advanced Settings to accommodate variable-length records.

4. The layout was saved after configuration.
5. A test was run using the layout:
   1. Clicked on the ‘Test’ button.
   2. Selected the source file.
   3. Clicked ‘Submit’ to run the test.

6. The test results confirmed that all 8 records from the sample data were successfully read.

7. To validate the output, we reviewed the processed records via the targetFile.xml > View Page Source option.

8. The XML output displayed detailed data from the processed records, confirming accurate parsing and layout functionality.