Talend Data Mapper - Finding the structure of a EBCDIC file without the copy book

[Morpheus]

Hi Team,

I need to create a data map for an EBCDIC data file. However, we do not have the copybook for the data file. Also we are not sure of the exact encoding. However, we do have the metadata from a different DI tool (DataStage). Is it possible for us to create the structure and do the mapping without having the copybook?

[Morpheus]

Hi Terry,

Finally they send the copy book and I was able to import it. However, when I point it to the data file to display data, it is throwing one error as shown below while showing the data in XML format. I have not modified the default structure it implied. Any thoughts?

Overall: Error
1: Error - An end-of-file was encountered during the processing of this element. (802)
Structure: Structures/NOPOST-DETAIL-RECORD/NOPOST-DETAIL-RECORD.xml - Element: /NOPOST-DETAIL-RECORD/Record/NP-KEY/NP-ACCT
Starting Line/Column: 1/1001 Byte offset: 0x3e8 (1000)
Line: 2 column: 0
Byte offset: 0x3ea (1002)
SystemId: file:/C:/Program%20Files/Talend/Talend-Studio-V6.2.1/workspace/FLEXDEMO/Sample%20Data/5504_F1nopost.DAT_1_20180723004343

[Anonymous]

Try this.  Go to Windows->Settings->Preferences.  Find Mapping and click on it.  To the right, change "Maximum output characters to show" and "Maximum characters to read for sample docs/highlighting" to -1.

ScreenHunter_1165 Aug. 24 12.29.jpg

[Morpheus]

Thanks for the reply, Terry! Tried that option and restarted the designer. Still the problem persists. I noted two things.

1. The problematic field is having metadata for PIC S9(9). However, the actual data that is coming in the preview is having a length of 8.

2. Towards the end of the sample document I am seeing the below text.

 <Flat:Record>
<Flat:NP-KEY>
<Flat:NP-ACCT></Flat:NP-ACCT>
</Flat:NP-KEY>
</Flat:Record>

Could any of those two be the reason for the error?

Is there any way from me to make it skip the first byte while reading the data?

Also, I would like to know if there are ways to suppress the error when using this structure in a job.

[Anonymous]

You don't want to skip any bytes.  Sounds like your copybook doesn't match up with your data.  Can you take a screenshot of your structure with the associated data?  I will be gone next Mon - Thurs so will try to look into this when I get back.