I am building a task which extracts data from a CSV source which fails at run time. In the logs i see a number of errors which I can't interpret - log is attached and an extract is pasted at the end of my post. The basic task details are as follows:
I have tried all kinds of alterations to the task and the source endpoint but can't seem to make any head way. All help would be greatly appreciated.
Thanks very much, jonna
Date and Time Level Message
05/05/2022 14:30:38 ERROR_GENERAL "Cannot refresh source table (1) metadata
Failed on getting table definition for table id: 1
Getting DB object (''QlikSense Server File Location'.'Web Chat'') info from repository failed."
05/05/2022 14:30:38 ERROR_GENERAL Could not get object: 'QlikSense Server File Location'.'Web Chat' from repository.
05/05/2022 14:30:38 ERROR_GENERAL "Stream component 'st_1_QlikSense Server File Location' terminated
Within your source file endpoint -> Tables tab -> open up 'Web Chat CSV'
Location of full load data file(s):
You need to reference the file name in your path, not just the folder.
current: \\VVL-QS-FS\QlikShare\Project Layer\Application Layer\Avaya\Reference Files
update to: \\VVL-QS-FS\QlikShare\Project Layer\Application Layer\Avaya\Reference Files\WebChat.csv
Try pointing to the exact file path and let us know if able to run without error.
Do NOT use Excel to visualize CSV files for support/understanding purposes. It tries to 'help' too much
Please just use NOTEPAD(++) or similar to show the exact contents with all details like quoted columns, seperators, dates which turn out to be day numbers and so on.
from the log :
00006152: 2022-05-05T17:00:34 [SOURCE_UNLOAD ]E: Failed to write record id: 2195, Number of values: 1 is not equal to number of columns: 2.  (file_unload.c:344)
00006152: 2022-05-05T17:00:34 [SOURCE_UNLOAD ]E: Failed to init unloading table.  (file_unload.c:395)
this indicate that when you set the table it does not have the correct number of columns as compare to your csv file.
do you have your table set in the endpoint?
see example screen-shot?
This could be that your csv file have more column or the delimiter is not correctly.
1. lets try to isolate the issue, could you create a small csv file with the two column and data (example 5 records) , using the delimiter that you define in your source endpoint.
2. then use the sample csv, does the task works ?
3. if the test sample csv works then it is your source CSV file that have more delimiter (causing more column) , therefore, error message.