Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
richard_chilvers
Specialist
Specialist

Wild card filename with concatenate load

My script has a wildcard filename to load data from numerous files (all with the same structure) within a folder . I then want to load into the tables the data from more files with this structure from a different folder. I have used CONCATENATE LOAD, with the wildcard as before, but only the last file gets loaded.

Is my approach wrong ? I cannot see anything in the documentation which says this is not allowed.

Richard

4 Replies
m_woolf
Master II
Master II

Sounds OK, but showing your load script would be helpful.

erichshiino
Partner - Master
Partner - Master

You can only use wildcards for filename not folders but I'm not sure if this is your problem.

Not applicable

As long as the file layout matches you dont need to do the concatenate load. i.e.

source_data:

load a, b, c

from table*.xls;

load a, b, c

from myotherfolder\b_table*.xls;

will load all of the data for fields a, b, & c, into the source_data table from all files named table(anything).xls and b_table(anything).xls.

Note, dont do a load * from table*.xls as there may be other fields in there that wont map to the rest of your source files.

richard_chilvers
Specialist
Specialist
Author

Hi Leonard

The (.xml) file layouts are identical so I didn't realise that I didn't need to use CONCATENATE.

Works well now thanks !