Source Tables have dynamic names how can we process them?

[jonna]

Hi Replicate friends

(apologies, this is a repost - the other solution didn't quite tick all the boxes I think I need  or perhaps I don't understand the solution fully)

The source system we are collecting data from stores its records into a NEW TABLE EVERY DAY - this is because of the sheer volumes being processed. The tables are named as follows: "travel_data_yyyymmdd" with one for every day. 

Is there a way to create a single task that can read these table names dynamically?  Perhaps something along the lines of using wildcards??

Thanks in advance

ianjonna

[jonna]

Hi Replicate friends

(apologies, this is a repost - the other solution didn't quite tick all the boxes I think I need  or perhaps I don't understand the solution fully)

The source system we are collecting data from stores its records into a NEW TABLE EVERY DAY - this is because of the sheer volumes being processed. The tables are named as follows: "travel_data_yyyymmdd" with one for every day. 

Is there a way to create a single task that can read these table names dynamically?  Perhaps something along the lines of using wildcards??

Thanks in advance

ianjonna

[Heinvandenheuvel · Accepted solution]

@jonna  please delete this topic and continue in the original topic explaining WHY <the other solution didn't quite tick all the boxes> or <what detail is not understood>.