I m having this situation.
I have 2015 and 2016 data file. in year 2015, there are data files transaction_20151101 , inside there is a column/field called version with data 1 - 1 is version 1'
In 2016, I have 2016 data records_20161110 , with column version 3, another data file records_20161111, with column version 5.
Now there are 2 many version files. And I only need latest version files to do comparison.
How should I write in my data loading?