currently we are using tKinesisInput component to consume data from kinesis stream. it works when data is in readable format ex- json, but with aws cloud watch log data , subscription filters gzip's data and publishes into the stream. so when
tKinesisInput component reads this data, it cannot unzip it ( field type for payload is string, and it cannot be modified to byte[]) , we see unreadable data and unzip java code says , payload is not a zipped file/format.
we raise a support ticket to give flexibility to change payload data type from string to byte[] , so to unzip using java code, but its been a while and no ETA yet form talend r&d.
im checking in here to see, if there are any alternative solutions to unzip data ( I tried to place data in file and use tunarchive comoponent but it gives same error - not a zipped file/format.
