Skip to main content
Announcements
Qlik Introduces a New Era of Visualization! READ ALL ABOUT IT
cancel
Showing results for 
Search instead for 
Did you mean: 
Jon_Donker
Creator
Creator

QR: Log stream vs header__timestamp

Hi,

Just need a conformation of header__timestamp in regards to reading from the Log stream task:

Jon_Donker_0-1704753381789.png

Is the header__timestamp in the S3 json file the timestamp of the change on the source? 

Or the time the change was written to the log stream?

 

Labels (1)
5 Replies
Alan_Wang
Support
Support

Hi @Jon_Donker 

Header timestamp is the timestamp of the Change operation, which is represented as the local time on the Replicate Server. Header commit timestamp is the source database commit timestamp, according to Replicate Server time. For an extensive explanation of all our header variables, please refer to the following link:

https://help.qlik.com/en-US/replicate/May2022/Content/Global_Common/Content/SharedEMReplicate/Custom...

 

If the issue is solved please mark the answer with Accept as Solution.
Jon_Donker
Creator
Creator
Author

Thanks Alan.

So those values are not impacted by the fact that the data is reading from a Log stream?  They still relate to the source DB2 database?

Alan_Wang
Support
Support

Header timestamp is when the change is applied for the child log stream task. No relation to the DB2 timestamps. Header commit timestamp is the one that logs DB2 commit timestamps.

If the issue is solved please mark the answer with Accept as Solution.
Jon_Donker
Creator
Creator
Author

Hi - just coming back to this problem.

The downstream users would like the "Header DB Commit Timestamp".

When we shift to log stream; is it possible to overwrite the header__timestamp with H_DB_COMMIT_TIMESTAMP so they don't have to modify their ingestion patterns to use a new field?

Alan_Wang
Support
Support

Change Tables have some prebuilt headers that can be turned on or off in task settings.

Change Processing -> Stored Changes Settings

Headers that do not come prebuilt into the table will need to be added as a new column through transformations. You will use the expression builder to add the header in as the value. You can name the column anything you like.

$AR_H_DB_COMMIT_TIMESTAMP

These changes will need a reload to rebuild the table.

If the issue is solved please mark the answer with Accept as Solution.