https://community.qlik.com/t5/Talend-Studio/Surrogate-Key-Generation-in-Talend-Big-Data-Batch-Spark-Job/m-p/2235141#M24268 <P><SPAN>Hi All , We were unable to use the Numeric Sequence (in tmap) in Talend Big Data Batch Spark Job as the spark job is running with multiple executors and is creating duplicate keys. We don't want to use UUID as we want to have a integer value to surrogate key column . Could you please let us know how to generate unique surrogate key in Talend Big Data Batch Spark Job ?</SPAN></P><P>&nbsp;</P><P>&nbsp;</P> Sat, 16 Nov 2024 02:32:12 GMT ravi999 2024-11-16T02:32:12Z https://community.qlik.com/t5/Talend-Studio/Surrogate-Key-Generation-in-Talend-Big-Data-Batch-Spark-Job/m-p/2235141#M24268 <P><SPAN>Hi All , We were unable to use the Numeric Sequence (in tmap) in Talend Big Data Batch Spark Job as the spark job is running with multiple executors and is creating duplicate keys. We don't want to use UUID as we want to have a integer value to surrogate key column . Could you please let us know how to generate unique surrogate key in Talend Big Data Batch Spark Job ?</SPAN></P><P>&nbsp;</P><P>&nbsp;</P> Sat, 16 Nov 2024 02:32:12 GMT https://community.qlik.com/t5/Talend-Studio/Surrogate-Key-Generation-in-Talend-Big-Data-Batch-Spark-Job/m-p/2235141#M24268 ravi999 2024-11-16T02:32:12Z https://community.qlik.com/t5/Talend-Studio/Surrogate-Key-Generation-in-Talend-Big-Data-Batch-Spark-Job/m-p/2235142#M24269 You can use tSqlrow and generate numeric sequence by writing similar way of oracle query form the input row.<BR /> Mon, 04 May 2020 02:16:28 GMT https://community.qlik.com/t5/Talend-Studio/Surrogate-Key-Generation-in-Talend-Big-Data-Batch-Spark-Job/m-p/2235142#M24269 manodwhb 2020-05-04T02:16:28Z