https://community.qlik.com/t5/Talend-Studio/Best-Approach-for-Project-Design/m-p/2350289#M117166 <P>Hello All, </P><P></P><P></P><P>we are going to launch new phase and extract data from <B>350-500 data source like (oracle -mssql-impala-Greenplum)</B> and many different data sources, </P><P></P><P></P><P></P><P></P><P>what is the best approach/design to perform this phase to extract data with sysdate -1 from mentioned sources and insert it into parquet file and then move the file to HDFS </P><P></P><P></P><P>i have a fear of having memory issue on the server that jobs will run on it , what should i consider and have a logging for all of these tables/jobs ?</P><P></P><P></P><P>can anyone help me to sort out this ? </P><P></P><P></P> Fri, 15 Nov 2024 21:39:26 GMT mshafeeq 2024-11-15T21:39:26Z https://community.qlik.com/t5/Talend-Studio/Best-Approach-for-Project-Design/m-p/2350289#M117166 <P>Hello All, </P><P></P><P></P><P>we are going to launch new phase and extract data from <B>350-500 data source like (oracle -mssql-impala-Greenplum)</B> and many different data sources, </P><P></P><P></P><P></P><P></P><P>what is the best approach/design to perform this phase to extract data with sysdate -1 from mentioned sources and insert it into parquet file and then move the file to HDFS </P><P></P><P></P><P>i have a fear of having memory issue on the server that jobs will run on it , what should i consider and have a logging for all of these tables/jobs ?</P><P></P><P></P><P>can anyone help me to sort out this ? </P><P></P><P></P> Fri, 15 Nov 2024 21:39:26 GMT https://community.qlik.com/t5/Talend-Studio/Best-Approach-for-Project-Design/m-p/2350289#M117166 mshafeeq 2024-11-15T21:39:26Z