https://community.qlik.com/t5/Talend-Studio/Submit-Multiple-Big-Data-batch-job-on-Azure-Databricks-cluster/m-p/2228827#M19973 <P>Hi ,</P> <P>&nbsp;</P> <P>We have requirement of submitting multiple spark big data batch jobs on single Azure Databricks cluster. We tried submitting more than one job at the same&nbsp; time to single databricks cluster, but jobs start failing with the issue :</P> <P>“org.talend.bigdata.launcher.utils.BigDataLauncherException: Status 400 for /api/2.0/clusters/restart”</P> <P>&nbsp;</P> <P>After some analysis I figured out that as per the talend official documentation, we can’t run multiple big data batch jobs in parallel on single databricks cluster. Please find the link below:</P> <P><A href="https://help.talend.com/reader/iLJ_d4Eb9ZgJEEFVKwPNig/uG6WXACe~Vz1fYBBPjpnPA" target="_blank" rel="nofollow noopener noreferrer">https://help.talend.com/reader/iLJ_d4Eb9ZgJEEFVKwPNig/uG6WXACe~Vz1fYBBPjpnPA</A></P> <P>&nbsp;</P> <P>Is there a way I can run big data jobs in parallel on a single databricks cluster?</P> <P>&nbsp;</P> <P>&nbsp;</P> Sat, 16 Nov 2024 04:46:37 GMT Anonymous 2024-11-16T04:46:37Z https://community.qlik.com/t5/Talend-Studio/Submit-Multiple-Big-Data-batch-job-on-Azure-Databricks-cluster/m-p/2228827#M19973 <P>Hi ,</P> <P>&nbsp;</P> <P>We have requirement of submitting multiple spark big data batch jobs on single Azure Databricks cluster. We tried submitting more than one job at the same&nbsp; time to single databricks cluster, but jobs start failing with the issue :</P> <P>“org.talend.bigdata.launcher.utils.BigDataLauncherException: Status 400 for /api/2.0/clusters/restart”</P> <P>&nbsp;</P> <P>After some analysis I figured out that as per the talend official documentation, we can’t run multiple big data batch jobs in parallel on single databricks cluster. Please find the link below:</P> <P><A href="https://help.talend.com/reader/iLJ_d4Eb9ZgJEEFVKwPNig/uG6WXACe~Vz1fYBBPjpnPA" target="_blank" rel="nofollow noopener noreferrer">https://help.talend.com/reader/iLJ_d4Eb9ZgJEEFVKwPNig/uG6WXACe~Vz1fYBBPjpnPA</A></P> <P>&nbsp;</P> <P>Is there a way I can run big data jobs in parallel on a single databricks cluster?</P> <P>&nbsp;</P> <P>&nbsp;</P> Sat, 16 Nov 2024 04:46:37 GMT https://community.qlik.com/t5/Talend-Studio/Submit-Multiple-Big-Data-batch-job-on-Azure-Databricks-cluster/m-p/2228827#M19973 Anonymous 2024-11-16T04:46:37Z https://community.qlik.com/t5/Talend-Studio/Submit-Multiple-Big-Data-batch-job-on-Azure-Databricks-cluster/m-p/2228828#M19974 <P>Hello,</P> <P>Could you please create a new feature jira issue on talend bug tracker?</P> <P>Best regards</P> <P>Sabrina</P> Mon, 30 Sep 2019 08:44:43 GMT https://community.qlik.com/t5/Talend-Studio/Submit-Multiple-Big-Data-batch-job-on-Azure-Databricks-cluster/m-p/2228828#M19974 Anonymous 2019-09-30T08:44:43Z