In the tBigQueryOutput documentation, it mentions that google cloud storage (GCS) is required for the tBigQueryOutput component. Is this necessary if we do not want to use GCS? We are already using azure datalake and it doesnt quite make sense to duplicate the data again in GCS. Is there any workaround?
This component writes the data it receives in a user-specified directory and transfers the data to Google BigQuery
What's more, it is common for solutions within the Azure environment to store data within ADLS and process it with other compute resources, such as Azure Data bricks.
Talend 7.1 adds support for executing Jobs in Azure Data bricks 3.5 LTS.
Feel free to let us know if it is what you are looking for.
