I have several components that depend on a schema and most I manually create based on what I'm working with. I use the data to create a file then call a job that loads that file into our storage.
How can I use a context variable in the load job to call a Generic schema?
The issue is that every job in this set of flows needs to call a load job. I can paramertize the connection, bucket and file name. But the schemas will be different. I can create Generic schemas but have no way to call them dynamically. If I could, then I would only have the 1 load job.
Below is a job that I'd like to be a 1 job loads all.