How select fields to be onboarded quickly

saveriospa — Wed, 10 Aug 2022 13:08:26 GMT

Hi All,

we're using and we need to onboard huge tables as entities. There are table that contains more than 400 fields and we would like to import just a subset of this.

The only way to achieve this seems to be to select manually the checkbox for each field, but in our case this is not feasible (if I need just 100/400 I cannot do this manually).

Playing with the entity properties (in the Source module) I found the src.file.glob. Here there is the SQL statement and adding a where condition works, indeed only the filtered data is imported.

Unfortunately this does not work when the SQL statement is modified to get a subset of fields. Seems the system keep somewhere the list of fields selected in the wizard (in the load log I find the message expected 400 fields but found 100).

Please, can you help me?

Thanks a lot!

Saverio

Re: How select fields to be onboarded quickly

demein — Fri, 25 Aug 2023 15:42:25 GMT

You'll get faster credentials. You'll just have something else fall by the wayside that's not tracked. And then someone will change their metrics again.

topic How select fields to be onboarded quickly in Catalog and Lineage

How select fields to be onboarded quickly

Re: How select fields to be onboarded quickly