I'm currently trying to load data for registered entities. My source data has a few variables that contain super long string and isn't quite necessary for loading/sampling for the data catalog purposes. Is there any way to skip a few variables for data load?
Thank you so much for your quick response on this matter. These few columns are long strings that contains info that is already broken down and generated for variables for other tables. With that being said, no, those few columns that I want to skip during data load will not be used for the end users. But the table still contains other info that could come in handy for analysis etc. My goal here is still load the data for this table but skipping the columns that are too computing heavy but not generating value.
So is it possible to still register the table but not specific columns?
NP, always trying to point others in the right direction. I’ve been a beginner forever...I might not know how to code yet, but I’m amassing a wealth of links/learning resources.hope it helps, Trey Hunner has great in depth coverage on many Python topics.