Dynamic Partition for Hive with TOS

Anonymous — Sat, 16 Nov 2024 08:36:54 GMT

Hello Experts,

As per the requirement i have to load the data in Hive partition table, Talend works fine static partition and however I'm facing issue for Dynamic partition.

For EX:

I Created a table with 5 columns like id, name , occupation,zip code and gender(Partition column) , while loading the data if i use gender = 'M' or 'F' in tHiveLoad / thiverow component its working fine, if i'm not passing any value to gender column then i'm getting the error.

I am getting the below error, to resolve this i tried with "hive.exec.dynamic.partition.mode=nonstrict" and "hive.exec.dynamic.partition = true" , but no luck

However i'm able to achieve Dynamic partitioning in Hive scripting with out passing any value to partition column, but not in Talend

Error while compiling statement: FAILED: SemanticException [Error 10096]: Dynamic partition strict mode requires at least one static partition column. To turn this off set hive.exec.dynamic.partition.mode=nonstrict

Your help is highly appreciate!!

Thanks,

Bharath

Re: Dynamic Partition for Hive with TOS

Anonymous — Mon, 05 Mar 2018 08:16:31 GMT

Hello Talend Folks,

Can anyone please help me on this Dynamic partition?

Regards,

Bharath

Re: Dynamic Partition for Hive with TOS

Anonymous — Wed, 14 Mar 2018 09:07:46 GMT

Hello,

On which build version you got this issue?

Have you tried to put

hiveContext.setConf("hive.exec.dynamic.partition", "true")
hiveContext.setConf("hive.exec.dynamic.partition.mode", "nonstrict")?

Best regards

Sabrina

topic Re: Dynamic Partition for Hive with TOS in Talend Studio

Dynamic Partition for Hive with TOS

Re: Dynamic Partition for Hive with TOS

Re: Dynamic Partition for Hive with TOS