Qlik Replicate - Source - HIVE Db Issues

[skokanay]

The task fails due to the below fatal errors :- Diagnostic package is attached. 

00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: Failed (retcode -1) to execute statement: 'SELECT `key`,`collections_customer_flags_attributes`,`audit_rec`,`cdc_flag`,`process_date` FROM `interfaces`.`coll_cust_flags_if_snap`' [1022502] (ar_odbc_stmt.c:2799)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: RetCode: SQL_ERROR SqlState: 42000 NativeError: 80 Message: [Cloudera][Hardy] (80) Syntax or semantic analysis error thrown in server while executing query. Error message from server: Error while compiling statement: FAILED: SemanticException [Error 10056]: Queries against partitioned tables without a partition filter are disabled for safety reasons. If you know what you are doing, please set hive.strict.checks.no.partition.filter to f [1022502] (ar_odbc_stmt.c:2805)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]I: Unload finished for table 'interfaces'.'coll_cust_flags_if_snap' (Id = 1). 0 rows sent. (streamcomponent.c:3690)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: ODBC source. Cannot init table workspace - '1022505' - for table 0 [1022505] (odbc_endpoint_unload.c:477)
00016991: 2023-02-24T03:46:54 [TARGET_LOAD ]I: Load finished for table 'interfaces'.'coll_cust_flags_if_snap' (Id = 1). 0 rows received. 0 rows skipped. Volume transferred 0. (streamcomponent.c:3974)
00016852: 2023-02-24T03:46:54 [TASK_MANAGER ]E: Table error occurred. Based on error behavior policy, task will stop. [1021705] (replicationtask.c:3113)
00016852: 2023-02-24T03:46:54 [TASK_MANAGER ]W: Task 'CRDHS_NP_TEST' encountered a fatal error (repository.c:5853)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: Error executing source loop [1022505] (streamcomponent.c:1917)
00016990: 2023-02-24T03:46:54 [TASK_MANAGER ]E: Stream component failed at subtask 1, component st_1_CRDHS_NP_TEST [1022505] (subtask.c:1396)
00016990: 2023-02-24T03:46:54 [SOURCE_UNLOAD ]E: Stream component 'st_1_CRDHS_NP_TEST' terminated [1022505] (subtask.c:1565)

[SwathiPulagam · Accepted solution]

Hi @skokanay ,

You got an exception from Hive. Please enable set hive.strict.checks.no.partition.filter to false on the Hive server and rerun the task.

Thanks,

Swathi

[skokanay]

Hi swathi, thnal for the response. It soesnt need the config changes in HIVE server. The task need to be added with the filter condition i.e partitioned column and it worked.

[SwathiPulagam · Accepted solution]

@skokanay  Thanks for the confirmation. Yes, one way to disable restriction on the Hive side(so we can run the same select without filter) or we need to add a partition filter.

Thanks,

Swathi