topic Re: org.apache.spark.sql.catalyst.analysis.NoSuchDatabaseException in Talend Studio

org.apache.spark.sql.catalyst.analysis.NoSuchDatabaseException

Anonymous — Sat, 16 Nov 2024 04:16:33 GMT

Hello,

Here's the screenshot of my spark job where I get that error:

I'm encountering the following error:

[INFO ]: org.apache.spark.sql.execution.SparkSqlParser - Parsing command: USE zzx_rel_zzy_edo_dq
[INFO ]: org.apache.spark.scheduler.DAGScheduler - Asked to cancel job group GLOBE_EDO_DQ_VBR_AUDIT_spark_job_for_transactional_1
[INFO ]: globe_edo_dq_vbr_audit.spark_job_for_transactional_0_1.spark_job_for_transactional - Application spark_job_for_transactional ended in 00:00:16.225
[INFO ]: globe_edo_dq_vbr_audit.spark_job_for_transactional_0_1.spark_job_for_transactional - Spark counters per job (1 jobs):[INFO ]: globe_edo_dq_vbr_audit.spark_job_for_transactional_0_1.spark_job_for_transactional - spark_job_for_transactional.job0.duration=00:00:13.910[INFO ]: globe_edo_dq_vbr_audit.spark_jo

To see the whole post, download it here

Re: org.apache.spark.sql.catalyst.analysis.NoSuchDatabaseException

Anonymous — Mon, 28 Oct 2019 09:47:21 GMT

Does the zzx_rel_zzy_edo_dq database exist? Is it configured correctly?

Re: org.apache.spark.sql.catalyst.analysis.NoSuchDatabaseException

Anonymous — Mon, 28 Oct 2019 09:54:17 GMT

Yes, upon checking in Production environment it exists. May I know how to identify if it is configured correctly?

Re: org.apache.spark.sql.catalyst.analysis.NoSuchDatabaseException

Anonymous — Mon, 28 Oct 2019 10:19:12 GMT

Where are you running this job from? You need to ensure you can access the database from where the job is running.