Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello,
Here's the screenshot of my spark job where I get that error:
I'm encountering the following error:
[INFO ]: org.apache.spark.sql.execution.SparkSqlParser - Parsing command: USE zzx_rel_zzy_edo_dq
[INFO ]: org.apache.spark.scheduler.DAGScheduler - Asked to cancel job group GLOBE_EDO_DQ_VBR_AUDIT_spark_job_for_transactional_1
[INFO ]: globe_edo_dq_vbr_audit.spark_job_for_transactional_0_1.spark_job_for_transactional - Application spark_job_for_transactional ended in 00:00:16.225
[INFO ]: globe_edo_dq_vbr_audit.spark_job_for_transactional_0_1.spark_job_for_transactional - Spark counters per job (1 jobs):[INFO ]: globe_edo_dq_vbr_audit.spark_job_for_transactional_0_1.spark_job_for_transactional - spark_job_for_transactional.job0.duration=00:00:13.910[INFO ]: globe_edo_dq_vbr_audit.spark_jo
Does the zzx_rel_zzy_edo_dq database exist? Is it configured correctly?
Yes, upon checking in Production environment it exists. May I know how to identify if it is configured correctly?
Where are you running this job from? You need to ensure you can access the database from where the job is running.