Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
hi,
i m trying to read the data from oracle table using big data spark job. I am using 6.2. I have standard job which is running fine and planning migrating to big data job.
I am using YARN client for the Spark Mode. When I am using only files it is working fine,but if I include oracle component, it is throwing below error.
For a test, i created a sample job as attached
Query I am using is select (*) cnt from schema.table where ABC=111;
In "Advance Spark and JDBC parameter" setting, added below
"dbtable" --> schema.table
Please guide me if I am doing something wrong or how to solve this?
org.apache.spark.sql.catalyst.parser.ParseException:
no viable alternative at input '<EOF>'(line 1, pos 0)
== SQL ==
^^^
at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197)
at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99)
at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45)
at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parseTableIdentifier(ParseDriver.scala:48)
Hello,
This issue seem to be the Spark Configuration, Use local mode property settings. Could you please try to select YARN client for the Spark Mode in the Spark Configuration of the Job? Let us know if it helps.
Best regards
Sabrina