We have a table in Hive that requires a SerDe to parse the data. In other to run the query to extract the data in Talend, we need to add the SerDe Jar files prior to the SQL statement. Using TOS Big Data v5.3, with tHiveInput, I was not able to add both 'ADD JAR /usr/lib/hive/lib/contrib.jar;' and the 'select' statement because it won't allow multiple SQL statements within the query. The current work around is to create another physical table in Hive with create-table-as outside of Talend. Are there other ways?
Thanks Brandon for responding. I tried the tLibraryLoad, but it seemed like the SerDe Jar needed to be added within the Hive session. We are also playing around the idea of changing the hive-site.xml to include the contrib.jar by default.
Hello, I think you need to do additional things in order to add the JAR in the Hive classpath. ADD JAR ?s3n://matthewsbucket/superudf.jar?; CREATE TEMPORARY FUNCTION super as ?com.matthewrathbone.SuperFunction?; You could try to use that with two tHiveRow components. Regards, Rémy.
