Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Save $650 on Qlik Connect, Dec 1 - 7, our lowest price of the year. Register with code CYBERWEEK: Register
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Map Object data type to Postgressql

Hi,

 

I have a Cassandra's table with a column type of Object. My goal is to map and store that column in a Postgre's table that have a column as text[]. So I am mapping a column of Object to a column of text[]. But, in Postgres the column is empty after I run the job.  The other filed instead are filled up correctly.

 

Does anyone have an idea of storing Object data type in Postgres?

Thank you in advance!0683p000009LzLu.png

 

Labels (3)
10 Replies
fdenis
Master
Master

Did you try to use document type in place of object?
Anonymous
Not applicable
Author

I tried, but it generate exception and the jub does not run.


@fdenis wrote:
Did you try to use document type in place of object?

 

fdenis
Master
Master

what is the exception?
wat is you casandra request?
Anonymous
Not applicable
Author

This happen when I change Object to Document:

 

org.talend.designer.runprocess.ProcessorException: Failed to generate code.
at org.talend.designer.runprocess.java.JavaProcessor.generateCode(JavaProcessor.java:614)
at org.talend.designer.runprocess.maven.MavenJavaProcessor.generateCode(MavenJavaProcessor.java:81)
at org.talend.designer.runprocess.ProcessorUtilities.generateContextInfo(ProcessorUtilities.java:867)
at org.talend.designer.runprocess.ProcessorUtilities.generateCode(ProcessorUtilities.java:574)
at org.talend.designer.runprocess.ProcessorUtilities.generateCode(ProcessorUtilities.java:1736)
at org.talend.designer.runprocess.RunProcessContext$1.run(RunProcessContext.java:582)
at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:466)
at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:374)
at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:527)
at org.eclipse.ui.internal.progress.ProgressMonitorJobsDialog.run(ProgressMonitorJobsDialog.java:284)
at org.eclipse.ui.internal.progress.ProgressManager.run(ProgressManager.java:1190)
at org.talend.designer.runprocess.RunProcessContext.exec(RunProcessContext.java:534)
at org.talend.designer.runprocess.ui.ProcessComposite.exec(ProcessComposite.java:1401)
at org.talend.designer.runprocess.ui.views.ProcessView$RunAction.run(ProcessView.java:701)
at org.talend.designer.runprocess.ui.actions.RunProcessAction.run(RunProcessAction.java:58)
at org.talend.designer.core.debug.JobLaunchConfigurationDelegate$1.run(JobLaunchConfigurationDelegate.java:84)
at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35)
at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:136)
at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:3774)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3412)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032)
at org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148)
at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579)
at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150)
at org.talend.rcp.intro.Application.start(Application.java:265)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:603)
at org.eclipse.equinox.launcher.Main.run(Main.java:1465)
at org.eclipse.equinox.launcher.Main.main(Main.java:1438)
Caused by: org.talend.designer.codegen.exception.CodeGeneratorException: org.eclipse.emf.codegen.jet.JETException: InvocationTargetException in subOpenConn job
at org.talend.designer.codegen.CodeGenerator.generateComponentCode(CodeGenerator.java:831)
at org.talend.designer.codegen.CodeGenerator.generateComponentsCode(CodeGenerator.java:542)
at org.talend.designer.codegen.CodeGenerator.generatesTreeCode(CodeGenerator.java:741)
at org.talend.designer.codegen.CodeGenerator.generateComponentsCode(CodeGenerator.java:545)
at org.talend.designer.codegen.CodeGenerator.generatesTreeCode(CodeGenerator.java:741)
at org.talend.designer.codegen.CodeGenerator.generateComponentsCode(CodeGenerator.java:545)
at org.talend.designer.codegen.CodeGenerator.generateComponentsCode(CodeGenerator.java:484)
at org.talend.designer.codegen.CodeGenerator.generateProcessCode(CodeGenerator.java:228)
at org.talend.designer.runprocess.java.JavaProcessor.generateCode(JavaProcessor.java:611)
... 41 more
Caused by: org.eclipse.emf.codegen.jet.JETException: InvocationTargetException
at org.eclipse.emf.codegen.jet.JETEmitter.generate(JETEmitter.java:469)
at org.talend.designer.codegen.config.TalendJetEmitter.generate(TalendJetEmitter.java:684)
at org.eclipse.emf.codegen.jet.JETEmitter.generate(JETEmitter.java:441)
at org.eclipse.emf.codegen.jet.JETEmitter.generate(JETEmitter.java:432)
at org.talend.designer.codegen.proxy.JetProxy.generate(JetProxy.java:54)
at org.talend.designer.codegen.CodeGenerator.generateComponentCode(CodeGenerator.java:821)
... 49 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.emf.codegen.jet.JETEmitter.generate(JETEmitter.java:461)
... 54 more
Caused by: java.lang.NullPointerException
at org.talend.designer.codegen.translators.databases.dbspecifics.postgresql.TPostgresqlOutputMainJava$PostgreManager.generateSetStmt(TPostgresqlOutputMainJava.java:4009)
at org.talend.designer.codegen.translators.databases.dbspecifics.postgresql.TPostgresqlOutputMainJava.generate(TPostgresqlOutputMainJava.java:8342)
... 59 more

 

My request is mapping Cassandra's table fileds to a Postgres table.

Anonymous
Not applicable
Author

Cassandra column:

    

1) type: Object db_type: varint

2) type: Object db_type: set

 

I do not know ho to manage them.

fdenis
Master
Master

varint is like integer
set is a collection of element like an array
Anonymous
Not applicable
Author

I know that. But how can I store them in Postgres? 

fdenis
Master
Master

numeric and array or enumerated data type
Anonymous
Not applicable
Author

I saved all by using character varying and converting in toString in tMap. I tried using json column in Postgres, but I did not get it..