Map Object data type to Postgressql

Anonymous — Sat, 16 Nov 2024 07:40:14 GMT

Hi,

I have a Cassandra's table with a column type of Object. My goal is to map and store that column in a Postgre's table that have a column as text[]. So I am mapping a column of Object to a column of text[]. But, in Postgres the column is empty after I run the job. The other filed instead are filled up correctly.

Does anyone have an idea of storing Object data type in Postgres?

Thank you in advance!

Re: Map Object data type to Postgressql

fdenis — Wed, 12 Sep 2018 11:39:17 GMT

Did you try to use document type in place of object?

Re: Map Object data type to Postgressql

Anonymous — Wed, 12 Sep 2018 11:51:54 GMT

I tried, but it generate exception and the jub does not run.

@fdenis wrote:
Did you try to use document type in place of object?

Re: Map Object data type to Postgressql

fdenis — Wed, 12 Sep 2018 12:20:46 GMT

what is the exception?
wat is you casandra request?

Re: Map Object data type to Postgressql

Anonymous — Wed, 12 Sep 2018 12:45:03 GMT

This happen when I change Object to Document:

org.talend.designer.runprocess.ProcessorException: Failed to generate code.
at org.talend.designer.runprocess.java.JavaProcessor.generateCode(JavaProcessor.java:614)
at org.talend.designer.runprocess.maven.MavenJavaProcessor.generateCode(MavenJavaProcessor.java:81)
at org.talend.designer.runprocess.ProcessorUtilities.generateContextInfo(ProcessorUtilities.java:867)
at org.talend.designer.runprocess.ProcessorUtilities.generateCode(ProcessorUtilities.java:574)
at org.talend.designer.runprocess.ProcessorUtilities.generateCode(ProcessorUtilities.java:1736)
at org.talend.designer.runprocess.RunProcessContext$1.run(RunProcessContext.java:582)
at org.eclipse.jface.operation.ModalContext.runInCurrentThread(ModalContext.java:466)
at org.eclipse.jface.operation.ModalContext.run(ModalContext.java:374)
at org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:527)
at org.eclipse.ui.internal.progress.ProgressMonitorJobsDialog.run(ProgressMonitorJobsDialog.java:284)
at org.eclipse.ui.internal.progress.ProgressManager.run(ProgressManager.java:1190)
at org.talend.designer.runprocess.RunProcessContext.exec(RunProcessContext.java:534)
at org.talend.designer.runprocess.ui.ProcessComposite.exec(ProcessComposite.java:1401)
at org.talend.designer.runprocess.ui.views.ProcessView$RunAction.run(ProcessView.java:701)
at org.talend.designer.runprocess.ui.actions.RunProcessAction.run(RunProcessAction.java:58)
at org.talend.designer.core.debug.JobLaunchConfigurationDelegate$1.run(JobLaunchConfigurationDelegate.java:84)
at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35)
at org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:136)
at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:3774)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3412)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032)
at org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148)
at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579)
at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150)
at org.talend.rcp.intro.Application.start(Application.java:265)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:603)
at org.eclipse.equinox.launcher.Main.run(Main.java:1465)
at org.eclipse.equinox.launcher.Main.main(Main.java:1438)
Caused by: org.talend.designer.codegen.exception.CodeGeneratorException: org.eclipse.emf.codegen.jet.JETException: InvocationTargetException in subOpenConn job
at org.talend.designer.codegen.CodeGenerator.generateComponentCode(CodeGenerator.java:831)
at org.talend.designer.codegen.CodeGenerator.generateComponentsCode(CodeGenerator.java:542)
at org.talend.designer.codegen.CodeGenerator.generatesTreeCode(CodeGenerator.java:741)
at org.talend.designer.codegen.CodeGenerator.generateComponentsCode(CodeGenerator.java:545)
at org.talend.designer.codegen.CodeGenerator.generatesTreeCode(CodeGenerator.java:741)
at org.talend.designer.codegen.CodeGenerator.generateComponentsCode(CodeGenerator.java:545)
at org.talend.designer.codegen.CodeGenerator.generateComponentsCode(CodeGenerator.java:484)
at org.talend.designer.codegen.CodeGenerator.generateProcessCode(CodeGenerator.java:228)
at org.talend.designer.runprocess.java.JavaProcessor.generateCode(JavaProcessor.java:611)
... 41 more
Caused by: org.eclipse.emf.codegen.jet.JETException: InvocationTargetException
at org.eclipse.emf.codegen.jet.JETEmitter.generate(JETEmitter.java:469)
at org.talend.designer.codegen.config.TalendJetEmitter.generate(TalendJetEmitter.java:684)
at org.eclipse.emf.codegen.jet.JETEmitter.generate(JETEmitter.java:441)
at org.eclipse.emf.codegen.jet.JETEmitter.generate(JETEmitter.java:432)
at org.talend.designer.codegen.proxy.JetProxy.generate(JetProxy.java:54)
at org.talend.designer.codegen.CodeGenerator.generateComponentCode(CodeGenerator.java:821)
... 49 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.eclipse.emf.codegen.jet.JETEmitter.generate(JETEmitter.java:461)
... 54 more
Caused by: java.lang.NullPointerException
at org.talend.designer.codegen.translators.databases.dbspecifics.postgresql.TPostgresqlOutputMainJava$PostgreManager.generateSetStmt(TPostgresqlOutputMainJava.java:4009)
at org.talend.designer.codegen.translators.databases.dbspecifics.postgresql.TPostgresqlOutputMainJava.generate(TPostgresqlOutputMainJava.java:8342)
... 59 more

My request is mapping Cassandra's table fileds to a Postgres table.

Re: Map Object data type to Postgressql

Anonymous — Wed, 12 Sep 2018 15:40:51 GMT

Cassandra column:

1) type: Object db_type: varint

2) type: Object db_type: set

I do not know ho to manage them.

Re: Map Object data type to Postgressql

fdenis — Wed, 12 Sep 2018 16:02:04 GMT

varint is like integer
set is a collection of element like an array

Re: Map Object data type to Postgressql

Anonymous — Wed, 12 Sep 2018 16:15:25 GMT

I know that. But how can I store them in Postgres?

Re: Map Object data type to Postgressql

fdenis — Fri, 14 Sep 2018 07:49:20 GMT

numeric and array or enumerated data type

Re: Map Object data type to Postgressql

Anonymous — Fri, 14 Sep 2018 11:04:37 GMT

I saved all by using character varying and converting in toString in tMap. I tried using json column in Postgres, but I did not get it..

Re: Map Object data type to Postgressql

fdenis — Fri, 14 Sep 2018 12:18:39 GMT

conversion have to be on the db side . think of perf.

topic Re: Map Object data type to Postgressql in Talend Studio

Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql

Re: Map Object data type to Postgressql