topic Re: TOS for Data Quality - Column refreshing issues in Data Quality

TOS for Data Quality - Column refreshing issues

Anonymous — Sat, 16 Nov 2024 04:59:46 GMT

Hi,

I use Talend Open Studio for Data Quality (Version: 7.2.1). The metadata I use are SQL server views stored in a single schema.

My issue happen if I modify a view in my SQL database (for example let's say I add a new column to the view).

I click "Refresh columns", the number of colums is updated, but then I can't develop the columns arborescence anymore, and I can't use the new column as part of a simple column analysis.

"Refrech columns" button

Can't display the column details after refreshing

When I try to select the column as part of an analysis, I get a "java.lang.NullPointerException" error.

The spot where the new column should appear is blank and the data type is not recognized.

New column "Owner Name" appear blank in the second line

However, in the preview the data is displayed fine.

Column "Owner Name" appear fine in the preview but its type is not detected

How can I fix this?

Thanks in advance for your help,

Claire.

Re: TOS for Data Quality - Column refreshing issues

Anonymous — Mon, 12 Aug 2019 17:13:55 GMT

Also, here's what I have in my error log:

Problems occurred when invoking code from plug-in: "org.eclipse.jface".

java.lang.NullPointerException
at org.talend.dq.nodes.DBColumnRepNode.getNodeDataType(DBColumnRepNode.java:114)
at org.talend.dq.nodes.DBColumnRepNode.getDisplayText(DBColumnRepNode.java:129)
at org.talend.dq.nodes.DQRepositoryNode.getDisplayTextWithProjectName(DQRepositoryNode.java:361)
at org.talend.dq.helper.RepositoryNodeHelper.getDisplayLabel(RepositoryNodeHelper.java:3975)
at org.talend.dataprofiler.core.ui.views.provider.DQRepositoryViewLabelProvider.getText(DQRepositoryViewLabelProvider.java:239)
at org.talend.dataprofiler.core.ui.dialog.provider.DBTablesViewLabelProvider.getText(DBTablesViewLabelProvider.java:97)
at org.talend.dataprofiler.core.ui.dialog.provider.DBTablesViewLabelProvider.getColumnText(DBTablesViewLabelProvider.java:58)
at org.eclipse.jface.viewers.TableColumnViewerLabelProvider.update(TableColumnViewerLabelProvider.java:69)
at org.eclipse.jface.viewers.ViewerColumn.refresh(ViewerColumn.java:144)
at org.eclipse.jface.viewers.AbstractTableViewer.doUpdateItem(AbstractTableViewer.java:394)
at org.eclipse.jface.viewers.CheckboxTableViewer.doUpdateItem(CheckboxTableViewer.java:172)
at org.eclipse.jface.viewers.StructuredViewer$UpdateItemSafeRunnable.run(StructuredViewer.java:478)
at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:45)
at org.eclipse.ui.internal.JFaceUtil.lambda$0(JFaceUtil.java:47)
at org.eclipse.jface.util.SafeRunnable.run(SafeRunnable.java:176)
at org.eclipse.jface.viewers.StructuredViewer.updateItem(StructuredViewer.java:2161)
at org.eclipse.jface.viewers.AbstractTableViewer.createItem(AbstractTableViewer.java:286)
at org.eclipse.jface.viewers.AbstractTableViewer.internalRefreshAll(AbstractTableViewer.java:723)
at org.eclipse.jface.viewers.AbstractTableViewer.internalRefresh(AbstractTableViewer.java:615)
at org.eclipse.jface.viewers.AbstractTableViewer.internalRefresh(AbstractTableViewer.java:607)
at org.eclipse.jface.viewers.AbstractTableViewer.lambda$0(AbstractTableViewer.java:569)
at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1449)
at org.eclipse.jface.viewers.StructuredViewer.preservingSelection(StructuredViewer.java:1410)
at org.eclipse.jface.viewers.CheckboxTableViewer.preservingSelection(CheckboxTableViewer.java:342)
at org.eclipse.jface.viewers.AbstractTableViewer.inputChanged(AbstractTableViewer.java:569)
at org.eclipse.jface.viewers.ContentViewer.setInput(ContentViewer.java:289)
at org.eclipse.jface.viewers.StructuredViewer.setInput(StructuredViewer.java:1687)
at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog.setOutput(TwoPartCheckSelectionDialog.java:264)
at org.talend.dataprofiler.core.ui.dialog.ColumnsSelectionDialog.selectionChanged(ColumnsSelectionDialog.java:497)
at org.eclipse.jface.viewers.Viewer$1.run(Viewer.java:158)
at org.eclipse.core.runtime.SafeRunner.run(SafeRunner.java:45)
at org.eclipse.ui.internal.JFaceUtil.lambda$0(JFaceUtil.java:47)
at org.eclipse.jface.util.SafeRunnable.run(SafeRunnable.java:176)
at org.eclipse.jface.viewers.Viewer.fireSelectionChanged(Viewer.java:155)
at org.eclipse.jface.viewers.StructuredViewer.updateSelection(StructuredViewer.java:2182)
at org.eclipse.jface.viewers.StructuredViewer.setSelection(StructuredViewer.java:1719)
at org.eclipse.jface.viewers.TreeViewer.setSelection(TreeViewer.java:1084)
at org.eclipse.jface.viewers.Viewer.setSelection(Viewer.java:383)
at org.talend.dataprofiler.core.ui.dialog.ColumnsSelectionDialog.unfoldRepositoryNode(ColumnsSelectionDialog.java:150)
at org.talend.dataprofiler.core.ui.dialog.ColumnsSelectionDialog.unfoldToCheckedElements(ColumnsSelectionDialog.java:127)
at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog.createDialogArea(TwoPartCheckSelectionDialog.java:423)
at org.eclipse.jface.dialogs.Dialog.createContents(Dialog.java:771)
at org.eclipse.jface.window.Window.create(Window.java:430)
at org.eclipse.jface.dialogs.Dialog.create(Dialog.java:1099)
at org.eclipse.ui.dialogs.SelectionStatusDialog.create(SelectionStatusDialog.java:149)
at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog.parentCreate(TwoPartCheckSelectionDialog.java:336)
at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog.access$2(TwoPartCheckSelectionDialog.java:335)
at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog$1.run(TwoPartCheckSelectionDialog.java:349)
at org.eclipse.swt.custom.BusyIndicator.showWhile(BusyIndicator.java:72)
at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog.create(TwoPartCheckSelectionDialog.java:346)
at org.eclipse.jface.window.Window.open(Window.java:787)
at org.talend.dataprofiler.core.ui.dialog.TwoPartCheckSelectionDialog.open(TwoPartCheckSelectionDialog.java:314)
at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage.openColumnsSelectionDialog(AbstractAnalysisMetadataPage.java:1446)
at org.talend.dataprofiler.core.ui.editor.analysis.AbstractAnalysisMetadataPage$13.mouseDown(AbstractAnalysisMetadataPage.java:1423)
at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:196)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:89)
at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4131)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1055)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3944)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3547)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$5.run(PartRenderingEngine.java:1173)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:339)
at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1062)
at org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:156)
at org.eclipse.ui.internal.Workbench.lambda$3(Workbench.java:636)
at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:339)
at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:563)
at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:151)
at org.talend.dataprofiler.rcp.intro.Application.start(Application.java:91)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:203)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:137)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:107)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:400)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:255)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:659)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:595)
at org.eclipse.equinox.launcher.Main.run(Main.java:1501)

Re: TOS for Data Quality - Column refreshing issues

Sebastiao_Qlik — Mon, 19 Aug 2019 13:17:33 GMT

Hi Claire,

Unfortunately, this looks like a bug.

Meanwhile, did you try to restart the Studio?

Do you still have the null pointer issue?

About the type, you should be able to manually modify it in the column analysis (even though it should have been detected correctly). Did you try to modify it?

We're going to take a look at this in more details and we'll try to reproduce it.

We'll come back to you soon.

Thanks for raising this issue.

Sebastiao.

Re: TOS for Data Quality - Column refreshing issues

Anonymous — Tue, 20 Aug 2019 09:13:21 GMT

Hi Sebastiao,

Thanks for your answer.

I tried restarting the studio several times before posting this, I always had the same error.

Yes, the type was just a hint that something was wrong. But either way the analysis would not run.

(In the meantime, I had to switch to another data quality tool, so I'm not going to test the error again for the moment.)

Maybe I'm missing a java component or something?

Claire.

Re: TOS for Data Quality - Column refreshing issues

Sebastiao_Qlik — Tue, 20 Aug 2019 09:35:02 GMT

Hi Claire,

I'm sad that you are not using TOS for DQ anymore now.

Feel free to feedback to us what you are missing.

The issue you raised has been confirmed as a bug: https://jira.talendforge.org/browse/TDQ-17429

We'll work on it to resolve it soon.

Thanks