Component Creation tutorial: error when doing mvn build

[pashworth]

HI All I have followed the tutorial https://talend.github.io/component-runtime/main/1.1.6/tutorial-create-my-first-component.html. However when I run mvnw clean install it gets to the validation section and gives the error shown below.

[ERROR] Failed to execute goal org.talend.sdk.component:talend-component-maven-plugin:1.1.4:validate (talend-validate) on project tutorial-component: Some error were detected:
[ERROR] - No source instantiable without adding parameters for @DataSet("default") (com.tutorial.components.configuration.TutorialComponentDataSet), please ensure at least a source using this dataset can be used just filling the dataset i
nformation.

I have two questions.

1. What and how do I need to add to the Dataset definition to make it work...

2. How do I turn off validation in the mvn build process. ( I can see an example of how to trun it off but I cannot find the file in which to add the 'false' flag.

Help gratefully received.

Cheers

Phil

[Anonymous]

Hello,

1. You will need to add 2 class or annotate existing one by @Datastore and @Dataset
The Datastore annotation indicate the configuration part that hold the connection properties, and the Dataset annotation mark the class that define the data that will be handled by the component. for example an sql query.
Those two marker will be used by the studio and some talend web application to provide some features like the metadata one in the studio for connection and dataset reuse.

2. You can skip the validation by adding the skip properties to the maven-talend-plugin here is an example of that https://github.com/Talend/connectors-se/blob/master/pom.xml#L385

Also you can find more complete real components example in this repository https://github.com/Talend/connectors-se/

Hopefully it helps.

[pashworth]

Thanks this is a great help.

I am new to Beam and how it works. Could you elaborate on what I would need to add to the @dataset to annotate it ?

It would have been good to have this in the tutorial as it seems to be required to do the basic example.

Many thanks in advance

Phil

[florentlb]

Hi Phil,

Updates are on the way for the tutorials.

There's also some documentation specific to datasets and datastores, here: https://talend.github.io/component-runtime/main/1.1.6/component-configuration.html#dataset-and-datas....

Hope that helps while we work on the tutorials.

Florent

[Anonymous]

Hi Florent,

tin the 1.1.6 documentation it says, "In order for this tutorial to work, use version 1.1.1...",  and in 1.1.1 Data(set/store) are not enforced  in  outputs/processing components. I have tried to no avail to create an output/processing components  using version 1.1(.4.5.6) the validation will not pass even when the datasets and stores are correctly defined. Is this an issue that will be fixed soon? i mentioned this in a post last year and i was told that the documentation will be updated early this year but the issue still seems to be there.

Best Regards

Samba

[florentlb]

Hi Samba,

Yes a fix is coming in the next release and we'll update the docs along with this fix. Sorry it took longer than initially planned.

Should be coming later this week or next week.

Florent

[ypiel]

Hi,

A new issue has been fixed today. It maybe related to your issue : https://jira.talendforge.org/browse/TCOMP-1375

when you had two connectors, the first using a dataset and other required properties, and the second only using the dataset, the validation still raised the error "No source instantiable without adding parameters for @DataSet...." whereas the second connector should have validated it.

Regards.