topic Re: Talend and R Integration in Talend Studio

Talend and R Integration

Anonymous — Tue, 21 Feb 2017 19:48:41 GMT

Hi All,
We have a requirement for running an R Model to produce some results for us. The flow we would like to go with is:
SnowFlakes(Data Warehouse) -- > tExecuteRScript ----> SQL Server
I want to pull data from snowflakes which is in the cloud and then pass the data through the R script and store the output to SQL server. I have installed the tExecuteRscript but for some reason I am not able to establish a connection between SnowFlakes and R. Any help will be appreciated.
Thanks

Re: Talend and R Integration

vapukov — Tue, 21 Feb 2017 21:30:52 GMT

https://gabrielebaldassarre.com/talend/texecuterscript/

Please note that this is a starting/generating component, not a processing component. This means that incoming data connections are not allowed here.
To use it, just write down in the box the code you want to be executed by R. Please note this must be correctly quoted and escaped. Alternatively, you can source a code from an external .R file.

You can read this site, in this case Your flow must be
SnowFlake -> local storage (csv ?) -> R-Script which load and calculate result -> Store Result somewhere -> load result to SQL Server

or You can test SQL Server 2016 with R-Service installed
in last case Your flow will be
SnowFlake -> SQL Server table -> tMSSQLrow (call r-script from T-SQL)

Re: Talend and R Integration

Anonymous — Tue, 21 Feb 2017 21:37:09 GMT

Thanks for your response. I tried that as well, but the tFileOutputDelimited component does not establish a connection with tExecuteRScript.
The flow was like
Snowflakes-->tFileOutputDelimited--->tExecuteRScript--->Sql Server

Re: Talend and R Integration

Anonymous — Wed, 22 Feb 2017 15:33:03 GMT

Hi All,
Any help on this topic is apprecaited.

Re: Talend and R Integration

vapukov — Thu, 23 Feb 2017 09:00:38 GMT

tFileOutputDelimited could not be connected with tExecuteRScript
use OnSubJobOk (or OnComponentOk) instead

Re: Talend and R Integration

Anonymous — Thu, 23 Feb 2017 14:07:00 GMT

Yes I did that and it was getting connected. Thanks for the suggestion.

Re: Talend and R Integration

Anonymous — Fri, 24 Feb 2017 15:37:37 GMT

Hi Vapukov,
I am getting the below error. Could you please let me know if this is something you have faced earlier. Sorry I am new to Talend:
As no loop expression was given, the biggest column of data will actually limit the number of iterations
Exception in component tExecuteRScript_2
java.lang.NullPointerException
at org.gabrielebaldassarre.customcode.jri.tJRISymbol.evaluate(tJRISymbol.java:29)
at org.gabrielebaldassarre.customcode.jri.tJRISilentClientImpl.evaluateSymbol(tJRISilentClientImpl.java:31)
at org.gabrielebaldassarre.customcode.jri.tJRIFlowBehaviour.visit(tJRIFlowBehaviour.java:55)
at test__java.rmodel_0_1.RModel.tExecuteRScript_2Process(RModel.java:1873)
at test__java.rmodel_0_1.RModel.tSnowflakeInput_1Process(RModel.java:1069)
at test__java.rmodel_0_1.RModel.runJobInTOS(RModel.java:2395)
at test__java.rmodel_0_1.RModel.main(RModel.java:2229)
: test__java.rmodel_0_1.RModel - tExecuteRScript_2 null

Re: Talend and R Integration

Anonymous — Fri, 24 Feb 2017 19:36:08 GMT

Any help on the same is appreciated.

Re: Talend and R Integration

Anonymous — Fri, 24 Feb 2017 21:22:58 GMT

Hi All,
Below is the error that we get although we installed all the required packages:
Error in library(dplyr) : there is no package called 'dplyr'
As no loop expression was given, the biggest column of data will actually limit the number of iterations
Evaluating expression: 'is.integer(x)'
Error: object 'x' not found
Exception in component tExecuteRScript_2
java.lang.NullPointerException
at org.gabrielebaldassarre.customcode.jri.tJRISymbol.evaluate(tJRISymbol.java:29)
at org.gabrielebaldassarre.customcode.jri.tJRIStandardClientImpl.evaluateSymbol(tJRIStandardClientImpl.java:82)
at org.gabrielebaldassarre.customcode.jri.tJRIFlowBehaviour.visit(tJRIFlowBehaviour.java:55)
at test__java.rmodel_0_1.RModel.tExecuteRScript_2Process(RModel.java:1882)
at test__java.rmodel_0_1.RModel.tSnowflakeInput_1Process(RModel.java:1078)
at test__java.rmodel_0_1.RModel.runJobInTOS(RModel.java:2404)
at test__java.rmodel_0_1.RModel.main(RModel.java:2238)
: test__java.rmodel_0_1.RModel - tExecuteRScript_2 null
Any help on the above error is appreciated

Re: Talend and R Integration

Anonymous — Mon, 27 Feb 2017 19:14:00 GMT

Any help on the above will be appreciated.

Re: Talend and R Integration

Anonymous — Mon, 15 Apr 2019 16:50:59 GMT

hi,

how to get texecuteRscript activity available in talend. please help with details on what component / packages to install