topic Re: Reading java or protobuf object in Talend Studio

Reading java or protobuf object

Anonymous — Sat, 16 Nov 2024 13:25:59 GMT

I have a senario where I recieve real time java or protobuf objects. I need to extract data from those object and store into database. Is there a way in Talend where I can take java object as input and extract fields of that object.

Re: Reading java or protobuf object

Anonymous — Fri, 14 May 2010 07:17:00 GMT

Hello
There is no component can extract records from an Java object directly, you have to hard code and create an routine to do that, and then call the routine on tJavaRow, for example:
input flow----tJavaRow--tMysqlOutput
on tJavaRow:
output_row.id=RoutineName.getID(input_row.Java object column);

Best regards
Shong

Re: Reading java or protobuf object

Anonymous — Fri, 14 May 2010 07:57:32 GMT

What should be content of routine? The method getID which you have specified takes object property and returns string. But how we will take object as input flow.

Re: Reading java or protobuf object

Anonymous — Fri, 14 May 2010 08:05:21 GMT

Hello

What should be content of routine? The method getID which you have specified takes object property and returns string. But how we will take object as input flow.

It is just my thinking, where does your java ojbect come from and what data do you want to extract?
Best regards
Shong

Re: Reading java or protobuf object

Anonymous — Fri, 21 May 2010 11:19:40 GMT

I have created a routine which will read java object and Using reflection I get values of all the fields of object in the form
id,name,age,course
2,ss,14,science
as one string.
Now I want to use this routine as input so that I can use it in my application which keep on getting object and they are converted into string and we can perform transformation on that data.
How can I use this routine as input or how to create component from that routine.
If require that piece of code I can paste it.

Re: Reading java or protobuf object

Anonymous — Fri, 21 May 2010 14:54:42 GMT

You can use a tfixedflowinput, to read your string, and with a tmap, you can split it in the schema :id,name,age,course

Re: Reading java or protobuf object

Anonymous — Mon, 24 May 2010 04:55:43 GMT

how to make my java routine as input flow in talend.

Re: Reading java or protobuf object

Anonymous — Mon, 24 May 2010 05:00:24 GMT

Can I make my java routine as component. How can I create my own component

Re: Reading java or protobuf object

Anonymous — Mon, 24 May 2010 08:28:33 GMT

Please help me. If you want I can send you my java program. i want to use that java program as input

Re: Reading java or protobuf object

Anonymous — Mon, 24 May 2010 11:30:11 GMT

Hello
What's the return type of your routine? You can call the routine on tfixedFlowInput, set the value as:
RoutineName.Methodname(parameters)
Best regards
Shong

Re: Reading java or protobuf object

Anonymous — Tue, 25 May 2010 06:31:55 GMT

routine returns string. How to use my routine in tFixedFlowInput.
my Routine is --
public class ReadObject {

public static String getString(Object obj) {
String str=objectToString(obj);
return str;
}
public static String objectToString(Object obj)
{
StringBuilder result = new StringBuilder();
StringBuilder result1 = new StringBuilder();

Field[] fields = obj.getClass().getDeclaredFields();
//print field names paired with their values
for ( Field field : fields ) {
try {
result.append( field.getName() );
result.append(",");
//requires access to private field:
field.setAccessible(true);
result1.append( field.get(obj) );
result1.append(",");
}
catch ( IllegalAccessException ex ) {
System.out.println(ex);
}

}
result.append("\n");
result.append(result1);
return result.toString();
}
}

Re: Reading java or protobuf object

Anonymous — Tue, 25 May 2010 08:13:35 GMT

Hello
Please see my screenshot.
Best regards
Shong

Re: Reading java or protobuf object

Anonymous — Tue, 25 May 2010 09:46:22 GMT

I want to use this code outside talend in my eclipse which will call this piece of code to pass object.how can I use this code outside talend.

Re: Reading java or protobuf object

Anonymous — Tue, 25 May 2010 10:49:48 GMT

Hello
You can write this piece of code in Eclipse and pass the return string to talend job. See
5932
5658
Best regards
Shong

Re: Reading java or protobuf object

Anonymous — Tue, 25 May 2010 11:44:17 GMT

Shong Thx for your valuable help. It really helped me. I want to know one more thing in tFixedflowInput we specify value as routine method. but i want to ReadObject.getString(new Person("shaky", "15")); should get object from outside talend. In eclipse I should also able to pass object to getString() method

Re: Reading java or protobuf object

Anonymous — Tue, 25 May 2010 12:01:14 GMT

Hello

ReadObject.getString(new Person("shaky", "15")); should get object from outside talend. In eclipse I should also able to pass object to getString() method

Why don't you write getString() method in eclipse and call it in eclipse, return a string and pass string to talend job?
Best regards
Shong

Re: Reading java or protobuf object

Anonymous — Tue, 25 May 2010 12:54:40 GMT

In my design, i get real time object from various networks. I have to pass these object directly to talend job which will perform ETL. That is why I was trying to take java object as input to the talend job. It should be talend job to extract data from object. I need solution around this.

Re: Reading java or protobuf object

Anonymous — Wed, 26 May 2010 02:57:46 GMT

Hello

I want to use this code outside talend in my eclipse which will call this piece of code to pass object.how can I use this code outside talend.

But you said that you want to call this piece of code in Eclipse, outside Talend.
Best regards
Shong

Re: Reading java or protobuf object

Anonymous — Wed, 26 May 2010 05:22:28 GMT

ya, so that I can pass my objects to this talend thorugh another application.

Re: Reading java or protobuf object

Anonymous — Wed, 02 Jun 2010 10:19:36 GMT

I failed to find any solution to pass java object to talend input from outside. Please give me some solution for this. Or for time being how can I pass string to talend input from outside Talend.