topic Re: Using RSSInput to get Atom Feed pubdate in Talend Studio

Using RSSInput to get Atom Feed pubdate

Anonymous — Sat, 16 Nov 2024 14:10:50 GMT

I am trying to extract a Twitter feed using tRSSInput in TOS 3.0 in Java. I have used tRSSIput successfully before for RSS feeds. Twitter is an Atom feed. When I use following link (or any link for that matter).
http://search.twitter.com/search.atom?lang=en&q=obama&rpp=10&page=2&show_user=true
This is the sample output I get in tLogRow (TITLE, DESCRIPTION, NULL DATE, LINK)
geek3point0: I say let barack obama redistribute wealth until I sit above the 100k mark then kick him out....|geek3point0: I say let barack obama redistribute wealth until I sit above the 100k mark then kick him out....|| http://twitter.com/geek3point0/statuses/980112990
luv2shoppe: Ret: @larrymwalkerjr Reading: JUST WORDS? Obama's Four Tax Plans In Four Days http://tinyurl.com/6hhhx4 |luv2shoppe: Ret: @larrymwalkerjr Reading: JUST WORDS? Obama's Four Tax Plans In Four Days http://tinyurl.com/6hhhx4 || http://twitter.com/luv2shoppe/statuses/980112976
I do get the Title, Description as well as the Link elements. But my date element is always NULL (with other real RSS feeds, I have gotten date). Date is very important for my analysis. Is there anyway I can do this with tRSSInput or using any other component in Talend? I know I can write some Curl/PHP or something to get this information but I want to keep all my work in Talend if possible. Please let me know if any of you have attempted something similar.
Regards,
Sean

Re: Using RSSInput to get Atom Feed pubdate

Anonymous — Wed, 29 Oct 2008 06:00:15 GMT

A follow up to my above question.
Twitter also gives a JSON feed. JSON is getting to be quite standard. I was examining this field and it gives more in-depth information. Is there anyway I can read that feed and more importantly parse it in Talend?
A sample JSON will be:
http://search.twitter.com/search.json?lang=en&q=obama&rpp=10&page=2&show_user=true
Thanks
Sean

Re: Using RSSInput to get Atom Feed pubdate

Anonymous — Wed, 29 Oct 2008 19:52:44 GMT

I hope someone can answer my questions above. I really do not want to use PHP etc. for this and keep everything nicely in TOS. I'm going to try to use Web Service component and see if I can achieve the same results as tRSSInput.
Sean

Re: Using RSSInput to get Atom Feed pubdate

Anonymous — Mon, 06 Jun 2011 12:40:35 GMT

Hi,
Is your problem solve ?
I need to dowload a lot of tweet (from a lot of twitter account).
Do you have a solution ?
Regards

Re: Using RSSInput to get Atom Feed pubdate

Anonymous — Tue, 07 Jun 2011 08:32:47 GMT

Hi Scots
This is topic is rather old, please report a new topic with details, we will answer you on new topic.
Best regards
Shong