topic Re: tGoogleAnalyticsInput help required. in Talend Studio

tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 09:53:39 GMT

Hi,
I want to fetch Google Analytics (GA) data. For this, my friend added my google email as a user to his website GA. Now i can view his GA reports through my id. So this part is done.
I want to discuss three fields of tGoogleAnalyticsInput,
1.Application Name: Although it is not required but what should i enter here?
2.Service Account Email: i have given my google email address here as it has already been added as mentioned above.
3.Key File (*.p12): This is what confuses me. I've generated a p12 key file by turning my Analytics API to ON and following the required process.
My question is related to the 3rd field. Should i use p12 file that i generated or should i ask my friend to provide me his p12 key file?
any idea? Thanks in advance.
regards,
abdul.

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 11:03:26 GMT

Hi,
Attached is my component settings.
regards,

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 12:18:58 GMT

At first, there is a documentation and there is always the possibility to contact me. There is absolute no reason to rate a component badly because of the lack of own knowlegde!
You should NOT use your own email address! You have to use the email address of your service account.
And to avoid your next stupid bad rating: Please add your service account email as user to all profiles you need to gather data.
Please keep in mind, the rating system should give users a hint about the quality of the component and not about the quality of developers which have less interest in communication and reading manuals.

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 12:57:13 GMT

Hi jlolling,
To be honest, i was looking for you on this post.
Sorry about that rating but my purpose, to post this link there, was just to gather attention of concerned persons. I will update my rating. Its is certainly worth appreciating if someone is working on custom components to make our tasks easier.
About the email address, I have added the service account email (see attached images) now but it still returns nothing.
btw, i tried fetching data from https://developers.google.com/apis-explorer/#s/analytics/v3/analytics.data.ga.get and it returns data correctly.
can u please explain a bit?
Thanks for replying.
regards,
abdul.

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 13:05:09 GMT

no need to be rude jlolling. As i said, i will update it

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 13:16:52 GMT

Sorry for my writing but it makes me angry if developers actually say: "your work is crap" because of a lack of knowledge. It is not the first time I am facing that problem.
Ok back to your problem: There is not result? That sound unusually. In your dimension is actually a metric, I am a bit surprised about this works for you.
I have tried your dimensions and metrics and get an exception because of the invalid usage of a metric as dimension.
You are sure there is no exception in your run console window?
Please take a look to the reference:
https://developers.google.com/analytics/devguides/reporting/core/v3/reference
Here you get an complete descriptions about dimensions and metrics, and please do not mix them up.

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 14:58:29 GMT

its perfectly ok.
well according to this https://developers.google.com/analytics/devguides/reporting/core/dimsmets/visitor#ga:visitCount
visitCount is a dimension. since it is optional, that is not my concern. There was no error with this dimension/metric combination as can be seen in attached image.
Since i'm taking my friend's help to add my email as a user to his webiste's GA, i've confusions about the whole process. Let me state steps i did to make it work.
1. My friend has a website with GA integrated, he added my google email as user. Now i was able to view hi stats through my google analytics home page.
2. Then i turned ON my Analytics API services and also added one service account. I also downloaded p12 key file associated to this service account.
3. My friend also added this service account email as user to his GA. He also provided me Profile Id.
That is all i need to make a data fetch request through tGoogleAnalyticsInput. But it returns nothing.
Please let me know that what is the point that i may be missing.
regards,
abdul

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 15:23:16 GMT

Could you please check this:
Please select the google component and switch to the code view.
Between the section start and stop
must be a lot of code where you find your given attributes.
There is an annoying bug in Talend that prevents the job from getting the necessary code from the component.

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 15:27:37 GMT

In which way you have installed the user components?

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 16:29:55 GMT

Thanks for looking into it in detail.
This is the code you asked for
"
/**
* start
*/
ok_Hash.put("tGoogleAnalyticsInput_1", false);
start_Hash.put("tGoogleAnalyticsInput_1",
System.currentTimeMillis());
currentComponent = "tGoogleAnalyticsInput_1";
int tos_count_tGoogleAnalyticsInput_1 = 0;
/**
* stop
*/
/**
* start
*/
"
and there is nothing in it.
I used this https://help.talend.com/search/all?query=Installing+a+custom+component&content-lang=en to install the custom component.
regards,
abdul.

Re: tGoogleAnalyticsInput help required.

Anonymous — Thu, 23 May 2013 21:54:46 GMT

There is an annoying bug in Talend that prevents the job from getting the necessary code from the component.

Hi Jan,
Sorry for popping up in your thread, but I suppose you have reported this issue already in JIRA?
Cheers,
Elisa

Re: tGoogleAnalyticsInput help required.

Anonymous — Fri, 02 Aug 2013 01:53:55 GMT

Yes I have created an JIRA ticket to this issue.
@abdul: Please try this:
1. remove the file <studio_install_dir>/configuration/ComponentCache.javacache
2. check if the component is in the folder for user components (sometimes also called custom components)
3. open your preferences and navigate to Talend->Component and click on Apply.
Alternatively you can install the component via the Exchange view, this is by far the best way.

Re: tGoogleAnalyticsInput help required.

_AnonymousUser — Wed, 23 Jul 2014 13:49:42 GMT

Hi
i want to keep this value in a column with the data i extracted from GA. any idea how can i put this return value(CONTAINS_SAMPLED_DATA) in the data for each row.
if not possible top put this in the data flow. i want to throw and exception in tjava if this value is true? and don't know how to acess this value ???
CONTAINS_SAMPLED_DATA
--------------------------------
want to acess this values and store them.
Return values
Return value
Content
ERROR_MESSAGE
Last error message
NB_LINE
Number of delivered lines
CONTAINS_SAMPLED_DATA
True if data are sampled, means not exactly
calculated. This can happen if you query to
many details.
SAMPLE_SIZE
The amount of datasets used for the query
SAMPLE_SPACE
The amount of available datasets for this query
TOTAL_AFFECTED_ROWS
Number of rows which are collected by Google
to calculate the result.

Re: tGoogleAnalyticsInput help required.

Anonymous — Fri, 06 Feb 2015 06:17:40 GMT

Hi jlolling
I need help with the tGoogleAnalyticsInput talend component. I have configured the job as per above comments but still im getting the below error. Please can you provide some help. Also attaching the screenshot of configuration and error.

Exception in component tGoogleAnalyticsInput_1
com.google.api.client.auth.oauth2.TokenResponseException: 400 Bad Request
{
"error" : "invalid_grant"
}
Also i set the clock on my machine(On which talend is running) to sync time with internet. All screenshot attached below.

Re: tGoogleAnalyticsInput help required.

Anonymous — Sat, 07 Feb 2015 07:44:33 GMT

Did you have enabled the access to the Analytics API in the Developer Console?
No this is not the problem. Please check if you have used the correct view-ID or better please check your request at first in the Google API Explorer.
Here the the google advices about errors:
https://developers.google.com/analytics/devguides/reporting/core/v3/coreErrors
and here the API explorer:
https://developers.google.com/apis-explorer/#s/analytics/v3/analytics.data.ga.get

Re: tGoogleAnalyticsInput help required.

Anonymous — Tue, 10 Feb 2015 07:05:28 GMT

Thanks jlolling for the response,
All of the configuration were valid.but the issue was related to my silly mistake, there was leading space in the service account email ID in entered.It is resolved and job worked perfectly.
Thanks
Puneet

Re: tGoogleAnalyticsInput help required.

Anonymous — Tue, 10 Feb 2015 07:18:13 GMT

Ok, I will take care in the next release such kind of mistakes does not matter anymore.

Re: tGoogleAnalyticsInput help required.

Anonymous — Wed, 18 Feb 2015 15:15:01 GMT

I get a similar error:
Exception in component tGoogleAnalyticsInput_1
com.google.api.client.auth.oauth2.TokenResponseException: 400 Bad Request
{
"error" : "invalid_grant"
}
    at com.google.api.client.auth.oauth2.TokenResponseException.from(TokenResponseException.java:105)
    at com.google.api.client.auth.oauth2.TokenRequest.executeUnparsed(TokenRequest.java:287)
    at com.google.api.client.auth.oauth2.TokenRequest.execute(TokenRequest.java:307)
    at com.google.api.client.googleapis.auth.oauth2.GoogleCredential.executeRefreshToken(GoogleCredential.java:384)
    at com.google.api.client.auth.oauth2.Credential.refreshToken(Credential.java:489)
    at com.google.api.client.auth.oauth2.Credential.intercept(Credential.java:217)
    at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:859)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:410)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:343)
disconnected
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:460)
    at de.jlo.talendcomp.googleanalytics.GoogleAnalyticsInput.executeDataQuery(GoogleAnalyticsInput.java:352)
    at de.jlo.talendcomp.googleanalytics.GoogleAnalyticsInput.executeQuery(GoogleAnalyticsInput.java:417)
    at test.googleanalytics_0_1.googleAnalytics.tGoogleAnalyticsInput_1Process(googleAnalytics.java:575)
    at test.googleanalytics_0_1.googleAnalytics.runJobInTOS(googleAnalytics.java:1058)
    at test.googleanalytics_0_1.googleAnalytics.main(googleAnalytics.java:916)
No clues...

Re: tGoogleAnalyticsInput help required.

Anonymous — Wed, 18 Feb 2015 15:19:08 GMT

Check this:
https://developers.google.com/analytics/devguides/reporting/core/v3/gdataAuthorization
and
https://developers.google.com/analytics/devguides/reporting/core/v3/coreErrors

Re: tGoogleAnalyticsInput help required.

Anonymous — Tue, 13 Oct 2015 00:36:50 GMT

jlolling,
Great piece of code. Thanks.
Quick question what is the best way to get the meta data from the various Google Analytics reports? I saw that someone was using a PreJob component before the tGoogleAnalyticsInput module. Is that required?
Thank sin advance.

Patrick