Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
See why IDC MarketScape names Qlik a 2025 Leader! Read more
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

parsing and extract json

Hello,

 In fact, I just started working with Talend open studio for data integration; I want to export an array long json and I want to transform the data coming from JSON by using Talend to organize and store them in a SQL database and sqlserver

my json:  https://security-tracker.debian.org/tracker/data/json

How I would like the output to look like:

Package
 
CVE
 
Scope
 
Debian bug
 
description
 
status
 
fixed_version
 
urgency 
 
             

I attach all the configuration photos of my components and the code; can someone help me?

I have two problems :

1: first I couldn't extract the package name; I attach a picture of my json file; in fact CVEs are categorized in different packages, CVEs extract good but I want to add a column Package in my DB ; I don't know what to add in tjava for node extraction from each cves that is called package

0683p000009M5qA.png

2: I found a problem my codes do not extract all the CVEs well for example in my source I have CVE-2019_3462 but my job does not extract it, I could not find what is  the problem 

 

Does anyone have any advice or ideas on how I can achieve this?

 

I use "Talend open studio for data integration version 7.1.1.2018102681147

 

Thank you very much for your time and help

Best regard

0683p000009M56B.png0683p000009M56G.png0683p000009Lzhk.png0683p000009M55x.png0683p000009M4gP.png0683p000009M56u.png

Labels (3)
18 Replies
Anonymous
Not applicable
Author

Ram: 8 g, I've already tested it but it shows the same problem0683p000009M63n.png

Anonymous
Not applicable
Author

This is very strange. I am running the same job (I recreated it) with the standard 1024MB assigned to a job. My version will run with no issues whatsoever. I get the same number of rows displayed by your job. Can you replace the tLogRow component with another one? Simply delete it and add a new one. Leave the standard settings for the tLogRow.

Anonymous
Not applicable
Author

no I rebuilt the job with the new components and tested it but it shows the same problem. in any case I thank you very much

Anonymous
Not applicable
Author

This could be related to the Studio I guess. Take a look here (https://community.talend.com/t5/Migration-Configuration-and/Allocating-more-memory-to-Talend-Studio/...) and make some of the changes suggested.

 

How much RAM does you computer have?

Anonymous
Not applicable
Author

thanks for the site but I've already made this change.finally, I managed to solve the problem by reinstalling another talend version; I'm tired because it doesn't work well and the cve columns are null

regards

0683p000009M5XX.png

 

 

Anonymous
Not applicable
Author

What version are you using? If it is v7.1.1 the attached job should be OK to be imported into your Studio. It will retrieve every CVE attached to a Package and returns the JSON for every CVE so that you can return the data associated to every CVE. Take a look at it to see how I achieved this. The problem you had was with dynamic arrays of key values. This solution can be extrapolated from to solve other similar issues.

Anonymous
Not applicable
Author

I now use version 7.1.1 . Thank you for attaching but I think there is a mistake to send the project.
it's for other projects

regards

0683p000009M65F.png

Anonymous
Not applicable
Author

You are correct. I was working on another demonstration at the time and sent the wrong one. The one attached here is the correct one. Sorry about that.


test1234.zip
Anonymous
Not applicable
Author

I thank you very much. You help me a lot.

regards