topic Re: Merge 2 output lines into 1 single line in Talend Studio

Merge 2 output lines into 1 single line

julien2022 — Thu, 09 Jun 2022 15:39:15 GMT

Hi all

I'm a total newbie into Talend 🙂

I'm using tSSH component in order to execute 2 commands on a Linux server, to get the date + the temperature :

"date +\"%Y-%m-%d %T\"; sensors |grep Package"

This gives me this output :

As you can see, the output gives me 2 lines

the first one for the date
the second one for the temperature

In order to be able to use this input for powerBI, I would like to get this output into one signle line.

Basically, what I'm willing to get should look like :

2022-06-09 17:29:55 Package id 0: +44.0 .......

Could you please help me to get this reslut? What is the component I need to use?

I've already tried with tNormalise, tDenormalize but did not manage to get what I'm looking for.

Many thanks in advance for your help! 🙂

Kind regards,

Julien

Re: Merge 2 output lines into 1 single line

Anonymous — Thu, 09 Jun 2022 16:05:39 GMT

I presume that you are sending the output to the globalMap using the functionality of the component? If so, you can achieve this with some Java String manipulation. The process for doing this will be to let this tSSH component run and connect it to a tJavaFlex using an OnComponentOK link. The tJavaFlex will need the String manipulation code in the Main section.

I am not sure of the exact text that the tSSH is returning as it is in a screenshot. But if you are not familiar with Java String manipulation, get the output sent to the globalMap, print it the screen from the tJavaFlex and then send us the returned text EXACTLY in text format. I will take a look and see what is best.

Re: Merge 2 output lines into 1 single line

julien2022 — Thu, 09 Jun 2022 17:24:39 GMT

Thanks for your feedback

This is the exact output that I get on the console :

Démarrage du Job nuc à 19:18 09/06/2022.

[statistics] connecting to socket on port 3939

[statistics] connected

[WARN ] 19:19:00 org.apache.sshd.client.keyverifier.AcceptAllServerKeyVerifier- Server at /192.168.1.80:22 presented unverified EC key: SHA256:8+S46OmYvVoC26F0T6tOMlOVGbjIBI6jjTq8bXze1Hs

[WARN ] 19:19:01 org.apache.sshd.client.session.ClientConnectionService- globalRequest(ClientConnectionService[ClientSessionImpl[root@/192.168.1.80:22]])[hostkeys-00@openssh.com, want-reply=false] failed (SshException) to process: EdDSA provider not supported

2022-06-09 19:19:01

Package id 0: +45.0�C (high = +100.0�C, crit = +100.0�C)

[statistics] disconnected

Job nuc terminé à 19:19 09/06/2022. [Code de sortie = 0]

****

In fact, what I would like to achieve is :

Insead of :

2022-06-09 19:19:01

Package id 0: +45.0�C (high = +100.0�C, crit = +100.0�C)

I need :

2022-06-09 19:19:01 Package id 0: +45.0�C (high = +100.0�C, crit = +100.0�C)

Or, more generaly, if I use these commands, for an other exemple :

date +\"%Y-%m-%d %T\"; pwd

Instead of getting this (each command on a seperate line) :

2022-06-09 19:21:24

/root

I need the result of the 2 commands on the same line :

2022-06-09 19:21:24 /root

What is the component I need to use to reach that?

Many thanks in advance.

Julien

Re: Merge 2 output lines into 1 single line

InfoCraft — Thu, 09 Jun 2022 18:48:14 GMT

Hello, qu'est ce que ça donne quand tu mets la sortie en normal ?

Re: Merge 2 output lines into 1 single line

julien2022 — Thu, 09 Jun 2022 19:09:44 GMT

Hello

Merci pour la réponse en français 🙂

En fait, ca donne toujours 2 lignes :

Mais cela provient, basiquement, du fait que j'exécute 2 commandes via le tShell

Si j'en exécutais 3 :

J'aurais 3 lignes :

Ce que je voudrais, c'est afficher le résultat de mes N commandes sur 1 seule ligne.

Re: Merge 2 output lines into 1 single line

julien2022 — Thu, 09 Jun 2022 19:16:20 GMT

J'ai aussi essayé ça :

Mais le résultat est toujours sur 3 lignes distinctes :

Re: Merge 2 output lines into 1 single line

InfoCraft — Thu, 09 Jun 2022 20:34:08 GMT

Bonsoir,

Dans ce cas là, essai ainsi

*** Petit test

NB. tu peux personnaliser le séparateur en mettant espace" " à la place de ";" ou autres...

Re: Merge 2 output lines into 1 single line

Anonymous — Fri, 10 Jun 2022 00:34:03 GMT

Interesting nickname @not specified not specified 😷

It seems I misinterpreted the requirement here and started a path that wasn't required. Thanks for picking this up and creating the right solution 👍

Re: Merge 2 output lines into 1 single line

julien2022 — Fri, 10 Jun 2022 08:27:35 GMT

I'll go ahead in english, to get more poeple able to help, hopefully 😉

Many thanks for help.

The feedback you gave seems to be the right direction.

But for a reason I don't understand, it still doesn't work for me 😔

The result I get is still on multiple lines, instead of being into 1 single line.

Here are some details, if that can help understanding what is not fine :

3 commands executed to Linux host, with tShell, with "normal" output

outputline :

tlogRow_1 :

tDenormalize :

tlogRow_2 :

My aim is to get :

/home/julien; debian11; 9

Insead of getting this (bad) result :

/home/julien

debian11

There might be something set incorrectly, but I don't know what....

If you could help me clarifying that, it would be really great!! 😀

Many thanks in advance!

Regards,

Julien

Re: Merge 2 output lines into 1 single line

InfoCraft — Fri, 10 Jun 2022 08:53:01 GMT

Thank you, 😂 yes I created my account in the middle of the covid19 pandemic👹 , so it was the only idea that came to my mind

Re: Merge 2 output lines into 1 single line

julien2022 — Fri, 10 Jun 2022 08:57:33 GMT

I've tried with a simple file :

And the Denormalization is working fine :

So I think my issue is focused on the output from the 3 commands

=> maybe the result of these 3 commands are NOT seen as 3 "real" lines ??? 😕

But why??

Here is the tlogrow result of these 3 commands :

Re: Merge 2 output lines into 1 single line

InfoCraft — Fri, 10 Jun 2022 09:03:54 GMT

I see a single row at the output of the tDenormalize_1 component.

which would mean that the response contains carriage returns ===> Put a tJavaRow to replace the carriage return with ; ===> "\n"-->";"

Re: Merge 2 output lines into 1 single line

julien2022 — Fri, 10 Jun 2022 09:14:13 GMT

Sorry, I'm discovering the tJavaRow component, and am not familiar at all with it....

But for sure, there is something around the carriage returns (see my other post : the output of the 3 shell commands seem not seen as 3 real lines).

I've tried something, but doesn't work (there was 0,1% chance it worked.... 😂

Could you please precise how I should use this tJavaRow?

Re: Merge 2 output lines into 1 single line

InfoCraft — Fri, 10 Jun 2022 09:20:31 GMT

Contact me in private if you still can't find the solution, so as not to pollute the discussion

Re: Merge 2 output lines into 1 single line

julien2022 — Fri, 10 Jun 2022 13:12:07 GMT

Many many thanks to you, dear @not specified not specified !!! 😊

Thanks to your help, I've managed to get what I expected, by using this tJavaRow component :

The results of the command are now displayed on a single row, which is what I was looking for.👍

Just on last point (which is not blocking, but would be nice if you had an idea) :

in order to write the result to a file, I'm using tFileOutputDelimited.

But the (little) issue I have is that it gives a blank line between each result :

Do you have any idea how I can delete these empty lines?

Re: Merge 2 output lines into 1 single line

InfoCraft — Fri, 10 Jun 2022 15:23:21 GMT

Bravoo👏

try replacing "\n" with "\r\n" if that doesn't work ⏬ 2️⃣
to avoid complicating your task, put a tFilterRow between tJava and tFileOutputDelimited

NB. Next time, to avoid this kind of problem copy the result of your commands and paste in NotePad++ then activate the "show all characters" button to get an idea before developing.

Re: Merge 2 output lines into 1 single line

julien2022 — Fri, 10 Jun 2022 16:13:15 GMT

You're a real beast!! 😊

Many thanks again, that worked perfectly with tFilterRow :

I'm now getting the exact result I was looking for, that means :

the result of the 3 commands into 1 single line
no empty line btw each execution of the job

Perfect!!

Thank you very much again and enjoy your weekend! 😎

Julien