Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi Team,
I have recently came across quite weird issue and unable to understand it's root cause.
Here, is the details.
We are monitoring the pipeline by checking the check box in advanced tab of each connecting main line. Also, we are logging the stats,log,meter details in the files at job level. Until this setting everything is working fine. Now, recently we have change this properties to Project level and logging the details in files for all three stats,log and meter along with added new change to log only stats on database level as we need to show the job run details through table on UI.
After this recent change, we came across this error as below and it seems something with inserting data for stats in our Postgres DB. However, it will insert the Begin state but unable to add the end state row in DB whereas in file we are getting both begin and end for the same job.
Error
-----------------------------------------------------------
[statistics] connecting to socket on port 3599
[statistics] connected
Exception in component talendMeter_DB (VMRJORDER_EXTRT_POP)
org.postgresql.util.PSQLException: ERROR: zero-length delimited identifier at or near """"
Position: 25
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2440)
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2183)
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308)
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365)
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:307)
at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:293)
at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:270)
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:266)
at migration.vmrjorder_extrt_pop_0_1.VMRJORDER_EXTRT_POP.talendMeter_METTERProcess(VMRJORDER_EXTRT_POP.java:7272)
at migration.vmrjorder_extrt_pop_0_1.VMRJORDER_EXTRT_POP.tDBInput_1Process(VMRJORDER_EXTRT_POP.java:2389)
at migration.vmrjorder_extrt_pop_0_1.VMRJORDER_EXTRT_POP.tDBRow_1Process(VMRJORDER_EXTRT_POP.java:825)
at migration.vmrjorder_extrt_pop_0_1.VMRJORDER_EXTRT_POP.runJobInTOS(VMRJORDER_EXTRT_POP.java:8196)
at migration.vmrjorder_extrt_pop_0_1.VMRJORDER_EXTRT_POP.main(VMRJORDER_EXTRT_POP.java:8021)
Batch entry 0 INSERT INTO "vmrctta1"."stats" ("moment","pid","father_pid","root_pid","system_pid","project","job","job_repository_id","job_version","context","origin","message_type","message","duration") VALUES ('2019-09-24 17:40:58.903+05:30','SdNebb','SdNebb','SdNebb',536,'MIGRATION','VMRJORDER_EXTRT_POP','_HgGCAN3CEemVHMpQt77UPA','0.1','Default',NULL,'end','failure',6031) was aborted: ERROR: current transaction is aborted, commands ignored until end of transaction block Call getNextException to see other errors in the batch.
caused by: ERROR: current transaction is aborted, commands ignored until end of transaction block
[statistics] disconnected
--------------------------------------------------------------
Screenshots as below for each respective page.
Job details with Monitored set
Project level setting
File level Job Begin and End entry
DB level Job missing end entry
Kindly suggest as we need the DB entry for Job begin and end state to display in UI.
We are using Talend Open source.
Hi,
The error message in your job is as below.
ERROR: zero-length delimited identifier at or near """"
Position: 25
Could you please try to make all columns as Nullable and then try to load the data?
Warm Regards,
Nikhil Thampi
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved
@nthampiThanks for your reply. I check the stats table structure but there is no non-nullable column.
Please find the below DDL for the same.
CREATE TABLE vmrctta1.stats (
moment timestamp NULL,
pid varchar(20) NULL,
father_pid varchar(20) NULL,
root_pid varchar(20) NULL,
system_pid int8 NULL,
project varchar(50) NULL,
job varchar(255) NULL,
job_repository_id varchar(255) NULL,
job_version varchar(255) NULL,
context varchar(50) NULL,
origin varchar(255) NULL,
message_type varchar(255) NULL,
message varchar(255) NULL,
duration int8 NULL
);
Please suggest.
Talend Team, Any update on this?
Hi,
This is triggered by a PostgreSQL error where it will not allow double quotes around an empty string.
Please refer the below link for similar issues.
Now, this error might be coming either from one of your adhoc Insert statements or through automated insert statements generated by Talend during logging time. If its from any automated flow (like logging of stat component, then I would advise to raise a ticket through Talend Support team so that Product team can verify whether its a bug.
Warm Regards,
Nikhil Thampi
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved
@nthampiYes, it's automated insert. Can you please provide the link to raise the issue.