data duplication

ddd111rgg23 — Tue, 27 Jan 2026 10:45:26 GMT

hello

I tried to combine 2 queries of same data one for 2025 and the other for the previous years,

there are some filed in the query of 2025, and it is not for the previous one.

when i use the final table, it shows duplication of data

this is my query

LIB CONNECT TO 'ERP_PRO';

Qualify *;
//Unqualify MRR_NO, MMR_STATUS_25, CANDIDATE_STATUS_28;
Unqualify MRR_NO, MMR_STATUS_25, CANDIDATE_STATUS_28 ,NATURE_OF_EMPLOYMENT,DEPARTMENT,SECTION ,POSITION,MRR_DIV;

NEW_EMPLOYEE_RECR_STATUS_QUERY:
LOAD
MRR_NO,
IF(ISNULL(DEPARTMENT), 'NOT ENTERED', DEPARTMENT) AS DEPARTMENT,
SECTION,
BUDGET_CENTER,
// POSITION,
Subfield(POSITION, '|', 2) AS POSITION,
IF(ISNULL(GRADE), 'NOT ENTERED', GRADE) AS GRADE,
SOURCE,
PREFERRED_NATIONALITY,
METHOD_OF_RECRUITMENT,
PREVIOUS_EMPLOYEE_NAME,
NATURE_OF_EMPLOYMENT,
DURATION,
WORK_LOCATION,
PROJECTS,
BUDGET_STATUS,
REQUIRED_WITHIN,
EXPERIENCE_REQUIRED,
WORK_OFFICE,
PC_REQUIRED,
REMARK,
CANDIDATE_NAME,
IF(ISNULL(NATIONALITY_HR), 'NOT ENTERED', NATIONALITY_HR) AS NATIONALITY_HR,
EMP_NO,
DATE_REPORTED,
MRR_STATUS,
CANDIDATE_STATUS,
HR_REMARK,
CREATION_DATE,
"TRUNC(PPA.LAST_UPDATE_DATE)",
ANALYSIS_CRITERIA_ID,
EMPLOYEE_NUMBER,
FULL_NAME,
Date(Floor(MRR_CREATION_DATE)) AS MRR_CREATION_DATE,
DEGREE,
MAJOR,
CERTIFICATION
// 'Null' as MRR_DIV
//'Null' as REQUESTER_NUMBER
FROM [lib://HR/NEW_EMPLOYEE_RECR_STATUS_QUERY.qvd] (qvd);

LEFT JOIN (NEW_EMPLOYEE_RECR_STATUS_QUERY)
LOAD
REQUEST_NAME,
REQUESTER_NAME,
REQUESTER_PERSON_ID,
APPROVER,
ACTION,
ROW_TIMESTAMP,
SEGMENT1 AS MRR_NO,
SEGMENT25 AS MMR_STATUS_25,
SEGMENT28 AS CANDIDATE_STATUS_28
FROM [lib://HR/MRR_PER_ANALYSIS_CRITERIA.qvd] (qvd);

LEFT JOIN (NEW_EMPLOYEE_RECR_STATUS_QUERY)
LOAD
"MRR NO" AS MRR_NO,
// "Position Title",
"Position Title" as POSITION,
"Department/Section",
"Budget Center",
Grade,
"if Temp Duration (Months)",
"Candidate Name",
"Nature Of Employment",
"Hiring Manager",
"Basic Salary",
"Housing Allowance",
"Transportation Allowance",
"Cost Of Living Allowance",
"Total Compensation",
"Medical Insurance Coverage",
"Additional Details",
"Offer Status",
CREATION_DATE,
MRR_PERIOD_DAYS,
LAST_UPDATE_DATE,
ANALYSIS_CRITERIA_ID
FROM [lib://HR/NEW_EMPLOYEE_RECRUITMENT.qvd] (qvd);

CONCATENATE (NEW_EMPLOYEE_RECR_STATUS_QUERY)
LOAD
MRR_NO,
DIV AS MRR_DIV,
// DEPARTMENT AS MRR_DEPARTMENT,
DEPARTMENT,
SECTION ,
//AS MRR_SECTION,
Subfield(POSITION, '|', 2) AS POSITION,
NATURE_OF_EMPLOYMENT ,
//AS MRR_NATURE_OF_EMPLOYMENT,
REQUESTER_NUMBER,
REQUESTER_NAME AS MRR_REQUESTER_NAME,
Date(Floor(MRR_CREATION_DATE)) AS MRR_CREATION_DATE,
Date(Floor(LAST_OFFER_CREATION_DATE)) AS LAST_OFFER_CREATION_DATE,
MRR_WORKING_DAYS,
MRR_CLANDER_DAYS
FROM [lib://HR/MRR_DASHBOARD_DATA_V.qvd] (qvd);

thank you

Re: data duplication

robert_mika — Thu, 07 Aug 2025 05:33:44 GMT

Where does the dups accurse first? After first second join or concat? Can you go step by step?

Re: data duplication

avinashelite — Thu, 07 Aug 2025 05:52:53 GMT

Check the data output at each level step by step

topic data duplication in Move to Qlik Cloud Analytics

data duplication

Re: data duplication

Re: data duplication