topic Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik in Connectivity & Data Prep

Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Tue, 21 Dec 2021 14:01:50 GMT

Hi Everyone,

Good Evening,

My source is jira, Loaded data from Jira through REST API into qlik sense, while loading Issue table custom fields are loading into Qlik like Custom filed ids as lable, so its difficult to identify what is the actual filed name from jira.

Due to requirement in project few field were added in Jira by Jira developer those fields called custom fields. These newly added fields by Jira developer are coming into qlik as custom filed with id (ex: custom field 250,custom filed 340).

While creating the REST connection defined the filed names in the parameters, even though custom filed with ids are loading.

Do i missed something while loading,please help on this.

Thanks in Advance!!!!!!!!!!!

Varsha.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Wed, 30 Sep 2020 20:52:34 GMT

Hi @Qlik-Developer

As you have identified the custom fields in Jira are a bit of a pain, as they are just given fieldnames custom_xxxxx, and it is not clear which number which custom field is given.

What I do with my Jira app is when I need to get a new custom field I enter a string into that field on a ticket and then select all data from the Jira connector into a new blank app and then use the global search to find the string I have input. This then gives me the fieldname I am looking for. I then go back into the load script for the whole Jira dataset and find the bit of the code that has the custom field. More often than not it is in a sub-table which joins to the main table with a foreign key. The code for that is then copied (carefully) into the load for my actual Jira QVD generator.

To get the custom fields into the main table (rather than hanging off the side) I create a mapping table for each custom field, using the FK fields to ApplyMap it back in. You need to be careful when doing this with a paged load to ensure you include the page number, as the FKs restart on 1 for each page. I inject the page number into the mapping table name, e.g. Map_$(iPage)BusinessReason.

Hope that points you in the right direction.

Steve

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Wed, 30 Sep 2020 20:58:48 GMT

Can you provide me the sample app for better understanding

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Wed, 30 Sep 2020 21:30:02 GMT

Hi @Qlik-Developer

I can't provide the app, but I can provide some code snippets from it. I am not connected to the right network to get the code at present, but will get it when I am next on that network. Feel free to remind me if I haven't found it for you by the weekend.

If you share your code here I can potentially give some pointers, even ahead of me getting my code.

Steve

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Fri, 02 Oct 2020 19:05:25 GMT

Thanks for your explination.

Which jira connector you used to load data from jira to qlik sense.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Fri, 02 Oct 2020 19:20:55 GMT

Yes please provide me the code for reference.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Fri, 02 Oct 2020 19:37:48 GMT

I have loaded just issues table into qlik just for try but the issue is while loading through rest api each field of jira is trearing as one table in qlik.

As u said how can i create mapping table for my custom fileds to get all customs fields into maim table .as i dnt see main table while loading from jira beacuse each field of jira in qlik trearing as single table please see in below attached screenshot.

Only 14 fields are presnt in issues table of jira but while loading into qlik some extra fields are loading as table which creating confusion.

Thanks in advance......

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Fri, 02 Oct 2020 20:46:49 GMT

Hi @Qlik-Developer

When you load from the REST connector all of the sub tables come into one large table, with nulls in some of the columns. You need to pull the right columns from the main table, where certain fields are not null, to get to the right individual tables. The connector wizard has a go at this for you, but I find it is better ignoring that and building it yourself a bit.

I've attached a redacted version of my load script. It has code in there for incremental load and paging. It only picks up the most recent few pages on most loads, but you can set a variable for it to refresh all.

Obviously, all of the custom fields will be different in your load and many of the standard fields will be also. Hopefully this will give you the pointer you need to build your own code.

To use this you need to create a filter in Jira and put the filter into the variable at the start of the script.

Please let me know if you have any further questions. Good luck!

Steve

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Thu, 08 Oct 2020 11:51:49 GMT

How the mapping table created for each custom field, using the FK fields to ApplyMap?

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Thu, 08 Oct 2020 12:01:13 GMT

Exactly that. It's all in the attached zip.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Thu, 08 Oct 2020 12:12:27 GMT

After entering a string in Jira,When i load data into qliksense 100's of custom filed tables are appearing under select data to load ,so to find the string what i entered in jira do i need to load all the custom tables appearing under select data to load?

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Thu, 08 Oct 2020 12:57:46 GMT

The thing to do is create a new app and use the Select Data wizard and load all of the data from the connector. Enter a unique value into all of the columns you want to take. Delete all of the residents loads from the load script before reloading. Once the data is in you can use the global search to find the custom_xxxx fields for all of the values you want. Once you have these you can build the statement you need to pull just the fields you want and create mapping tables to give them the right values with the right names.

It's a bit long winded, but hopefully you will be able to get to where you need to.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Thu, 08 Oct 2020 13:32:50 GMT

Where the data wizard option will available? do you mean it is data manager?

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Thu, 08 Oct 2020 13:25:17 GMT

Just when you click Select Data next to the connector on the right hand side. You can select to bring in the root table and all tables beneath it in one go.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Thu, 08 Oct 2020 13:38:16 GMT

we need to enter unique value in jira while creating a ticket.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Thu, 08 Oct 2020 13:40:39 GMT

You don't need to, but it can make the column easier to find.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Thu, 08 Oct 2020 13:58:54 GMT

then where we have to enter unique values into all of columns?

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Thu, 08 Oct 2020 15:08:54 GMT

It's not a necessity to enter unique values anywhere, you just need some way of being sure that you have the correct custom field. By entering values into Jira that will pull through via the API you can be sure when you find that value in Qlik that you have the correct column.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

Qlik-Developer — Thu, 08 Oct 2020 15:29:58 GMT

Thing is "story points" field is created by jira developer so its custom field from jira.but when i tried to create ticket "story points" filed column is not coming to enter the string for easy identification of columns in qlik.

Re: Qlik Sense Rest API Connector for Jira/Getting custom fields with their names from jira to Qlik

stevedark — Thu, 08 Oct 2020 16:01:20 GMT

Yes, I see the problem. In a feed I pull from the Story Points are in a custom field in the main body of the request (which means no ApplyMap is needed for that field):

alt(customfield_10026, 0) as [Story Points],

Obviously, the custom field will not necessarily have the same suffix.

As the field can only contain an integer value it will not be possible to put in a string that you can search for. In that case you will need to pick a ticket with story points on it and select it in the data. Then search for all of the fields that have that value. Then create a table with Ticket ID and all of the fields which were a match for that one ticket and find which of those fields are most likely to be the story points field.

The fact it is in the main body of the data, rather than joined with a FK, should make it a lot easier to find.

Good luck!