1 Reply Latest reply: Feb 1, 2018 10:40 AM by MAnuela Engl RSS

    Qlikview REST connector NextURL-pagination XML

    MAnuela Engl

       

      Hi everbody,

       

      we try to load data from MS Sharepoint via REST Connector 1.2.0 into a QlikView application (11.20 SR12). Pagination on Server side is set to 100 and Sharepoint uses NextURL-Pagination. The XML looks pretty much like the following (only confidential data removed):

       

       

      <?xml version="1.0" encoding="utf-8" ?>
      - <feed xml:base="http://some.sharepoint.de/xy/_api/" xmlns="http://www.w3.org/2005/Atom">
         <id>b8ac15ff-dbc5-4b78-8a8d-33d8c31b8a50</id>
         <title />
         <updated>2017-12-14T14:11:27Z</updated>
      - <entry m:etag=""22"">
         <id>Web/Lists(guid'608da7f5-bf0c-4426-92de-e5cdf3e4e7f2')/Items(500)</id>
         <category term="SP.Data.AufgabenListItem" scheme="http://schemas.microsoft.com/ado/2007/08/dataservices/scheme" /> 
         <link rel="edit" href="Web/Lists(guid'608da7f5-bf0c-4426-92de-e5cdf3e4e7f2')/Items(500)" />
         <link rel="http://schemas.microsoft.com/ado/2007/08/dataservices/related/FirstUniqueAncestorSecurableObject" type="application/atom+xml;type=entry" title="FirstUniqueAncestorSecurableObject" href="Web/Lists(guid'608da7f5-bf0c-4426-92de-e5cdf3e4e7f2')/Items(500)/FirstUniqueAncestorSecurableObject" /> 
         <title />
         <updated>2017-12-14T14:11:27Z</updated>
      - <author>
        <name />
         </author>
      - <content type="application/xml">
        - <m:properties>
           <d:FileSystemObjectType m:type="Edm.Int32">0</d:FileSystemObjectType>
           <d:Id m:type="Edm.Int32">500</d:Id>
           <d:Status>abgeschlossen</d:Status>
          </m:properties>
          </content>
         </entry>
        <link rel="next" href="http://some.sharepoint.de/xy/_api/web/Lists/getbyid('608DA7F5BF0C442692DEE5CDF3E4E7F2')/items?%24skiptoken=Paged%3dTRUE%26p_ID%3d613" />
      </feed>
      
      

       

      We try to load with following settings:

       

      • Pagination Type:Next URL
      • Next URL field path: feed/link/attr:href (--> NextURL see line 24)
      • Look in header: deactivated

        

      Test Connection is okay and we can load data, but QlikView loads only first 100 entries from the initial URL. And then proceeds with the script without any error message.

       

      Really hope someone can help!

       

      Regards Manuela

       

        • Re: Qlikview REST connector NextURL-pagination XML
          MAnuela Engl

          Unfortunately, there is no real solution as it seems to be a bug in recognizing the XML-structure. But we found a workaround.

           

          You can use custom pagination:

           

          1. With a Loop you can iterate trough data packages. Starting with Initial URI

           

           

          2. at the end of each select-statement you can write the next URI in a variable

          3. Next.....

          4. In last data package the NextHref ist empty --> Exit for

           

          Best regards,

           

          Manuela