MetadataCrawler produces empty metadata xml-files

Anonymous — Mon, 12 Jun 2017 14:08:48 GMT

Hi all

I use the MetadataCrawler to make xml metadatafiles of two raster maps (Kwel_gem.asc, openheid2009_mean.asc) and a vector map (contour_nl.shp). All goes well without any error or warning (except on the tif overview) until at the point of publication the MetadataCrawler suddenly notices that the xml-file that itself has generated is empty. See the log file:

Start Job run at 14:24 12/06/2017.

[statistics] connecting to socket on port 3401
[statistics] connected
2017-06-12 14:24:04|jJOUo4|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|scan_vector|Default|3|tWarn|tWarn_1|# Analyzing datasource : /media/data/Geodata_Test/contour_nl.shp|0
2017-06-12 14:24:04|jJOUo4|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|scan_vector|Default|3|tWarn|tWarn_2|## Analyzing layer:  contour_nl|0
2017-06-12 14:24:04|QtYQbJ|hZQ9Ra|jJOUo4|METADATA_CRAWLER|generateVectorOverview|Default|3|tWarn|tWarn_3|## Creating overview for  : /media/data/Geodata_Test/contour_nl.shp|0
Creating overview for /media/data/Geodata_Test/contour_nl.shp (layer contour_nl) ...
0...10...20...30...40...50...60...70...80...90...100 - done.
Input file size is 400, 400
0...10...20...30...40...50...60...70...80...90...100 - done.
Done.
2017-06-12 14:24:04|QtYQbJ|hZQ9Ra|jJOUo4|METADATA_CRAWLER|generateVectorOverview|Default|3|tWarn|tWarn_4|## Overview created  : /media/data/Geodata_Test/contour_nl.shp_overview.png|0
2017-06-12 14:24:04|1dBK2G|hZQ9Ra|jJOUo4|METADATA_CRAWLER|pack_data|Default|3|tWarn|tWarn_1|Packing data: /media/data/Geodata_Test/contour_nl.shp layers: contour_nl...|0
2017-06-12 14:24:04|1dBK2G|hZQ9Ra|jJOUo4|METADATA_CRAWLER|pack_data|Default|3|tWarn|tWarn_2|Creating archive: contour_nl.shp.zip in /tmp/scan/download/ (all files matching: 'contour_nl.*' in '/media/data/Geodata_Test' will be included in the archive) ...|0
2017-06-12 14:24:04|jJOUo4|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|scan_vector|Default|3|tWarn|tWarn_4|### Metadata record /media/data/Geodata_Test/contour_nl.shp_md_iso19139.xml created for :  contour_nl|0
2017-06-12 14:24:04|jJOUo4|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|scan_vector|Default|3|tWarn|tWarn_5|### Metadata record for feature catalog  /media/data/Geodata_Test/contour_nl.shp_md_iso19110.xml created for :  contour_nl|0
2017-06-12 14:24:04|jh4f3j|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|scan_raster|test|3|tWarn|tWarn_4|# Analyzing raster datasource : /media/data/Geodata_Test/Kwel_gem.asc|0
2017-06-12 14:24:05|WEwlGg|hZQ9Ra|jh4f3j|METADATA_CRAWLER|generateRasterOverview|Default|3|tWarn|tWarn_2|## Creating overview for  : /media/data/Geodata_Test/Kwel_gem.asc|0
Input file size is 280, 325
0...10...20...30...40...50...60...70...80...90...100 - done.
2017-06-12 14:24:05|WEwlGg|hZQ9Ra|jh4f3j|METADATA_CRAWLER|generateRasterOverview|Default|5|tWarn|tWarn_1|Error generating TIF overview for vector file :/media/data/Geodata_Test/Kwel_gem.asc 
 Error message : Warning 6: PNG driver doesn't support data type Float32. Only eight bit (Byte) and sixteen bit (UInt16) bands supported. Defaulting to Byte
|0
2017-06-12 14:24:05|WEwlGg|hZQ9Ra|jh4f3j|METADATA_CRAWLER|generateRasterOverview|Default|3|tWarn|tWarn_3|## Overview created  : /media/data/Geodata_Test/Kwel_gem.asc_overview.png|0
2017-06-12 14:24:05|yTmzUo|hZQ9Ra|jh4f3j|METADATA_CRAWLER|pack_data|Default|3|tWarn|tWarn_1|Packing data: /media/data/Geodata_Test/Kwel_gem.asc layers: raster...|0
2017-06-12 14:24:05|yTmzUo|hZQ9Ra|jh4f3j|METADATA_CRAWLER|pack_data|Default|3|tWarn|tWarn_2|Creating archive: Kwel_gem.asc.zip in /tmp/scan/download/ (all files matching: 'Kwel_gem.*' in '/media/data/Geodata_Test' will be included in the archive) ...|0
2017-06-12 14:24:05|jh4f3j|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|scan_raster|test|3|tWarn|tWarn_5|### Metadata record /media/data/Geodata_Test/Kwel_gem.asc_md_iso19139-.xml created for :  /media/data/Geodata_Test/Kwel_gem.asc|0
2017-06-12 14:24:05|mRV3ma|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|scan_raster|test|3|tWarn|tWarn_4|# Analyzing raster datasource : /media/data/Geodata_Test/openheid2009_mean.asc|0
2017-06-12 14:24:05|8NCGnV|hZQ9Ra|mRV3ma|METADATA_CRAWLER|generateRasterOverview|Default|3|tWarn|tWarn_2|## Creating overview for  : /media/data/Geodata_Test/openheid2009_mean.asc|0
Input file size is 280, 325
0...10...20...30...40...50...60...70...80...90...100 - done.
2017-06-12 14:24:05|8NCGnV|hZQ9Ra|mRV3ma|METADATA_CRAWLER|generateRasterOverview|Default|5|tWarn|tWarn_1|Error generating TIF overview for vector file :/media/data/Geodata_Test/openheid2009_mean.asc 
 Error message : Warning 6: PNG driver doesn't support data type Float32. Only eight bit (Byte) and sixteen bit (UInt16) bands supported. Defaulting to Byte
|0
2017-06-12 14:24:05|8NCGnV|hZQ9Ra|mRV3ma|METADATA_CRAWLER|generateRasterOverview|Default|3|tWarn|tWarn_3|## Overview created  : /media/data/Geodata_Test/openheid2009_mean.asc_overview.png|0
2017-06-12 14:24:05|haPeJA|hZQ9Ra|mRV3ma|METADATA_CRAWLER|pack_data|Default|3|tWarn|tWarn_1|Packing data: /media/data/Geodata_Test/openheid2009_mean.asc layers: raster...|0
2017-06-12 14:24:05|haPeJA|hZQ9Ra|mRV3ma|METADATA_CRAWLER|pack_data|Default|3|tWarn|tWarn_2|Creating archive: openheid2009_mean.asc.zip in /tmp/scan/download/ (all files matching: 'openheid2009_mean.*' in '/media/data/Geodata_Test' will be included in the archive) ...|0
2017-06-12 14:24:05|mRV3ma|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|scan_raster|test|3|tWarn|tWarn_5|### Metadata record /media/data/Geodata_Test/openheid2009_mean.asc_md_iso19139-.xml created for :  /media/data/Geodata_Test/openheid2009_mean.asc|0
2017-06-12 14:24:05|asK7XA|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|publish_metadata|Default|3|tWarn|tWarn_3|Start publication of metadata in CSW server http://buteo.sovon.nl:8080/geonetwork/srv/eng/csw-publication using user christian ...|0
2017-06-12 14:24:05|asK7XA|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|publish_metadata|Default|4|tWarn|tWarn_4|Kwel_gem.asc_md_iso19139.xml is empty. XML document was not properly created. Check the file.|42
2017-06-12 14:24:05|asK7XA|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|publish_metadata|Default|4|tWarn|tWarn_4|contour_nl.shp_md_iso19110.xml is empty. XML document was not properly created. Check the file.|42
2017-06-12 14:24:05|asK7XA|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|publish_metadata|Default|4|tWarn|tWarn_4|contour_nl.shp_md_iso19139.xml is empty. XML document was not properly created. Check the file.|42
2017-06-12 14:24:05|asK7XA|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|publish_metadata|Default|4|tWarn|tWarn_4|openheid2009_mean.asc_md_iso19139.xml is empty. XML document was not properly created. Check the file.|42
2017-06-12 14:24:05|asK7XA|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|publish_metadata|Default|4|tWarn|tWarn_4|-mediaGeodata_Test-Kwel_gem.asc_md_iso19139.xml-csw-update-by-props.xml is empty. XML document was not properly created. Check the file.|42
2017-06-12 14:24:05|asK7XA|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|publish_metadata|Default|4|tWarn|tWarn_4|-mediaGeodata_Test-contour_nl.shp_md_iso19139.xml-csw-update-by-props.xml is empty. XML document was not properly created. Check the file.|42
2017-06-12 14:24:05|asK7XA|hZQ9Ra|hZQ9Ra|METADATA_CRAWLER|publish_metadata|Default|4|tWarn|tWarn_4|-mediaGeodata_Test-openheid2009_mean.asc_md_iso19139.xml-csw-update-by-props.xml is empty. XML document was not properly created. Check the file.|42

What has gone wrong here? What does it mean when MetadataCrawler reports that the "XML document was not properly created"? Has anybody experienced similar problems?

I'm thankful for any hint!

Re: MetadataCrawler produces empty metadata xml-files

Anonymous — Thu, 06 Jul 2017 08:11:21 GMT

Hi,

Could you please give us your metadata crawler setting screenshot? Which will be helpful for us to address your issue.

Best regards

Sabrina

Re: MetadataCrawler produces empty metadata xml-files

Anonymous — Thu, 06 Jul 2017 10:03:41 GMT

@xdshi: Thanks for helping! I attach some screenshots. Let me know if this helps or if you need other information (and where I can find it).

Best wishes,

Christian

Graphical job representationJob log outputMetadata-Crawler Kontext (1/3)Metadata-Crawler Kontext (2/3)Metadata-Crawler Kontext (3/3)Job overview

topic Re: MetadataCrawler produces empty metadata xml-files in Talend Studio

MetadataCrawler produces empty metadata xml-files

Re: MetadataCrawler produces empty metadata xml-files

Re: MetadataCrawler produces empty metadata xml-files