Unable to get a free rasdaman server when ingests hundred files by wcst_import

[Bang Pham Huu]

I tested wcst_import with a directory has 10000 tiff files with map_mosaic recipe (NOTE: using RNP not rasnet) (each file is 438 KB).

Size is 600, 720
Coordinate System is:
GEOGCS["WGS 84",
    DATUM["WGS_1984",
        SPHEROID["WGS 84",6378137,298.257223563,
            AUTHORITY["EPSG","7030"]],
        AUTHORITY["EPSG","6326"]],
    PRIMEM["Greenwich",0],
    UNIT["degree",0.0174532925199433],
    AUTHORITY["EPSG","4326"]]
Origin = (-110.000000000000000,80.000000000000000)
Pixel Size = (0.083333333333333,-0.083333333333333)

After 357 files, wcst_import stop due to unable to get a free rasdaman server.

Progress: [#-----------------------------] 357/9763 3.66% 
Failed to insert slice. Attempted 1 times.
Service Call: http://localhost:8080/rasdaman/ows?service=WCS&version=2.0.1&request=UpdateCoverage&coverageId=test_hyper_cub_001&subset1=Lat(19.9583333333,80.0416666667)&inputCoverageRef=file:///tmp/84ad4cd0_1391_41b1_87a6_09d0171916f4.gml&subset2=Long(-109.958333333,-60.0416666667)
Error Code: InternalComponentError
Error Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<ows:ExceptionReport version="2.0.0"
    xsd:schemaLocation="http://www.opengis.net/ows/2.0 http://schemas.opengis.net/ows/2.0/owsExceptionReport.xsd"
    xmlns:ows="http://www.opengis.net/ows/2.0" xmlns:xsd="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
    <ows:Exception exceptionCode="InternalComponentError">
        <ows:ExceptionText>Error while executing RasQL query</ows:ExceptionText>
    </ows:Exception>

</ows:ExceptionReport>

Petascope log

[09:00:11] TRACE RangeElement@65: Range Element { name 'Palette', type 'unsigned char'}
[09:00:11] DEBUG DbMetadataSource@1094: Added range element: Range Element { name 'Palette', type 'unsigned char'}
[09:00:11] DEBUG DbMetadataSource@1121: SQL query:  SELECT storage_table, storage_id FROM ps_range_set WHERE coverage_id=1
[09:00:11] DEBUG DbMetadataSource@1145: SQL query:  SELECT name, oid,base_type FROM ps_rasdaman_collection WHERE id=1
[09:00:11] TRACE DbMetadataSource@1157: Coverage 'test_hyper_cub_001' has range-set data in test_hyper_cub_001:513.
[09:00:11] DEBUG DbMetadataSource@2456: RasQL query : select sdom(c) from test_hyper_cub_001 AS c where oid(c) = 513
[09:00:11] ERROR DbMetadataSource@2460: Error while executing RasQL query
RasdamanUnavailable: Unable to get a free rasdaman server.

[Alex Dumitru]

This looks like a bug in rasserver, the information given cannot be used to diagnose such a problem, please open a ticket with the specific error of rasserver (check the logs).

[Dimitar Misev]

Bang can you test this again with rasnet?

[Bang Pham Huu]

Dimitar, the problem seems not appear in rasnet, so I think it is invalid.

[Dimitar Misev]

Great, another bug solved by rasnet!

[Bang Pham Huu]

yeah, but another problem, so this time may be not relate to rasserver

Progress: [########----------------------] 2689/10001 26.89% 
Failed to insert slice. Attempted 1 times.
Service Call: http://localhost:8080/rasdaman/ows?service=WCS&version=2.0.1&request=UpdateCoverage&coverageId=test_006&subset1=Lat(19.9583333333,80.0416666667)&inputCoverageRef=file:///tmp/f478675e_b1cb_412b_938a_fcf86d1a1b1d.gml&subset2=Long(-109.958333333,-60.0416666667)
Error Code: ResourceError
Error Text: <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<ows:ExceptionReport version="2.0.0"
    xsd:schemaLocation="http://www.opengis.net/ows/2.0 http://schemas.opengis.net/ows/2.0/owsExceptionReport.xsd"
    xmlns:ows="http://www.opengis.net/ows/2.0" xmlns:xsd="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
    <ows:Exception exceptionCode="ResourceError">
        <ows:ExceptionText>Metadata database error</ows:ExceptionText>
    </ows:Exception>

</ows:ExceptionReport>

[Alex Dumitru]

@Bang: Please provide the petascope log in another ticket. Thanks!