Custom Query (2764 matches)

I have a lot of ingredients to import, and would prefer if the import doesn't generate a lot of log files as a side-effect. It's unusual for command-line tools to generate log files without explicitly asking for that anyway.

I think it's best to disable it altogether. Users can redirect stdout to a file if needed.

log_file = None

try:
    log_file = open(ConfigManager.log_file, "a+")
    log_file.write("\n-------------------------------------------------------------------------------------")
    log_file.write(prepend_time("Ingesting coverage '{}'...".format(self.coverage.coverage_id)))
except Exception as e:
    is_loggable = False
    log.warn("\nCannot create log file for this ingestion process, only log to console.")

The text on ​this page should be integrated into ​https://doc.rasdaman.org/11_cheatsheets.html#clients (after the Leaflet part).

  INFO [2023-09-16 09:20:43] AbstractController@895: Received request req-195: /rasdaman/ows?service=WMS&request=GetMap&version=1.3.0&transparent=TRUE&layers=DGM&styles=hillshade&format=image/png&width=256&height=256&time=2021-01-01T00:00:00.000Z&crs=EPSG:4326&bbox=49.724609375,8.52099609375,49.73095703125,8.525390625 with user rasadmin
  INFO [2023-09-16 09:20:43] AbstractController@895: Received request req-199: /rasdaman/ows?service=WMS&request=GetMap&version=1.3.0&transparent=TRUE&layers=DGM&styles=hillshade&format=image/png&width=256&height=256&time=2021-01-01T00:00:00.000Z&crs=EPSG:4326&bbox=49.75,8.54296875,49.775390625,8.560546875 with user rasadmin
 ERROR [2023-09-16 09:22:42] AbstractController@914: Failed processing request req-0, evaluation time 120386 ms. Reason: http://localhost:8080/rasdaman/def/crs/OGC/0/AnsiDate has IO error. Reason: Read timed out
 ERROR [2023-09-16 09:22:42] AbstractController@914: Failed processing request req-8, evaluation time 120101 ms. Reason: http://localhost:8080/rasdaman/def/crs/OGC/0/AnsiDate has IO error. Reason: Read timed out
 ERROR [2023-09-16 09:22:42] ExceptionUtil@98: Caught an exception:
http://localhost:8080/rasdaman/def/crs/OGC/0/AnsiDate has IO error. Reason: Read timed out
        at petascope.util.CrsUtil.getCrsDefinition(CrsUtil.java:764)
        at petascope.util.CrsUtil.getDatumOrigin(CrsUtil.java:440)
        at org.rasdaman.domain.cis.GeoAxis.getBoundNumber(GeoAxis.java:123)
        at org.rasdaman.domain.cis.GeoAxis.getLowerBoundNumber(GeoAxis.java:138)
        at petascope.wcps.metadata.service.WcpsCoverageMetadataTranslator.buildAxes(WcpsCoverageMetadataTranslator.java:488)
        at petascope.wcps.metadata.service.WcpsCoverageMetadataTranslator.create(WcpsCoverageMetadataTranslator.java:118)
        at petascope.wcps.metadata.service.WcpsCoverageMetadataTranslator.translate(WcpsCoverageMetadataTranslator.java:172)
        at petascope.wms.handlers.service.WMSGetMapWCPSMetadataTranslatorService.translate(WMSGetMapWCPSMetadataTranslatorService.java:68)
        at petascope.wms.handlers.kvp.KVPWMSGetMapHandler.handle(KVPWMSGetMapHandler.java:294)
        at petascope.controller.handler.service.KVPWMSServiceHandler.handle(KVPWMSServiceHandler.java:73)
        at petascope.controller.PetascopeController.lambda$requestDispatcher$0(PetascopeController.java:181)
        at petascope.controller.AbstractController.handleRequest(AbstractController.java:943)
        at petascope.controller.PetascopeController.requestDispatcher(PetascopeController.java:237)
        at petascope.controller.PetascopeController.handleGet(PetascopeController.java:95)
        at org.rasdaman.SecoreFilter.doFilter(SecoreFilter.java:79)
        at petascope.controller.SecoreFilter.doFilter(SecoreFilter.java:81)
        at org.rasdaman.CorsFilter.doFilterInternal(CorsFilter.java:47)
        at com.rasdaman.accesscontrol.service.RequestsFilter.doFilter(RequestsFilter.java:201)
Caused by: Read timed out
        at petascope.util.HttpUtil.getInputStream(HttpUtil.java:102)
        at petascope.util.HttpUtil.getSECOREInputStream(HttpUtil.java:118)
        at petascope.util.CrsUtil.getInputStreamByInternalOrExternalSECORE(CrsUtil.java:496)
        at petascope.util.CrsUtil.getCrsDefinition(CrsUtil.java:576)

I sent the requests like this:

xargs --verbose -P 0 -n 1 curl -u "$rasuser:$raspass" -s -o /dev/null < "requests.txt"

Notice the -P 0: If max-procs is 0, xargs will run as many processes as possible at a time.