Opened 5 years ago
Closed 5 years ago
#2293 closed enhancement (fixed)
wcst_import - enhancement for importing with large number of input files
Reported by: | Bang Pham Huu | Owned by: | Bang Pham Huu |
---|---|---|---|
Priority: | major | Milestone: | 10.0 |
Component: | wcst_import | Version: | 9.8 |
Keywords: | Cc: | Dimitar Misev, Vlad Merticariu | |
Complexity: | Medium |
Description
The case is importing Sentinel 2 data with input file paths collected by other scripts and generate ingredient files from these list of file paths.
In ingredients file if the input file paths are already absolute paths, wcst_import stills use glob to try to collect files and it makes it much more slow for nothing.
And in case of the number of input files are large (thousands of files), it will take very long time to validate file paths (e.g: try to open with gdal). This file path validation is not needed as it has the option "skip": true
already in the ingredients file to bypass a broken input file.