Opened 6 years ago
Last modified 6 years ago
#1870 closed defect
"watch" option in wcst_import — at Version 2
Reported by: | Dimitar Misev | Owned by: | bphmahuu |
---|---|---|---|
Priority: | major | Milestone: | 9.7 |
Component: | wcst_import | Version: | development |
Keywords: | Cc: | Vlad Merticariu, Peter Baumann, Bang Pham Huu | |
Complexity: | Medium |
Description (last modified by )
In the case of a growing archive of data (where new data is continuously being added), it would be convenient to automatically ingest this data in rasdaman as soon as it becomes available.
One idea to support this is through an option in the ingredients file. This is pretty natural as the ingredients file fully specifies how the coverage is constructed. E.g.
"watch": True, or "watch": <interval in seconds>
With such an option in the ingredients:
- User executes
wcst_import.sh
- wcst_import.sh ingests the currently available data as collected by the "paths"
- Rather than exiting at the end, it continues running as a daemon (relevant: python-daemon) that regularly checks for new data. When new data becomes available, the ingestion is automatically done with the same ingredients file to update the coverage.
- starting
wcst_import.sh
on the same ingredients file while the daemon is already running should exit with an error in this case, and the daemon keeps running
- starting
Some extra useful stuff:
- Add options to wcst_import for daemon control (start/stop/status), e.g:
wcst_import.sh ingredients.json --daemon status
Change History (2)
comment:1 by , 6 years ago
Description: | modified (diff) |
---|
comment:2 by , 6 years ago
Description: | modified (diff) |
---|
Note:
See TracTickets
for help on using tickets.