Opened 6 years ago
Last modified 6 years ago
#1870 closed defect
"watch" option in wcst_import — at Initial Version
Reported by: | Dimitar Misev | Owned by: | bphmahuu |
---|---|---|---|
Priority: | major | Milestone: | 9.7 |
Component: | wcst_import | Version: | development |
Keywords: | Cc: | Vlad Merticariu, Peter Baumann, Bang Pham Huu | |
Complexity: | Medium |
Description
In the case of a growing archive of data (where new data is continuously being added), it would be convenient to automatically ingest this data in rasdaman as soon as it becomes available.
One idea to support this is through an option in the ingredients file. This is pretty natural as the ingredients file fully specifies how the coverage is constructed. E.g.
"watch": True, or "watch": <interval in seconds>
With such an option in the ingredients:
- User executes
wcst_import.sh
- wcst_import.sh ingests the currently available data as collected by the "paths"
- Rather than exiting at the end, it continues running as a daemon (relevant: python-daemon) that regularly checks for new data.
- starting
wcst_import.sh
on the same ingredients file while the daemon is already running should exit with an error in this case, and the daemon keeps running
- starting
- It will be useful to add some options to wcst_import for daemon control (start/stop/status), e.g:
wcst_import.sh ingredients.json --daemon status
Note:
See TracTickets
for help on using tickets.