Opened 6 years ago

Last modified 6 years ago

#1870 closed defect

"watch" option in wcst_import — at Initial Version

Reported by: Dimitar Misev Owned by: bphmahuu
Priority: major Milestone: 9.7
Component: wcst_import Version: development
Keywords: Cc: Vlad Merticariu, Peter Baumann, Bang Pham Huu
Complexity: Medium

Description

In the case of a growing archive of data (where new data is continuously being added), it would be convenient to automatically ingest this data in rasdaman as soon as it becomes available.

One idea to support this is through an option in the ingredients file. This is pretty natural as the ingredients file fully specifies how the coverage is constructed. E.g.

"watch": True,
or
"watch": <interval in seconds>

With such an option in the ingredients:

  1. User executes wcst_import.sh
  2. wcst_import.sh ingests the currently available data as collected by the "paths"
  3. Rather than exiting at the end, it continues running as a daemon (relevant: python-daemon) that regularly checks for new data.
    • starting wcst_import.sh on the same ingredients file while the daemon is already running should exit with an error in this case, and the daemon keeps running
  4. It will be useful to add some options to wcst_import for daemon control (start/stop/status), e.g:
    wcst_import.sh ingredients.json --daemon status
    

Change History (0)

Note: See TracTickets for help on using tickets.