Opened 6 years ago

Last modified 6 years ago

#1870 closed defect

"watch" option in wcst_import — at Version 4

Reported by: Dimitar Misev Owned by: bphmahuu
Priority: major Milestone: 9.7
Component: wcst_import Version: development
Keywords: Cc: Vlad Merticariu, Peter Baumann, Bang Pham Huu
Complexity: Medium

Description (last modified by Dimitar Misev)

In the case of a growing archive of data (where new data is continuously being added), it would be convenient to automatically ingest this data in rasdaman as soon as it becomes available.

One idea to support this is through an option in the ingredients file. This is pretty natural as the ingredients file fully specifies how the coverage is constructed. E.g.

"watch": True,
or
"watch": <interval in seconds>

With such an option in the ingredients:

  1. User executes wcst_import.sh
  2. wcst_import.sh ingests the currently available data as collected by the "paths"
  3. Rather than exiting at the end, it continues running as a daemon (#1896) that regularly checks for new data. When new data becomes available, the ingestion is automatically done with the same ingredients file to update the coverage.

Note: while not a hard dependency, it would be nice to implement #1896 along with this ticket.

Change History (4)

comment:1 by Dimitar Misev, 6 years ago

Description: modified (diff)

comment:2 by Dimitar Misev, 6 years ago

Description: modified (diff)

comment:3 by Dimitar Misev, 6 years ago

Description: modified (diff)

comment:4 by Dimitar Misev, 6 years ago

Description: modified (diff)
Note: See TracTickets for help on using tickets.