Changes between Version 7 and Version 8 of Performance
- Timestamp:
- Jun 16, 2013, 9:53:38 PM (11 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Performance
v7 v8 24 24 || 0:31,0:31,0:149 || 460800 || 35 minutes || 184M || '''19416M''' || 267 MB || 18 GB || 25 25 26 * Using [#Tile Cache tile cache]26 * Using [#Tilecache tile cache] 27 27 28 28 || '''Tiling scheme''' || '''Tile size''' || '''Import time''' || '''DB size before''' || '''DB size after''' || '''BLOBs size''' || '''BLOBs size2''' || … … 104 104 A tile cache can be enabled in rasdaman during bulk ingestion, in order to work around inefficiencies of BLOB handling in postgres and slow performance for certain tiling schemes. 105 105 106 '''IMPORTANT:''' At the moment the tile cache should be used during bulk ingestion '''_ONLY_''', and disabled afterwards. Leaving the tile cache on will cause selection queries to fail randomly. Furthermore, it is best to have only one server defined in rasmgr.conf, and `-countdown` and `--timeout` parameters set to very large values. 106 == How to use == 107 107 108 108 The cache can be enabled in rasmgr.conf by specifying a `--cachelimit` parameter after the `-xp` parameter: … … 120 120 change srv N1 -countdown 20000000 -autorestart on -xp --timeout 30000000 --cachelimit 1073741824 121 121 }}} 122 123 When enabled, `INSERT` and `UPDATE` rasql statements can be issued in the normal way. At the end of the ingestion a `COMMIT` command should be executed, to make sure that the cache is cleared and everything is flushed to disk. E.g. 124 {{{ 125 rasql -q 'insert into coll ...' 126 rasql -q 'update coll ...' 127 rasql -q 'update coll ...' 128 rasql -q 'update coll ...' 129 130 # done with ingestion 131 rasql -q 'commit' 132 }}} 133 134 == Important limitation == 135 136 At the moment the tile cache should be used during bulk ingestion '''_ONLY_''', and disabled afterwards. Leaving the tile cache on will cause selection queries to fail randomly. Furthermore, it is best to have only one server defined in rasmgr.conf, and `-countdown` and `--timeout` parameters set to very large values.