Roman Zeyde
d1f5c61def
Use correct txids for getting mempool transactions
If block is found after "getmempoolentry()" and before "gettransactions()",
there will be more transactions at `txs` than in `entries` - causing a panic.
7 years ago
Roman Zeyde
ea24d6a01f
Add release notes
7 years ago
Roman Zeyde
ab4747ce7e
Add `cmake` to installation instructions
7 years ago
Roman Zeyde
849c83ed64
Bump version
7 years ago
Roman Zeyde
00de0c028c
Log daemon's network info
(including its version string)
7 years ago
Roman Zeyde
253e244a86
Fix `cargo fmt` for Travis
Stable Rust doesn't support `cargo fmt --check` (yet).
7 years ago
Roman Zeyde
197e5792f8
Improve error message for daemon disconnection
7 years ago
Roman Zeyde
ac9e300226
Run 'cargo fmt --check' on Travis
7 years ago
Roman Zeyde
2852020c58
Fix leftovers at examples/load.rs
7 years ago
Roman Zeyde
daee3fbe4b
Replace "Vec::new()" by shorter "vec![]"
7 years ago
Roman Zeyde
1a9b977dad
Update TODOs
- implemented Daemon::gettransactions() API
- implemented multithreaded indexing workers
- SSTable injection requires non-overlapping ranges (= pre-sorting = full compaction)
- HTTP parsing can be improved
7 years ago
Roman Zeyde
48cd929a99
Remove StoreOptions and enable manual compactions explicitly
7 years ago
Roman Zeyde
9a89e6a2d8
Update README with latest performance metrics
7 years ago
Roman Zeyde
03790d9977
Add logging for bulk indexing
7 years ago
Roman Zeyde
4d322d4819
Substract signed integers
7 years ago
Roman Zeyde
1e258f4b3d
Allow vectorized fetch for mempool transactions
7 years ago
Roman Zeyde
cdacf451a9
Log delta of mempool transactions
7 years ago
Roman Zeyde
e09ac477bb
Skip bulk indexing if it's already over
7 years ago
Roman Zeyde
b9a4cb4318
Move bulk reader and indexer to separate module
7 years ago
Roman Zeyde
4c7413db9d
Increase open files limit explicitly
Otherwise, full compaction may fail.
7 years ago
Roman Zeyde
c7b8f57228
Keep default parallism settings
7 years ago
Roman Zeyde
125bfe0e15
Log latest indexed block
7 years ago
Roman Zeyde
62a78f18ad
Put "finish" marker after compaction is over
7 years ago
Roman Zeyde
f92dfc808d
Log indexed blk*.dat file path
7 years ago
Roman Zeyde
7b5679db70
Panic if DB exists before running bulk load benchmark
7 years ago
Roman Zeyde
b32e503db2
Rename regular indexing benchmark
7 years ago
Roman Zeyde
dd70a1cc8a
Persist last indexed block marker
7 years ago
Roman Zeyde
6609d6e008
Store indexed blocks' hashes
7 years ago
Roman Zeyde
2158fa1961
Sort blk*.dat files
7 years ago
Roman Zeyde
10919035bd
Rename bulk load benchmark
7 years ago
Roman Zeyde
4da521b3cd
Refactor bulk load benchmark
- bulk writes take ~1h (reading blk*.dat files at ~48MB/s)
- full compaction takes ~45m (writing 37GB of SSTables)
7 years ago
Roman Zeyde
1f979baf8f
Increase compaction readahead to 2MB
This should improve compaction throughput on HDDs.
7 years ago
Roman Zeyde
219a962145
Use sort_unstable_by() instead of implementing `Ord` for Row
7 years ago
Roman Zeyde
ef7a7eac8a
Sort rows before writing to DB
Can happen in parallel, before sending the rows to the DB writer thread.
7 years ago
Roman Zeyde
49ec4d1c38
Support SSTable ingestion into DB
7 years ago
Roman Zeyde
e69686f988
Use multiple bulk index workers
7 years ago
Roman Zeyde
4b83c6536f
Add SSTableWriter to store module
7 years ago
Roman Zeyde
fb372b2915
Split reading from indexing blk*.dat files
Also, use a single Vec<Row> for write operation
7 years ago
Roman Zeyde
56229409a0
Simplify SIGINT polling
7 years ago
Roman Zeyde
314978f30a
Simplify bulk indexing flow
Use separate thread per blk*.dat file.
7 years ago
Roman Zeyde
45f3c7d178
Make store::Row sortable (by key) and clonable
7 years ago
Roman Zeyde
baf2d8624d
Rename bulk_load() -> bulk_index()
7 years ago
Roman Zeyde
e88f075c50
Use 1MB block for RocksDB
7 years ago
Roman Zeyde
4c182a0650
Fix formatting
7 years ago
Roman Zeyde
f4ac913c39
Pass blk*.dat file path during bulk indexing process
7 years ago
Roman Zeyde
89551f3e5d
Don't keep too much LOG.old.* files
7 years ago
Roman Zeyde
be20b5bd05
Update `store` to use pingcap RocksDB API
7 years ago
Roman Zeyde
586d6132d6
Use 'pingcap' RocksDB fork
7 years ago
Roman Zeyde
da570a9182
Fix benchmarks
7 years ago
Roman Zeyde
c82ceb6ad7
Update usage documentation for JSONRPC cookie
7 years ago