70743c9a10
Integrate bulk parser into main server binary
6 years ago
13b773f6e2
Improve logging at `daemon` and `mempool`
6 years ago
0cceb790b9
Rename `parse` into `bulk`
6 years ago
67b79079b8
Measure indexing duration over a signle blk*.dat file
6 years ago
c2c8e42712
Use readahead during bulk loads
6 years ago
fe03b121f1
Update multiple `use` formatting
6 years ago
35c8c1d000
Improve logging during block headers' download
6 years ago
7832be013d
Increase intermediate and final SSTable sizes
Otherwise, there are more than 1K files, causing full compaction to fail
(due to `ulimit -n` being 1024 by default).
6 years ago
e7e9a4bd34
Add mempool limiting TODO
6 years ago
4b008809ff
Settubg `max_open_files` doesn't seem to help with full compactions
6 years ago
1c70addede
Fix travis
6 years ago
f631bf26af
Dedup FakeStore definition
6 years ago
c197a51bc4
Support testnet network magic constant
6 years ago
f003bc5afc
Stop parsing if not enough bytes for magic
6 years ago
0de580a300
Perform compaction after blk*.dat parsing is over
6 years ago
8e0a719cee
Replace eprintln!() by error!()
6 years ago
4a56884da2
Use iterator adapter to find last indexed blockhash
6 years ago
9a5f746cc0
Refactor blk*.dat parser
6 years ago
e505eeabd3
Monitor parsed blocks indexing progress
6 years ago
ec844fe876
Support vectorized counter metric
6 years ago
2cf765ba5c
Make sure no block is skipped during parsing
6 years ago
5891133528
Improve parsing logging
6 years ago
841a800505
Support simple histogram metric
6 years ago
712c86d405
Fix small typo in bench_index
6 years ago
4200648c8d
Refactor blk*.dat parser
6 years ago
2625070cef
Allow loading indexed block hashes
6 years ago
f3d0384caa
Allow iterating on HeaderList
6 years ago
a1ee8ee3b8
Don't collect rows into a single list before writing to DB
6 years ago
456e38fa20
Add fake Store impl (for tests)
6 years ago
19c63cf06f
Limit max # of RockDB open files
6 years ago
6f3424f734
Move block indexing into `parse` module
6 years ago
8b0b4323e0
Store indexed rows into a DB
6 years ago
df3d9cf6e2
Rename `data` into `blob` at blk*.dat parser
6 years ago
c3cbf94551
Remove unneeded `use`
6 years ago
b2b799c4ce
Fix logging during parsing
6 years ago
8785f2747d
Add metrics to parse module
6 years ago
75b3fc969d
Allow closing Channel's internal sender
Otherwise, we may get stuck in a deadlock (e.g. parse module):
- the channel's receiver waits for messages
- but the last channel's sender is kept alive (at the channel)
6 years ago
a8e26e6e33
Revert "Update formatting following Rust 1.27 update"
This reverts commit 7372f8e239
6 years ago
144bc7ba6a
Improve error message when monitoring fails
6 years ago
11da7d884b
Add benchmark for blk*.dat parser
Also, create the parser from an existing daemon
6 years ago
f3a559824c
Make index_block() a public function
So it could be used by blk*.dat parsing
6 years ago
47a1de666a
Parse blk*.dat files concurrently
Reading and parsing should run in separate threads.
6 years ago
7372f8e239
Update formatting following Rust 1.27 update
6 years ago
656eef336b
Add async parser for blk*.dat files
6 years ago
8925857085
Move logging initialization into config.rs
6 years ago
0171b8f63c
Allow listing bitcoind blk*.dat files
6 years ago
9af70c95cf
Rename mempool vsize histograms
6 years ago
4cc417232d
Allow timestamping log entries
6 years ago
1e798c2ced
Log only to stderr
Also replace `argparse` by `clap`.
6 years ago
74becc9046
Make sure that all fee rate bands are updated
Otherwise, the higher fee rate bands may get stuck at their previous values
6 years ago
Roman Zeyde