lukechilds
/
lightning
mirror of https://github.com/lukechilds/lightning.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
9220 Commits
55 Branches
107 Tags
38 MiB
Tree: 9984c34f14
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '9984c34f14'
${ noResults }
lightning/common/Makefile

141 lines
3.6 KiB
Raw Normal View History

status: generate messages rather than marshal/unmarshal manually. Now we have wirestring, this is much more natural. And with the 24M length limit, we needn't be so concerned about dumping 64k peer messages in hex. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
COMMON_SRC_NOGEN := \
common: pull out scriptPubkey address method We're going to need this for P2WSH scripts. pull it out into a common file plus adopt the sanity checks so that it will allow for either P2WSH or P2WPKH (previously only encoded P2WPKH scripts)
6 years ago
common/addr.c \
common/amount: new types struct amount_msat and struct amount_sat. They're generally used pass-by-copy (unusual for C structs, but convenient they're basically u64) and all possibly problematic operations return WARN_UNUSED_RESULT bool to make you handle the over/underflow cases. The new #include in json.h means we bolt11.c sees the amount.h definition of MSAT_PER_BTC, so delete its local version. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
6 years ago
common/amount.c \
Initial TOR v2/v3 support. This is a rebased and combined patch for Tor support. It is extensively reworked in the following patches, but the basis remains Saibato's work, so it seemed fairest to begin with this. Minor changes: 1. Use --announce-addr instead of --tor-external. 2. I also reverted some whitespace and unrelated changes from the patch. 3. Removed unnecessary ';' after } in functions. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/base32.c \
Init commit to be able to create a tor static service on the fly. We want to have a static Tor service created from a blob bound to our node on cmdline Changelog-added: persistent Tor address support Changelog-added: allow the Tor inbound service port differ from 9735 Signed-off-by: Saibato <saibato.naga@pm.me> Add base64 encode/decode to common We need this to encode the blob for the tor service Signed-off-by: Saibato <saibato.naga@pm.me>
5 years ago
common/base64.c \
bech32: move to common/ Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/bech32.c \
common: Moving some bech32 related utilities to bech32_util These were so far only used for bolt11 construction, but we'll need them for the DNS seed as well, so here we just pull them out into their own unit and prefix them. Signed-off-by: Christian Decker <decker.christian@gmail.com>
7 years ago
common/bech32_util.c \
bigsize: make it a proper first-class type. It doesn't belong in bitcoin, and should not be confused with varint_t. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/bigsize.c \
billboard: break out common method for billboard updates
4 years ago
common/billboard.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/bip32.c \
common: add blinding helpers. We'll want this once we add blinded HTLCs. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/blinding.c \
bolt11: move to common/ and sign via callback. JSON stuff is moved to lightningd/invoice.c. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/bolt11.c \
common/bolt11_json: extract bolt11->json code. Our new "decode" command will also handle bolt11. We make a few cleanups: 1. Avoid type_to_string() in JSON, instead use format functions directly. 2. Don't need to escape description now that JSON core does that for us. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/bolt11_json.c \
common/bolt12: encode/decode for bolt12 offer, invoice_request and invoice Note the collapse of '+\s*' and the test cases from the spec. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/bolt12.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/channel_config.c \
common/channel_id: move channel_id into its own file. The definition was in wire/wire.h, and helper functions in fromwire.c! Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/channel_id.c \
coin_mvt: initial commit for coin movement structs and helpers Fleshes out coin movement structs etc
5 years ago
common/coin_mvt.c \
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/close_tx.c \
common: absorb remaining files from daemon/ Also, we split the more sophisticated json_add helpers to avoid pulling in everything into lightning-cli, and unify the routines to print struct short_channel_id (it's ':', not '/' too). Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/configdir.c \
crypto_state: move to its own file. In particular, the main daemon needs to pass it about (marshal/unmarshal) but it won't need to actually use it after the next patch. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/crypto_state.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/crypto_sync.c \
common/cryptomsg.c \
common/daemon: common routines for all daemons. In particular, the main daemon and subdaemons share the backtrace code, with hooks for logging. The daemon hook inserts the io_poll override, which means we no longer need io_debug.[ch]. Though most daemons don't need it, they still link against ccan/io, so it's harmess (suggested by @ZmnSCPxj). This was tested manually to make sure we get backtraces still. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/daemon.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/daemon_conn.c \
common: rename decode_short_channel_ids.{c,h} to decode_array.{c.h} This encoding scheme is no longer just used for short_channel_ids, so make the names more generic. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/decode_array.c \
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/derive_basepoints.c \
common: add a descriptor checksum computation module This is stolen from William's clightning-dumpkeys (https://github.com/jb55/clightning-dumpkeys), itself adapted from https://github.com/bitcoin/bitcoin/blob/42b66a6b814bca130a9ccf0a3f747cf33d628232/src/script/descriptor.cpp#L25 Co-authored-by: William Casarin <jb55@jb55.com> Signed-off-by: Antoine Poinsot <darosior@protonmail.com>
4 years ago
common/descriptor_checksum.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/dev_disconnect.c \
common/dijkstra: routine to calculate shortest/cheapest path. The user supplies callbacks to do channel selection and comparison. Note that this continues to map the entire network; not just to the source, for use with random routing. Benchmarks: (using current mainnet gossip store) /devtools/route gossip-store-2020-07-27 all 03c981ed4ad15837f29a212dc8cf4b31f274105b7c95274a41449bf496ebd2fe10 | grep 'Time to find path' With nothing (i.e. DEVELOPER build) Averages 17ms With -Og (i.e. standard non-DEVELOPER build) Averages 14ms With -O3 -flto: Averages 4ms Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/dijkstra.c \
common: generalize ecdh function. common/onion is going to need to use this for the case where it finds a blinding seed inside the TLV. But how it does ecdh is daemon-specific. We already had this problem for devtools/gossipwith, which supplied a special hsm_do_ecdh(). This just makes it more general. So we create a generic ecdh() interface, with a specific implementation which subdaemons and lightningd can use. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/ecdh_hsmd.c \
features: Move feature-handling code to a common/features.c source.
7 years ago
common/features.c \
common: add fee_states state machine for update_fee. This uses the same state machine as HTLCs, but they're only ever added, not removed. Since we can only have one in each state, we use a simple array; mostly NULL. We could make this more space-efficient by folding everything into the first 5 states, but that would be more complex than just using the identical state machine. One subtlety: we don't send uncommitted fee_states over the wire. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/fee_states.c \
common/gossip_rcvd_filter: cache for received gossip. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/gossip_rcvd_filter.c \
common: move gossip_store read routine where subdaemons can access it. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
6 years ago
common/gossip_store.c \
common/hash_u5: routines to hash 5 bit values. Needed for creating/verifying signatures on bolt11 invoices. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/hash_u5.c \
common: new file hmac for hmac calculation. Blinded paths will want this too; it's mainly copied from sphinx. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/hmac.c \
lightningd: group hsm_secret encryption key derivation This avoids duplication of both logic and error-prone values, such as the salt. Grouping all hsm encryption logic into a public API will also allow us to fuzz it. Signed-off-by: Antoine Poinsot <darosior@protonmail.com>
4 years ago
common/hsm_encryption.c \
common: absorb remaining files from daemon/ Also, we split the more sophisticated json_add helpers to avoid pulling in everything into lightning-cli, and unify the routines to print struct short_channel_id (it's ':', not '/' too). Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/htlc_state.c \
channeld: extract HTLC trim logic into common. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
6 years ago
common/htlc_trim.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/htlc_tx.c \
common/htlc_wire.c \
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/initial_channel.c \
common/initial_commit_tx.c \
common: Added a small locking mechanism to simplify how we lock IO We've done this a number of times already where we're getting exclusive access to either the out direction of a connection, or we try to lock out the read side while we are responding to a previous request. They usually are really cumbersome because we reach around to the other direction to stop it from proceeding, or we flag our exclusive access somewhere, and we always need to know whom to notify. PR ElementsProject/lightning#1970 adds two new instances of this: - Streaming a JSON response requires that nothing else should write while the stream is active. - We also want to stop reading new requests while we are responding to one. To remove the complexity of having to know whom to stop and notify when we're done, this adds a simple `io_lock` primitive that can be used to get exclusive access to a connection. This inverts the requirement for notifications, since everybody registers interest in the lock and they get notified if the lock holder releases it.
6 years ago
common/io_lock.c \
common: absorb remaining files from daemon/ Also, we split the more sophisticated json_add helpers to avoid pulling in everything into lightning-cli, and unify the routines to print struct short_channel_id (it's ':', not '/' too). Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/json.c \
json: move bitcoin/lightning specific helpers into common/json_helpers. We don't need them in common/json, since lightning-cli doesn't need these, but plugins want them. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
6 years ago
common/json_helpers.c \
common: move json_stream from lightningd/ to common/ It's not lightningd-specific and we are going to need it for libplugin. The only drawback is the log_io removal in json_stream_output_write()..
5 years ago
common/json_stream.c \
Move json and param core functionality into common, for plugins. json_escaped.[ch], param.[ch] and jsonrpc_errors.h move from lightningd/ to common/. Tests moved too. We add a new 'common/json_tok.[ch]' for the common parameter parsing routines which a plugin might want, taking them out of lightningd/json.c (which now only contains the lightningd-specific ones). The rest is mainly fixing up includes. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
6 years ago
common/json_tok.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/key_derive.c \
common/keyset.c \
common/gossmap: helper to map the gossip store. I went overboard on optimization. I am so sorry: 1. Squeezed channel min/max into 16 bits. 2. Uses mmap and leaves node_ids in the file. 3. Uses offsets instead of pointers where possible. 4. Uses custom free-list to allocate inside arrays. 5. Ignores our autogenerated marshalling code in favor of direct derefs. 6. Carefully aligns everything so we use minimal ram. The result is that the current gossip_store: - load time (-O3 -flto laptop): 40msec - load time (-g laptop i.e. DEVELOPER=0): 60msec - load time (-O0 laptop i.e. DEVELOPER=1): 110msec - Total memory: 2.6MB: - 1.5MB for the array of channels - 512k for the channel htable to map scid -> channel. - 320k for the node htable to map nodeid -> node. - 192k for the array of channels inside each node - 94k for the array of nodes Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/gossmap.c \
lightningd: tal memleak detection, dev-memleak command. This is a primitive mark-and-sweep-style garbage detector. The core is in common/ for later use by subdaemons, but for now it's just lightningd. We initialize it before most other allocations. We walk the tal tree to get all the pointers, then search the `ld` object for those pointers, recursing down. Some specific helpers are required for hashtables (which stash bits in the unused pointer bits, so won't be found). There's `notleak()` for annotating things that aren't leaks: things like globals and timers, and other semi-transients. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/memleak.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/msg_queue.c \
common/node_id: new type. Node ids are pubkeys, but we only use them as pubkeys for routing and checking gossip messages. So we're packing and unpacking them constantly, and wasting some space and time. This introduces a new type, explicitly the SEC1 compressed encoding (33 bytes). We ensure its validity when we load from the db, or get it from JSON. We still use 'struct pubkey' for peer messages, which checks validity. Results from 5 runs, min-max(mean +/- stddev): store_load_msec,vsz_kb,store_rewrite_sec,listnodes_sec,listchannels_sec,routing_sec,peer_write_all_sec 39475-39572(39518+/-36),2880732,41.150000-41.390000(41.298+/-0.085),2.260000-2.550000(2.336+/-0.11),44.390000-65.150000(58.648+/-7.5),32.740000-33.020000(32.89+/-0.093),44.130000-45.090000(44.566+/-0.32) Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
6 years ago
common/node_id.c \
common: make sphinx code ignorant of payload format. Now "raw_payload" is always the complete string (including realm or length bytes at the front). This has several effects: 1. We can receive an decrypt an onion which is grossly malformed. 2. We can still hand this to the htlc_accepted hook. 3. We then fail it unless the htlc_accepted accepts it manually. 4. The createonion API now takes the raw payload, and does not know anything about "style". The only caveat is that the sphinx code needs to know the payload length: we have a call for that, which simply tells it to copy the entire onion (and treat us as the final node) if it's invalid. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/onion.c \
common: add struct onionreply I really want a type which means "I am a wrapped onion reply" as separate from "I am a normal wire msg". Currently both user u8 *, and I got very confused trying to figure out where each one was an unwrapped error msg, or where it still needed (un)wrapping. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/onionreply.c \
Move json and param core functionality into common, for plugins. json_escaped.[ch], param.[ch] and jsonrpc_errors.h move from lightningd/ to common/. Tests moved too. We add a new 'common/json_tok.[ch]' for the common parameter parsing routines which a plugin might want, taking them out of lightningd/json.c (which now only contains the lightningd-specific ones). The rest is mainly fixing up includes. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
6 years ago
common/param.c \
watchtower: Add a struct containing the penalty base information Suggested-by: Rusty Russell <@rustyrussell>
5 years ago
common/penalty_base.c \
common/per_per_state: generalize lightningd/peer_comm Part 1 Encapsulating the peer state was a win for lightningd; not surprisingly, it's even more of a win for the other daemons, especially as we want to add a little gossip information. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
6 years ago
common/per_peer_state.c \
common: peer_billboard() helper for updating the billboard. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/peer_billboard.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/peer_failed.c \
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/permute_tx.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/ping.c \
dualfund: rearrange things so that the wire-dependent calls are separate There's a few structs/wire calls that only exist under experimental features. These were in a common file that was shared/used a bunch of places but this causes problems. Here we move one of the problematic methods back into `openingd`, as it's only used locally and then isolate the references to the `witness_stack` in a new `common/psbt_internal` file. This lets us remove the iff EXP_FEATURES inclusion switches in most of the Makefiles.
4 years ago
common/psbt_open.c \
gossip_store: make private channels more similar to channel_announcement Instead of a boutique message, use a "real" channel_announcement for private channels (with fake sigs and pubkeys). This makes it far easier for gossmap to handle local channels. Backwards compatible update, since we update old stores. We also fix devtools/dump-gossipstore to know about the tombstone markers. Since we increment our channel_announce count for local channels now, the stats in the tests changed too. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/private_channel_announcement.c \
common: absorb remaining files from daemon/ Also, we split the more sophisticated json_add helpers to avoid pulling in everything into lightning-cli, and unify the routines to print struct short_channel_id (it's ':', not '/' too). Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/pseudorand.c \
common/random_select: central place for reservoir sampling. Turns out we can make quite a simple API out of it. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/random_select.c \
common: read_peer_msg helpers for per-peer subds. It's a bit ugly because each caller has slightly different needs, but we have three hooks and standard helpers. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/read_peer_msg.c \
common/route: routing helpers built on gossmap and dijksra. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/route.c \
setup: create a common setup which will handle the wally-context Since we now over-write the wally malloc/free functions, we need to do so for tests as well. Here we pull up all of the common setup/teardown logic into a separate place, and update the tests that use libwally to use the new common_setup core Changelog-None
5 years ago
common/setup.c \
closingd: Ensure proper closing of TCP socket. Fixes: #1457
7 years ago
common/socket_close.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/sphinx.c \
common/status.c \
Makefile: add status_levels.c to $(COMMON_SRC_NOGEN) Signed-off-by: YOSHIDA Masanori <masanori.yoshida@gmail.com> Changelog-None
4 years ago
common/status_levels.c \
status: generate messages rather than marshal/unmarshal manually. Now we have wirestring, this is much more natural. And with the 24M length limit, we needn't be so concerned about dumping 64k peer messages in hex. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/status_wire.c \
subdaemon.c: subdaemon_setup() routine for all daemons. Our handling of SIGPIPE was incoherent and inconsistent, and we had much cut & paste between the daemons. They should *ALL* ignore SIGPIPE, and much of the rest of the boilerplate can be shared, so should be. Reported-by: @ZmnSCPxj Fixes: #528 Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/subdaemon.c \
common: absorb remaining files from daemon/ Also, we split the more sophisticated json_add helpers to avoid pulling in everything into lightning-cli, and unify the routines to print struct short_channel_id (it's ':', not '/' too). Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/timeout.c \
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/type_to_string.c \
common/utils.c \
common: move some files out of lightningd/ Basically all files shared by different daemons. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/utxo.c \
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/version.c \
wallet: Rip out the txtypes type in favor of enum wallet_tx_type Suggested-by: Rusty Russell <@rustyrussell> Signed-off-by: Christian Decker <decker.christian@gmail.com>
6 years ago
common/wallet.c \
ipaddr: rename to wireaddr. In future it will have TOR support, so the name will be awkward. We collect the to/fromwire functions in common/wireaddr.c, and the parsing functions in lightningd/netaddress.c. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/wireaddr.c \
wallet: switch over to withdraw in module, remove lots of unused code. This removes the reservation cleanup at startup, too, now they're all using 'reserved_til'. This changes test_withdraw, since it asserted that outputs were marked spent as soon as we broadcast a transaction: now they're reserved until it's mined. Similarly, test_addfunds_from_block assumed we'd see funds as soon as we broadcast the tx. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au> Changelog-Changed: JSON-RPC: `withdraw` now randomizes input and output order, not BIP69.
4 years ago
common/wire_error.c
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
build: exclude dualopend from non-experimental builds
4 years ago
ifeq ($(EXPERIMENTAL_FEATURES),1)
dualfund: rearrange things so that the wire-dependent calls are separate There's a few structs/wire calls that only exist under experimental features. These were in a common file that was shared/used a bunch of places but this causes problems. Here we move one of the problematic methods back into `openingd`, as it's only used locally and then isolate the references to the `witness_stack` in a new `common/psbt_internal` file. This lets us remove the iff EXP_FEATURES inclusion switches in most of the Makefiles.
4 years ago
COMMON_SRC_NOGEN += common/psbt_internal.c
common/blindedpath: EXPERIMENTAL creation of blinded paths. For inclusion in the onion as a reply path. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
COMMON_SRC_NOGEN += common/blindedpath.c
build: exclude dualopend from non-experimental builds
4 years ago
endif
common: convert to new wire generation style. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
COMMON_SRC_GEN := common/status_wiregen.c common/peer_status_wiregen.c
status: generate messages rather than marshal/unmarshal manually. Now we have wirestring, this is much more natural. And with the 24M length limit, we needn't be so concerned about dumping 64k peer messages in hex. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
common/bolt12_merkle.h: experimental bolt 12 implementation. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
ifeq ($(EXPERIMENTAL_FEATURES),1)
common/bolt12: encode/decode for bolt12 offer, invoice_request and invoice Note the collapse of '+\s*' and the test cases from the spec. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
COMMON_SRC_NOGEN += common/bolt12.c
common/bolt12_merkle.h: experimental bolt 12 implementation. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
COMMON_SRC_NOGEN += common/bolt12_merkle.c
endif
Use dedicated type for error codes Before this patch we used `int` for error codes. The problem with `int` is that we try to pass it to/from wire and the size of `int` is not defined by the standard. So a sender with 4-byte `int` would write 4 bytes to the wire and a receiver with 2-byte `int` (for example) would read just 2 bytes from the wire. To resolve this: * Introduce an error code type with a known size: `typedef s32 errcode_t`. * Change all error code macros to constants of type `errcode_t`. Constants also play better with gdb - it would visualize the name of the constant instead of the numeric value. * Change all functions that take error codes to take the new type `errcode_t` instead of `int`. * Introduce towire / fromwire functions to send / receive the newly added type `errcode_t` and use it instead of `towire_int()`. In addition: * Remove the now unneeded `towire_int()`. * Replace a hardcoded error code `-2` with a new constant `INVOICE_EXPIRED_DURING_WAIT` (903). Changelog-Changed: The waitinvoice command would now return error code 903 to designate that the invoice expired during wait, instead of the previous -2
5 years ago
COMMON_HEADERS_NOGEN := $(COMMON_SRC_NOGEN:.c=.h) \
closingd: configurable closing fee negotiation step When negotiating the transaction fee for closing a channel [1], we used to always pick the middle of the range between our proposal and the peer's proposal. Introduce a new option `fee_negotiation_step` to the close command, so the peer who initiates the close can choose his back off step. Partially resolves https://github.com/ElementsProject/lightning/issues/3270 [1] https://github.com/lightningnetwork/lightning-rfc/blob/master/02-peer-protocol.md#closing-negotiation-closing_signed Changelog-Added: New optional parameter to the `close` command to control the closing transaction fee negotiation back off step
5 years ago
common/closing_fee.h \
common: generalize ecdh function. common/onion is going to need to use this for the case where it finds a blinding seed inside the TLV. But how it does ecdh is daemon-specific. We already had this problem for devtools/gossipwith, which supplied a special hsm_do_ecdh(). This just makes it more general. So we create a generic ecdh() interface, with a specific implementation which subdaemons and lightningd can use. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
5 years ago
common/ecdh.h \
Use dedicated type for error codes Before this patch we used `int` for error codes. The problem with `int` is that we try to pass it to/from wire and the size of `int` is not defined by the standard. So a sender with 4-byte `int` would write 4 bytes to the wire and a receiver with 2-byte `int` (for example) would read just 2 bytes from the wire. To resolve this: * Introduce an error code type with a known size: `typedef s32 errcode_t`. * Change all error code macros to constants of type `errcode_t`. Constants also play better with gdb - it would visualize the name of the constant instead of the numeric value. * Change all functions that take error codes to take the new type `errcode_t` instead of `int`. * Introduce towire / fromwire functions to send / receive the newly added type `errcode_t` and use it instead of `towire_int()`. In addition: * Remove the now unneeded `towire_int()`. * Replace a hardcoded error code `-2` with a new constant `INVOICE_EXPIRED_DURING_WAIT` (903). Changelog-Changed: The waitinvoice command would now return error code 903 to designate that the invoice expired during wait, instead of the previous -2
5 years ago
common/errcode.h \
common/gossip_constants.h \
common/htlc.h \
common/iso4217: define the currency codes. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/iso4217.h \
Use dedicated type for error codes Before this patch we used `int` for error codes. The problem with `int` is that we try to pass it to/from wire and the size of `int` is not defined by the standard. So a sender with 4-byte `int` would write 4 bytes to the wire and a receiver with 2-byte `int` (for example) would read just 2 bytes from the wire. To resolve this: * Introduce an error code type with a known size: `typedef s32 errcode_t`. * Change all error code macros to constants of type `errcode_t`. Constants also play better with gdb - it would visualize the name of the constant instead of the numeric value. * Change all functions that take error codes to take the new type `errcode_t` instead of `int`. * Introduce towire / fromwire functions to send / receive the newly added type `errcode_t` and use it instead of `towire_int()`. In addition: * Remove the now unneeded `towire_int()`. * Replace a hardcoded error code `-2` with a new constant `INVOICE_EXPIRED_DURING_WAIT` (903). Changelog-Changed: The waitinvoice command would now return error code 903 to designate that the invoice expired during wait, instead of the previous -2
5 years ago
common/json_command.h \
common/jsonrpc_errors.h \
common/overflows.h \
tx_roles: pull up roles, rename We're going to use these elsewhere/more widely so having them in common and using a more generic name is a obvious place to start.
4 years ago
common/tx_roles.h
common: add routines for log level names. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
Makefile: unify generated files definition. We change gen_ to _gen, because filtering on gen_% doesn't work if they're in subdirectories :( Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
COMMON_HEADERS_GEN := common/htlc_state_names_gen.h common/status_wiregen.h common/peer_status_wiregen.h
common: absorb remaining files from daemon/ Also, we split the more sophisticated json_add helpers to avoid pulling in everything into lightning-cli, and unify the routines to print struct short_channel_id (it's ':', not '/' too). Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
COMMON_HEADERS := $(COMMON_HEADERS_GEN) $(COMMON_HEADERS_NOGEN)
status: generate messages rather than marshal/unmarshal manually. Now we have wirestring, this is much more natural. And with the 24M length limit, we needn't be so concerned about dumping 64k peer messages in hex. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
COMMON_SRC := $(COMMON_SRC_NOGEN) $(COMMON_SRC_GEN)
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
COMMON_OBJS := $(COMMON_SRC:.c=.o)
Makefiles: simplify dependencies. Gather all binaries and objects and make the depend on external requirements and common headers. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
# Common objects depends on bitcoin/ external/ and ccan
$(COMMON_OBJS): $(CCAN_HEADERS) $(BITCOIN_HEADERS) $(EXTERNAL_HEADERS) $(COMMON_HEADERS_GEN)
Makefile: Remove gen_version.h from ALL_GEN_HEADERS. This prevents recompiling everything when you are changing just a doc, or touching only one file among hundreds of sources, just because the `gen_version.h` is changed, especially since only one source actually depends on that header.
4 years ago
# Only common/version.c can include this header.
Makefile: unify generated files definition. We change gen_ to _gen, because filtering on gen_% doesn't work if they're in subdirectories :( Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/version.o: version_gen.h
Makefile: Remove gen_version.h from ALL_GEN_HEADERS. This prevents recompiling everything when you are changing just a doc, or touching only one file among hundreds of sources, just because the `gen_version.h` is changed, especially since only one source actually depends on that header.
4 years ago
Makefile: normalize all the Makefiles We create ALL_PROGRAMS, ALL_TEST_PROGRAMS, ALL_C_SOURCES and ALL_C_HEADERS. Then the toplevel Makefile knows which are autogenerated (by wildcard), so it can have all the rules to clean them or check the source as necessary. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
ALL_C_HEADERS += $(COMMON_HEADERS)
Makefile: include common objects in ALL_C_SOURCES. They didn't have correct dependencies without this. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
ALL_C_SOURCES += $(COMMON_SRC)
Rename subdaemons, move them into top level. We leave the *build* results in lightningd/ for ease of in-place testing though. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
Makefile: unify generated files definition. We change gen_ to _gen, because filtering on gen_% doesn't work if they're in subdirectories :( Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/htlc_state_names_gen.h: common/htlc_state.h ccan/ccan/cdump/tools/cdump-enumstr
common: absorb remaining files from daemon/ Also, we split the more sophisticated json_add helpers to avoid pulling in everything into lightning-cli, and unify the routines to print struct short_channel_id (it's ':', not '/' too). Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
ccan/ccan/cdump/tools/cdump-enumstr common/htlc_state.h > $@
common/gossmap: helper to map the gossip store. I went overboard on optimization. I am so sorry: 1. Squeezed channel min/max into 16 bits. 2. Uses mmap and leaves node_ids in the file. 3. Uses offsets instead of pointers where possible. 4. Uses custom free-list to allocate inside arrays. 5. Ignores our autogenerated marshalling code in favor of direct derefs. 6. Carefully aligns everything so we use minimal ram. The result is that the current gossip_store: - load time (-O3 -flto laptop): 40msec - load time (-g laptop i.e. DEVELOPER=0): 60msec - load time (-O0 laptop i.e. DEVELOPER=1): 110msec - Total memory: 2.6MB: - 1.5MB for the array of channels - 512k for the channel htable to map scid -> channel. - 320k for the node htable to map nodeid -> node. - 192k for the array of channels inside each node - 94k for the array of nodes Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
4 years ago
common/gossip_store.o: gossipd/gossip_store_wiregen.h
status: generate messages rather than marshal/unmarshal manually. Now we have wirestring, this is much more natural. And with the 24M length limit, we needn't be so concerned about dumping 64k peer messages in hex. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
check-source-bolt: $(COMMON_SRC_NOGEN:%=bolt-check/%) $(COMMON_HEADERS:%=bolt-check/%)
check-whitespace: $(COMMON_SRC_NOGEN:%=check-whitespace/%) $(COMMON_HEADERS:%=check-whitespace/%)
common: new directory for any shared objects. To avoid everything pulling in HTLCs stuff to the opening daemon, we split the channel and commit_tx routines into initial_channel and initial_commit_tx (no HTLC support) and move full HTLC supporting versions into channeld. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
Makefile: clean needs to do more, distclean should remove everything. I checked this with git status --ignored after a full build and 'make distclean'. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
clean: common-clean
common-clean:
$(RM) common/gen*
Makefiles: simplify dependencies. Gather all binaries and objects and make the depend on external requirements and common headers. Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
7 years ago
include common/test/Makefile