Packaging cleanups ("syslibs")

Adds options to build using system LevelDB, libsecp256k1, and UniValue libraries, and/or without protobuf (see ./configure --help for usage).

Please note this may be dangerous and make theft from you possible if used with versions of the LevelDB or libsecp256k1 libraries which have not been audited to meet the bug-for-bug compatibility required by Bitcoin's consensus protocol. These options are disabled by default for this reason.

It also adds options to disable building bitcoin-cli or bitcoin-tx individually, and fixes minor bugs that affect building only.

See also:

• Support for building against system LevelDB
• configure: Add unsupported --with-system-libsecp256k1 configure flag
• configure: BITCOIN_SUBDIR_TO_INCLUDE: Improve compatibility with paths including space and multiline cpp output
• crypto/sha256: Use pragmas to enforce necessary intrinsics for GCC and Clang
• test: Support -cli tests using external bitcoin-cli

Fixes

• rpc: Don't FlushStateToDisk when pruneblockchain(0)
• Escape rather than remove any printable characters in UAs
• Try to use posix_fadvise with CBufferedFile
• http: Fail initialization when any bind fails
• Bugfix: GUI: Remove broken ability to edit the address field in the sending address book
• Bugfix? Restore linking to libmingwthrd
• Bugfix: devtools/symbol-check: Check PE libraries case-insensitively
• Fix release tarball generated by gitian
• Bugfix: Only use git for build info if the repository is actually the right one
• wallet: let Listwalletdir do not iterate through our blocksdata
• util/system: Close non-std fds when execing slave processes
• Bugfix: Skip tests for tools not being built
• Bugfix: util: Correctly handle Number value types in GetArg/GetBoolArg
• rpc: getblock/getrawtransaction/decode*/gettxout fixups
• prune, import: allow pruning to work during loadblock import
• wallet, tests: Expand and test when the blank wallet flag should be un/set
• Implement `CCoinsViewErrorCatcher::HaveCoin` and check disk space periodically
• assumeutxo: catch and log fs::remove error instead of two exist checks
• init: Error if ignored bitcoin.conf file is found
• p2p: Restrict self-advertisements with privacy networks to avoid fingerprinting
• mempool / rpc: add getprioritisedtransactions, delete a mapDeltas entry when delta==0
• test: fix `feature_addrman.py` on big-endian systems
• test: add ripemd160 to test framework modules list
• test: Treat `bitcoin-wallet` binary in the same way as others
• p2p: give seednodes time before falling back to fixed seeds
• test: avoid sporadic MINIMALDATA failure in feature_taproot.py (fixes #27595)
• Return EXIT_FAILURE on post-init fatal errors
• test: Make `util/test_runner.py` honor `BITCOINUTIL` and `BITCOINTX`
• rpc: Use 'byte'/'bytes' for bech32(m) validation error message
• Blocking arguments -nohelp, -noh, and -no?
• CLI: Only one Request Handler can be specified
• [coinselection] Increase SRD target by change_fee
• net: do not `break` when `addr` is not from a distinct network group
• validation: add missing insert to m_dirty_blockindex
• Fix potential network stalling bug
• exclude ipc scheme from port check
• Fix issues in ZMQ error handling
• Bugfix: net_processing: Restore "Already requested" error for FetchBlock
• rpc: doc: Added `longpollid` and `data` params to `template_request`
• I2P: also sleep after errors in Accept() & destroy the session if we get an unexpected error
• Bugfix: RPC: Remove quotes from non-string oneline descriptions
• Bugfix: Package relay / bytespersigop checks
• index: coinstats reorg, fail when block cannot be reversed
• Fix virtual size limit enforcement in transaction package context
• bugfix: throw an error if an invalid parameter is passed to getnetworkhashps RPC
• descriptors: disallow hybrid public keys
• fuzz/RPC: Ban invokedisallowedsyscall and allow enumeratesigners
• build: Include `config/bitcoin-config.h` explicitly in `util/trace.h`
• net: Sanity check private keys received from SAM proxy
• depends: Allow PATH with spaces in directory names
• rpc: keep `.cookie` file if it was not generated
• doc: rewrite explanation for `-par=`
• Initialise DBus notifications in another thread
• Bugfix: Allow the user to start anyway when loading a wallet errors
• QRImageWidget: Sizing and font fixups
• Avoid unclean exit due to permissions issues when setting start on system startup
• Translate unit names & fix external signer error
• Fix shortcut ambiguities
• Intro: Never change the prune checkbox after the user has touched it
• Fix transaction view/table
• Bugfix: Address broken things around Peers detail view
• Improve 'Requested Payments History' Multiselect
• Switch RPCConsole wallet selection to the one most recently opened/restored/created
• Remove confusing "Dust" label from coincontrol / sendcoins dialog
• make '-min' minimize wallet loading dialog
• Modify command line help to show support for BIP21 URIs
• Add wallet name to address book page title
• Update Node window title with the chain type
• Fix coin control input size accounting for taproot spends
• Check for private keys disabled before attempting unlock
• Fix crash on selecting "Mask values" in transaction view
• Bugfix: macOS: Open Finder automatically when DMG is mounted
• RPC: Support specifying different types for param aliases
• Wallet: Hacky fix for getbalance bugs
• Bugfix: GUI/Addressbook: Drop confusing message about signed messages
• RPC/Net: Allow addconnection on non-regtest networks
• Add workaround for Boost bugs
• Allow -acceptstalefeeestimates on mainnet and enable by default for now
• Bugfix: ConnectTip: Avoid division by zero in logging if num_blocks_total is 0 when loading from disk
• Bugfix: QA: Restore Segwit MiniWallet for mempool_packages --legacy-wallet
• Bugfix: doc: Correct default for -upnp following removal of configure flag

Functional and policy enhancements

• Parse URIs with non-BTC amounts
• -acceptnonstdtxn option to skip "non-standard transaction" checks
• Support for Tonal Bitcoin units (ᵇTBC, ˢTBC, and TBC)
• Restore ability to display addresses in GUI
• [Qt] support for persisted rpc console history
• Qt: Add network port input box to GUI settings
• Make RBF policies optional
• Render icons from SVG
• Read/write bitcoin_rw.conf for exposing shared Daemon/GUI options in the GUI
• RPC: sendrawtransaction: Allow the user to ignore/override specific rejections
• Add mempool statistics collector
• [Qt] Add interactive mempool graph
• RPC: Add parameter to addmultisigaddress / createmultisig to sort public keys
• Wallet/RPC: sweepprivkeys method to scan UTXO set and send to local wallet
• Drop IO priority to idle while reading blocks for peer requests and startup verification
• [RPC] dumpmasterprivkey command
• If -spkreuse=0, ensure transactions in mempool always have unique scriptPubKeys
• Expire bitcoind & bitcoin-qt 7-8 years after its last change
• Added support for MSG_FILTERED_WITNESS_BLOCK messages
• ZMQ: add publishers for wallet transactions
• Relax punishment for peers relaying invalid blocks and headers
• RPC: Allow rpcauth configs to specify a 4th parameter naming a specific wallet
• Add new bitcoin_rw.conf file that is used for settings modified by this software itself
• Multiselect in coincontrol treewidget and display selected count
• [REST] add a rest endpoint for estimatesmartfee, docs, and test
• Bugfix: RPC/Wallet: Include HD key metadata in dumpwallet
• Wallet: Support disabling implicit Segwit operation
• RPC: Support addnode onetry without making the connection priviliged
• Add RPC call setscriptthreadsenabled: allow to temp. throttle CPU usage
• Add POWER8 ASM for 4-way SHA256
• gui: Add Windows taskbar progress
• rpc: Add min_conf option to fund transaction calls
• validation: Flush state after initial sync
• torcontrol: Launch a private Tor instance when not already running
• GUI: Add Pairing tab with Tor onion address as copyable text and QR code
• Add feerate histogram to getmempoolinfo
• Restore warning for individual unknown version bits, as well as unknown version schemas
• qt: Add -guisettingsdir option
• gui: Shortcut to close RPC Console
• rpc: query general daemon information via RPC
• lib: Optimizing siphash implementation
• Add new filter type v0 for segwit only Scripts to blockfilterindex
• RPC: Show fee in results for signrawtransaction* for segwit inputs
• net: Add blockfilters white{bind,list} permission flag
• cli, test, doc: bitcoin-cli -getinfo multiwallet balances follow-ups
• cli: display multiwallet total balance in -getinfo
• RPC: Add getrpcwhitelist method
• Add -uaappend option to append a literal string to user agent
• Prune locks
• Flush dbcache early if system is under memory pressure
• wallet: introduce setfeerate (an improved settxfee, in sat/vB)
• rpc: Support -rpcauthfile argument
• RPC/Net: Allow changing the connection_type for addnode onetry
• rpc: Add getblocklocations call
• During IBD, prune as much as possible until we get close to where we will eventually keep blocks
• wallet: indicate whether a transaction is in the mempool
• RPC/Blockchain: Optimise getblock for simple disk->hex case
• - Add maxmempool RPC
• wallet: allow toggling external_signer flag
• rpc: add period_start to version bits statistics
• Add reindex=auto flag to automatically reindex corrupt data
• build: Add --with-append-cxxflags option
• Support multiple -*notify commands
• build: Use guix within gitian
• RPC/Wallet: Add "use_txids" to output of getaddressinfo
• util: Add "importfromcoldcard" command to bitcoin-wallet tool
• add support to save fee estimates without having to shut down the node
• rpc: add require_checksum flag to deriveaddresses
• rpc: allow dumptxoutset to dump human-readable data
• RPC/Wallet: Convert walletprocesspsbt to use options parameter
• rpc: Filter inputs by type during CoinSelection
• rpc, docs: Add note for commands that supports only legacy wallets
• rpc: Return block hash & height in getbalances, gettransaction and getwalletinfo
• validation, zmq: pass block in UpdatedBlockTip to avoid duplicate read
• rpc, p2p: allow `disconnectnode` with subnet
• cli: improve error message on multiwallet and add validation to cli-side commands
• rpc: make importaddress compatible with descriptors wallet
• p2p: Allow whitelisting outgoing connections
• wallet: Add wallet method to detect if a key is "active"
• util: implement `noexcept` move assignment & move ctor for `prevector`
• wallet: add `seeds` argument to `importdescriptors`
• Allow configuring target block time for a signet
• rpc: Add test-only RPC getaddrmaninfo for new/tried table address count
• net: Add new permission `forceinbound` to evict a random unprotected connection if all slots are otherwise full
• p2p: Log addresses of stalling peers
• Introduce 'getblockfileinfo' RPC command
• wallet: Add tracing for sqlite statements
• doc, refactor: changing -torcontrol help to specify that a default port is used
• init: Add option for rpccookie permissions (replace 26088)
• datacarriersize: Match more datacarrying
• wallet rpc: return final tx hex from walletprocesspsbt if complete
• fix: unnecessary continuation after finding mutation
• rpc: getaddrmaninfo followups
• p2p: Increase tx relay rate
• Replace send-to-self with dual send+receive entries
• Intro: Have user choose assumevalid
• Support backup to new text-based database dump format
• Network Graph layout - debug window improvement
• Make row color alternating in the Peers tab optional
• Peers window: Show direction in a new column, with clearer icon
• Network Watch tool
• Enable a non-linear network traffic option (click to toggle between linear and non-linear)
• Show ToolTip on Network Traffic graph
• Enable users to configure their monospace font specifically
• Point out position of invalid characters in Bech32 addresses
• Warn when sending to already-used Bitcoin addresses
• Showing Local Addresses in Node Window
• Show own outputs on PSBT signing window
• Remove embedded libminisketch (not used at all in 25.x)
• txdb: Increase max dbcache size to 1 TB
• GUI: Alt-P shortcut key for paste button in Open URI dialog
• GUI: Enable customisation of QR Code font
• contrib/guix: Attempt to use `guix shell` before the deprecated `guix environment`
• utilioprio: Add Windows support as ioprio_set_file_idle
• crypto/sha256: Use pragmas to enforce necessary intrinsics for GCC and Clang (POWER8)
• RPC: Backward compatibility with Knots 0.19-0.21.0 validateaddress (address_type param and error_index output)
• RPC: getrpcwhitelist: Return a list of wallets as a JSON Object
• wallettool: Warn about dump commands not fully dumping/restoring BDB wallets
• Revert "Remove -feefilter option"
• GUI: Convert payment request to show in QTextEdit
• RPC: add transaction hash to mempool entry output
• wallet: Support %w in -walletnotify script, on Windows
• Restore blockmaxsize option, allowing to limit mined blocks by byte size
• Policy: Restore support for mining based on coin-age priority
• GUI/Wallet: Strip ".dat" from end of wallet display names
• GUI: Restore "request payment" button text
• GUI: Peers: When sorting by address, sort by network first
• GUI/Peers: Drop redundant Network column
• RPC/blockchain: Restore ability for pruned nodes to getblockfrompeer future blocks
• RPC/blockchain: Allow using getblockfrompeer without already having the block header
• Wallet: Remove deprecation warning for newly created legacy wallets
• wallet: Preserve unsupported key origin flags
• net_permissions: Include "addr" permission on implicit whitelist entries
• RPC/blockchain: Add getblockfrompeer nodeid alias for backward compatibility
• GUI: Make Peers table column/splitter size keys uniquely named for Knots 23.0
• Wallet: Increase default confirmation target to 144
• Restore original bytespersigop as bytespersigopstrict
• Add -datacarriercost option to adjust policy vsize of datacarrier bytes
• Revert "Disable bloom filtering by default."
• Wallet: Avoid using change types newer than user's preferred address type
• Add maxscriptsize policy option
• Enforce checkpoints at their specific block height
• Update checkpoints and chain params, adding a new checkpoint at block 803,584
• Make most policy options configurable in GUI Options, and add "corepolicy" option to use Bitcoin Core defaults
• Include Tonal digits and BTC symbol in bundled font