aboutsummaryrefslogtreecommitdiff
path: root/src/serialization (follow)
AgeCommit message (Collapse)AuthorFilesLines
2022-04-06Merge pull request #8197luigi111117-17/+17
da9aa1f Copyright: Update to 2022 (mj-xmr)
2022-04-05plug bulletproofs plus into consensusmoneromooo-monero2-2/+43
2022-03-04Copyright: Update to 2022mj-xmr17-17/+17
2021-09-11RPC and ZeroMQ APIs to support p2poolSChernykh2-0/+25
Adds the following: - "get_miner_data" to RPC API - "json-miner-data" to ZeroMQ subscriber contexts Both provide the necessary data to create a custom block template. They are used by p2pool. Data provided: - major fork version - current height - previous block id - RandomX seed hash - network difficulty - median block weight - coins mined by the network so far - mineable mempool transactions
2021-07-18Fixed json serialization of rct::RCTTypeNullSChernykh1-6/+12
rct::RCTTypeNull doesn't have these fields (ecdhInfo, outPk, txnFee).
2021-06-10Merge pull request #7661luigi111111-89/+94
08e4497 Improve cryptonote (block and tx) binary read performance (Lee Clagett)
2021-04-27clang: fix -Wrange-loop-analysis warningsselsta1-1/+1
2021-03-05fix serialization being different on macmoneromooo-monero4-13/+40
On Mac, size_t is a distinct type from uint64_t, and some types (in wallet cache as well as cold/hot wallet transfer data) use pairs/containers with size_t as fields. Mac would save those as full size, while other platforms would save them as varints. Might apply to other platforms where the types are distinct. There's a nasty hack for backward compatibility, which can go after a couple forks.
2021-01-23Improve cryptonote (block and tx) binary read performanceLee Clagett11-89/+94
2020-09-15wallet2: adapt to deterministic unlock timeTheCharlatan1-0/+2
2020-08-17replace most boost serialization with existing monero serializationmoneromooo-monero8-251/+152
This reduces the attack surface for data that can come from malicious sources (exported output and key images, multisig transactions...) since the monero serialization is already exposed to the outside, and the boost lib we were using had a few known crashers. For interoperability, a new load-deprecated-formats wallet setting is added (off by default). This allows loading boost format data if there is no alternative. It will likely go at some point, along with the ability to load those. Notably, the peer lists file still uses the boost serialization code, as the data it stores is define in epee, while the new serialization code is in monero, and migrating it was fairly hairy. Since this file is local and not obtained from anyone else, the marginal risk is minimal, but it could be migrated later if needed. Some tests and tools also do, this will stay as is for now.
2020-08-16Merge pull request #6603Alexander Blair2-0/+31
4e2377995 Change ZMQ-JSON txextra to hex and remove unnecessary base fields (Lee Clagett)
2020-08-14Change ZMQ-JSON txextra to hex and remove unnecessary base fieldsLee Clagett2-0/+31
2020-08-14Optimize ZMQ-JSON vector reading; GetBlocksFast reads 24%+ fasterLee Clagett1-3/+19
2020-08-14Fix pruned tx for ZMQ's GetBlocksFastLee Clagett3-17/+39
2020-05-04Adding ZMQ/Pub support for txpool_add and chain_main eventsLee Clagett1-1/+1
2020-07-19Merge pull request #6512Alexander Blair18-18/+18
5ef0607da Update copyright year to 2020 (SomaticFanatic)
2020-05-18serialization: fix bad rapidjson api usagemoneromooo-monero1-1/+1
2020-05-06Update copyright year to 2020SomaticFanatic18-18/+18
Update copyright year to 2020
2020-04-11Add byte_stream for zero-copy serialization, and add support in ZMQ-JSON.Lee Clagett2-95/+95
2020-04-04Merge pull request #6395luigi11111-3/+2
ad13a4b Fixing static_asserts in ZMQ JSON (vtnerd)
2020-03-19Fixing static_asserts in ZMQ JSONLee Clagett1-3/+2
2020-03-14workaround for GetObject windows.h macro and rapidjson conflictxiphon1-1/+1
2020-03-09Reduce template bloat in hex->bin for ZMQ jsonLee Clagett2-16/+26
2020-03-05Various improvements to the ZMQ JSON-RPC handling:Lee Clagett3-356/+428
- Finding handling function in ZMQ JSON-RPC now uses binary search - Temporary `std::vector`s in JSON output now use `epee::span` to prevent allocations. - Binary -> hex in JSON output no longer allocates temporary buffer - C++ structs -> JSON skips intermediate DOM creation, and instead write directly to an output stream.
2019-10-25daemon, wallet: new pay for RPC use systemmoneromooo-monero1-0/+4
Daemons intended for public use can be set up to require payment in the form of hashes in exchange for RPC service. This enables public daemons to receive payment for their work over a large number of calls. This system behaves similarly to a pool, so payment takes the form of valid blocks every so often, yielding a large one off payment, rather than constant micropayments. This system can also be used by third parties as a "paywall" layer, where users of a service can pay for use by mining Monero to the service provider's address. An example of this for web site access is Primo, a Monero mining based website "paywall": https://github.com/selene-kovri/primo This has some advantages: - incentive to run a node providing RPC services, thereby promoting the availability of third party nodes for those who can't run their own - incentive to run your own node instead of using a third party's, thereby promoting decentralization - decentralized: payment is done between a client and server, with no third party needed - private: since the system is "pay as you go", you don't need to identify yourself to claim a long lived balance - no payment occurs on the blockchain, so there is no extra transactional load - one may mine with a beefy server, and use those credits from a phone, by reusing the client ID (at the cost of some privacy) - no barrier to entry: anyone may run a RPC node, and your expected revenue depends on how much work you do - Sybil resistant: if you run 1000 idle RPC nodes, you don't magically get more revenue - no large credit balance maintained on servers, so they have no incentive to exit scam - you can use any/many node(s), since there's little cost in switching servers - market based prices: competition between servers to lower costs - incentive for a distributed third party node system: if some public nodes are overused/slow, traffic can move to others - increases network security - helps counteract mining pools' share of the network hash rate - zero incentive for a payer to "double spend" since a reorg does not give any money back to the miner And some disadvantages: - low power clients will have difficulty mining (but one can optionally mine in advance and/or with a faster machine) - payment is "random", so a server might go a long time without a block before getting one - a public node's overall expected payment may be small Public nodes are expected to compete to find a suitable level for cost of service. The daemon can be set up this way to require payment for RPC services: monerod --rpc-payment-address 4xxxxxx \ --rpc-payment-credits 250 --rpc-payment-difficulty 1000 These values are an example only. The --rpc-payment-difficulty switch selects how hard each "share" should be, similar to a mining pool. The higher the difficulty, the fewer shares a client will find. The --rpc-payment-credits switch selects how many credits are awarded for each share a client finds. Considering both options, clients will be awarded credits/difficulty credits for every hash they calculate. For example, in the command line above, 0.25 credits per hash. A client mining at 100 H/s will therefore get an average of 25 credits per second. For reference, in the current implementation, a credit is enough to sync 20 blocks, so a 100 H/s client that's just starting to use Monero and uses this daemon will be able to sync 500 blocks per second. The wallet can be set to automatically mine if connected to a daemon which requires payment for RPC usage. It will try to keep a balance of 50000 credits, stopping mining when it's at this level, and starting again as credits are spent. With the example above, a new client will mine this much credits in about half an hour, and this target is enough to sync 500000 blocks (currently about a third of the monero blockchain). There are three new settings in the wallet: - credits-target: this is the amount of credits a wallet will try to reach before stopping mining. The default of 0 means 50000 credits. - auto-mine-for-rpc-payment-threshold: this controls the minimum credit rate which the wallet considers worth mining for. If the daemon credits less than this ratio, the wallet will consider mining to be not worth it. In the example above, the rate is 0.25 - persistent-rpc-client-id: if set, this allows the wallet to reuse a client id across runs. This means a public node can tell a wallet that's connecting is the same as one that connected previously, but allows a wallet to keep their credit balance from one run to the other. Since the wallet only mines to keep a small credit balance, this is not normally worth doing. However, someone may want to mine on a fast server, and use that credit balance on a low power device such as a phone. If left unset, a new client ID is generated at each wallet start, for privacy reasons. To mine and use a credit balance on two different devices, you can use the --rpc-client-secret-key switch. A wallet's client secret key can be found using the new rpc_payments command in the wallet. Note: anyone knowing your RPC client secret key is able to use your credit balance. The wallet has a few new commands too: - start_mining_for_rpc: start mining to acquire more credits, regardless of the auto mining settings - stop_mining_for_rpc: stop mining to acquire more credits - rpc_payments: display information about current credits with the currently selected daemon The node has an extra command: - rpc_payments: display information about clients and their balances The node will forget about any balance for clients which have been inactive for 6 months. Balances carry over on node restart.
2019-09-27monerod can now sync from pruned blocksmoneromooo-monero2-0/+22
If the peer (whether pruned or not itself) supports sending pruned blocks to syncing nodes, the pruned version will be sent along with the hash of the pruned data and the block weight. The original tx hashes can be reconstructed from the pruned txes and theur prunable data hash. Those hashes and the block weights are hashes and checked against the set of precompiled hashes, ensuring the data we received is the original data. It is currently not possible to use this system when not using the set of precompiled hashes, since block weights can not otherwise be checked for validity. This is off by default for now, and is enabled by --sync-pruned-blocks
2019-07-24Merge pull request #5595luigi11111-0/+2
2aa1134 daemon: display peer address type in print_cn (moneromooo-monero)
2019-06-14serialization: check stream good flag at the endmoneromooo-monero1-1/+1
just in case
2019-06-14serialization: fail on read_varint errormoneromooo-monero1-1/+2
2019-05-31daemon: display peer address type in print_cnmoneromooo-monero1-0/+2
2019-05-01fix wide difficulty conversion with some versions of boostmoneromooo-monero1-2/+2
2019-03-24Make difficulty 128 bit instead of 64 bitmoneromooo-monero1-0/+65
Based on Boolberry work by: jahrsg <jahr@jahr.me> cr.zoidberg <crypto.zoidberg@gmail.com>
2019-03-17Merge pull request #5190Riccardo Spagni1-0/+4
551104fb daemon: add --public-node mode, RPC port propagation over P2P (xiphon)
2019-03-05Update 2019 copyrightbinaryFate19-19/+19
2019-03-04various: remove unused variablesmoneromooo-monero1-1/+0
2019-02-25daemon: add --public-node mode, RPC port propagation over P2Pxiphon1-0/+4
2019-02-01serialization: Use pos_type instead of streamposTom Smeding1-1/+1
According to [1], the ios_base::streampos member type is deprecated, and removed in C++17. This type was an alias for pos_type, which this commit uses instead. [1]: https://en.cppreference.com/w/cpp/io/ios_base
2019-01-22Pruningmoneromooo-monero1-0/+2
The blockchain prunes seven eighths of prunable tx data. This saves about two thirds of the blockchain size, while keeping the node useful as a sync source for an eighth of the blockchain. No other data is currently pruned. There are three ways to prune a blockchain: - run monerod with --prune-blockchain - run "prune_blockchain" in the monerod console - run the monero-blockchain-prune utility The first two will prune in place. Due to how LMDB works, this will not reduce the blockchain size on disk. Instead, it will mark parts of the file as free, so that future data will use that free space, causing the file to not grow until free space grows scarce. The third way will create a second database, a pruned copy of the original one. Since this is a new file, this one will be smaller than the original one. Once the database is pruned, it will stay pruned as it syncs. That is, there is no need to use --prune-blockchain again, etc.
2018-11-15json_archive: initialize inner_array_size in ctormoneromooo-monero1-1/+1
Coverity 136581
2018-11-14Merge pull request #4753Riccardo Spagni1-0/+4
157054b8 hardfork: initialize current_fork_index in ctor (moneromooo-monero) 2362baf7 network_throttle: initialize m_last_sample_time in ctor (moneromooo-monero) d9400f69 serializtion: add missing mainnet and stagenet fields for 0mq (moneromooo-monero) cbe0122b wallet2: initialize amount to 0 in tx_scan_info_t ctor (moneromooo-monero)
2018-10-29serializtion: add missing mainnet and stagenet fields for 0mqmoneromooo-monero1-0/+4
Coverity 184940
2018-10-23Update ZMQ fee estimate and add ZMQ output distributionLee Clagett2-0/+26
2018-10-08tx_pool: avoid parsing a whole tx if only the prefix is neededmoneromooo-monero1-6/+17
2018-09-11v8: per byte fee, pad bulletproofs, fixed 11 ring sizemoneromooo-monero1-0/+8
2018-08-02Fixed ZMQ-RPC for transactions and GET_BLOCKS_FASTLee Clagett2-162/+172
2018-06-29update get_info RPC and bump RPC versionvictorsintnicolaas1-0/+2
2018-03-05Correct spelling mistakes.Edward Betts2-2/+2
2018-01-26Readd copyright starting datexmr-eric1-1/+1
2018-01-26Update 2018 copyrightxmr-eric16-16/+16
2018-01-10Merge pull request #2990Riccardo Spagni7-216/+274
2d17feb0 factor STL container serialization (moneromooo-monero)
2017-12-25Add a chacha20 variant to go with chacha8moneromooo-monero1-2/+2
2017-12-22factor STL container serializationmoneromooo-monero7-216/+274
2017-12-16move includes around to lessen overall loadmoneromooo-monero1-0/+1
2017-12-08add bulletproofs from v7 on testnetmoneromooo-monero2-0/+44
2017-11-24serialization: add std::set and std::unordered_set serializationmoneromooo-monero2-0/+130
2017-11-06track double spending in the txpoolmoneromooo-monero1-0/+2
Transactions in the txpool are marked when another transaction is seen double spending one or more of its inputs. This is then exposed wherever appropriate. Note that being marked with this "double spend seen" flag does NOT mean this transaction IS a double spend and will never be mined: it just means that the network has seen at least another transaction spending at least one of the same inputs, so care should be taken to wait for a few confirmations before acting upon that transaction (ie, mostly of use for merchants wanting to accept unconfirmed transactions).
2017-10-02Merge pull request #2506Riccardo Spagni1-0/+1
c3de19ed json_object: add missing do_not_relay to tx_in_pool serialization (moneromooo-monero)
2017-09-25serialization: add deque serializationmoneromooo-monero2-2/+34
2017-09-21json_object: add missing do_not_relay to tx_in_pool serializationmoneromooo-monero1-0/+1
2017-09-19Fixes static_assert on arm and ppc buildsLee Clagett1-1/+3
2017-09-05Fix various oversights/bugs in ZMQ RPC server codeThomas Winget2-69/+193
- Add some RPC commands (and touch up a couple others) - some bounds checking - some better pointer management - const correctness and error handling -- Thanks @vtnerd for type help with serialization and CMake changes
2017-09-05json serialization for rpc-relevant monero typesThomas Winget3-0/+1466
Structured {de-,}serialization methods for (many new) types which are used for requests or responses in the RPC. New types include RPC requests and responses, and structs which compose types within those. # Conflicts: # src/cryptonote_core/blockchain.cpp
2017-02-21update copyright year, fix occasional lack of newline at line endRiccardo Spagni10-10/+10
2016-09-26serialization: add support for serializing std::pair and std::listmoneromooo-monero3-4/+219
2016-08-28serialization: add override for serializing boolmoneromooo-monero1-0/+6
2016-08-28make rct tx serialization workmoneromooo-monero1-28/+0
It may be suboptimal, but it's a pain to have to rebuild everything when some of this changes. Also, no clue why there seems to be two different code paths for serializing a tx...
2016-08-28rct: add serialization machinery to rct typesmoneromooo-monero1-0/+29
2016-08-28serialization: declare do_serialize specializations before usemoneromooo-monero1-0/+5
This lets my gcc picks those instead of the generic template where appropriate (and then fail since std::vector<something> does not have a serialize method.
2016-01-25even more typosHenning Kopp1-2/+2
2016-01-25more typos fixedHenning Kopp1-2/+2
2016-01-25fixed typoHenning Kopp1-1/+1
2015-12-31updated copyright yearRiccardo Spagni10-10/+10
2015-08-09encrypted payment ids are now 64 bit, instead of 256 bitmoneromooo-monero1-0/+2
Pros: - smaller on the blockchain - shorter integrated addresses Cons: - less sparseness - less ability to embed actual information The boolean argument to encrypt payment ids is now gone from the RPC calls, since the decision is made based on the length of the payment id passed.
2015-02-202014 network limit 1.1 +utils +toc -doc -drmonerorfree2monero1-2/+2
Update of the PR with network limits works very well for all speeds (but remember that low download speed can stop upload because we then slow down downloading of blockchain requests too) more debug options fixed pedantic warnings in our code should work again on Mac OS X and FreeBSD fixed warning about size_t tested on Debian, Ubuntu, Windows(testing now) TCP options and ToS (QoS) flag FIXED peer number limit FIXED some spikes in ingress/download FIXED problems when other up and down limit
2015-01-02year updated in licenseRiccardo Spagni10-10/+10
2014-10-15fixed errant >Riccardo Spagni1-1/+1
2014-10-13Commented most of src/serialization/ going to read up more on variant's and ↵jebes5-101/+319
finish off the job/add last touchs next
2014-07-23License updated to BSD 3-clausefluffypony10-30/+290
2014-07-01Improved (fixed?) serialization for vec<uint32_t>Zachary Michaels1-0/+7
2014-07-01Add missing pragmaZachary Michaels1-0/+2
2014-07-01Add missing pragmaZachary Michaels1-0/+2
2014-07-01Add missing pragmaZachary Michaels1-0/+2
2014-05-250.8.8updatemydesktop2-1/+7
2014-05-13Update serialization.hNoodleDoodleNoodleDoodleNoodleDoodleNoo1-1/+6
1. Added VARINT_FIELD_N(t,f) macro required for tx_extra_merge_mining_tag serialization.
2014-05-03initial [broken] updatemydesktop1-1/+1
2014-03-03moved all stuff to githubAntonio Juarez10-0/+816