aboutsummaryrefslogtreecommitdiff
path: root/src/crypto (follow)
AgeCommit message (Collapse)AuthorFilesLines
2015-07-15** CHANGES ARE EXPERIMENTAL (FOR TESTING ONLY)NoodleDoodleNoodleDoodleNoodleDoodleNoo2-2/+200
Bockchain: 1. Optim: Multi-thread long-hash computation when encountering groups of blocks. 2. Optim: Cache verified txs and return result from cache instead of re-checking whenever possible. 3. Optim: Preload output-keys when encoutering groups of blocks. Sort by amount and global-index before bulk querying database and multi-thread when possible. 4. Optim: Disable double spend check on block verification, double spend is already detected when trying to add blocks. 5. Optim: Multi-thread signature computation whenever possible. 6. Patch: Disable locking (recursive mutex) on called functions from check_tx_inputs which causes slowdowns (only seems to happen on ubuntu/VMs??? Reason: TBD) 7. Optim: Removed looped full-tx hash computation when retrieving transactions from pool (???). 8. Optim: Cache difficulty/timestamps (735 blocks) for next-difficulty calculations so that only 2 db reads per new block is needed when a new block arrives (instead of 1470 reads). Berkeley-DB: 1. Fix: 32-bit data errors causing wrong output global indices and failure to send blocks to peers (etc). 2. Fix: Unable to pop blocks on reorganize due to transaction errors. 3. Patch: Large number of transaction aborts when running multi-threaded bulk queries. 4. Patch: Insufficient locks error when running full sync. 5. Patch: Incorrect db stats when returning from an immediate exit from "pop block" operation. 6. Optim: Add bulk queries to get output global indices. 7. Optim: Modified output_keys table to store public_key+unlock_time+height for single transaction lookup (vs 3) 8. Optim: Used output_keys table retrieve public_keys instead of going through output_amounts->output_txs+output_indices->txs->output:public_key 9. Optim: Added thread-safe buffers used when multi-threading bulk queries. 10. Optim: Added support for nosync/write_nosync options for improved performance (*see --db-sync-mode option for details) 11. Mod: Added checkpoint thread and auto-remove-logs option. 12. *Now usable on 32-bit systems like RPI2. LMDB: 1. Optim: Added custom comparison for 256-bit key tables (minor speed-up, TBD: get actual effect) 2. Optim: Modified output_keys table to store public_key+unlock_time+height for single transaction lookup (vs 3) 3. Optim: Used output_keys table retrieve public_keys instead of going through output_amounts->output_txs+output_indices->txs->output:public_key 4. Optim: Added support for sync/writemap options for improved performance (*see --db-sync-mode option for details) 5. Mod: Auto resize to +1GB instead of multiplier x1.5 ETC: 1. Minor optimizations for slow-hash for ARM (RPI2). Incomplete. 2. Fix: 32-bit saturation bug when computing next difficulty on large blocks. [PENDING ISSUES] 1. Berkely db has a very slow "pop-block" operation. This is very noticeable on the RPI2 as it sometimes takes > 10 MINUTES to pop a block during reorganization. This does not happen very often however, most reorgs seem to take a few seconds but it possibly depends on the number of outputs present. TBD. 2. Berkeley db, possible bug "unable to allocate memory". TBD. [NEW OPTIONS] (*Currently all enabled for testing purposes) 1. --fast-block-sync arg=[0:1] (default: 1) a. 0 = Compute long hash per block (may take a while depending on CPU) b. 1 = Skip long-hash and verify blocks based on embedded known good block hashes (faster, minimal CPU dependence) 2. --db-sync-mode arg=[[safe|fast|fastest]:[sync|async]:[nblocks_per_sync]] (default: fastest:async:1000) a. safe = fdatasync/fsync (or equivalent) per stored block. Very slow, but safest option to protect against power-out/crash conditions. b. fast/fastest = Enables asynchronous fdatasync/fsync (or equivalent). Useful for battery operated devices or STABLE systems with UPS and/or systems with battery backed write cache/solid state cache. Fast - Write meta-data but defer data flush. Fastest - Defer meta-data and data flush. Sync - Flush data after nblocks_per_sync and wait. Async - Flush data after nblocks_per_sync but do not wait for the operation to finish. 3. --prep-blocks-threads arg=[n] (default: 4 or system max threads, whichever is lower) Max number of threads to use when computing long-hash in groups. 4. --show-time-stats arg=[0:1] (default: 1) Show benchmark related time stats. 5. --db-auto-remove-logs arg=[0:1] (default: 1) For berkeley-db only. Auto remove logs if enabled. **Note: lmdb and berkeley-db have changes to the tables and are not compatible with official git head version. At the moment, you need a full resync to use this optimized version. [PERFORMANCE COMPARISON] **Some figures are approximations only. Using a baseline machine of an i7-2600K+SSD+(with full pow computation): 1. The optimized lmdb/blockhain core can process blocks up to 585K for ~1.25 hours + download time, so it usually takes 2.5 hours to sync the full chain. 2. The current head with memory can process blocks up to 585K for ~4.2 hours + download time, so it usually takes 5.5 hours to sync the full chain. 3. The current head with lmdb can process blocks up to 585K for ~32 hours + download time and usually takes 36 hours to sync the full chain. Averate procesing times (with full pow computation): lmdb-optimized: 1. tx_ave = 2.5 ms / tx 2. block_ave = 5.87 ms / block memory-official-repo: 1. tx_ave = 8.85 ms / tx 2. block_ave = 19.68 ms / block lmdb-official-repo (0f4a036437fd41a5498ee5e74e2422ea6177aa3e) 1. tx_ave = 47.8 ms / tx 2. block_ave = 64.2 ms / block **Note: The following data denotes processing times only (does not include p2p download time) lmdb-optimized processing times (with full pow computation): 1. Desktop, Quad-core / 8-threads 2600k (8Mb) - 1.25 hours processing time (--db-sync-mode=fastest:async:1000). 2. Laptop, Dual-core / 4-threads U4200 (3Mb) - 4.90 hours processing time (--db-sync-mode=fastest:async:1000). 3. Embedded, Quad-core / 4-threads Z3735F (2x1Mb) - 12.0 hours processing time (--db-sync-mode=fastest:async:1000). lmdb-optimized processing times (with per-block-checkpoint) 1. Desktop, Quad-core / 8-threads 2600k (8Mb) - 10 minutes processing time (--db-sync-mode=fastest:async:1000). berkeley-db optimized processing times (with full pow computation) 1. Desktop, Quad-core / 8-threads 2600k (8Mb) - 1.8 hours processing time (--db-sync-mode=fastest:async:1000). 2. RPI2. Improved from estimated 3 months(???) into 2.5 days (*Need 2AMP supply + Clock:1Ghz + [usb+ssd] to achieve this speed) (--db-sync-mode=fastest:async:1000). berkeley-db optimized processing times (with per-block-checkpoint) 1. RPI2. 12-15 hours (*Need 2AMP supply + Clock:1Ghz + [usb+ssd] to achieve this speed) (--db-sync-mode=fastest:async:1000).
2015-04-13disable non-working optimized slow_hash on 32 bit intelJavier Smooth1-1/+1
2015-04-05no newline at end of fileRiccardo Spagni1-1/+1
2015-01-28make fallback compatible with newer slow-hashRiccardo Spagni1-0/+12
2015-01-27added portable slow-hash, updated makefile targets, fixed readmeRiccardo Spagni1-2/+152
2015-01-27fixed sse2 ifdefRiccardo Spagni1-2/+2
2015-01-27remove aes flag, detect no sse2Riccardo Spagni1-0/+2
2015-01-02year updated in licenseRiccardo Spagni26-26/+26
2014-10-23cmake: handle private vs. public headersBen Boeckel1-2/+7
2014-10-23cmake: refactor common code with librariesBen Boeckel1-9/+1
2014-10-23cmake: put each library into its own directoryBen Boeckel1-0/+79
This cleans up the CMake code and shows patterns more easily (to be refactored in the next commit).
2014-10-06capitalize Keccak everywhereDavid G. Andersen1-1/+1
2014-10-06typo fix - cryptonight, not cryptonoteDavid G. Andersen1-1/+1
2014-10-06Fix comment start for two functionsDavid G. Andersen1-2/+2
2014-10-05another typo fixDavid G. Andersen1-1/+1
2014-10-05fix typoDavid G. Andersen1-1/+1
2014-10-05More documentationDavid G. Andersen1-10/+63
2014-10-05initial doxygen commenting of the CryptoNight proof-of-work codeDavid G. Andersen1-1/+85
2014-09-28Merge with origin/masterOran Juice1-4/+12
2014-09-23Moved mnemonics code to src/mnemonicsOran Juice2-3446/+0
2014-09-15More preprocessor fixes for slow-hashZachary Michaels1-3/+3
2014-09-15Correct includes for mingw in slow-hashZachary Michaels1-0/+8
This needs testing
2014-09-15Change Windows include to windowsZachary Michaels1-1/+1
mingw is case sensitive
2014-09-10mmap on FreeBSD doesn't have MAP_HUGETLBfluffypony1-1/+1
2014-09-10Include sys/time.h on BSDfluffypony1-0/+2
2014-09-10replace ftime with gettimeofday on FreeBSD because lcompat is stupidfluffypony1-0/+28
2014-09-09more FreeBSD fixesfluffypony1-2/+7
2014-09-09malloc.h reference fixed for FreeBSDfluffypony1-2/+2
2014-09-09FreeBSD alloca.h reference fixedfluffypony2-2/+12
2014-09-06Fix tree-hash cnt n^2. Asserts, comment. Squash2rfree2monero1-6/+48
2014-09-02fixed OS X malloc.h referencefluffypony1-1/+4
2014-07-23License updated to BSD 3-clausefluffypony26-57/+750
2014-07-01Remove unused array in cn_slow_hashZachary Michaels1-1/+0
2014-06-19Update slow-hash.cNoodleDoodleNoodleDoodleNoodleDoodleNoo1-0/+5
1. Fix for Mac OSX compilation errors.
2014-06-16Update slow-hash.cNoodleDoodleNoodleDoodleNoodleDoodleNoo1-1/+8
1. Added multiplication support in 32-bit mode
2014-06-16Update slow-hash.cNoodleDoodleNoodleDoodleNoodleDoodleNoo1-110/+288
1. Added huge pages support and optimized scratchpad twiddling. (credits to dga). 2. Added aes-ni key expansion support. 3. Minor speedup to scratchpad initialization/finalization.
2014-06-12stupid signed arithmetic.Thomas Winget1-6/+3
2014-06-12more pointer-based derpThomas Winget2-3/+13
2014-06-12fixed some pointer- and loop-based derpsThomas Winget1-1/+1
2014-06-12builds, but doesn't link. other than that, electrum-style recovery ↵Thomas Winget3-11/+26
implemented (but not tested\!)
2014-06-12missing '.at' on two map calls. built on some machines, very strange...Thomas Winget1-2/+2
2014-06-12revert 'dirty hack' change to crypto.h. need a better way for sure.Thomas Winget1-4/+1
2014-06-12compile issues, resolve later. commiting because switching machinestom3-2/+83
2014-06-12most functions prototyped/modified for wallet recoveryThomas Winget3-0/+3311
2014-05-250.8.8updatemydesktop2-13/+11
2014-05-21Update slow-hash.cNoodleDoodleNoodleDoodleNoodleDoodleNoo1-117/+223
1. Added AES-NI support for modern processors.
2014-05-17Create aesb.cNoodleDoodleNoodleDoodleNoodleDoodleNoo1-0/+177
2014-05-17Update slow-hash.cNoodleDoodleNoodleDoodleNoodleDoodleNoo1-14/+18
1. Various optimizations for faster hashing performance.
2014-05-17Update oaes_lib.cNoodleDoodleNoodleDoodleNoodleDoodleNoo1-24/+0
1. Moved structs oaes_ctx and oaes_key into oeas_lib header.
2014-05-17Update oaes_lib.hNoodleDoodleNoodleDoodleNoodleDoodleNoo1-0/+26
1. Moved structs oaes_ctx and oaes_key into oeas_lib header.
2014-05-17Update oaes_config.hNoodleDoodleNoodleDoodleNoodleDoodleNoo1-3/+3
1. Disabled OAES_DEBUG flag
2014-05-07Update slow-hash.cNoodleDoodleNoodleDoodleNoodleDoodleNoo1-6/+4
Fixed scratchpad initialization/finalization for faster looping.
2014-04-30various fixes to allow mac osx compilationmydesktop1-0/+1
2014-03-03moved all stuff to githubAntonio Juarez37-440/+6347
2013-11-15crypto libamjuarez11-0/+4627
generated by cgit v1.2.3 (git 2.25.1) at 2025-01-04 11:45:20 +0000