Commit Graph

509 Commits

Author SHA1 Message Date
Kevin Froman ecd2cc54da progress removing communicator timers 2020-11-15 18:26:25 +00:00
Kevin Froman bbd76da333 added flood fill work, misc bug fixes and removing communicator timers 2020-11-13 08:17:48 +00:00
Kevin Froman 8d839f62c9 bump version 2020-11-03 04:21:17 +00:00
Kevin Froman a0ae62d0a3 added togglenetwork module in torcontrol 2020-11-03 03:56:24 +00:00
Kevin Froman a9d0524ccc + added sandbox script
* handle sigterm
2020-11-02 23:47:38 +00:00
Kevin Froman 130e9de5e9 remove disablenetwork for now 2020-11-02 02:09:52 +00:00
Kevin Froman f0cd2fb2b9 moved blockmetadata to onionrblocks 2020-11-02 01:31:11 +00:00
Kevin Froman 44112750ec Merge branch 'master' into flood-fill 2020-10-29 20:58:17 +00:00
Kevin Froman f2d7075b3a bump version 2020-10-28 08:28:56 +00:00
Kevin Froman 256c402223 fix connectnewpeers not using specified peer 2020-10-28 07:54:11 +00:00
Kevin Froman 2601263b87 disable forward secrecy for now, fix autocomplete for to address in mail 2020-10-28 02:49:21 +00:00
Kevin Froman 2837210cf4 blockapi decrypt fix 2020-10-27 15:58:06 +00:00
Kevin Froman f7f4732789 added floodfill network visualization script 2020-10-26 08:32:36 +00:00
Kevin Froman 4a831a4a4d fixed closeness calculation 2020-10-26 06:11:24 +00:00
Kevin Froman da11c74f6c finished closeness measurement 2020-10-25 04:12:42 +00:00
Kevin Froman 299980f126 work on flood fill network 2020-10-24 08:07:54 +00:00
Kevin Froman eec8c356ad fix systemrandom shuffle 2020-10-22 15:16:19 +00:00
Kevin Froman cf0507b82d ensure whole tree is made in createdirs 2020-10-22 14:52:49 +00:00
Kevin Froman 862b39c217 fix systemrandom shuffle 2020-10-22 14:25:57 +00:00
Kevin Froman 4847d9bddf added cpu optimize onboarding option 2020-10-22 12:51:20 +00:00
Kevin Froman 8a4c138eed don't netcheck if tor disabled 2020-10-22 12:45:19 +00:00
Kevin Froman 5dddeb3f10 remove random shuffle function for systemrandom equivalent 2020-10-21 09:46:05 +00:00
Kevin Froman 183e6491d0 use SystemRandom for randomshuffle instead of own rolled implementation 2020-10-19 07:28:38 +00:00
Kevin Froman c23b286540 added file reader offset 2020-10-17 07:51:28 +00:00
Kevin Froman fcfecaff7e fix removing circles from nav bar when disabled 2020-10-16 06:30:17 +00:00
Kevin Froman 895b4fe4fd side bar and ui node list fixes 2020-10-15 23:24:25 +00:00
Kevin Froman cf669024bf handle invalid input when adding peer better 2020-10-15 22:02:51 +00:00
Kevin Froman a9096dc048 correct return type in storage setdata 2020-10-15 09:50:52 +00:00
Kevin Froman 57225f57f0 work on fixing weird upload issues 2020-10-15 03:56:43 +00:00
Kevin Froman fbcb95be9e fix mixmate indent 2020-10-15 02:46:20 +00:00
Kevin Froman e0f59784b1 Fix mixmate and sneakernet 2020-10-14 00:07:41 +00:00
Kevin Froman d067a343e6 fixed pex 2020-10-11 05:58:42 +00:00
Kevin Froman 3ef29077e7 plaintext block fixes with sharing, fixed peer lookup 2020-10-10 23:23:22 +00:00
Kevin Froman 835c2e527e Fixed encrypted uploads 2020-10-10 08:49:33 +00:00
Kevin Froman 1c44a514a5 Fixed encrypted uploads 2020-10-10 08:43:20 +00:00
Kevin Froman 5baa048a4e Fixed encrypted uploads 2020-10-10 08:41:55 +00:00
Kevin Froman 0338cd64b6 do not upload plaintext to peers that do not support it, closes #14 2020-10-10 04:50:11 +00:00
Kevin Froman fc7db42deb do not upload plaintext to peers that do not support it, closes #14 2020-10-10 04:26:51 +00:00
Kevin Froman 503bf65cbe fix error on deletion or upload of plaintext blocks to node that does not support it 2020-10-10 02:51:04 +00:00
Kevin Froman 2dc706a894 fixed sneakernet, removed unused vdf 2020-10-10 00:16:24 +00:00
Kevin Froman d0baa7fd12 deleted csharppow and bumped version 2020-10-09 17:57:12 +00:00
Kevin Froman 10ba2be93f small bug fixes, added more cors headers for pub api browser requests 2020-10-06 02:53:56 +00:00
Kevin Froman 45940b2dba + added address adding input to web ui in sidebar
fixes #10
2020-10-03 22:43:18 +00:00
Kevin Froman 092233027c allow truncated hashes in getblocks public endpoint 2020-09-30 10:05:40 +00:00
Kevin Froman 5abe4cf704 (re)added cors to public api 2020-09-30 07:45:14 +00:00
Kevin Froman ab9726a41a in removeblock calculate size of block before removing it 2020-09-28 08:19:06 +00:00
Kevin Froman 6370d07f90 fix standalone block file ext in removeblock 2020-09-28 08:18:30 +00:00
Kevin Froman fa0318802b use new pow value formats 2020-09-25 08:09:08 +00:00
Kevin Froman 48f988877d use new pow value formats 2020-09-25 07:32:29 +00:00
Kevin Froman 68a557daf5 added block type filter for public get blocks endpoint 2020-09-25 05:17:08 +00:00
Kevin Froman 60d6aa0510 c# pow implementation work 2020-09-23 00:36:08 +00:00
Kevin Froman 499981ed52 c# pow implementation work 2020-09-20 21:13:46 +00:00
Kevin Froman 60c1ec07e9 started c# pow implementation 2020-09-19 21:01:31 +00:00
Kevin Froman 646a7c0b80 Removed difficulty adjuster from pow
Fixed board popularity cache
2020-09-19 03:08:42 +00:00
Kevin Froman 5b3d76067a Move users to use phrase system for sites as well 2020-09-15 18:12:39 +00:00
Kevin Froman c0ebfec034 Default disabled upload mixing with new config value 2020-09-15 18:11:44 +00:00
Kevin Froman 1f067f614a Added tor restart button to index and tor restart command. Enabled tor restart daemon event 2020-09-15 17:08:50 +00:00
Kevin Froman b4d80da3ff Work on fixing node uptime 2020-09-14 23:28:01 +00:00
Kevin Froman 4bc2bf5db5 removed deterministic keys due to poor hashing 2020-09-14 11:54:14 +00:00
Kevin Froman b4ddf343fc Removed unreachable return in onionrproofs 2020-09-10 21:44:42 +00:00
Kevin Froman 196d02a751 Sped up + fixed statistics table command using psutil, removed checkcommunicator as a result 2020-09-10 21:44:30 +00:00
Kevin Froman a5b6805b5f Update readme to have version tag 2020-09-10 20:50:41 +00:00
Kevin Froman 2ce5f48c90 Added ui.public_remote_enabled and ui.public_remote_hosts 2020-09-08 08:39:18 +00:00
Kevin Froman 17ef138c21 bump version 2020-09-07 05:49:13 +00:00
Kevin Froman b7091d2062 fix showlogo crash when not connected to terminal, bump version 2020-09-07 03:42:13 +00:00
Kevin Froman f8fcd6d4e5 Formatting changes 2020-09-07 03:18:23 +00:00
Kevin Froman 15a66c7fb4 fix showlogo crash when not connected to terminal 2020-09-07 03:17:20 +00:00
Kevin Froman 37e5dbab4b Moved plugin web files to be in the plugin folder to reduce staticfiles blueprint coupling 2020-09-01 22:41:59 +00:00
Kevin Froman 14f2d03ebf Formatting improvements in httpapis 2020-08-26 08:25:43 +00:00
Kevin Froman 3422ca43ff Fixing block syncing quirks 2020-08-25 15:02:13 -05:00
Kevin Froman a83351a73c misc formatting improvements 2020-08-25 13:20:37 -05:00
Kevin Froman 39650a4ca0 catch and log when cannot reach non-managed tor 2020-08-23 22:26:54 -05:00
Kevin Froman 8d54519771 implemented the sybil attack script 2020-08-23 11:54:14 -05:00
Kevin Froman 9f1f1435ce Fix block downloading for shared state 2020-08-23 11:53:49 -05:00
Kevin Froman 68aac2153b add some more useful logging for failed signed blocks in validatemetadata 2020-08-23 06:29:12 -05:00
Kevin Froman 02fde0ad70 fix subprocesspow keyboard interrupt not being catched 2020-08-21 10:44:59 -05:00
Kevin Froman cd0b69b03f Use init-time creation only of StorageCounter to use less inotify instances 2020-08-21 09:56:49 -05:00
Kevin Froman bbc9646a25 fix LANServer dns rebinding crashing because of old kwarg format 2020-08-20 20:03:11 -05:00
Kevin Froman fd73f63ecd fix public block list not working because of old kwarg format 2020-08-20 20:00:44 -05:00
Kevin Froman 6089cc3c98 fix formatting in onionrservices 2020-08-19 23:05:06 -05:00
Kevin Froman 05127dd3b7 remove warden since it won't be implemented 2020-08-19 23:04:29 -05:00
Kevin Froman ce0e60c4ea Correct formatting in expiredblocks 2020-08-17 19:03:42 -05:00
Kevin Froman 0938bf0692 Deduplicate infoNumbers in transportinfo keydb 2020-08-17 19:03:21 -05:00
Kevin Froman fb4dd07ba4 fix missed blockHash->block_hash change in onionrstorage 2020-08-17 19:02:51 -05:00
Kevin Froman 0b2658374b Added/corrected timeouts for sqlite3 database connections
Bumped mail plugin patch version for sqlite3 timeout change
Code formatting corrections
2020-08-16 19:52:50 -05:00
Kevin Froman 2a7c933321 Utils format fixes 2020-08-12 18:07:04 -05:00
Kevin Froman c9af24392d Fix netutils formatting 2020-08-12 17:30:12 -05:00
Kevin Froman 272d7d7f74 Removed Windows specific code 2020-08-12 17:21:11 -05:00
Kevin Froman ce63c4cd3b Show a terminal message if bridge is enabled but one is not set. By design, there is no easy way for us to get Tor bridges automatically
work on tor blocking detection
2020-08-12 13:16:13 -05:00
Kevin Froman 2ddeab8788 work on tor blocking detection 2020-08-11 23:49:26 -05:00
Kevin Froman a24086da62 add comments to bootstrappeers 2020-08-10 21:35:19 -05:00
Kevin Froman 8389ed190c Basic check for QubesOS in runtime tests and to avoid starting LAN server 2020-08-10 01:09:19 -05:00
Kevin Froman 87b8655b83 do not start lan on qubes 2020-08-10 01:03:32 -05:00
Kevin Froman feb8004c95 fix generating hashes not being removed when done, add endpoint to get generating hashes 2020-08-09 22:13:06 -05:00
Kevin Froman 3473c5e36a Improved torcontrol formatting and efficency 2020-08-08 21:18:56 -05:00
Kevin Froman e14955cb6b Improved formatting and removed unnecessary imports in torcontrol 2020-08-08 20:44:11 -05:00
Kevin Froman 5e00bb930f added client api request crafting script 2020-08-08 15:40:20 -05:00
Kevin Froman 6976dcf8f3 Friends API now shows redirect error message when ref header not set instead of request failing 2020-08-08 15:39:24 -05:00
Kevin Froman 96af4e8db0 Fixed some broken things from communicator decoupling 2020-08-08 12:38:14 -05:00
Kevin Froman bff2595ac9 Merge branch 'new-release' into sidebar 2020-08-08 10:51:04 -05:00
Kevin Froman 522cd2c462 bumped requirements versions 2020-08-08 00:11:45 -05:00
Kevin 077f530b72 Fix peeraction still using comm_inst 2020-08-07 21:57:02 -05:00
Kevin ab10cea8b6 add forgotten spawndaemonthreads and added license info to bulma extension files 2020-08-04 08:45:06 -05:00
Kevin 086f2f718c fix onlinepeers decoupling 2020-08-04 08:44:24 -05:00
Kevin 4cf17ffe62 work on removing communicator 2020-07-30 20:15:36 -05:00
Kevin 0b34aa7385 added onionrthreads to replace communicator timers 2020-07-29 20:36:41 -05:00
Kevin 6f1daf50d3 added setup kvvars 2020-07-29 20:36:11 -05:00
Kevin 5bde99967b Moved all communicator ext vars to KV 2020-07-29 04:32:09 -05:00
Kevin f28d469e56 Moved all communicator ext vars to KV 2020-07-29 03:57:06 -05:00
Kevin 080f33bf1f More decoupling, removed unnecessary announceCache 2020-07-26 21:45:17 -05:00
Kevin fad5e8547e Moved cooldownPeer to KV to further reduce coupling 2020-07-26 19:15:26 -05:00
Kevin dde10b7005 Moved offllinePeers to KV to further reduce coupling 2020-07-26 19:12:52 -05:00
Kevin 10c1cd7803 Moved blocksToUpload to KV to further reduce coupling 2020-07-26 19:02:39 -05:00
Kevin 97a5f50271 Moved dbTimestamps and newPeers to KV for more decoupling 2020-07-26 15:49:34 -05:00
Kevin e00d41f8a9 Moved onlinePeers and announceCache to kv for more decoupling 2020-07-26 15:26:15 -05:00
Kevin 6a6718c9fd Moved onlinePeers to KV to further reduce coupling 2020-07-25 22:28:32 -05:00
Kevin 0e4e7bb050 Moved communicator shutdown over to KV model for more decoupling 2020-07-25 21:36:48 -05:00
Kevin 6ecb62356a Moved blockQueue to DSKV singleton as part of communicator decoupling 2020-07-24 14:37:01 -05:00
Kevin 47013431d2 Removed use of communicator's storagecounter to reduce coupling 2020-07-24 03:27:42 -05:00
Kevin f4d1739e4a made storagecounter use a watchdog (inotify) instead of excessive file reads 2020-07-24 02:57:44 -05:00
Kevin 8b5c87d356 Removed single-process POW support, which was just needed on Windows 2020-07-23 15:16:52 -05:00
Kevin ac279c1cef bumped version 2020-07-21 21:57:44 -05:00
Kevin 9fc741106a made localcommand pep8 compliant 2020-07-17 13:49:18 -05:00
Kevin 782c980b69 formatting and comment improvements, cleanup 2020-07-07 09:11:30 -05:00
Kevin 714b3a3c33 cleaned up onionrblocks/insert/main some 2020-07-04 14:44:06 -05:00
Kevin 7931f514b6 Only hide blocks uploaded to us if we have outgoing peers (don't send to upload event handler) 2020-06-30 18:34:13 -05:00
Kevin c46e9590c6 share too_many to all requests (flask "g") handled by public security module 2020-06-30 17:17:22 -05:00
Kevin 3a6322c6c6 Remove _delay_wait_for_share_block_removal because it doesn't seem to exist 2020-06-30 17:16:33 -05:00
Kevin d6422801a2 don't set lookupblocks timestamp unless they actually have new blocks 2020-06-30 17:09:18 -05:00
Kevin 63e676ed6f cleanup lookupblocks 2020-06-30 17:08:32 -05:00
Kevin 3f13cd84ea * Do not print border around quotes when the terminal is small 2020-06-29 02:30:37 -05:00
Kevin 25485e6aa4 * Revert back to hiding blocks even when we have no outgoing connections
* ensure that block is hidden in public list in insert test
2020-06-29 02:29:55 -05:00
Kevin 1aa707cea5 Do not run LANserver runtime test if we are not on an appropriate LAN (such as VMs/VPS) 2020-06-29 02:28:50 -05:00
Kevin 049956544e improve upload error log messages 2020-06-28 04:18:00 -05:00
Kevin 7f8e63f19b keep trying to connect to new peers eagerly if we have no outgoing connections 2020-06-28 04:17:45 -05:00
Kevin 6738eaf222 don't hide uploaded blocks if we have no peers 2020-06-28 04:16:55 -05:00
Kevin 0d58d57467 add line break to a quote 2020-06-28 04:15:58 -05:00
Kevin 27adbbb199 swap spock for snowden in quotes 2020-06-27 18:05:53 -05:00
Kevin e9bbd38aab improve verifypow error message info to show affected block 2020-06-27 18:05:39 -05:00
Kevin cc41ad793e correct gettortransport endpoint tor config reading to use int and not bool 2020-06-27 18:05:04 -05:00
Kevin b878faeb4c fix bug where onionr would complain while restarting about not being able to start 2020-06-27 18:03:20 -05:00
Kevin ee28aba792 do not bind to lan if there is no lan 2020-06-25 23:44:39 -05:00
Kevin 1aea6c3362 don't show tor transport box if there is none 2020-06-25 03:29:27 -05:00
Kevin 1bf365aff4 disable lan if there is a local threat (sec level >=3) 2020-06-25 03:28:59 -05:00
Kevin 8d33e1a188 added sqlite3 check for weird python setups 2020-06-23 04:16:40 -05:00
Kevin 6c75c525d2 added gettoraddress private endpoint 2020-06-21 17:54:30 -05:00
Kevin 7d8c3f75e4 fix formatting in httpapi security 2020-06-21 15:48:00 -05:00
Kevin Froman a24c87c5b0 fix lan server test for real this time 2020-06-21 14:23:46 -05:00
Kevin 34416c07fe made particles more efficient, finished basic blocks feed 2020-06-21 02:27:55 -05:00
Kevin c81df9093d added particles and some code for recent block listing 2020-06-20 05:31:51 -05:00
Kevin c9a6769be7 fix lan server test not using raw 2020-06-19 01:29:47 -05:00
Kevin 7205189d62 make lan server test only a few ports, add run time test grace period in service detection attack prevetion mechanism 2020-06-19 01:08:39 -05:00
Kevin 5751468e8a remove deprecated POW 2020-06-19 00:55:37 -05:00
Kevin eeab5ef2c2 basic lan syncing support is done 2020-06-19 00:55:13 -05:00
Kevin bae8b38f08 handle ping missed in lan connecting 2020-06-17 00:53:33 -05:00
Kevin c0b72f9007 handle ping missed in lan connecting 2020-06-17 00:42:40 -05:00
Kevin 1f2c116b4b handle ping missed in lan connecting 2020-06-17 00:37:11 -05:00
Kevin 5b9bb2e5e2 made lan port identification faster 2020-06-17 00:29:03 -05:00
Kevin 1e76990d1e made lan port identification faster 2020-06-17 00:00:52 -05:00
Kevin 0c7afa89f1 fix setup_online_mode in daemon launch 2020-06-16 02:12:05 -05:00
Kevin a10a32fafb improved documentation + refactored daemonlaunch 2020-06-14 19:08:17 -05:00
Kevin 88824b7913 update runtime test result 2020-06-13 18:18:24 -05:00
Kevin 3c7b090a4e Merge branch 'master' into lan 2020-06-13 18:04:20 -05:00
Kevin a401f49da3 fix index.html not being auto loaded in subdirs
fix pep8 styling in sitefiles.py
2020-06-13 17:51:09 -05:00
Kevin 3d0f1d9337 fix import format in sitecreator init 2020-06-13 17:50:37 -05:00
Kevin 2a65f605f5 fix site creator not working with full paths by using a temporary chdir
fix grammar issue in site creator
2020-06-13 17:49:16 -05:00
Kevin Froman 7c5359c39e added colors.py 2020-06-09 21:05:33 -05:00
Kevin Froman 026901ce90 Fix gettransports 2020-04-14 22:40:31 -05:00
Kevin Froman a52465a54f work on lan 2020-04-06 08:51:20 -05:00
Kevin Froman d13d9a3039 added is_friend test for onionrusers and fixed bug where isFriend was setting instead of getting the value 2020-04-05 23:35:03 -05:00
Kevin Froman aa729d862c added escape_ansi unittest 2020-04-04 02:21:28 -05:00
Kevin Froman d47c546620 added dns rebinding runtime test 2020-04-03 23:34:23 -05:00
Kevin Froman 39d0be32ac import jsondecodeerror seperately since its not in ujson 2020-04-03 04:33:30 -05:00
Kevin Froman a8ab5d20f1 moving onionrutils over to ujson 2020-04-03 04:20:55 -05:00
Kevin Froman 37913d544b fixed localcommand formatting and imports 2020-04-03 04:19:20 -05:00
Kevin Froman eea8b39b0f refactored onionrusers formatting and json 2020-04-03 04:17:45 -05:00
Kevin Froman dee5d8ceed make config use ujson
made httpapi use ujson

made onionrblocks mod use ujson

made setup config use ujson

made devreporting use ujson

made transports/tor use ujson

made contactmanager use ujson
2020-04-03 04:13:50 -05:00
Kevin Froman b23343e7cb use ujson in serializeddata 2020-04-03 03:51:31 -05:00
Kevin Froman 8804c13225 * refactored subprocess and made it 20%+ faster by using ujson
+ added watchdog dep for sneakernet
+ added ujson dep for faster json esp in pow
2020-04-03 03:28:48 -05:00
Kevin Froman 8d372cccfb added stats reporter 2020-03-31 04:00:48 -05:00
Kevin Froman 0da27a78c7 basic requests can now use lan, work on lan client 2020-03-31 01:48:20 -05:00
Kevin Froman b2f630e4f9 added disk ministry 2020-03-31 00:15:24 -05:00
Kevin Froman 09134eaba4 comment sneakernet 2020-03-30 21:14:48 -05:00
Kevin Froman 1bd0aa9419 added sneakernet auto importing
exportblocks now takes argument
2020-03-30 20:52:04 -05:00
Kevin Froman d50e6db1d2 fix removeblock docstring 2020-03-27 20:03:30 -05:00
Kevin Froman 012ee33499 corrected onionrstorage formatting 2020-03-26 03:57:54 -05:00
Kevin Froman b8a8cfd3f6 changed socket_server config key to more accurate ephemeral_tunnels key 2020-03-26 03:49:23 -05:00
Kevin Froman 62b4f5eb0e Removed support for v2 onions 2020-03-26 03:48:57 -05:00
Kevin Froman db9cd3eb60 remove defunct import in register_private_blueprints.py 2020-03-26 02:33:08 -05:00
Kevin Froman d24fd41c53 added fd and disk usage stats 2020-03-24 03:18:05 -05:00
Kevin Froman 1be08e09ef reformated sizeutils 2020-03-24 03:17:22 -05:00
Kevin Froman 2aa8cdbaa0 corrected utils formatting and removed defunct utils 2020-03-23 23:55:57 -05:00
Kevin Froman b5e57da191 lan can now properly connect 2020-03-23 03:39:57 -05:00
Kevin Froman 2c8f1fdf99 restore unicoding in multicast ad 2020-03-23 01:25:27 -05:00
Kevin Froman eec7efd38d use right multicast address 2020-03-23 01:24:13 -05:00
Kevin Froman d77f802fdd lan client thread added 2020-03-23 00:37:49 -05:00
Kevin Froman acabeab7c4 added files for vdf proofing 2020-03-22 19:16:26 -05:00
Kevin Froman 9369a22841 correct updateblockinfo docstring and format 2020-03-22 19:16:08 -05:00
Kevin Froman 481cb5aeff use a smaller offset for obscuring block metadb time 2020-03-21 01:15:07 -05:00
Kevin Froman 4696e7be3f added offset test for lan block list and improved run time tests to be random order and have better iterative output 2020-03-21 01:14:35 -05:00