Commit Graph

509 Commits

Author SHA1 Message Date
Kevin Froman
ecd2cc54da progress removing communicator timers 2020-11-15 18:26:25 +00:00
Kevin Froman
bbd76da333 added flood fill work, misc bug fixes and removing communicator timers 2020-11-13 08:17:48 +00:00
Kevin Froman
8d839f62c9 bump version 2020-11-03 04:21:17 +00:00
Kevin Froman
a0ae62d0a3 added togglenetwork module in torcontrol 2020-11-03 03:56:24 +00:00
Kevin Froman
a9d0524ccc + added sandbox script
* handle sigterm
2020-11-02 23:47:38 +00:00
Kevin Froman
130e9de5e9 remove disablenetwork for now 2020-11-02 02:09:52 +00:00
Kevin Froman
f0cd2fb2b9 moved blockmetadata to onionrblocks 2020-11-02 01:31:11 +00:00
Kevin Froman
44112750ec Merge branch 'master' into flood-fill 2020-10-29 20:58:17 +00:00
Kevin Froman
f2d7075b3a bump version 2020-10-28 08:28:56 +00:00
Kevin Froman
256c402223 fix connectnewpeers not using specified peer 2020-10-28 07:54:11 +00:00
Kevin Froman
2601263b87 disable forward secrecy for now, fix autocomplete for to address in mail 2020-10-28 02:49:21 +00:00
Kevin Froman
2837210cf4 blockapi decrypt fix 2020-10-27 15:58:06 +00:00
Kevin Froman
f7f4732789 added floodfill network visualization script 2020-10-26 08:32:36 +00:00
Kevin Froman
4a831a4a4d fixed closeness calculation 2020-10-26 06:11:24 +00:00
Kevin Froman
da11c74f6c finished closeness measurement 2020-10-25 04:12:42 +00:00
Kevin Froman
299980f126 work on flood fill network 2020-10-24 08:07:54 +00:00
Kevin Froman
eec8c356ad fix systemrandom shuffle 2020-10-22 15:16:19 +00:00
Kevin Froman
cf0507b82d ensure whole tree is made in createdirs 2020-10-22 14:52:49 +00:00
Kevin Froman
862b39c217 fix systemrandom shuffle 2020-10-22 14:25:57 +00:00
Kevin Froman
4847d9bddf added cpu optimize onboarding option 2020-10-22 12:51:20 +00:00
Kevin Froman
8a4c138eed don't netcheck if tor disabled 2020-10-22 12:45:19 +00:00
Kevin Froman
5dddeb3f10 remove random shuffle function for systemrandom equivalent 2020-10-21 09:46:05 +00:00
Kevin Froman
183e6491d0 use SystemRandom for randomshuffle instead of own rolled implementation 2020-10-19 07:28:38 +00:00
Kevin Froman
c23b286540 added file reader offset 2020-10-17 07:51:28 +00:00
Kevin Froman
fcfecaff7e fix removing circles from nav bar when disabled 2020-10-16 06:30:17 +00:00
Kevin Froman
895b4fe4fd side bar and ui node list fixes 2020-10-15 23:24:25 +00:00
Kevin Froman
cf669024bf handle invalid input when adding peer better 2020-10-15 22:02:51 +00:00
Kevin Froman
a9096dc048 correct return type in storage setdata 2020-10-15 09:50:52 +00:00
Kevin Froman
57225f57f0 work on fixing weird upload issues 2020-10-15 03:56:43 +00:00
Kevin Froman
fbcb95be9e fix mixmate indent 2020-10-15 02:46:20 +00:00
Kevin Froman
e0f59784b1 Fix mixmate and sneakernet 2020-10-14 00:07:41 +00:00
Kevin Froman
d067a343e6 fixed pex 2020-10-11 05:58:42 +00:00
Kevin Froman
3ef29077e7 plaintext block fixes with sharing, fixed peer lookup 2020-10-10 23:23:22 +00:00
Kevin Froman
835c2e527e Fixed encrypted uploads 2020-10-10 08:49:33 +00:00
Kevin Froman
1c44a514a5 Fixed encrypted uploads 2020-10-10 08:43:20 +00:00
Kevin Froman
5baa048a4e Fixed encrypted uploads 2020-10-10 08:41:55 +00:00
Kevin Froman
0338cd64b6 do not upload plaintext to peers that do not support it, closes #14 2020-10-10 04:50:11 +00:00
Kevin Froman
fc7db42deb do not upload plaintext to peers that do not support it, closes #14 2020-10-10 04:26:51 +00:00
Kevin Froman
503bf65cbe fix error on deletion or upload of plaintext blocks to node that does not support it 2020-10-10 02:51:04 +00:00
Kevin Froman
2dc706a894 fixed sneakernet, removed unused vdf 2020-10-10 00:16:24 +00:00
Kevin Froman
d0baa7fd12 deleted csharppow and bumped version 2020-10-09 17:57:12 +00:00
Kevin Froman
10ba2be93f small bug fixes, added more cors headers for pub api browser requests 2020-10-06 02:53:56 +00:00
Kevin Froman
45940b2dba + added address adding input to web ui in sidebar
fixes #10
2020-10-03 22:43:18 +00:00
Kevin Froman
092233027c allow truncated hashes in getblocks public endpoint 2020-09-30 10:05:40 +00:00
Kevin Froman
5abe4cf704 (re)added cors to public api 2020-09-30 07:45:14 +00:00
Kevin Froman
ab9726a41a in removeblock calculate size of block before removing it 2020-09-28 08:19:06 +00:00
Kevin Froman
6370d07f90 fix standalone block file ext in removeblock 2020-09-28 08:18:30 +00:00
Kevin Froman
fa0318802b use new pow value formats 2020-09-25 08:09:08 +00:00
Kevin Froman
48f988877d use new pow value formats 2020-09-25 07:32:29 +00:00
Kevin Froman
68a557daf5 added block type filter for public get blocks endpoint 2020-09-25 05:17:08 +00:00
Kevin Froman
60d6aa0510 c# pow implementation work 2020-09-23 00:36:08 +00:00
Kevin Froman
499981ed52 c# pow implementation work 2020-09-20 21:13:46 +00:00
Kevin Froman
60c1ec07e9 started c# pow implementation 2020-09-19 21:01:31 +00:00
Kevin Froman
646a7c0b80 Removed difficulty adjuster from pow
Fixed board popularity cache
2020-09-19 03:08:42 +00:00
Kevin Froman
5b3d76067a Move users to use phrase system for sites as well 2020-09-15 18:12:39 +00:00
Kevin Froman
c0ebfec034 Default disabled upload mixing with new config value 2020-09-15 18:11:44 +00:00
Kevin Froman
1f067f614a Added tor restart button to index and tor restart command. Enabled tor restart daemon event 2020-09-15 17:08:50 +00:00
Kevin Froman
b4d80da3ff Work on fixing node uptime 2020-09-14 23:28:01 +00:00
Kevin Froman
4bc2bf5db5 removed deterministic keys due to poor hashing 2020-09-14 11:54:14 +00:00
Kevin Froman
b4ddf343fc Removed unreachable return in onionrproofs 2020-09-10 21:44:42 +00:00
Kevin Froman
196d02a751 Sped up + fixed statistics table command using psutil, removed checkcommunicator as a result 2020-09-10 21:44:30 +00:00
Kevin Froman
a5b6805b5f Update readme to have version tag 2020-09-10 20:50:41 +00:00
Kevin Froman
2ce5f48c90 Added ui.public_remote_enabled and ui.public_remote_hosts 2020-09-08 08:39:18 +00:00
Kevin Froman
17ef138c21 bump version 2020-09-07 05:49:13 +00:00
Kevin Froman
b7091d2062 fix showlogo crash when not connected to terminal, bump version 2020-09-07 03:42:13 +00:00
Kevin Froman
f8fcd6d4e5 Formatting changes 2020-09-07 03:18:23 +00:00
Kevin Froman
15a66c7fb4 fix showlogo crash when not connected to terminal 2020-09-07 03:17:20 +00:00
Kevin Froman
37e5dbab4b Moved plugin web files to be in the plugin folder to reduce staticfiles blueprint coupling 2020-09-01 22:41:59 +00:00
Kevin Froman
14f2d03ebf Formatting improvements in httpapis 2020-08-26 08:25:43 +00:00
Kevin Froman
3422ca43ff Fixing block syncing quirks 2020-08-25 15:02:13 -05:00
Kevin Froman
a83351a73c misc formatting improvements 2020-08-25 13:20:37 -05:00
Kevin Froman
39650a4ca0 catch and log when cannot reach non-managed tor 2020-08-23 22:26:54 -05:00
Kevin Froman
8d54519771 implemented the sybil attack script 2020-08-23 11:54:14 -05:00
Kevin Froman
9f1f1435ce Fix block downloading for shared state 2020-08-23 11:53:49 -05:00
Kevin Froman
68aac2153b add some more useful logging for failed signed blocks in validatemetadata 2020-08-23 06:29:12 -05:00
Kevin Froman
02fde0ad70 fix subprocesspow keyboard interrupt not being catched 2020-08-21 10:44:59 -05:00
Kevin Froman
cd0b69b03f Use init-time creation only of StorageCounter to use less inotify instances 2020-08-21 09:56:49 -05:00
Kevin Froman
bbc9646a25 fix LANServer dns rebinding crashing because of old kwarg format 2020-08-20 20:03:11 -05:00
Kevin Froman
fd73f63ecd fix public block list not working because of old kwarg format 2020-08-20 20:00:44 -05:00
Kevin Froman
6089cc3c98 fix formatting in onionrservices 2020-08-19 23:05:06 -05:00
Kevin Froman
05127dd3b7 remove warden since it won't be implemented 2020-08-19 23:04:29 -05:00
Kevin Froman
ce0e60c4ea Correct formatting in expiredblocks 2020-08-17 19:03:42 -05:00
Kevin Froman
0938bf0692 Deduplicate infoNumbers in transportinfo keydb 2020-08-17 19:03:21 -05:00
Kevin Froman
fb4dd07ba4 fix missed blockHash->block_hash change in onionrstorage 2020-08-17 19:02:51 -05:00
Kevin Froman
0b2658374b Added/corrected timeouts for sqlite3 database connections
Bumped mail plugin patch version for sqlite3 timeout change
Code formatting corrections
2020-08-16 19:52:50 -05:00
Kevin Froman
2a7c933321 Utils format fixes 2020-08-12 18:07:04 -05:00
Kevin Froman
c9af24392d Fix netutils formatting 2020-08-12 17:30:12 -05:00
Kevin Froman
272d7d7f74 Removed Windows specific code 2020-08-12 17:21:11 -05:00
Kevin Froman
ce63c4cd3b Show a terminal message if bridge is enabled but one is not set. By design, there is no easy way for us to get Tor bridges automatically
work on tor blocking detection
2020-08-12 13:16:13 -05:00
Kevin Froman
2ddeab8788 work on tor blocking detection 2020-08-11 23:49:26 -05:00
Kevin Froman
a24086da62 add comments to bootstrappeers 2020-08-10 21:35:19 -05:00
Kevin Froman
8389ed190c Basic check for QubesOS in runtime tests and to avoid starting LAN server 2020-08-10 01:09:19 -05:00
Kevin Froman
87b8655b83 do not start lan on qubes 2020-08-10 01:03:32 -05:00
Kevin Froman
feb8004c95 fix generating hashes not being removed when done, add endpoint to get generating hashes 2020-08-09 22:13:06 -05:00
Kevin Froman
3473c5e36a Improved torcontrol formatting and efficency 2020-08-08 21:18:56 -05:00
Kevin Froman
e14955cb6b Improved formatting and removed unnecessary imports in torcontrol 2020-08-08 20:44:11 -05:00
Kevin Froman
5e00bb930f added client api request crafting script 2020-08-08 15:40:20 -05:00
Kevin Froman
6976dcf8f3 Friends API now shows redirect error message when ref header not set instead of request failing 2020-08-08 15:39:24 -05:00
Kevin Froman
96af4e8db0 Fixed some broken things from communicator decoupling 2020-08-08 12:38:14 -05:00
Kevin Froman
bff2595ac9 Merge branch 'new-release' into sidebar 2020-08-08 10:51:04 -05:00
Kevin Froman
522cd2c462 bumped requirements versions 2020-08-08 00:11:45 -05:00
Kevin
077f530b72 Fix peeraction still using comm_inst 2020-08-07 21:57:02 -05:00
Kevin
ab10cea8b6 add forgotten spawndaemonthreads and added license info to bulma extension files 2020-08-04 08:45:06 -05:00
Kevin
086f2f718c fix onlinepeers decoupling 2020-08-04 08:44:24 -05:00
Kevin
4cf17ffe62 work on removing communicator 2020-07-30 20:15:36 -05:00
Kevin
0b34aa7385 added onionrthreads to replace communicator timers 2020-07-29 20:36:41 -05:00
Kevin
6f1daf50d3 added setup kvvars 2020-07-29 20:36:11 -05:00
Kevin
5bde99967b Moved all communicator ext vars to KV 2020-07-29 04:32:09 -05:00
Kevin
f28d469e56 Moved all communicator ext vars to KV 2020-07-29 03:57:06 -05:00
Kevin
080f33bf1f More decoupling, removed unnecessary announceCache 2020-07-26 21:45:17 -05:00
Kevin
fad5e8547e Moved cooldownPeer to KV to further reduce coupling 2020-07-26 19:15:26 -05:00
Kevin
dde10b7005 Moved offllinePeers to KV to further reduce coupling 2020-07-26 19:12:52 -05:00
Kevin
10c1cd7803 Moved blocksToUpload to KV to further reduce coupling 2020-07-26 19:02:39 -05:00
Kevin
97a5f50271 Moved dbTimestamps and newPeers to KV for more decoupling 2020-07-26 15:49:34 -05:00
Kevin
e00d41f8a9 Moved onlinePeers and announceCache to kv for more decoupling 2020-07-26 15:26:15 -05:00
Kevin
6a6718c9fd Moved onlinePeers to KV to further reduce coupling 2020-07-25 22:28:32 -05:00
Kevin
0e4e7bb050 Moved communicator shutdown over to KV model for more decoupling 2020-07-25 21:36:48 -05:00
Kevin
6ecb62356a Moved blockQueue to DSKV singleton as part of communicator decoupling 2020-07-24 14:37:01 -05:00
Kevin
47013431d2 Removed use of communicator's storagecounter to reduce coupling 2020-07-24 03:27:42 -05:00
Kevin
f4d1739e4a made storagecounter use a watchdog (inotify) instead of excessive file reads 2020-07-24 02:57:44 -05:00
Kevin
8b5c87d356 Removed single-process POW support, which was just needed on Windows 2020-07-23 15:16:52 -05:00
Kevin
ac279c1cef bumped version 2020-07-21 21:57:44 -05:00
Kevin
9fc741106a made localcommand pep8 compliant 2020-07-17 13:49:18 -05:00
Kevin
782c980b69 formatting and comment improvements, cleanup 2020-07-07 09:11:30 -05:00
Kevin
714b3a3c33 cleaned up onionrblocks/insert/main some 2020-07-04 14:44:06 -05:00
Kevin
7931f514b6 Only hide blocks uploaded to us if we have outgoing peers (don't send to upload event handler) 2020-06-30 18:34:13 -05:00
Kevin
c46e9590c6 share too_many to all requests (flask "g") handled by public security module 2020-06-30 17:17:22 -05:00
Kevin
3a6322c6c6 Remove _delay_wait_for_share_block_removal because it doesn't seem to exist 2020-06-30 17:16:33 -05:00
Kevin
d6422801a2 don't set lookupblocks timestamp unless they actually have new blocks 2020-06-30 17:09:18 -05:00
Kevin
63e676ed6f cleanup lookupblocks 2020-06-30 17:08:32 -05:00
Kevin
3f13cd84ea * Do not print border around quotes when the terminal is small 2020-06-29 02:30:37 -05:00
Kevin
25485e6aa4 * Revert back to hiding blocks even when we have no outgoing connections
* ensure that block is hidden in public list in insert test
2020-06-29 02:29:55 -05:00
Kevin
1aa707cea5 Do not run LANserver runtime test if we are not on an appropriate LAN (such as VMs/VPS) 2020-06-29 02:28:50 -05:00
Kevin
049956544e improve upload error log messages 2020-06-28 04:18:00 -05:00
Kevin
7f8e63f19b keep trying to connect to new peers eagerly if we have no outgoing connections 2020-06-28 04:17:45 -05:00
Kevin
6738eaf222 don't hide uploaded blocks if we have no peers 2020-06-28 04:16:55 -05:00
Kevin
0d58d57467 add line break to a quote 2020-06-28 04:15:58 -05:00
Kevin
27adbbb199 swap spock for snowden in quotes 2020-06-27 18:05:53 -05:00
Kevin
e9bbd38aab improve verifypow error message info to show affected block 2020-06-27 18:05:39 -05:00
Kevin
cc41ad793e correct gettortransport endpoint tor config reading to use int and not bool 2020-06-27 18:05:04 -05:00
Kevin
b878faeb4c fix bug where onionr would complain while restarting about not being able to start 2020-06-27 18:03:20 -05:00
Kevin
ee28aba792 do not bind to lan if there is no lan 2020-06-25 23:44:39 -05:00
Kevin
1aea6c3362 don't show tor transport box if there is none 2020-06-25 03:29:27 -05:00
Kevin
1bf365aff4 disable lan if there is a local threat (sec level >=3) 2020-06-25 03:28:59 -05:00
Kevin
8d33e1a188 added sqlite3 check for weird python setups 2020-06-23 04:16:40 -05:00
Kevin
6c75c525d2 added gettoraddress private endpoint 2020-06-21 17:54:30 -05:00
Kevin
7d8c3f75e4 fix formatting in httpapi security 2020-06-21 15:48:00 -05:00
Kevin Froman
a24c87c5b0 fix lan server test for real this time 2020-06-21 14:23:46 -05:00
Kevin
34416c07fe made particles more efficient, finished basic blocks feed 2020-06-21 02:27:55 -05:00
Kevin
c81df9093d added particles and some code for recent block listing 2020-06-20 05:31:51 -05:00
Kevin
c9a6769be7 fix lan server test not using raw 2020-06-19 01:29:47 -05:00
Kevin
7205189d62 make lan server test only a few ports, add run time test grace period in service detection attack prevetion mechanism 2020-06-19 01:08:39 -05:00
Kevin
5751468e8a remove deprecated POW 2020-06-19 00:55:37 -05:00
Kevin
eeab5ef2c2 basic lan syncing support is done 2020-06-19 00:55:13 -05:00
Kevin
bae8b38f08 handle ping missed in lan connecting 2020-06-17 00:53:33 -05:00
Kevin
c0b72f9007 handle ping missed in lan connecting 2020-06-17 00:42:40 -05:00
Kevin
1f2c116b4b handle ping missed in lan connecting 2020-06-17 00:37:11 -05:00
Kevin
5b9bb2e5e2 made lan port identification faster 2020-06-17 00:29:03 -05:00
Kevin
1e76990d1e made lan port identification faster 2020-06-17 00:00:52 -05:00
Kevin
0c7afa89f1 fix setup_online_mode in daemon launch 2020-06-16 02:12:05 -05:00
Kevin
a10a32fafb improved documentation + refactored daemonlaunch 2020-06-14 19:08:17 -05:00
Kevin
88824b7913 update runtime test result 2020-06-13 18:18:24 -05:00
Kevin
3c7b090a4e Merge branch 'master' into lan 2020-06-13 18:04:20 -05:00
Kevin
a401f49da3 fix index.html not being auto loaded in subdirs
fix pep8 styling in sitefiles.py
2020-06-13 17:51:09 -05:00
Kevin
3d0f1d9337 fix import format in sitecreator init 2020-06-13 17:50:37 -05:00
Kevin
2a65f605f5 fix site creator not working with full paths by using a temporary chdir
fix grammar issue in site creator
2020-06-13 17:49:16 -05:00
Kevin Froman
7c5359c39e added colors.py 2020-06-09 21:05:33 -05:00
Kevin Froman
026901ce90 Fix gettransports 2020-04-14 22:40:31 -05:00
Kevin Froman
a52465a54f work on lan 2020-04-06 08:51:20 -05:00
Kevin Froman
d13d9a3039 added is_friend test for onionrusers and fixed bug where isFriend was setting instead of getting the value 2020-04-05 23:35:03 -05:00
Kevin Froman
aa729d862c added escape_ansi unittest 2020-04-04 02:21:28 -05:00
Kevin Froman
d47c546620 added dns rebinding runtime test 2020-04-03 23:34:23 -05:00
Kevin Froman
39d0be32ac import jsondecodeerror seperately since its not in ujson 2020-04-03 04:33:30 -05:00
Kevin Froman
a8ab5d20f1 moving onionrutils over to ujson 2020-04-03 04:20:55 -05:00
Kevin Froman
37913d544b fixed localcommand formatting and imports 2020-04-03 04:19:20 -05:00
Kevin Froman
eea8b39b0f refactored onionrusers formatting and json 2020-04-03 04:17:45 -05:00
Kevin Froman
dee5d8ceed make config use ujson
made httpapi use ujson

made onionrblocks mod use ujson

made setup config use ujson

made devreporting use ujson

made transports/tor use ujson

made contactmanager use ujson
2020-04-03 04:13:50 -05:00
Kevin Froman
b23343e7cb use ujson in serializeddata 2020-04-03 03:51:31 -05:00
Kevin Froman
8804c13225 * refactored subprocess and made it 20%+ faster by using ujson
+ added watchdog dep for sneakernet
+ added ujson dep for faster json esp in pow
2020-04-03 03:28:48 -05:00
Kevin Froman
8d372cccfb added stats reporter 2020-03-31 04:00:48 -05:00
Kevin Froman
0da27a78c7 basic requests can now use lan, work on lan client 2020-03-31 01:48:20 -05:00
Kevin Froman
b2f630e4f9 added disk ministry 2020-03-31 00:15:24 -05:00
Kevin Froman
09134eaba4 comment sneakernet 2020-03-30 21:14:48 -05:00
Kevin Froman
1bd0aa9419 added sneakernet auto importing
exportblocks now takes argument
2020-03-30 20:52:04 -05:00
Kevin Froman
d50e6db1d2 fix removeblock docstring 2020-03-27 20:03:30 -05:00
Kevin Froman
012ee33499 corrected onionrstorage formatting 2020-03-26 03:57:54 -05:00
Kevin Froman
b8a8cfd3f6 changed socket_server config key to more accurate ephemeral_tunnels key 2020-03-26 03:49:23 -05:00
Kevin Froman
62b4f5eb0e Removed support for v2 onions 2020-03-26 03:48:57 -05:00
Kevin Froman
db9cd3eb60 remove defunct import in register_private_blueprints.py 2020-03-26 02:33:08 -05:00
Kevin Froman
d24fd41c53 added fd and disk usage stats 2020-03-24 03:18:05 -05:00
Kevin Froman
1be08e09ef reformated sizeutils 2020-03-24 03:17:22 -05:00
Kevin Froman
2aa8cdbaa0 corrected utils formatting and removed defunct utils 2020-03-23 23:55:57 -05:00
Kevin Froman
b5e57da191 lan can now properly connect 2020-03-23 03:39:57 -05:00
Kevin Froman
2c8f1fdf99 restore unicoding in multicast ad 2020-03-23 01:25:27 -05:00
Kevin Froman
eec7efd38d use right multicast address 2020-03-23 01:24:13 -05:00
Kevin Froman
d77f802fdd lan client thread added 2020-03-23 00:37:49 -05:00
Kevin Froman
acabeab7c4 added files for vdf proofing 2020-03-22 19:16:26 -05:00
Kevin Froman
9369a22841 correct updateblockinfo docstring and format 2020-03-22 19:16:08 -05:00
Kevin Froman
481cb5aeff use a smaller offset for obscuring block metadb time 2020-03-21 01:15:07 -05:00
Kevin Froman
4696e7be3f added offset test for lan block list and improved run time tests to be random order and have better iterative output 2020-03-21 01:14:35 -05:00