Commit Graph

436 Commits

Author SHA1 Message Date
Kevin Froman
9f1f1435ce Fix block downloading for shared state 2020-08-23 11:53:49 -05:00
Kevin Froman
68aac2153b add some more useful logging for failed signed blocks in validatemetadata 2020-08-23 06:29:12 -05:00
Kevin Froman
02fde0ad70 fix subprocesspow keyboard interrupt not being catched 2020-08-21 10:44:59 -05:00
Kevin Froman
cd0b69b03f Use init-time creation only of StorageCounter to use less inotify instances 2020-08-21 09:56:49 -05:00
Kevin Froman
bbc9646a25 fix LANServer dns rebinding crashing because of old kwarg format 2020-08-20 20:03:11 -05:00
Kevin Froman
fd73f63ecd fix public block list not working because of old kwarg format 2020-08-20 20:00:44 -05:00
Kevin Froman
6089cc3c98 fix formatting in onionrservices 2020-08-19 23:05:06 -05:00
Kevin Froman
05127dd3b7 remove warden since it won't be implemented 2020-08-19 23:04:29 -05:00
Kevin Froman
ce0e60c4ea Correct formatting in expiredblocks 2020-08-17 19:03:42 -05:00
Kevin Froman
0938bf0692 Deduplicate infoNumbers in transportinfo keydb 2020-08-17 19:03:21 -05:00
Kevin Froman
fb4dd07ba4 fix missed blockHash->block_hash change in onionrstorage 2020-08-17 19:02:51 -05:00
Kevin Froman
0b2658374b Added/corrected timeouts for sqlite3 database connections
Bumped mail plugin patch version for sqlite3 timeout change
Code formatting corrections
2020-08-16 19:52:50 -05:00
Kevin Froman
2a7c933321 Utils format fixes 2020-08-12 18:07:04 -05:00
Kevin Froman
c9af24392d Fix netutils formatting 2020-08-12 17:30:12 -05:00
Kevin Froman
272d7d7f74 Removed Windows specific code 2020-08-12 17:21:11 -05:00
Kevin Froman
ce63c4cd3b Show a terminal message if bridge is enabled but one is not set. By design, there is no easy way for us to get Tor bridges automatically
work on tor blocking detection
2020-08-12 13:16:13 -05:00
Kevin Froman
2ddeab8788 work on tor blocking detection 2020-08-11 23:49:26 -05:00
Kevin Froman
a24086da62 add comments to bootstrappeers 2020-08-10 21:35:19 -05:00
Kevin Froman
8389ed190c Basic check for QubesOS in runtime tests and to avoid starting LAN server 2020-08-10 01:09:19 -05:00
Kevin Froman
87b8655b83 do not start lan on qubes 2020-08-10 01:03:32 -05:00
Kevin Froman
feb8004c95 fix generating hashes not being removed when done, add endpoint to get generating hashes 2020-08-09 22:13:06 -05:00
Kevin Froman
3473c5e36a Improved torcontrol formatting and efficency 2020-08-08 21:18:56 -05:00
Kevin Froman
e14955cb6b Improved formatting and removed unnecessary imports in torcontrol 2020-08-08 20:44:11 -05:00
Kevin Froman
5e00bb930f added client api request crafting script 2020-08-08 15:40:20 -05:00
Kevin Froman
6976dcf8f3 Friends API now shows redirect error message when ref header not set instead of request failing 2020-08-08 15:39:24 -05:00
Kevin Froman
96af4e8db0 Fixed some broken things from communicator decoupling 2020-08-08 12:38:14 -05:00
Kevin Froman
bff2595ac9 Merge branch 'new-release' into sidebar 2020-08-08 10:51:04 -05:00
Kevin Froman
522cd2c462 bumped requirements versions 2020-08-08 00:11:45 -05:00
Kevin
077f530b72 Fix peeraction still using comm_inst 2020-08-07 21:57:02 -05:00
Kevin
ab10cea8b6 add forgotten spawndaemonthreads and added license info to bulma extension files 2020-08-04 08:45:06 -05:00
Kevin
086f2f718c fix onlinepeers decoupling 2020-08-04 08:44:24 -05:00
Kevin
4cf17ffe62 work on removing communicator 2020-07-30 20:15:36 -05:00
Kevin
0b34aa7385 added onionrthreads to replace communicator timers 2020-07-29 20:36:41 -05:00
Kevin
6f1daf50d3 added setup kvvars 2020-07-29 20:36:11 -05:00
Kevin
5bde99967b Moved all communicator ext vars to KV 2020-07-29 04:32:09 -05:00
Kevin
f28d469e56 Moved all communicator ext vars to KV 2020-07-29 03:57:06 -05:00
Kevin
080f33bf1f More decoupling, removed unnecessary announceCache 2020-07-26 21:45:17 -05:00
Kevin
fad5e8547e Moved cooldownPeer to KV to further reduce coupling 2020-07-26 19:15:26 -05:00
Kevin
dde10b7005 Moved offllinePeers to KV to further reduce coupling 2020-07-26 19:12:52 -05:00
Kevin
10c1cd7803 Moved blocksToUpload to KV to further reduce coupling 2020-07-26 19:02:39 -05:00
Kevin
97a5f50271 Moved dbTimestamps and newPeers to KV for more decoupling 2020-07-26 15:49:34 -05:00
Kevin
e00d41f8a9 Moved onlinePeers and announceCache to kv for more decoupling 2020-07-26 15:26:15 -05:00
Kevin
6a6718c9fd Moved onlinePeers to KV to further reduce coupling 2020-07-25 22:28:32 -05:00
Kevin
0e4e7bb050 Moved communicator shutdown over to KV model for more decoupling 2020-07-25 21:36:48 -05:00
Kevin
6ecb62356a Moved blockQueue to DSKV singleton as part of communicator decoupling 2020-07-24 14:37:01 -05:00
Kevin
47013431d2 Removed use of communicator's storagecounter to reduce coupling 2020-07-24 03:27:42 -05:00
Kevin
f4d1739e4a made storagecounter use a watchdog (inotify) instead of excessive file reads 2020-07-24 02:57:44 -05:00
Kevin
8b5c87d356 Removed single-process POW support, which was just needed on Windows 2020-07-23 15:16:52 -05:00
Kevin
ac279c1cef bumped version 2020-07-21 21:57:44 -05:00
Kevin
9fc741106a made localcommand pep8 compliant 2020-07-17 13:49:18 -05:00
Kevin
782c980b69 formatting and comment improvements, cleanup 2020-07-07 09:11:30 -05:00
Kevin
714b3a3c33 cleaned up onionrblocks/insert/main some 2020-07-04 14:44:06 -05:00
Kevin
7931f514b6 Only hide blocks uploaded to us if we have outgoing peers (don't send to upload event handler) 2020-06-30 18:34:13 -05:00
Kevin
c46e9590c6 share too_many to all requests (flask "g") handled by public security module 2020-06-30 17:17:22 -05:00
Kevin
3a6322c6c6 Remove _delay_wait_for_share_block_removal because it doesn't seem to exist 2020-06-30 17:16:33 -05:00
Kevin
d6422801a2 don't set lookupblocks timestamp unless they actually have new blocks 2020-06-30 17:09:18 -05:00
Kevin
63e676ed6f cleanup lookupblocks 2020-06-30 17:08:32 -05:00
Kevin
3f13cd84ea * Do not print border around quotes when the terminal is small 2020-06-29 02:30:37 -05:00
Kevin
25485e6aa4 * Revert back to hiding blocks even when we have no outgoing connections
* ensure that block is hidden in public list in insert test
2020-06-29 02:29:55 -05:00
Kevin
1aa707cea5 Do not run LANserver runtime test if we are not on an appropriate LAN (such as VMs/VPS) 2020-06-29 02:28:50 -05:00
Kevin
049956544e improve upload error log messages 2020-06-28 04:18:00 -05:00
Kevin
7f8e63f19b keep trying to connect to new peers eagerly if we have no outgoing connections 2020-06-28 04:17:45 -05:00
Kevin
6738eaf222 don't hide uploaded blocks if we have no peers 2020-06-28 04:16:55 -05:00
Kevin
0d58d57467 add line break to a quote 2020-06-28 04:15:58 -05:00
Kevin
27adbbb199 swap spock for snowden in quotes 2020-06-27 18:05:53 -05:00
Kevin
e9bbd38aab improve verifypow error message info to show affected block 2020-06-27 18:05:39 -05:00
Kevin
cc41ad793e correct gettortransport endpoint tor config reading to use int and not bool 2020-06-27 18:05:04 -05:00
Kevin
b878faeb4c fix bug where onionr would complain while restarting about not being able to start 2020-06-27 18:03:20 -05:00
Kevin
ee28aba792 do not bind to lan if there is no lan 2020-06-25 23:44:39 -05:00
Kevin
1aea6c3362 don't show tor transport box if there is none 2020-06-25 03:29:27 -05:00
Kevin
1bf365aff4 disable lan if there is a local threat (sec level >=3) 2020-06-25 03:28:59 -05:00
Kevin
8d33e1a188 added sqlite3 check for weird python setups 2020-06-23 04:16:40 -05:00
Kevin
6c75c525d2 added gettoraddress private endpoint 2020-06-21 17:54:30 -05:00
Kevin
7d8c3f75e4 fix formatting in httpapi security 2020-06-21 15:48:00 -05:00
Kevin Froman
a24c87c5b0 fix lan server test for real this time 2020-06-21 14:23:46 -05:00
Kevin
34416c07fe made particles more efficient, finished basic blocks feed 2020-06-21 02:27:55 -05:00
Kevin
c81df9093d added particles and some code for recent block listing 2020-06-20 05:31:51 -05:00
Kevin
c9a6769be7 fix lan server test not using raw 2020-06-19 01:29:47 -05:00
Kevin
7205189d62 make lan server test only a few ports, add run time test grace period in service detection attack prevetion mechanism 2020-06-19 01:08:39 -05:00
Kevin
5751468e8a remove deprecated POW 2020-06-19 00:55:37 -05:00
Kevin
eeab5ef2c2 basic lan syncing support is done 2020-06-19 00:55:13 -05:00
Kevin
bae8b38f08 handle ping missed in lan connecting 2020-06-17 00:53:33 -05:00
Kevin
c0b72f9007 handle ping missed in lan connecting 2020-06-17 00:42:40 -05:00
Kevin
1f2c116b4b handle ping missed in lan connecting 2020-06-17 00:37:11 -05:00
Kevin
5b9bb2e5e2 made lan port identification faster 2020-06-17 00:29:03 -05:00
Kevin
1e76990d1e made lan port identification faster 2020-06-17 00:00:52 -05:00
Kevin
0c7afa89f1 fix setup_online_mode in daemon launch 2020-06-16 02:12:05 -05:00
Kevin
a10a32fafb improved documentation + refactored daemonlaunch 2020-06-14 19:08:17 -05:00
Kevin
88824b7913 update runtime test result 2020-06-13 18:18:24 -05:00
Kevin
3c7b090a4e Merge branch 'master' into lan 2020-06-13 18:04:20 -05:00
Kevin
a401f49da3 fix index.html not being auto loaded in subdirs
fix pep8 styling in sitefiles.py
2020-06-13 17:51:09 -05:00
Kevin
3d0f1d9337 fix import format in sitecreator init 2020-06-13 17:50:37 -05:00
Kevin
2a65f605f5 fix site creator not working with full paths by using a temporary chdir
fix grammar issue in site creator
2020-06-13 17:49:16 -05:00
Kevin Froman
7c5359c39e added colors.py 2020-06-09 21:05:33 -05:00
Kevin Froman
026901ce90 Fix gettransports 2020-04-14 22:40:31 -05:00
Kevin Froman
a52465a54f work on lan 2020-04-06 08:51:20 -05:00
Kevin Froman
d13d9a3039 added is_friend test for onionrusers and fixed bug where isFriend was setting instead of getting the value 2020-04-05 23:35:03 -05:00
Kevin Froman
aa729d862c added escape_ansi unittest 2020-04-04 02:21:28 -05:00
Kevin Froman
d47c546620 added dns rebinding runtime test 2020-04-03 23:34:23 -05:00
Kevin Froman
39d0be32ac import jsondecodeerror seperately since its not in ujson 2020-04-03 04:33:30 -05:00
Kevin Froman
a8ab5d20f1 moving onionrutils over to ujson 2020-04-03 04:20:55 -05:00
Kevin Froman
37913d544b fixed localcommand formatting and imports 2020-04-03 04:19:20 -05:00
Kevin Froman
eea8b39b0f refactored onionrusers formatting and json 2020-04-03 04:17:45 -05:00
Kevin Froman
dee5d8ceed make config use ujson
made httpapi use ujson

made onionrblocks mod use ujson

made setup config use ujson

made devreporting use ujson

made transports/tor use ujson

made contactmanager use ujson
2020-04-03 04:13:50 -05:00
Kevin Froman
b23343e7cb use ujson in serializeddata 2020-04-03 03:51:31 -05:00
Kevin Froman
8804c13225 * refactored subprocess and made it 20%+ faster by using ujson
+ added watchdog dep for sneakernet
+ added ujson dep for faster json esp in pow
2020-04-03 03:28:48 -05:00
Kevin Froman
8d372cccfb added stats reporter 2020-03-31 04:00:48 -05:00
Kevin Froman
0da27a78c7 basic requests can now use lan, work on lan client 2020-03-31 01:48:20 -05:00
Kevin Froman
b2f630e4f9 added disk ministry 2020-03-31 00:15:24 -05:00
Kevin Froman
09134eaba4 comment sneakernet 2020-03-30 21:14:48 -05:00
Kevin Froman
1bd0aa9419 added sneakernet auto importing
exportblocks now takes argument
2020-03-30 20:52:04 -05:00
Kevin Froman
d50e6db1d2 fix removeblock docstring 2020-03-27 20:03:30 -05:00
Kevin Froman
012ee33499 corrected onionrstorage formatting 2020-03-26 03:57:54 -05:00
Kevin Froman
b8a8cfd3f6 changed socket_server config key to more accurate ephemeral_tunnels key 2020-03-26 03:49:23 -05:00
Kevin Froman
62b4f5eb0e Removed support for v2 onions 2020-03-26 03:48:57 -05:00
Kevin Froman
db9cd3eb60 remove defunct import in register_private_blueprints.py 2020-03-26 02:33:08 -05:00
Kevin Froman
d24fd41c53 added fd and disk usage stats 2020-03-24 03:18:05 -05:00
Kevin Froman
1be08e09ef reformated sizeutils 2020-03-24 03:17:22 -05:00
Kevin Froman
2aa8cdbaa0 corrected utils formatting and removed defunct utils 2020-03-23 23:55:57 -05:00
Kevin Froman
b5e57da191 lan can now properly connect 2020-03-23 03:39:57 -05:00
Kevin Froman
2c8f1fdf99 restore unicoding in multicast ad 2020-03-23 01:25:27 -05:00
Kevin Froman
eec7efd38d use right multicast address 2020-03-23 01:24:13 -05:00
Kevin Froman
d77f802fdd lan client thread added 2020-03-23 00:37:49 -05:00
Kevin Froman
acabeab7c4 added files for vdf proofing 2020-03-22 19:16:26 -05:00
Kevin Froman
9369a22841 correct updateblockinfo docstring and format 2020-03-22 19:16:08 -05:00
Kevin Froman
481cb5aeff use a smaller offset for obscuring block metadb time 2020-03-21 01:15:07 -05:00
Kevin Froman
4696e7be3f added offset test for lan block list and improved run time tests to be random order and have better iterative output 2020-03-21 01:14:35 -05:00
Kevin Froman
2a104d7459 added ram stats 2020-03-20 18:39:26 -05:00
Kevin Froman
a52a17ac25 removed thread debug from events 2020-03-20 18:39:08 -05:00
Kevin Froman
3e4a39016f work on lan server (upload endpoint) 2020-03-20 03:51:08 -05:00
Kevin Froman
e6181bdd1f fixed nasty bug where tor circuits was causing gevent to leak threads 2020-03-20 03:50:48 -05:00
Kevin Froman
022fbaa1af bumped disk allocation to 1gb 2020-03-20 03:47:08 -05:00
Kevin Froman
b5ac1ed7d8 correct timer thread amounts 2020-03-20 03:45:25 -05:00
Kevin Froman
fe3b6c01c4 * Remove ifaddr since psutil provides access to net interfaces
+ added mimcvdf dependency for future block spec
2020-03-19 16:02:15 -05:00
Kevin Froman
d4f4487fb6 finished block list endpoint for lan and added get data endpoint 2020-03-19 01:44:44 -05:00
Kevin Froman
e90d7e96f4 moved daemon kill command to its own seperate file in daemonlaunch 2020-03-19 01:43:57 -05:00
Kevin Froman
6fed37a237 reduced sleep in housekeeping run test 2020-03-19 01:43:02 -05:00
Kevin Froman
69bb257166 made ownnode run test only run if tor is enabled 2020-03-19 01:42:15 -05:00
Kevin Froman
24284e058f ensure public api served blocks are not decrypted 2020-03-19 01:40:52 -05:00
Kevin Froman
68678177ed type hinted bytesconverter 2020-03-16 02:55:36 -05:00
Kevin Froman
9575352e3e added config option for using LAN transport 2020-03-16 02:51:47 -05:00
Kevin Froman
3aec35ef33 * lan server including discovery and publishing added (only ping implemented in server) 2020-03-16 02:28:41 -05:00
Kevin Froman
92c4109572 * updated big brother to allow multicast and LAN 2020-03-16 02:06:37 -05:00
Kevin Froman
18aca5aeea finishd tests for multicast lan service discovery 2020-03-14 00:56:10 -05:00
Kevin Froman
d4652e1107 added test for learning lan services 2020-03-13 23:47:44 -05:00
Kevin Froman
7bb95c3b87 work on lan transport, added service discovery logic 2020-03-11 04:46:42 -05:00
Kevin Froman
a8290e2ac3 added cleanup test and test-re-runner automation script 2020-03-09 21:43:18 -05:00
Kevin Froman
e4d4091e66 fixed pep8 formatting in daemon launch 2020-03-09 04:13:37 -05:00
Kevin Froman
c106d5881f removed imports in daemon launch 2020-03-09 04:13:13 -05:00
Kevin Froman
25766e02fc Fixed epoch formatting 2020-03-09 04:05:10 -05:00
Kevin Froman
a5c733469f made better sleep ignored sleep and added test for it 2020-03-09 04:04:41 -05:00
Kevin Froman
04133035ba fix existing tor daemon not having closed ephemeral onions and work on mail test 2020-03-07 18:51:39 -06:00
Kevin Froman
60d2ebfaed + added more tests
* fixed chdir home bug
* fixed some tests creating normal data dir
2020-03-04 01:15:58 -06:00
Kevin Froman
665cb0c732 fixed housekeeping being broken 2020-03-03 05:55:50 -06:00
Kevin Froman
02fa6dd558 added first browser test, tests if circles opens out of ot the box 2020-02-28 03:49:30 -06:00
Kevin Froman
b62e613e8e work on mail settings, onionruser own key adding bug fix 2020-02-27 21:06:28 -06:00
Kevin Froman
862c6f2ea4 work on mail settings 2020-02-25 20:30:04 -06:00
Kevin Froman
6f0ef390a7 work on mail settings 2020-02-24 04:45:29 -06:00
Kevin Froman
56e86460d1 more vanityonionr changes 2020-02-23 02:12:30 -06:00
Kevin Froman
b8348be65a now avoid looking up older than allowed blocks 2020-02-23 02:12:13 -06:00
Kevin Froman
34a55f63f9 fixed vanity not working and added integration test for it 2020-02-22 05:44:21 -06:00
Kevin Froman
080933639c fixed 'is onionr client' security exit attribute error and improved public security module formatting 2020-02-19 18:02:20 -06:00
Kevin Froman
9f1790a601 Added mail message padding support 2020-02-19 01:57:56 -06:00
Kevin Froman
83ef9dc3ca added sound notifications (used in mail for now) and more settings UI work 2020-02-18 05:32:17 -06:00
Kevin Froman
aea4815fbd added sound notification support and forward secery setting finished 2020-02-17 06:13:57 -06:00
Kevin Froman
23782dcb8f work on mail settings 2020-02-12 05:31:05 -06:00
Kevin Froman
47eef04643 fix #45 2020-02-12 01:19:59 -06:00
Kevin Froman
d149f351d2 made onionr ascii image default, added quotes to startup 2020-02-12 00:58:15 -06:00
Kevin Froman
59a1ad1235 move tor start finished message to bottom during merge from work on fixing onboarding 2020-02-11 20:10:21 -06:00
Kevin Froman
353b2f1c63 + added check for Tor to be ready before openhome works
* fixed not being able to stop Onionr when awaiting onboarding survey to be finished
2020-02-11 19:49:44 -06:00
Kevin Froman
3bb51a16e1 check for onionr exit when awaiting onboarding completion 2020-02-11 16:47:30 -06:00
Kevin Froman
26ddee54ce work on mail settings 2020-02-10 08:01:49 -06:00
Kevin Froman
dee531fd51 added license info to boxprint 2020-02-08 17:07:39 -06:00
Kevin Froman
982ac88a72 print tor startup progress to term 2020-02-08 04:24:19 -06:00
Kevin Froman
572e29f5d5 bumped network version and main version, lots of test work and some stability improvements 2020-02-08 03:34:11 -06:00
Kevin Froman
e77d422fc2 fix main init formatting 2020-02-06 16:00:19 -06:00
Kevin Froman
b8c288259b fix keymanager formatting 2020-02-06 16:00:06 -06:00
Kevin Froman
2319ff8344 added config option to shred log file on exit 2020-02-06 04:11:39 -06:00
Kevin Froman
7c7e5de091 do not allow restart on windows 2020-02-06 00:54:49 -06:00
Kevin Froman
3456fae533 added site lister 2020-02-05 01:49:24 -06:00
Kevin Froman
c8f0427f45 make data dir readable only by user by default, make no dep release 2020-02-04 18:07:03 -06:00
Kevin Froman
b305380447 protect data dir by default 2020-02-04 16:58:24 -06:00
Kevin Froman
d91480104b handle more sec levels in ui stats 2020-02-04 15:42:08 -06:00
Kevin Froman
52e3600ae1 bump version 2020-02-04 14:55:56 -06:00
Kevin Froman
fe36b87c57 fix notifier formatting 2020-02-04 14:18:20 -06:00
Kevin Froman
8e1eaa2b42 updated readme 2020-02-04 00:59:52 -06:00
Kevin Froman
b86eb821ce clean up onboarding handler 2020-02-03 21:49:21 -06:00
Kevin Froman
68074d4dd8 moving to release with better settings and onboarding 2020-02-03 20:08:06 -06:00
Kevin Froman
246ba6eb7b fixed onboarding bugs and enabled it by default 2020-02-03 17:01:08 -06:00
Kevin Froman
6500229000 added attack simulation scripts 2020-02-02 21:21:51 -06:00
Kevin Froman
c58bbbb10f Add missing import in daemon launch 2020-02-02 19:16:30 -06:00
Kevin Froman
d4dd964069 don't restart tor unless its our own 2020-02-02 19:07:48 -06:00
Kevin Froman
5b78a8810d only nuke data on node shutdown 2020-02-02 19:00:49 -06:00
Kevin Froman
8a82e76182 fix tor dir being too open 2020-02-02 03:23:59 -06:00
Kevin Froman
8e5152a14e added support to wipe data directory on exit 2020-02-02 02:48:23 -06:00
Kevin Froman
567af997d7 Added dev config scripts 2020-02-02 00:55:39 -06:00
Kevin Froman
88146a5690 use thread instead of greenlet to start run time tests 2020-01-31 22:57:53 -06:00
Kevin Froman
cd671feb92 tor can now be attached 2020-01-31 22:14:26 -06:00
Kevin Froman
ea47ae456b work on the ability to attach to existing Tor 2020-01-31 18:23:48 -06:00
Kevin Froman
840563f75c work on the ability to attach to existing Tor 2020-01-31 07:35:44 -06:00