Commit Graph

399 Commits

Author SHA1 Message Date
Kevin
fad5e8547e Moved cooldownPeer to KV to further reduce coupling 2020-07-26 19:15:26 -05:00
Kevin
dde10b7005 Moved offllinePeers to KV to further reduce coupling 2020-07-26 19:12:52 -05:00
Kevin
10c1cd7803 Moved blocksToUpload to KV to further reduce coupling 2020-07-26 19:02:39 -05:00
Kevin
97a5f50271 Moved dbTimestamps and newPeers to KV for more decoupling 2020-07-26 15:49:34 -05:00
Kevin
e00d41f8a9 Moved onlinePeers and announceCache to kv for more decoupling 2020-07-26 15:26:15 -05:00
Kevin
6a6718c9fd Moved onlinePeers to KV to further reduce coupling 2020-07-25 22:28:32 -05:00
Kevin
0e4e7bb050 Moved communicator shutdown over to KV model for more decoupling 2020-07-25 21:36:48 -05:00
Kevin
6ecb62356a Moved blockQueue to DSKV singleton as part of communicator decoupling 2020-07-24 14:37:01 -05:00
Kevin
47013431d2 Removed use of communicator's storagecounter to reduce coupling 2020-07-24 03:27:42 -05:00
Kevin
f4d1739e4a made storagecounter use a watchdog (inotify) instead of excessive file reads 2020-07-24 02:57:44 -05:00
Kevin
8b5c87d356 Removed single-process POW support, which was just needed on Windows 2020-07-23 15:16:52 -05:00
Kevin
ac279c1cef bumped version 2020-07-21 21:57:44 -05:00
Kevin
9fc741106a made localcommand pep8 compliant 2020-07-17 13:49:18 -05:00
Kevin
782c980b69 formatting and comment improvements, cleanup 2020-07-07 09:11:30 -05:00
Kevin
714b3a3c33 cleaned up onionrblocks/insert/main some 2020-07-04 14:44:06 -05:00
Kevin
7931f514b6 Only hide blocks uploaded to us if we have outgoing peers (don't send to upload event handler) 2020-06-30 18:34:13 -05:00
Kevin
c46e9590c6 share too_many to all requests (flask "g") handled by public security module 2020-06-30 17:17:22 -05:00
Kevin
3a6322c6c6 Remove _delay_wait_for_share_block_removal because it doesn't seem to exist 2020-06-30 17:16:33 -05:00
Kevin
d6422801a2 don't set lookupblocks timestamp unless they actually have new blocks 2020-06-30 17:09:18 -05:00
Kevin
63e676ed6f cleanup lookupblocks 2020-06-30 17:08:32 -05:00
Kevin
3f13cd84ea * Do not print border around quotes when the terminal is small 2020-06-29 02:30:37 -05:00
Kevin
25485e6aa4 * Revert back to hiding blocks even when we have no outgoing connections
* ensure that block is hidden in public list in insert test
2020-06-29 02:29:55 -05:00
Kevin
1aa707cea5 Do not run LANserver runtime test if we are not on an appropriate LAN (such as VMs/VPS) 2020-06-29 02:28:50 -05:00
Kevin
049956544e improve upload error log messages 2020-06-28 04:18:00 -05:00
Kevin
7f8e63f19b keep trying to connect to new peers eagerly if we have no outgoing connections 2020-06-28 04:17:45 -05:00
Kevin
6738eaf222 don't hide uploaded blocks if we have no peers 2020-06-28 04:16:55 -05:00
Kevin
0d58d57467 add line break to a quote 2020-06-28 04:15:58 -05:00
Kevin
27adbbb199 swap spock for snowden in quotes 2020-06-27 18:05:53 -05:00
Kevin
e9bbd38aab improve verifypow error message info to show affected block 2020-06-27 18:05:39 -05:00
Kevin
cc41ad793e correct gettortransport endpoint tor config reading to use int and not bool 2020-06-27 18:05:04 -05:00
Kevin
b878faeb4c fix bug where onionr would complain while restarting about not being able to start 2020-06-27 18:03:20 -05:00
Kevin
ee28aba792 do not bind to lan if there is no lan 2020-06-25 23:44:39 -05:00
Kevin
1aea6c3362 don't show tor transport box if there is none 2020-06-25 03:29:27 -05:00
Kevin
1bf365aff4 disable lan if there is a local threat (sec level >=3) 2020-06-25 03:28:59 -05:00
Kevin
8d33e1a188 added sqlite3 check for weird python setups 2020-06-23 04:16:40 -05:00
Kevin
6c75c525d2 added gettoraddress private endpoint 2020-06-21 17:54:30 -05:00
Kevin
7d8c3f75e4 fix formatting in httpapi security 2020-06-21 15:48:00 -05:00
Kevin Froman
a24c87c5b0 fix lan server test for real this time 2020-06-21 14:23:46 -05:00
Kevin
34416c07fe made particles more efficient, finished basic blocks feed 2020-06-21 02:27:55 -05:00
Kevin
c81df9093d added particles and some code for recent block listing 2020-06-20 05:31:51 -05:00
Kevin
c9a6769be7 fix lan server test not using raw 2020-06-19 01:29:47 -05:00
Kevin
7205189d62 make lan server test only a few ports, add run time test grace period in service detection attack prevetion mechanism 2020-06-19 01:08:39 -05:00
Kevin
5751468e8a remove deprecated POW 2020-06-19 00:55:37 -05:00
Kevin
eeab5ef2c2 basic lan syncing support is done 2020-06-19 00:55:13 -05:00
Kevin
bae8b38f08 handle ping missed in lan connecting 2020-06-17 00:53:33 -05:00
Kevin
c0b72f9007 handle ping missed in lan connecting 2020-06-17 00:42:40 -05:00
Kevin
1f2c116b4b handle ping missed in lan connecting 2020-06-17 00:37:11 -05:00
Kevin
5b9bb2e5e2 made lan port identification faster 2020-06-17 00:29:03 -05:00
Kevin
1e76990d1e made lan port identification faster 2020-06-17 00:00:52 -05:00
Kevin
0c7afa89f1 fix setup_online_mode in daemon launch 2020-06-16 02:12:05 -05:00
Kevin
a10a32fafb improved documentation + refactored daemonlaunch 2020-06-14 19:08:17 -05:00
Kevin
88824b7913 update runtime test result 2020-06-13 18:18:24 -05:00
Kevin
3c7b090a4e Merge branch 'master' into lan 2020-06-13 18:04:20 -05:00
Kevin
a401f49da3 fix index.html not being auto loaded in subdirs
fix pep8 styling in sitefiles.py
2020-06-13 17:51:09 -05:00
Kevin
3d0f1d9337 fix import format in sitecreator init 2020-06-13 17:50:37 -05:00
Kevin
2a65f605f5 fix site creator not working with full paths by using a temporary chdir
fix grammar issue in site creator
2020-06-13 17:49:16 -05:00
Kevin Froman
7c5359c39e added colors.py 2020-06-09 21:05:33 -05:00
Kevin Froman
026901ce90 Fix gettransports 2020-04-14 22:40:31 -05:00
Kevin Froman
a52465a54f work on lan 2020-04-06 08:51:20 -05:00
Kevin Froman
d13d9a3039 added is_friend test for onionrusers and fixed bug where isFriend was setting instead of getting the value 2020-04-05 23:35:03 -05:00
Kevin Froman
aa729d862c added escape_ansi unittest 2020-04-04 02:21:28 -05:00
Kevin Froman
d47c546620 added dns rebinding runtime test 2020-04-03 23:34:23 -05:00
Kevin Froman
39d0be32ac import jsondecodeerror seperately since its not in ujson 2020-04-03 04:33:30 -05:00
Kevin Froman
a8ab5d20f1 moving onionrutils over to ujson 2020-04-03 04:20:55 -05:00
Kevin Froman
37913d544b fixed localcommand formatting and imports 2020-04-03 04:19:20 -05:00
Kevin Froman
eea8b39b0f refactored onionrusers formatting and json 2020-04-03 04:17:45 -05:00
Kevin Froman
dee5d8ceed make config use ujson
made httpapi use ujson

made onionrblocks mod use ujson

made setup config use ujson

made devreporting use ujson

made transports/tor use ujson

made contactmanager use ujson
2020-04-03 04:13:50 -05:00
Kevin Froman
b23343e7cb use ujson in serializeddata 2020-04-03 03:51:31 -05:00
Kevin Froman
8804c13225 * refactored subprocess and made it 20%+ faster by using ujson
+ added watchdog dep for sneakernet
+ added ujson dep for faster json esp in pow
2020-04-03 03:28:48 -05:00
Kevin Froman
8d372cccfb added stats reporter 2020-03-31 04:00:48 -05:00
Kevin Froman
0da27a78c7 basic requests can now use lan, work on lan client 2020-03-31 01:48:20 -05:00
Kevin Froman
b2f630e4f9 added disk ministry 2020-03-31 00:15:24 -05:00
Kevin Froman
09134eaba4 comment sneakernet 2020-03-30 21:14:48 -05:00
Kevin Froman
1bd0aa9419 added sneakernet auto importing
exportblocks now takes argument
2020-03-30 20:52:04 -05:00
Kevin Froman
d50e6db1d2 fix removeblock docstring 2020-03-27 20:03:30 -05:00
Kevin Froman
012ee33499 corrected onionrstorage formatting 2020-03-26 03:57:54 -05:00
Kevin Froman
b8a8cfd3f6 changed socket_server config key to more accurate ephemeral_tunnels key 2020-03-26 03:49:23 -05:00
Kevin Froman
62b4f5eb0e Removed support for v2 onions 2020-03-26 03:48:57 -05:00
Kevin Froman
db9cd3eb60 remove defunct import in register_private_blueprints.py 2020-03-26 02:33:08 -05:00
Kevin Froman
d24fd41c53 added fd and disk usage stats 2020-03-24 03:18:05 -05:00
Kevin Froman
1be08e09ef reformated sizeutils 2020-03-24 03:17:22 -05:00
Kevin Froman
2aa8cdbaa0 corrected utils formatting and removed defunct utils 2020-03-23 23:55:57 -05:00
Kevin Froman
b5e57da191 lan can now properly connect 2020-03-23 03:39:57 -05:00
Kevin Froman
2c8f1fdf99 restore unicoding in multicast ad 2020-03-23 01:25:27 -05:00
Kevin Froman
eec7efd38d use right multicast address 2020-03-23 01:24:13 -05:00
Kevin Froman
d77f802fdd lan client thread added 2020-03-23 00:37:49 -05:00
Kevin Froman
acabeab7c4 added files for vdf proofing 2020-03-22 19:16:26 -05:00
Kevin Froman
9369a22841 correct updateblockinfo docstring and format 2020-03-22 19:16:08 -05:00
Kevin Froman
481cb5aeff use a smaller offset for obscuring block metadb time 2020-03-21 01:15:07 -05:00
Kevin Froman
4696e7be3f added offset test for lan block list and improved run time tests to be random order and have better iterative output 2020-03-21 01:14:35 -05:00
Kevin Froman
2a104d7459 added ram stats 2020-03-20 18:39:26 -05:00
Kevin Froman
a52a17ac25 removed thread debug from events 2020-03-20 18:39:08 -05:00
Kevin Froman
3e4a39016f work on lan server (upload endpoint) 2020-03-20 03:51:08 -05:00
Kevin Froman
e6181bdd1f fixed nasty bug where tor circuits was causing gevent to leak threads 2020-03-20 03:50:48 -05:00
Kevin Froman
022fbaa1af bumped disk allocation to 1gb 2020-03-20 03:47:08 -05:00
Kevin Froman
b5ac1ed7d8 correct timer thread amounts 2020-03-20 03:45:25 -05:00
Kevin Froman
fe3b6c01c4 * Remove ifaddr since psutil provides access to net interfaces
+ added mimcvdf dependency for future block spec
2020-03-19 16:02:15 -05:00
Kevin Froman
d4f4487fb6 finished block list endpoint for lan and added get data endpoint 2020-03-19 01:44:44 -05:00
Kevin Froman
e90d7e96f4 moved daemon kill command to its own seperate file in daemonlaunch 2020-03-19 01:43:57 -05:00
Kevin Froman
6fed37a237 reduced sleep in housekeeping run test 2020-03-19 01:43:02 -05:00
Kevin Froman
69bb257166 made ownnode run test only run if tor is enabled 2020-03-19 01:42:15 -05:00
Kevin Froman
24284e058f ensure public api served blocks are not decrypted 2020-03-19 01:40:52 -05:00
Kevin Froman
68678177ed type hinted bytesconverter 2020-03-16 02:55:36 -05:00
Kevin Froman
9575352e3e added config option for using LAN transport 2020-03-16 02:51:47 -05:00
Kevin Froman
3aec35ef33 * lan server including discovery and publishing added (only ping implemented in server) 2020-03-16 02:28:41 -05:00
Kevin Froman
92c4109572 * updated big brother to allow multicast and LAN 2020-03-16 02:06:37 -05:00
Kevin Froman
18aca5aeea finishd tests for multicast lan service discovery 2020-03-14 00:56:10 -05:00
Kevin Froman
d4652e1107 added test for learning lan services 2020-03-13 23:47:44 -05:00
Kevin Froman
7bb95c3b87 work on lan transport, added service discovery logic 2020-03-11 04:46:42 -05:00
Kevin Froman
a8290e2ac3 added cleanup test and test-re-runner automation script 2020-03-09 21:43:18 -05:00
Kevin Froman
e4d4091e66 fixed pep8 formatting in daemon launch 2020-03-09 04:13:37 -05:00
Kevin Froman
c106d5881f removed imports in daemon launch 2020-03-09 04:13:13 -05:00
Kevin Froman
25766e02fc Fixed epoch formatting 2020-03-09 04:05:10 -05:00
Kevin Froman
a5c733469f made better sleep ignored sleep and added test for it 2020-03-09 04:04:41 -05:00
Kevin Froman
04133035ba fix existing tor daemon not having closed ephemeral onions and work on mail test 2020-03-07 18:51:39 -06:00
Kevin Froman
60d2ebfaed + added more tests
* fixed chdir home bug
* fixed some tests creating normal data dir
2020-03-04 01:15:58 -06:00
Kevin Froman
665cb0c732 fixed housekeeping being broken 2020-03-03 05:55:50 -06:00
Kevin Froman
02fa6dd558 added first browser test, tests if circles opens out of ot the box 2020-02-28 03:49:30 -06:00
Kevin Froman
b62e613e8e work on mail settings, onionruser own key adding bug fix 2020-02-27 21:06:28 -06:00
Kevin Froman
862c6f2ea4 work on mail settings 2020-02-25 20:30:04 -06:00
Kevin Froman
6f0ef390a7 work on mail settings 2020-02-24 04:45:29 -06:00
Kevin Froman
56e86460d1 more vanityonionr changes 2020-02-23 02:12:30 -06:00
Kevin Froman
b8348be65a now avoid looking up older than allowed blocks 2020-02-23 02:12:13 -06:00
Kevin Froman
34a55f63f9 fixed vanity not working and added integration test for it 2020-02-22 05:44:21 -06:00
Kevin Froman
080933639c fixed 'is onionr client' security exit attribute error and improved public security module formatting 2020-02-19 18:02:20 -06:00
Kevin Froman
9f1790a601 Added mail message padding support 2020-02-19 01:57:56 -06:00
Kevin Froman
83ef9dc3ca added sound notifications (used in mail for now) and more settings UI work 2020-02-18 05:32:17 -06:00
Kevin Froman
aea4815fbd added sound notification support and forward secery setting finished 2020-02-17 06:13:57 -06:00
Kevin Froman
23782dcb8f work on mail settings 2020-02-12 05:31:05 -06:00
Kevin Froman
47eef04643 fix #45 2020-02-12 01:19:59 -06:00
Kevin Froman
d149f351d2 made onionr ascii image default, added quotes to startup 2020-02-12 00:58:15 -06:00
Kevin Froman
59a1ad1235 move tor start finished message to bottom during merge from work on fixing onboarding 2020-02-11 20:10:21 -06:00
Kevin Froman
353b2f1c63 + added check for Tor to be ready before openhome works
* fixed not being able to stop Onionr when awaiting onboarding survey to be finished
2020-02-11 19:49:44 -06:00
Kevin Froman
3bb51a16e1 check for onionr exit when awaiting onboarding completion 2020-02-11 16:47:30 -06:00
Kevin Froman
26ddee54ce work on mail settings 2020-02-10 08:01:49 -06:00
Kevin Froman
dee531fd51 added license info to boxprint 2020-02-08 17:07:39 -06:00
Kevin Froman
982ac88a72 print tor startup progress to term 2020-02-08 04:24:19 -06:00
Kevin Froman
572e29f5d5 bumped network version and main version, lots of test work and some stability improvements 2020-02-08 03:34:11 -06:00
Kevin Froman
e77d422fc2 fix main init formatting 2020-02-06 16:00:19 -06:00
Kevin Froman
b8c288259b fix keymanager formatting 2020-02-06 16:00:06 -06:00
Kevin Froman
2319ff8344 added config option to shred log file on exit 2020-02-06 04:11:39 -06:00
Kevin Froman
7c7e5de091 do not allow restart on windows 2020-02-06 00:54:49 -06:00
Kevin Froman
3456fae533 added site lister 2020-02-05 01:49:24 -06:00
Kevin Froman
c8f0427f45 make data dir readable only by user by default, make no dep release 2020-02-04 18:07:03 -06:00
Kevin Froman
b305380447 protect data dir by default 2020-02-04 16:58:24 -06:00
Kevin Froman
d91480104b handle more sec levels in ui stats 2020-02-04 15:42:08 -06:00
Kevin Froman
52e3600ae1 bump version 2020-02-04 14:55:56 -06:00
Kevin Froman
fe36b87c57 fix notifier formatting 2020-02-04 14:18:20 -06:00
Kevin Froman
8e1eaa2b42 updated readme 2020-02-04 00:59:52 -06:00
Kevin Froman
b86eb821ce clean up onboarding handler 2020-02-03 21:49:21 -06:00
Kevin Froman
68074d4dd8 moving to release with better settings and onboarding 2020-02-03 20:08:06 -06:00
Kevin Froman
246ba6eb7b fixed onboarding bugs and enabled it by default 2020-02-03 17:01:08 -06:00
Kevin Froman
6500229000 added attack simulation scripts 2020-02-02 21:21:51 -06:00
Kevin Froman
c58bbbb10f Add missing import in daemon launch 2020-02-02 19:16:30 -06:00
Kevin Froman
d4dd964069 don't restart tor unless its our own 2020-02-02 19:07:48 -06:00
Kevin Froman
5b78a8810d only nuke data on node shutdown 2020-02-02 19:00:49 -06:00
Kevin Froman
8a82e76182 fix tor dir being too open 2020-02-02 03:23:59 -06:00
Kevin Froman
8e5152a14e added support to wipe data directory on exit 2020-02-02 02:48:23 -06:00
Kevin Froman
567af997d7 Added dev config scripts 2020-02-02 00:55:39 -06:00
Kevin Froman
88146a5690 use thread instead of greenlet to start run time tests 2020-01-31 22:57:53 -06:00
Kevin Froman
cd671feb92 tor can now be attached 2020-01-31 22:14:26 -06:00
Kevin Froman
ea47ae456b work on the ability to attach to existing Tor 2020-01-31 18:23:48 -06:00
Kevin Froman
840563f75c work on the ability to attach to existing Tor 2020-01-31 07:35:44 -06:00
Kevin Froman
bffef46e89 Added boilerplate to gettransports 2020-01-31 07:35:44 -06:00
Kevin Froman
d0bdeca7c4 fixed hide blocks being broken in some cases 2020-01-30 00:54:43 -06:00
Kevin Froman
8649231860 fix cmd recommend to use f string 2020-01-29 23:22:23 -06:00
Kevin Froman
8a3f84097a + now require runtime tests to generate unittest result that is somewhat fresh
+ add runtime test for webpass needing to be set
2020-01-29 22:56:47 -06:00
Kevin Froman
6624a80c68 remove signed stats from stats command 2020-01-29 20:20:02 -06:00
Kevin Froman
2bc14b5c63 add gzip to exec bigbrother for sites and fix passphase print in site creator 2020-01-29 15:44:44 -06:00
Kevin Froman
a958b99fef remove sent mail from sentbox when block is blacklisted 2020-01-29 13:48:45 -06:00
Kevin Froman
c636e87b2c improve formatting in removeblock and blacklist 2020-01-29 13:48:45 -06:00
Kevin Froman
2732c3a149 reenable client security (OOPS) 2020-01-29 13:45:31 -06:00
Kevin Froman
0059c91b06 use fp symbol instead, merge master changes before merging back to improve circles 2020-01-28 00:29:20 -06:00
Kevin Froman
2bc996f660 supress gevent error from sses 2020-01-27 23:52:35 -06:00
Kevin Froman
a1fd5f2648 remove defunct test, add random bint ip test, and fix offline mode 2020-01-27 19:32:25 -06:00
Kevin Froman
ef25377e15 improved formatting in miscclient endpoints 2020-01-27 17:30:22 -06:00
Kevin Froman
11d97a12d0 give stats module more specific name 2020-01-27 02:20:09 -06:00
Kevin Froman
b1a7641db9 removed defunct communicator methods 2020-01-27 02:09:28 -06:00
Kevin Froman
5c636246fb added tor circuit stats to main page 2020-01-25 02:23:18 -06:00
Kevin Froman
57f233d856 added work on new main page with tor statistics. Added TorStats class to access tor statistics suck as circuit information 2020-01-21 02:36:19 -06:00
Kevin Froman
dd0ebd9238 add forgotten blocknoncestart file 2020-01-19 21:55:58 -06:00
Kevin Froman
07ab85698d raise exceptions instead of false return in blockimporter 2020-01-19 21:10:51 -06:00
Kevin Froman
3aeb305994 disable pool for mixing and announce node sooner after start 2020-01-19 21:10:01 -06:00
Kevin Froman
c7bbd054e4 make deniable blocks larger on average 2020-01-19 21:06:22 -06:00
Kevin Froman
4afa3d87e5 delete disk usage file after soft reset 2020-01-19 21:05:55 -06:00
Kevin Froman
f3b22dad56 remove DataPOW and make POW use non hard coded start int value 2020-01-19 21:02:51 -06:00
Kevin Froman
7db8193bf6 remove POW for annoncements 2020-01-19 21:02:04 -06:00
Kevin Froman
1c6893e297 fix variable misspelling when clearing wait for share session 2020-01-15 00:26:10 -06:00
Kevin Froman
828f7682b8 added server sent events wrapper and example 2020-01-14 02:29:42 -06:00
Kevin Froman
29421d678e KISS startup delete plaintext blocks based on config, no blacklist 2020-01-10 03:42:04 -06:00
Kevin Froman
f78809fa2a added config observers, delete plaintext blocks when plaintext storage is disabled 2020-01-07 05:44:53 -06:00
Kevin Froman
2e31155a5d fix insert queue removal not using json mode 2020-01-06 18:40:44 -06:00
Kevin Froman
27ef1d9ce4 remove never added daemon event function from pluginapi 2020-01-06 18:26:31 -06:00
Kevin Froman
88fe605762 finish up removing daemon queue, migrate shutdown to event system 2020-01-06 18:25:51 -06:00
Kevin Froman
a801960179 moved all but shutdown over to new daemon events system 2020-01-06 06:09:33 -06:00
Kevin Froman
c975d27906 switched to upload event api 2020-01-04 06:13:10 -06:00
Kevin Froman
1ba8b4c707 * fleshed out daemon events; also is now used for insertion queue removal
* deprecated daemon queue and removed unused daemon queue commands
2020-01-03 04:26:36 -06:00
Kevin Froman
6529d3e622 json mode added to local command 2020-01-03 04:15:20 -06:00
Kevin Froman
d7be2ca16d delete upload memory file file on shutdown if upload queue is empty 2020-01-03 04:14:04 -06:00
Kevin Froman
ee7b68c844 added new daemon events files 2020-01-01 20:07:34 -06:00