Commit Graph

433 Commits

Author SHA1 Message Date
Kevin Froman
dee5d8ceed make config use ujson
made httpapi use ujson

made onionrblocks mod use ujson

made setup config use ujson

made devreporting use ujson

made transports/tor use ujson

made contactmanager use ujson
2020-04-03 04:13:50 -05:00
Kevin Froman
b23343e7cb use ujson in serializeddata 2020-04-03 03:51:31 -05:00
Kevin Froman
8804c13225 * refactored subprocess and made it 20%+ faster by using ujson
+ added watchdog dep for sneakernet
+ added ujson dep for faster json esp in pow
2020-04-03 03:28:48 -05:00
Kevin Froman
8d372cccfb added stats reporter 2020-03-31 04:00:48 -05:00
Kevin Froman
0da27a78c7 basic requests can now use lan, work on lan client 2020-03-31 01:48:20 -05:00
Kevin Froman
b2f630e4f9 added disk ministry 2020-03-31 00:15:24 -05:00
Kevin Froman
09134eaba4 comment sneakernet 2020-03-30 21:14:48 -05:00
Kevin Froman
1bd0aa9419 added sneakernet auto importing
exportblocks now takes argument
2020-03-30 20:52:04 -05:00
Kevin Froman
d50e6db1d2 fix removeblock docstring 2020-03-27 20:03:30 -05:00
Kevin Froman
012ee33499 corrected onionrstorage formatting 2020-03-26 03:57:54 -05:00
Kevin Froman
b8a8cfd3f6 changed socket_server config key to more accurate ephemeral_tunnels key 2020-03-26 03:49:23 -05:00
Kevin Froman
62b4f5eb0e Removed support for v2 onions 2020-03-26 03:48:57 -05:00
Kevin Froman
db9cd3eb60 remove defunct import in register_private_blueprints.py 2020-03-26 02:33:08 -05:00
Kevin Froman
d24fd41c53 added fd and disk usage stats 2020-03-24 03:18:05 -05:00
Kevin Froman
1be08e09ef reformated sizeutils 2020-03-24 03:17:22 -05:00
Kevin Froman
2aa8cdbaa0 corrected utils formatting and removed defunct utils 2020-03-23 23:55:57 -05:00
Kevin Froman
b5e57da191 lan can now properly connect 2020-03-23 03:39:57 -05:00
Kevin Froman
2c8f1fdf99 restore unicoding in multicast ad 2020-03-23 01:25:27 -05:00
Kevin Froman
eec7efd38d use right multicast address 2020-03-23 01:24:13 -05:00
Kevin Froman
d77f802fdd lan client thread added 2020-03-23 00:37:49 -05:00
Kevin Froman
acabeab7c4 added files for vdf proofing 2020-03-22 19:16:26 -05:00
Kevin Froman
9369a22841 correct updateblockinfo docstring and format 2020-03-22 19:16:08 -05:00
Kevin Froman
481cb5aeff use a smaller offset for obscuring block metadb time 2020-03-21 01:15:07 -05:00
Kevin Froman
4696e7be3f added offset test for lan block list and improved run time tests to be random order and have better iterative output 2020-03-21 01:14:35 -05:00
Kevin Froman
2a104d7459 added ram stats 2020-03-20 18:39:26 -05:00
Kevin Froman
a52a17ac25 removed thread debug from events 2020-03-20 18:39:08 -05:00
Kevin Froman
3e4a39016f work on lan server (upload endpoint) 2020-03-20 03:51:08 -05:00
Kevin Froman
e6181bdd1f fixed nasty bug where tor circuits was causing gevent to leak threads 2020-03-20 03:50:48 -05:00
Kevin Froman
022fbaa1af bumped disk allocation to 1gb 2020-03-20 03:47:08 -05:00
Kevin Froman
b5ac1ed7d8 correct timer thread amounts 2020-03-20 03:45:25 -05:00
Kevin Froman
fe3b6c01c4 * Remove ifaddr since psutil provides access to net interfaces
+ added mimcvdf dependency for future block spec
2020-03-19 16:02:15 -05:00
Kevin Froman
d4f4487fb6 finished block list endpoint for lan and added get data endpoint 2020-03-19 01:44:44 -05:00
Kevin Froman
e90d7e96f4 moved daemon kill command to its own seperate file in daemonlaunch 2020-03-19 01:43:57 -05:00
Kevin Froman
6fed37a237 reduced sleep in housekeeping run test 2020-03-19 01:43:02 -05:00
Kevin Froman
69bb257166 made ownnode run test only run if tor is enabled 2020-03-19 01:42:15 -05:00
Kevin Froman
24284e058f ensure public api served blocks are not decrypted 2020-03-19 01:40:52 -05:00
Kevin Froman
68678177ed type hinted bytesconverter 2020-03-16 02:55:36 -05:00
Kevin Froman
9575352e3e added config option for using LAN transport 2020-03-16 02:51:47 -05:00
Kevin Froman
3aec35ef33 * lan server including discovery and publishing added (only ping implemented in server) 2020-03-16 02:28:41 -05:00
Kevin Froman
92c4109572 * updated big brother to allow multicast and LAN 2020-03-16 02:06:37 -05:00
Kevin Froman
18aca5aeea finishd tests for multicast lan service discovery 2020-03-14 00:56:10 -05:00
Kevin Froman
d4652e1107 added test for learning lan services 2020-03-13 23:47:44 -05:00
Kevin Froman
7bb95c3b87 work on lan transport, added service discovery logic 2020-03-11 04:46:42 -05:00
Kevin Froman
a8290e2ac3 added cleanup test and test-re-runner automation script 2020-03-09 21:43:18 -05:00
Kevin Froman
e4d4091e66 fixed pep8 formatting in daemon launch 2020-03-09 04:13:37 -05:00
Kevin Froman
c106d5881f removed imports in daemon launch 2020-03-09 04:13:13 -05:00
Kevin Froman
25766e02fc Fixed epoch formatting 2020-03-09 04:05:10 -05:00
Kevin Froman
a5c733469f made better sleep ignored sleep and added test for it 2020-03-09 04:04:41 -05:00
Kevin Froman
04133035ba fix existing tor daemon not having closed ephemeral onions and work on mail test 2020-03-07 18:51:39 -06:00
Kevin Froman
60d2ebfaed + added more tests
* fixed chdir home bug
* fixed some tests creating normal data dir
2020-03-04 01:15:58 -06:00
Kevin Froman
665cb0c732 fixed housekeeping being broken 2020-03-03 05:55:50 -06:00
Kevin Froman
02fa6dd558 added first browser test, tests if circles opens out of ot the box 2020-02-28 03:49:30 -06:00
Kevin Froman
b62e613e8e work on mail settings, onionruser own key adding bug fix 2020-02-27 21:06:28 -06:00
Kevin Froman
862c6f2ea4 work on mail settings 2020-02-25 20:30:04 -06:00
Kevin Froman
6f0ef390a7 work on mail settings 2020-02-24 04:45:29 -06:00
Kevin Froman
56e86460d1 more vanityonionr changes 2020-02-23 02:12:30 -06:00
Kevin Froman
b8348be65a now avoid looking up older than allowed blocks 2020-02-23 02:12:13 -06:00
Kevin Froman
34a55f63f9 fixed vanity not working and added integration test for it 2020-02-22 05:44:21 -06:00
Kevin Froman
080933639c fixed 'is onionr client' security exit attribute error and improved public security module formatting 2020-02-19 18:02:20 -06:00
Kevin Froman
9f1790a601 Added mail message padding support 2020-02-19 01:57:56 -06:00
Kevin Froman
83ef9dc3ca added sound notifications (used in mail for now) and more settings UI work 2020-02-18 05:32:17 -06:00
Kevin Froman
aea4815fbd added sound notification support and forward secery setting finished 2020-02-17 06:13:57 -06:00
Kevin Froman
23782dcb8f work on mail settings 2020-02-12 05:31:05 -06:00
Kevin Froman
47eef04643 fix #45 2020-02-12 01:19:59 -06:00
Kevin Froman
d149f351d2 made onionr ascii image default, added quotes to startup 2020-02-12 00:58:15 -06:00
Kevin Froman
59a1ad1235 move tor start finished message to bottom during merge from work on fixing onboarding 2020-02-11 20:10:21 -06:00
Kevin Froman
353b2f1c63 + added check for Tor to be ready before openhome works
* fixed not being able to stop Onionr when awaiting onboarding survey to be finished
2020-02-11 19:49:44 -06:00
Kevin Froman
3bb51a16e1 check for onionr exit when awaiting onboarding completion 2020-02-11 16:47:30 -06:00
Kevin Froman
26ddee54ce work on mail settings 2020-02-10 08:01:49 -06:00
Kevin Froman
dee531fd51 added license info to boxprint 2020-02-08 17:07:39 -06:00
Kevin Froman
982ac88a72 print tor startup progress to term 2020-02-08 04:24:19 -06:00
Kevin Froman
572e29f5d5 bumped network version and main version, lots of test work and some stability improvements 2020-02-08 03:34:11 -06:00
Kevin Froman
e77d422fc2 fix main init formatting 2020-02-06 16:00:19 -06:00
Kevin Froman
b8c288259b fix keymanager formatting 2020-02-06 16:00:06 -06:00
Kevin Froman
2319ff8344 added config option to shred log file on exit 2020-02-06 04:11:39 -06:00
Kevin Froman
7c7e5de091 do not allow restart on windows 2020-02-06 00:54:49 -06:00
Kevin Froman
3456fae533 added site lister 2020-02-05 01:49:24 -06:00
Kevin Froman
c8f0427f45 make data dir readable only by user by default, make no dep release 2020-02-04 18:07:03 -06:00
Kevin Froman
b305380447 protect data dir by default 2020-02-04 16:58:24 -06:00
Kevin Froman
d91480104b handle more sec levels in ui stats 2020-02-04 15:42:08 -06:00
Kevin Froman
52e3600ae1 bump version 2020-02-04 14:55:56 -06:00
Kevin Froman
fe36b87c57 fix notifier formatting 2020-02-04 14:18:20 -06:00
Kevin Froman
8e1eaa2b42 updated readme 2020-02-04 00:59:52 -06:00
Kevin Froman
b86eb821ce clean up onboarding handler 2020-02-03 21:49:21 -06:00
Kevin Froman
68074d4dd8 moving to release with better settings and onboarding 2020-02-03 20:08:06 -06:00
Kevin Froman
246ba6eb7b fixed onboarding bugs and enabled it by default 2020-02-03 17:01:08 -06:00
Kevin Froman
6500229000 added attack simulation scripts 2020-02-02 21:21:51 -06:00
Kevin Froman
c58bbbb10f Add missing import in daemon launch 2020-02-02 19:16:30 -06:00
Kevin Froman
d4dd964069 don't restart tor unless its our own 2020-02-02 19:07:48 -06:00
Kevin Froman
5b78a8810d only nuke data on node shutdown 2020-02-02 19:00:49 -06:00
Kevin Froman
8a82e76182 fix tor dir being too open 2020-02-02 03:23:59 -06:00
Kevin Froman
8e5152a14e added support to wipe data directory on exit 2020-02-02 02:48:23 -06:00
Kevin Froman
567af997d7 Added dev config scripts 2020-02-02 00:55:39 -06:00
Kevin Froman
88146a5690 use thread instead of greenlet to start run time tests 2020-01-31 22:57:53 -06:00
Kevin Froman
cd671feb92 tor can now be attached 2020-01-31 22:14:26 -06:00
Kevin Froman
ea47ae456b work on the ability to attach to existing Tor 2020-01-31 18:23:48 -06:00
Kevin Froman
840563f75c work on the ability to attach to existing Tor 2020-01-31 07:35:44 -06:00
Kevin Froman
bffef46e89 Added boilerplate to gettransports 2020-01-31 07:35:44 -06:00
Kevin Froman
d0bdeca7c4 fixed hide blocks being broken in some cases 2020-01-30 00:54:43 -06:00
Kevin Froman
8649231860 fix cmd recommend to use f string 2020-01-29 23:22:23 -06:00
Kevin Froman
8a3f84097a + now require runtime tests to generate unittest result that is somewhat fresh
+ add runtime test for webpass needing to be set
2020-01-29 22:56:47 -06:00
Kevin Froman
6624a80c68 remove signed stats from stats command 2020-01-29 20:20:02 -06:00
Kevin Froman
2bc14b5c63 add gzip to exec bigbrother for sites and fix passphase print in site creator 2020-01-29 15:44:44 -06:00
Kevin Froman
a958b99fef remove sent mail from sentbox when block is blacklisted 2020-01-29 13:48:45 -06:00
Kevin Froman
c636e87b2c improve formatting in removeblock and blacklist 2020-01-29 13:48:45 -06:00
Kevin Froman
2732c3a149 reenable client security (OOPS) 2020-01-29 13:45:31 -06:00
Kevin Froman
0059c91b06 use fp symbol instead, merge master changes before merging back to improve circles 2020-01-28 00:29:20 -06:00
Kevin Froman
2bc996f660 supress gevent error from sses 2020-01-27 23:52:35 -06:00
Kevin Froman
a1fd5f2648 remove defunct test, add random bint ip test, and fix offline mode 2020-01-27 19:32:25 -06:00
Kevin Froman
ef25377e15 improved formatting in miscclient endpoints 2020-01-27 17:30:22 -06:00
Kevin Froman
11d97a12d0 give stats module more specific name 2020-01-27 02:20:09 -06:00
Kevin Froman
b1a7641db9 removed defunct communicator methods 2020-01-27 02:09:28 -06:00
Kevin Froman
5c636246fb added tor circuit stats to main page 2020-01-25 02:23:18 -06:00
Kevin Froman
57f233d856 added work on new main page with tor statistics. Added TorStats class to access tor statistics suck as circuit information 2020-01-21 02:36:19 -06:00
Kevin Froman
dd0ebd9238 add forgotten blocknoncestart file 2020-01-19 21:55:58 -06:00
Kevin Froman
07ab85698d raise exceptions instead of false return in blockimporter 2020-01-19 21:10:51 -06:00
Kevin Froman
3aeb305994 disable pool for mixing and announce node sooner after start 2020-01-19 21:10:01 -06:00
Kevin Froman
c7bbd054e4 make deniable blocks larger on average 2020-01-19 21:06:22 -06:00
Kevin Froman
4afa3d87e5 delete disk usage file after soft reset 2020-01-19 21:05:55 -06:00
Kevin Froman
f3b22dad56 remove DataPOW and make POW use non hard coded start int value 2020-01-19 21:02:51 -06:00
Kevin Froman
7db8193bf6 remove POW for annoncements 2020-01-19 21:02:04 -06:00
Kevin Froman
1c6893e297 fix variable misspelling when clearing wait for share session 2020-01-15 00:26:10 -06:00
Kevin Froman
828f7682b8 added server sent events wrapper and example 2020-01-14 02:29:42 -06:00
Kevin Froman
29421d678e KISS startup delete plaintext blocks based on config, no blacklist 2020-01-10 03:42:04 -06:00
Kevin Froman
f78809fa2a added config observers, delete plaintext blocks when plaintext storage is disabled 2020-01-07 05:44:53 -06:00
Kevin Froman
2e31155a5d fix insert queue removal not using json mode 2020-01-06 18:40:44 -06:00
Kevin Froman
27ef1d9ce4 remove never added daemon event function from pluginapi 2020-01-06 18:26:31 -06:00
Kevin Froman
88fe605762 finish up removing daemon queue, migrate shutdown to event system 2020-01-06 18:25:51 -06:00
Kevin Froman
a801960179 moved all but shutdown over to new daemon events system 2020-01-06 06:09:33 -06:00
Kevin Froman
c975d27906 switched to upload event api 2020-01-04 06:13:10 -06:00
Kevin Froman
1ba8b4c707 * fleshed out daemon events; also is now used for insertion queue removal
* deprecated daemon queue and removed unused daemon queue commands
2020-01-03 04:26:36 -06:00
Kevin Froman
6529d3e622 json mode added to local command 2020-01-03 04:15:20 -06:00
Kevin Froman
d7be2ca16d delete upload memory file file on shutdown if upload queue is empty 2020-01-03 04:14:04 -06:00
Kevin Froman
ee7b68c844 added new daemon events files 2020-01-01 20:07:34 -06:00
Kevin Froman
66aafb6deb added new daemon events work 2019-12-30 18:57:14 -06:00
Kevin Froman
e9f0e60608 added toggle bootstrap command 2019-12-29 11:21:18 -06:00
Kevin Froman
01f9b9b470 work on block insertion mixing 2019-12-27 01:53:18 -06:00
Kevin Froman
87ea8d137b minor bug fixes and linting improvements 2019-12-23 01:51:24 -06:00
Kevin Froman
9329b07e3b added mixmate to improve base routing 2019-12-22 13:42:10 -06:00
Kevin Froman
f71f2f6246 fix env home regression and made identifyhome lint compliant 2019-12-20 15:50:56 -06:00
Kevin Froman
c469c5d871 made communicator init have better lint compliance 2019-12-20 02:59:27 -06:00
Kevin Froman
b5a8f295c9 made uploadqueue lint compliant 2019-12-20 02:43:18 -06:00
Kevin Froman
1019ff0773 * made api servers lint compliant
* made bigbrother lint compliant
2019-12-20 02:37:12 -06:00
Kevin Froman
9571ea519d identify home better supports env home in non daemon 2019-12-20 02:33:42 -06:00
Kevin Froman
e5f3866f9e linting refactoring communicator(utils) and reduced TOCTOU issus with online peer picking 2019-12-20 01:24:38 -06:00
Kevin Froman
9fbee668aa fix regression exposing socks port to daemon instead of api server 2019-12-20 01:21:43 -06:00
Kevin Froman
eb294dd9ae fix big brother docstrings and disable_hooks default arg 2019-12-19 23:28:12 -06:00
Kevin Froman
0484655e2e fix ofexec not properly checking for windows for tor kill os.system 2019-12-19 23:26:29 -06:00
Kevin Froman
f5a98fba13 fix ofexec auditor docstrings 2019-12-19 23:22:51 -06:00
Kevin Froman
906219fe30 * Refactored onionrcommands py to be linting compliant (started using mypy)
+ git ignore mypy cache
2019-12-19 20:46:11 -06:00
Kevin Froman
6d123b93fc made parser flake8 compliant 2019-12-19 04:32:40 -06:00
Kevin Froman
e77e213589 made keyadders pep8 compliant 2019-12-19 03:13:41 -06:00
Kevin Froman
027abd3f13 None is not a type 2019-12-18 04:13:38 -06:00
Kevin Froman
c1dd2a7213 flake8 log style for connect fails 2019-12-18 04:10:00 -06:00
Kevin Froman
00e20c54b0 don't try to connect to peers in offline mode 2019-12-18 04:09:37 -06:00
Kevin Froman
f7e2a94502 flake8 refactors get onlinePeers 2019-12-18 04:08:33 -06:00
Kevin Froman
9707d5e320 fix flake8 ofcommunication line len 2019-12-18 04:07:20 -06:00
Kevin Froman
aa51a2fea6 var for netCheckTimer and commented code removal 2019-12-18 04:06:52 -06:00
Kevin Froman
a1c68fabe7 set isOnline to false if offline mode 2019-12-18 04:05:37 -06:00
Kevin Froman
f42e777408 make network check obey offline mode 2019-12-18 04:03:55 -06:00
Kevin Froman
abe1dde57e pep8 refactor netcheck 2019-12-18 04:03:26 -06:00
Kevin Froman
8f1df8c371 make daemon launch obey offline mode and pep8 refactor it 2019-12-18 04:02:08 -06:00
Kevin Froman
a36885c806 pep8 formatted daemon launch boilerplate 2019-12-18 04:00:39 -06:00
Kevin Froman
9af3f06b56 added block system auditor 2019-12-18 03:58:47 -06:00
Kevin Froman
743e735c48 add big brother readme and test 2019-12-18 03:52:52 -06:00
Kevin Froman
9790785c08
made runtests init flake8/pylint conforming 2019-12-17 19:31:41 -06:00
Kevin Froman
ae416bc650 added big brother security auditing to prevent some RCE and leaks 2019-12-14 13:45:18 -06:00
Kevin Froman
47e69bab99 added big brother event auditor 2019-12-13 12:24:29 -06:00
Kevin Froman
bb87bc192e refactored netcontroller and split module 2019-12-12 02:47:33 -06:00
Kevin Froman
6b0c88aff9 added custom torrc support 2019-12-10 04:52:32 -06:00
Kevin Froman
15872f8f7c added watchdog, use it to kill tor 2019-12-10 00:29:16 -06:00
Kevin Froman
fd6096a93c default plugins now have navbar removal logic 2019-12-06 01:21:30 -06:00
Kevin Froman
1eb47a4584 onboarding work 2019-12-03 00:00:15 -06:00
Kevin
8a4102cbd1 Merge nick's fixes 2019-12-01 08:10:00 +00:00
Kevin Froman
1de668a9e5 onboarding work, now waits to start daemon timers 2019-11-30 02:42:49 -06:00
Kevin Froman
fb975dc52c fix time skew message formatting 2019-11-30 01:11:46 -06:00
KF
316b01ea85 properly delete run files when tor is not found 2019-11-29 17:49:14 -06:00
Kevin Froman
13c34a1c04 adjust tests for upload queue exception 2019-11-27 14:07:51 -06:00
Kevin Froman
f401518d24 fix insertion upload check when daemon is not running 2019-11-27 13:53:06 -06:00
Kevin Froman
00baf30141 add check and daemon api endpoint to fix #41 2019-11-27 13:39:48 -06:00
Kevin Froman
d1f9911fd4 when resetting plugins, dont copy until onionr is ran again 2019-11-26 18:36:50 -06:00
Kevin Froman
ee5f4409af work on onboarding and pep8 compliance. re-worded about 2019-11-26 18:01:32 -06:00
Kevin Froman
720efe4fca renamed onionr dir and bugfixes/linting progress 2019-11-21 02:23:58 -06:00