Commit Graph

383 Commits

Author SHA1 Message Date
Kevin Froman dee5d8ceed make config use ujson
made httpapi use ujson

made onionrblocks mod use ujson

made setup config use ujson

made devreporting use ujson

made transports/tor use ujson

made contactmanager use ujson
2020-04-03 04:13:50 -05:00
Kevin Froman b23343e7cb use ujson in serializeddata 2020-04-03 03:51:31 -05:00
Kevin Froman 8804c13225 * refactored subprocess and made it 20%+ faster by using ujson
+ added watchdog dep for sneakernet
+ added ujson dep for faster json esp in pow
2020-04-03 03:28:48 -05:00
Kevin Froman 8d372cccfb added stats reporter 2020-03-31 04:00:48 -05:00
Kevin Froman 0da27a78c7 basic requests can now use lan, work on lan client 2020-03-31 01:48:20 -05:00
Kevin Froman b2f630e4f9 added disk ministry 2020-03-31 00:15:24 -05:00
Kevin Froman 09134eaba4 comment sneakernet 2020-03-30 21:14:48 -05:00
Kevin Froman 1bd0aa9419 added sneakernet auto importing
exportblocks now takes argument
2020-03-30 20:52:04 -05:00
Kevin Froman d50e6db1d2 fix removeblock docstring 2020-03-27 20:03:30 -05:00
Kevin Froman 012ee33499 corrected onionrstorage formatting 2020-03-26 03:57:54 -05:00
Kevin Froman b8a8cfd3f6 changed socket_server config key to more accurate ephemeral_tunnels key 2020-03-26 03:49:23 -05:00
Kevin Froman 62b4f5eb0e Removed support for v2 onions 2020-03-26 03:48:57 -05:00
Kevin Froman db9cd3eb60 remove defunct import in register_private_blueprints.py 2020-03-26 02:33:08 -05:00
Kevin Froman d24fd41c53 added fd and disk usage stats 2020-03-24 03:18:05 -05:00
Kevin Froman 1be08e09ef reformated sizeutils 2020-03-24 03:17:22 -05:00
Kevin Froman 2aa8cdbaa0 corrected utils formatting and removed defunct utils 2020-03-23 23:55:57 -05:00
Kevin Froman b5e57da191 lan can now properly connect 2020-03-23 03:39:57 -05:00
Kevin Froman 2c8f1fdf99 restore unicoding in multicast ad 2020-03-23 01:25:27 -05:00
Kevin Froman eec7efd38d use right multicast address 2020-03-23 01:24:13 -05:00
Kevin Froman d77f802fdd lan client thread added 2020-03-23 00:37:49 -05:00
Kevin Froman acabeab7c4 added files for vdf proofing 2020-03-22 19:16:26 -05:00
Kevin Froman 9369a22841 correct updateblockinfo docstring and format 2020-03-22 19:16:08 -05:00
Kevin Froman 481cb5aeff use a smaller offset for obscuring block metadb time 2020-03-21 01:15:07 -05:00
Kevin Froman 4696e7be3f added offset test for lan block list and improved run time tests to be random order and have better iterative output 2020-03-21 01:14:35 -05:00
Kevin Froman 2a104d7459 added ram stats 2020-03-20 18:39:26 -05:00
Kevin Froman a52a17ac25 removed thread debug from events 2020-03-20 18:39:08 -05:00
Kevin Froman 3e4a39016f work on lan server (upload endpoint) 2020-03-20 03:51:08 -05:00
Kevin Froman e6181bdd1f fixed nasty bug where tor circuits was causing gevent to leak threads 2020-03-20 03:50:48 -05:00
Kevin Froman 022fbaa1af bumped disk allocation to 1gb 2020-03-20 03:47:08 -05:00
Kevin Froman b5ac1ed7d8 correct timer thread amounts 2020-03-20 03:45:25 -05:00
Kevin Froman fe3b6c01c4 * Remove ifaddr since psutil provides access to net interfaces
+ added mimcvdf dependency for future block spec
2020-03-19 16:02:15 -05:00
Kevin Froman d4f4487fb6 finished block list endpoint for lan and added get data endpoint 2020-03-19 01:44:44 -05:00
Kevin Froman e90d7e96f4 moved daemon kill command to its own seperate file in daemonlaunch 2020-03-19 01:43:57 -05:00
Kevin Froman 6fed37a237 reduced sleep in housekeeping run test 2020-03-19 01:43:02 -05:00
Kevin Froman 69bb257166 made ownnode run test only run if tor is enabled 2020-03-19 01:42:15 -05:00
Kevin Froman 24284e058f ensure public api served blocks are not decrypted 2020-03-19 01:40:52 -05:00
Kevin Froman 68678177ed type hinted bytesconverter 2020-03-16 02:55:36 -05:00
Kevin Froman 9575352e3e added config option for using LAN transport 2020-03-16 02:51:47 -05:00
Kevin Froman 3aec35ef33 * lan server including discovery and publishing added (only ping implemented in server) 2020-03-16 02:28:41 -05:00
Kevin Froman 92c4109572 * updated big brother to allow multicast and LAN 2020-03-16 02:06:37 -05:00
Kevin Froman 18aca5aeea finishd tests for multicast lan service discovery 2020-03-14 00:56:10 -05:00
Kevin Froman d4652e1107 added test for learning lan services 2020-03-13 23:47:44 -05:00
Kevin Froman 7bb95c3b87 work on lan transport, added service discovery logic 2020-03-11 04:46:42 -05:00
Kevin Froman a8290e2ac3 added cleanup test and test-re-runner automation script 2020-03-09 21:43:18 -05:00
Kevin Froman e4d4091e66 fixed pep8 formatting in daemon launch 2020-03-09 04:13:37 -05:00
Kevin Froman c106d5881f removed imports in daemon launch 2020-03-09 04:13:13 -05:00
Kevin Froman 25766e02fc Fixed epoch formatting 2020-03-09 04:05:10 -05:00
Kevin Froman a5c733469f made better sleep ignored sleep and added test for it 2020-03-09 04:04:41 -05:00
Kevin Froman 04133035ba fix existing tor daemon not having closed ephemeral onions and work on mail test 2020-03-07 18:51:39 -06:00
Kevin Froman 60d2ebfaed + added more tests
* fixed chdir home bug
* fixed some tests creating normal data dir
2020-03-04 01:15:58 -06:00
Kevin Froman 665cb0c732 fixed housekeeping being broken 2020-03-03 05:55:50 -06:00
Kevin Froman 02fa6dd558 added first browser test, tests if circles opens out of ot the box 2020-02-28 03:49:30 -06:00
Kevin Froman b62e613e8e work on mail settings, onionruser own key adding bug fix 2020-02-27 21:06:28 -06:00
Kevin Froman 862c6f2ea4 work on mail settings 2020-02-25 20:30:04 -06:00
Kevin Froman 6f0ef390a7 work on mail settings 2020-02-24 04:45:29 -06:00
Kevin Froman 56e86460d1 more vanityonionr changes 2020-02-23 02:12:30 -06:00
Kevin Froman b8348be65a now avoid looking up older than allowed blocks 2020-02-23 02:12:13 -06:00
Kevin Froman 34a55f63f9 fixed vanity not working and added integration test for it 2020-02-22 05:44:21 -06:00
Kevin Froman 080933639c fixed 'is onionr client' security exit attribute error and improved public security module formatting 2020-02-19 18:02:20 -06:00
Kevin Froman 9f1790a601 Added mail message padding support 2020-02-19 01:57:56 -06:00
Kevin Froman 83ef9dc3ca added sound notifications (used in mail for now) and more settings UI work 2020-02-18 05:32:17 -06:00
Kevin Froman aea4815fbd added sound notification support and forward secery setting finished 2020-02-17 06:13:57 -06:00
Kevin Froman 23782dcb8f work on mail settings 2020-02-12 05:31:05 -06:00
Kevin Froman 47eef04643 fix #45 2020-02-12 01:19:59 -06:00
Kevin Froman d149f351d2 made onionr ascii image default, added quotes to startup 2020-02-12 00:58:15 -06:00
Kevin Froman 59a1ad1235 move tor start finished message to bottom during merge from work on fixing onboarding 2020-02-11 20:10:21 -06:00
Kevin Froman 353b2f1c63 + added check for Tor to be ready before openhome works
* fixed not being able to stop Onionr when awaiting onboarding survey to be finished
2020-02-11 19:49:44 -06:00
Kevin Froman 3bb51a16e1 check for onionr exit when awaiting onboarding completion 2020-02-11 16:47:30 -06:00
Kevin Froman 26ddee54ce work on mail settings 2020-02-10 08:01:49 -06:00
Kevin Froman dee531fd51 added license info to boxprint 2020-02-08 17:07:39 -06:00
Kevin Froman 982ac88a72 print tor startup progress to term 2020-02-08 04:24:19 -06:00
Kevin Froman 572e29f5d5 bumped network version and main version, lots of test work and some stability improvements 2020-02-08 03:34:11 -06:00
Kevin Froman e77d422fc2 fix main init formatting 2020-02-06 16:00:19 -06:00
Kevin Froman b8c288259b fix keymanager formatting 2020-02-06 16:00:06 -06:00
Kevin Froman 2319ff8344 added config option to shred log file on exit 2020-02-06 04:11:39 -06:00
Kevin Froman 7c7e5de091 do not allow restart on windows 2020-02-06 00:54:49 -06:00
Kevin Froman 3456fae533 added site lister 2020-02-05 01:49:24 -06:00
Kevin Froman c8f0427f45 make data dir readable only by user by default, make no dep release 2020-02-04 18:07:03 -06:00
Kevin Froman b305380447 protect data dir by default 2020-02-04 16:58:24 -06:00
Kevin Froman d91480104b handle more sec levels in ui stats 2020-02-04 15:42:08 -06:00
Kevin Froman 52e3600ae1 bump version 2020-02-04 14:55:56 -06:00
Kevin Froman fe36b87c57 fix notifier formatting 2020-02-04 14:18:20 -06:00
Kevin Froman 8e1eaa2b42 updated readme 2020-02-04 00:59:52 -06:00
Kevin Froman b86eb821ce clean up onboarding handler 2020-02-03 21:49:21 -06:00
Kevin Froman 68074d4dd8 moving to release with better settings and onboarding 2020-02-03 20:08:06 -06:00
Kevin Froman 246ba6eb7b fixed onboarding bugs and enabled it by default 2020-02-03 17:01:08 -06:00
Kevin Froman 6500229000 added attack simulation scripts 2020-02-02 21:21:51 -06:00
Kevin Froman c58bbbb10f Add missing import in daemon launch 2020-02-02 19:16:30 -06:00
Kevin Froman d4dd964069 don't restart tor unless its our own 2020-02-02 19:07:48 -06:00
Kevin Froman 5b78a8810d only nuke data on node shutdown 2020-02-02 19:00:49 -06:00
Kevin Froman 8a82e76182 fix tor dir being too open 2020-02-02 03:23:59 -06:00
Kevin Froman 8e5152a14e added support to wipe data directory on exit 2020-02-02 02:48:23 -06:00
Kevin Froman 567af997d7 Added dev config scripts 2020-02-02 00:55:39 -06:00
Kevin Froman 88146a5690 use thread instead of greenlet to start run time tests 2020-01-31 22:57:53 -06:00
Kevin Froman cd671feb92 tor can now be attached 2020-01-31 22:14:26 -06:00
Kevin Froman ea47ae456b work on the ability to attach to existing Tor 2020-01-31 18:23:48 -06:00
Kevin Froman 840563f75c work on the ability to attach to existing Tor 2020-01-31 07:35:44 -06:00
Kevin Froman bffef46e89 Added boilerplate to gettransports 2020-01-31 07:35:44 -06:00
Kevin Froman d0bdeca7c4 fixed hide blocks being broken in some cases 2020-01-30 00:54:43 -06:00
Kevin Froman 8649231860 fix cmd recommend to use f string 2020-01-29 23:22:23 -06:00
Kevin Froman 8a3f84097a + now require runtime tests to generate unittest result that is somewhat fresh
+ add runtime test for webpass needing to be set
2020-01-29 22:56:47 -06:00
Kevin Froman 6624a80c68 remove signed stats from stats command 2020-01-29 20:20:02 -06:00
Kevin Froman 2bc14b5c63 add gzip to exec bigbrother for sites and fix passphase print in site creator 2020-01-29 15:44:44 -06:00
Kevin Froman a958b99fef remove sent mail from sentbox when block is blacklisted 2020-01-29 13:48:45 -06:00
Kevin Froman c636e87b2c improve formatting in removeblock and blacklist 2020-01-29 13:48:45 -06:00
Kevin Froman 2732c3a149 reenable client security (OOPS) 2020-01-29 13:45:31 -06:00
Kevin Froman 0059c91b06 use fp symbol instead, merge master changes before merging back to improve circles 2020-01-28 00:29:20 -06:00
Kevin Froman 2bc996f660 supress gevent error from sses 2020-01-27 23:52:35 -06:00
Kevin Froman a1fd5f2648 remove defunct test, add random bint ip test, and fix offline mode 2020-01-27 19:32:25 -06:00
Kevin Froman ef25377e15 improved formatting in miscclient endpoints 2020-01-27 17:30:22 -06:00
Kevin Froman 11d97a12d0 give stats module more specific name 2020-01-27 02:20:09 -06:00
Kevin Froman b1a7641db9 removed defunct communicator methods 2020-01-27 02:09:28 -06:00
Kevin Froman 5c636246fb added tor circuit stats to main page 2020-01-25 02:23:18 -06:00
Kevin Froman 57f233d856 added work on new main page with tor statistics. Added TorStats class to access tor statistics suck as circuit information 2020-01-21 02:36:19 -06:00
Kevin Froman dd0ebd9238 add forgotten blocknoncestart file 2020-01-19 21:55:58 -06:00
Kevin Froman 07ab85698d raise exceptions instead of false return in blockimporter 2020-01-19 21:10:51 -06:00
Kevin Froman 3aeb305994 disable pool for mixing and announce node sooner after start 2020-01-19 21:10:01 -06:00
Kevin Froman c7bbd054e4 make deniable blocks larger on average 2020-01-19 21:06:22 -06:00
Kevin Froman 4afa3d87e5 delete disk usage file after soft reset 2020-01-19 21:05:55 -06:00
Kevin Froman f3b22dad56 remove DataPOW and make POW use non hard coded start int value 2020-01-19 21:02:51 -06:00
Kevin Froman 7db8193bf6 remove POW for annoncements 2020-01-19 21:02:04 -06:00
Kevin Froman 1c6893e297 fix variable misspelling when clearing wait for share session 2020-01-15 00:26:10 -06:00
Kevin Froman 828f7682b8 added server sent events wrapper and example 2020-01-14 02:29:42 -06:00
Kevin Froman 29421d678e KISS startup delete plaintext blocks based on config, no blacklist 2020-01-10 03:42:04 -06:00
Kevin Froman f78809fa2a added config observers, delete plaintext blocks when plaintext storage is disabled 2020-01-07 05:44:53 -06:00
Kevin Froman 2e31155a5d fix insert queue removal not using json mode 2020-01-06 18:40:44 -06:00
Kevin Froman 27ef1d9ce4 remove never added daemon event function from pluginapi 2020-01-06 18:26:31 -06:00
Kevin Froman 88fe605762 finish up removing daemon queue, migrate shutdown to event system 2020-01-06 18:25:51 -06:00
Kevin Froman a801960179 moved all but shutdown over to new daemon events system 2020-01-06 06:09:33 -06:00
Kevin Froman c975d27906 switched to upload event api 2020-01-04 06:13:10 -06:00
Kevin Froman 1ba8b4c707 * fleshed out daemon events; also is now used for insertion queue removal
* deprecated daemon queue and removed unused daemon queue commands
2020-01-03 04:26:36 -06:00
Kevin Froman 6529d3e622 json mode added to local command 2020-01-03 04:15:20 -06:00
Kevin Froman d7be2ca16d delete upload memory file file on shutdown if upload queue is empty 2020-01-03 04:14:04 -06:00
Kevin Froman ee7b68c844 added new daemon events files 2020-01-01 20:07:34 -06:00
Kevin Froman 66aafb6deb added new daemon events work 2019-12-30 18:57:14 -06:00
Kevin Froman e9f0e60608 added toggle bootstrap command 2019-12-29 11:21:18 -06:00
Kevin Froman 01f9b9b470 work on block insertion mixing 2019-12-27 01:53:18 -06:00
Kevin Froman 87ea8d137b minor bug fixes and linting improvements 2019-12-23 01:51:24 -06:00
Kevin Froman 9329b07e3b added mixmate to improve base routing 2019-12-22 13:42:10 -06:00
Kevin Froman f71f2f6246 fix env home regression and made identifyhome lint compliant 2019-12-20 15:50:56 -06:00
Kevin Froman c469c5d871 made communicator init have better lint compliance 2019-12-20 02:59:27 -06:00
Kevin Froman b5a8f295c9 made uploadqueue lint compliant 2019-12-20 02:43:18 -06:00
Kevin Froman 1019ff0773 * made api servers lint compliant
* made bigbrother lint compliant
2019-12-20 02:37:12 -06:00
Kevin Froman 9571ea519d identify home better supports env home in non daemon 2019-12-20 02:33:42 -06:00
Kevin Froman e5f3866f9e linting refactoring communicator(utils) and reduced TOCTOU issus with online peer picking 2019-12-20 01:24:38 -06:00
Kevin Froman 9fbee668aa fix regression exposing socks port to daemon instead of api server 2019-12-20 01:21:43 -06:00
Kevin Froman eb294dd9ae fix big brother docstrings and disable_hooks default arg 2019-12-19 23:28:12 -06:00
Kevin Froman 0484655e2e fix ofexec not properly checking for windows for tor kill os.system 2019-12-19 23:26:29 -06:00
Kevin Froman f5a98fba13 fix ofexec auditor docstrings 2019-12-19 23:22:51 -06:00
Kevin Froman 906219fe30 * Refactored onionrcommands py to be linting compliant (started using mypy)
+ git ignore mypy cache
2019-12-19 20:46:11 -06:00
Kevin Froman 6d123b93fc made parser flake8 compliant 2019-12-19 04:32:40 -06:00
Kevin Froman e77e213589 made keyadders pep8 compliant 2019-12-19 03:13:41 -06:00
Kevin Froman 027abd3f13 None is not a type 2019-12-18 04:13:38 -06:00
Kevin Froman c1dd2a7213 flake8 log style for connect fails 2019-12-18 04:10:00 -06:00
Kevin Froman 00e20c54b0 don't try to connect to peers in offline mode 2019-12-18 04:09:37 -06:00
Kevin Froman f7e2a94502 flake8 refactors get onlinePeers 2019-12-18 04:08:33 -06:00
Kevin Froman 9707d5e320 fix flake8 ofcommunication line len 2019-12-18 04:07:20 -06:00
Kevin Froman aa51a2fea6 var for netCheckTimer and commented code removal 2019-12-18 04:06:52 -06:00
Kevin Froman a1c68fabe7 set isOnline to false if offline mode 2019-12-18 04:05:37 -06:00
Kevin Froman f42e777408 make network check obey offline mode 2019-12-18 04:03:55 -06:00
Kevin Froman abe1dde57e pep8 refactor netcheck 2019-12-18 04:03:26 -06:00
Kevin Froman 8f1df8c371 make daemon launch obey offline mode and pep8 refactor it 2019-12-18 04:02:08 -06:00
Kevin Froman a36885c806 pep8 formatted daemon launch boilerplate 2019-12-18 04:00:39 -06:00
Kevin Froman 9af3f06b56 added block system auditor 2019-12-18 03:58:47 -06:00
Kevin Froman 743e735c48 add big brother readme and test 2019-12-18 03:52:52 -06:00
Kevin Froman 9790785c08
made runtests init flake8/pylint conforming 2019-12-17 19:31:41 -06:00
Kevin Froman ae416bc650 added big brother security auditing to prevent some RCE and leaks 2019-12-14 13:45:18 -06:00
Kevin Froman 47e69bab99 added big brother event auditor 2019-12-13 12:24:29 -06:00
Kevin Froman bb87bc192e refactored netcontroller and split module 2019-12-12 02:47:33 -06:00
Kevin Froman 6b0c88aff9 added custom torrc support 2019-12-10 04:52:32 -06:00
Kevin Froman 15872f8f7c added watchdog, use it to kill tor 2019-12-10 00:29:16 -06:00
Kevin Froman fd6096a93c default plugins now have navbar removal logic 2019-12-06 01:21:30 -06:00
Kevin Froman 1eb47a4584 onboarding work 2019-12-03 00:00:15 -06:00
Kevin 8a4102cbd1 Merge nick's fixes 2019-12-01 08:10:00 +00:00
Kevin Froman 1de668a9e5 onboarding work, now waits to start daemon timers 2019-11-30 02:42:49 -06:00
Kevin Froman fb975dc52c fix time skew message formatting 2019-11-30 01:11:46 -06:00
KF 316b01ea85 properly delete run files when tor is not found 2019-11-29 17:49:14 -06:00
Kevin Froman 13c34a1c04 adjust tests for upload queue exception 2019-11-27 14:07:51 -06:00
Kevin Froman f401518d24 fix insertion upload check when daemon is not running 2019-11-27 13:53:06 -06:00
Kevin Froman 00baf30141 add check and daemon api endpoint to fix #41 2019-11-27 13:39:48 -06:00
Kevin Froman d1f9911fd4 when resetting plugins, dont copy until onionr is ran again 2019-11-26 18:36:50 -06:00
Kevin Froman ee5f4409af work on onboarding and pep8 compliance. re-worded about 2019-11-26 18:01:32 -06:00
Kevin Froman 720efe4fca renamed onionr dir and bugfixes/linting progress 2019-11-21 02:23:58 -06:00