Mention mitm_ignore_pre_boot in config.ini #983
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Expl0dingBanana
added a commit
to Expl0dingBanana/MAD
that referenced
this pull request
Dec 25, 2020
* Update quest_templates.json (Map-A-Droid#951) * AutoConfig UX Improvements (Map-A-Droid#953) * Viewing the log page for a session when completed or deleted now prompts an redirects to the pending page * Add a warning message if no auth is configured * Require MAD Packages to be up-to-date before a session can be accepted * MADmin Packages must be available or a blocking issue will prevent auto-config from executing * Allow a device to be added through the PogoAuth Page * Only allow a Google PogoAuth account to be assigned to a single device * Display a warning message on a device if autoconfig is required to have an assigned Pogo Auth and none is present * Viewing the log page for a session when completed or deleted now prompts an redirects to the pending page * Add a button on the pending device page to download mad_autoconf.txt filled filled out with the RGC information * Moved the Download Config button to the bottom of the page * Throw errors on default 0.0.0.0 and 127.0.0.1 for PD / RGC Config * fix init mode wording * wording for auto-config warnings * update frontend toggles library * visual device control overhaul * fix tests * fix missing test * remove unused assets * Fix CRLF in Auto-Config generation * fix device control dark theme * remove outdated offsets * add dummy addresses for 0.185.0 * Wizard Targeted PoGo Downloads (Map-A-Droid#964) * GPlay VersionCode Download * Wizard searches versionCode for latest supported PoGo * Wizard downloads based off versionCode instead of latest release which may not be supported * Version codes will be maintained within the file configs/version_codes.json * add 0.185.1 versionCode * Fixed an issue where the wizard would not properly download the correct version if it had searched from the previous version of the wizard Co-authored-by: Sascha Ohms <[email protected]> * fix tooltips for spawnpoint statistic * fix link color in alerts (Map-A-Droid#965) * fix typo in css * Pausing device enables ConfigMode for the worker (Map-A-Droid#962) * Pausing device enables ConfigMode for the worker * Autoconfig Issues class (Map-A-Droid#967) * Autoconfig Issues Class * Move the autoconfig issues identifier into a class * Update unit-tests for autoconfig issues to check for issue IDs vs text * ignore trash protos * Text fixes within madmin (Map-A-Droid#971) * Fix some Grammar/Spelling within spawn_statistics.html * Fix status.html formatting No more smiley. :) * add evolution support (Map-A-Droid#972) * Fix Config Editor (Map-A-Droid#970) * Fix an issue where RGC / PD selectors were not being checked on save * Add evolution to webhook (Map-A-Droid#973) It will be send always, even with eggs, just like CP set to 0. * Implemented geofence editing on map (Map-A-Droid#959) * Implemented geofence editing on map * Sorted geofences in map sidebar. * Support for 0.185.1 32/64 bit * force lowercase on PD backend email (Map-A-Droid#979) * use lowercase when saving email addresses for PD Configuration * Add GET and PATCH methods to API PD / RGC config * add option to ignore backlog mitm data (Map-A-Droid#978) If MAD is not available, PD will perform several retries to send mitm data to MAD. Due to recent changes in 0.185.0, the amount of data coming in from the game grew quite a lot. This can cause issue for dozens of devices filling up the queue without it being processed fast enough. Either start MAD with `--mitm_ignore_pre_boot` / `-mipb` or just add `mitm_ignore_pre_boot` without any value to your config.ini. * rename raid evolution property * fix tests * Mega quest support (Map-A-Droid#985) Support Quest Reward for Mega Energy Webhook will send mega energy reward as reward type 12 with the amount in item_amount + pokemon_id as pokemon Reward type 4 is also added similar for candy amount in item_amount Show energy quests on the map Add mega energy info to quest webhook poracle type * add version codes * Some UI fixes for MADmin (mainly for mobile) (Map-A-Droid#986) - Sorted the popup loading dialogue and moved to a central component - Added some priority to columns for small screens - Add expand/collapse for the responsive tables * fix workers not being available for location injection (Map-A-Droid#975) * Quick-fix for missing workers in Inject Location After Map-A-Droid#959 . We need workers to use them in Inject Location (right bottom corner, satellite dish icon) https://github.com/Map-A-Droid/MAD/blob/41047464753eba5612874bc70fdab1799f1b1d39/static/madmin/templates/map.html#L213 - without enabled workers layer list was empty. I don't think enabling workers here should kill performance (one more GETs), but maybe we want it 'on-demand' before opening Inject Location modal? @MrJul you decide, kinda nuking all this nice job of not requesting 175781785871578178 of GETs every few seconds :D * Update madmin.js Delete it rather than comment * Show proto type in 'got the data requested' log line (Map-A-Droid#968) * Give more info about 'got the data requested' * Make travis happy (hopefully?) * One more time... * add prioq popup for locations and lines. fixes Map-A-Droid#976 (Map-A-Droid#977) * add mitm_ignore_pre_boot to default config.ini (Map-A-Droid#983) * fix double clicking on map messing up fence creation/editing. (Map-A-Droid#987) * Remove need of PogoAssets for shiny mons stats (Map-A-Droid#982) * Remove need of PogoAssets for shiny mons stats But we lost the shinies of icons. I could not find a public repo with shiny icons :( Also removed old, not used anywhere function + endpoint. * Update statistics.py * cleanup import * Optimized mon statistics page load (Map-A-Droid#984) * Mon statistics page loads faster. * Updated pdfmake/jszip on all stats pages * Revert "Show proto type in 'got the data requested' log line (Map-A-Droid#968)" This reverts commit fb33e83. * Support for 0.185.3 32/64 bit * Add Remote pass to not-allowed-list * Fix delete button not doing anything on spawnpoints page (Map-A-Droid#994) also remove deleted class from convert link, that could backfire one day I guess :D * Bring back confirm dialog for Reset data (Map-A-Droid#993) * Bring back confirm dialog for Reset data krzTrack again. * Update phone.tpl * log MADMin ws clicks (Map-A-Droid#992) * log MADMin ws clicks Because krzTrack wanted! * Update control.py MADMin -> MADmin, because I was already there. * Removed map duplicate computed properties (Map-A-Droid#988) * update september DE quest_templates.json (Map-A-Droid#980) * Refactor data processing for easier implementation of raw data processing (Map-A-Droid#960) * initial refactor for data processing * allow overwriting the MITM data processor manager via plugins * fix syntax * move mitm data queue check to seperate thread * properly stop queue check thread * potential fix for batch walker update in MADmin * Support Mega Evolve quests * oeps * Quickfix, move mega empty def to correct quest (Map-A-Droid#999) * Update types.json (Map-A-Droid#998) Double space, lel * Hide the Expand All/Collapse button all on Status page when on a large display and there is no hidden columns * - Stop drop down menus (<select>) overflowing - Make settings an expandable nav item - If on a device with a mouse/pointer the drop downs in the nav bar will expand on hover * Whoop! * Make the dropdowns sticky, so if you click the menu it stays open until you click again. If you don't click it will open on hover and close when pointer moves away * Add % known to spawnpoint stats page * Remove Ledyba 165 from ditto list * Add option for more entries in status page (Map-A-Droid#1002) We have "all" now for people running more than 100 devices and want to overload theirs browsers. (c) for Boby360 * Add more variations of Remote Raid Pass/Premium Battle Pass (Map-A-Droid#1001) This looks like a long string ("Remote Raid Pass") and premium was renamed to "Battle" pass and with nice OCR it was still trying to delete it. ``` 0.1 for Gift vs Remote Raid Pass 0.16666666666666666 for Geschenk vs Remote Raid Pass 0.08333333333333333 for Glücksei vs Remote Raid Pass 0.08 for Glucks-Ei vs Remote Raid Pass 0.08 for Glücks-Ei vs Remote Raid Pass 0.08 for Lucky Egg vs Remote Raid Pass 0.14814814814814814 for CEuf Chance vs Remote Raid Pass 0.2727272727272727 for Cadeau vs Remote Raid Pass 0.2 for Appareil photo vs Remote Raid Pass 0.08 for Wunderbox vs Remote Raid Pass 0.2222222222222222 for Mystery Box vs Remote Raid Pass 0.3448275862068966 for Boîte Mystère vs Remote Raid Pass 0.2608695652173913 for Premium vs Remote Raid Pass 0.4 for Raid vs Remote Raid Pass 0.2 for Teil vs Remote Raid Pass 0.17391304347826086 for Élément vs Remote Raid Pass 0.15384615384615385 for mystérieux vs Remote Raid Pass 0.3076923076923077 for Mysterious vs Remote Raid Pass 0.16 for Component vs Remote Raid Pass 0.37037037037037035 for Mysteriöses vs Remote Raid Pass 0.5454545454545454 for Remote vs Remote Raid Pass 0.1 for Fern vs Remote Raid Pass 0.6 for Fern-Raid-Pass vs Remote Raid Pass 0.4 for Pass vs Remote Raid Pass 0.38095238095238093 for Passe vs Remote Raid Pass 0.16666666666666666 for distance vs Remote Raid Pass Deleting Remote Raid Pass ``` Was on threshold edge on Fern-Raid-Pass (???????), but not enough. * Implement PTC as PogoAuth (Map-A-Droid#995) Convert PTC to PogoAuth * Create a PogoAuth account for each ptc_login under devices * Update schema to have the device link in settings_pogoauth * Add a Multi-Select for PTC accounts on the devices page * Fix an issue where PTC accounts were being sent as Google accounts during auto-config * add 0.187.1 64bit support "0.187.1_64": {}, * PTC / Data Manager fixes (Map-A-Droid#1012) * Fix an issue where instance_id was being set incorrectly during migration * Data Manager searching update * Update search functionality to support .eq and .like * Allows for more granular searching capabilities * greenlet 0.4.17 causes issues with python3.7 * Support 0.187.1 32 bit * Fix PD Case Sensitivity (Map-A-Droid#1009) * Remove converting PD login to lowercase * Update PogoAuth for google to convert to lowercase * Wizard download fixes (Map-A-Droid#1014) * Update wizard to read version_codes.json * Remove dependency on addresses.json * Remove /get_addresses/ from MITM server * Remove the search history when a package is removed from the wizard * Re-Implement PD get_addresses endpoint * PD may require this endpoint if backend fails * Return supported versions from version_codes.json * Exclude W503 from flake Add exclude rules for APK and configs folders * Enforcement within MAD for unique MAC addresses * Display devices associated with the duplicate MAC addresses * add codeql integration * Delete old versions (Map-A-Droid#1017) * Fixed walking speed display (Map-A-Droid#1008) * Allow easier PD debugging (Map-A-Droid#1019) * Allow addresses to be specified in addresses.json if that file exists * Actually fix the PD debugging... * Wizard support for 0.187.2 * Wizard support for 0.187.2 * For real this time * FIX: autojob unexpected keyword argument * Remove Wikimedia tileserver from maptiles (Map-A-Droid#1024) It's deprecated for 3rd parties, and use will be disallowed in the near future (slated for 2020-10-12; ie tomorrow as of writing) https://lists.wikimedia.org/pipermail/maps-l/2020-August/001729.html https://phabricator.wikimedia.org/T261424 * Fix Statistic for Worker (Map-A-Droid#1021) This MIN() breaks everything, delete it. * rework webhook worker to fetch only data for filtered types (Map-A-Droid#1027) * only fetch data if webhook filters are defined accordingly * prevent duplicates * remove unused method arg * add 0.189.0 version codes for the wizard * Update MitmDataProcessorManager.py (Map-A-Droid#1037) [03:54] 𝔈𝔵𝔭𝔩0𝔡𝔦𝔫𝔤𝔅𝔞𝔫𝔞𝔫𝔞: @JabLuszko🍏 (...) 😮 PR plz * Wizard GPlay Version Code Validation (Map-A-Droid#1032) * Wizard now validates Version Codes before downloading. This fixes version mismatches and download loops for ATVs and SmartJob failures due to "downgrade" * Wizard can download an older supported version from GPlay if the latest it not supported * Unit tests so I dont break this in the future * Support for new quest type AR scanning of pokestops are now supported * German translations * PokeStop * Add Stickers to not deletable items (Map-A-Droid#1042) * Add Stickers to not deletable items You can now click Stickers in inventory and it will open page full of stickers. There is no trashcan on those stickers in main menu (for now, I can imagine Niantic QoL update). Can't really get names in French/German, not translated in PokeMiners assets, will update later (or someone can comment). * Update WorkerQuests.py Sticker should cover StickerS too! * Fix lat_long_to_cell_id (Map-A-Droid#1036) * Fix lat_long_to_cell_id Helper method could return the wrong s2 cell in some edge cases because we used regioncoverer methods with a point area given coordinates instead of points * Travis 👲 * Message error when can't save file to temp_path (Map-A-Droid#1038) * Message error when can't save file to temp_path cv2.imwrite will silently fail if it can't save image (for example due to permissions). It will not throw any error, just False/True as return. Let's handle it, so next guy will waste less time on debugging * Update pogoWindows.py wrong logger :( * Update pogoWindows.py * Update pogoWindows.py * Calculate despawn time from data timestamp instead of now() (Map-A-Droid#1033) * Calculate despawn time from data timestamp * insulted travis with frivolous style transgression * Warning message when trying to run init and level (Map-A-Droid#1035) * Warning message when trying to run init and level This should be a proper place to put it, I guess. I would assume we don't really need to check if mode is pokestop due to `level` being only in pokestop thing * Update area.py Travis * Update area.py * Test initlevel * Update test_area.py * Update test_area.py * Update test_area.py * WorkerBase fixes (Map-A-Droid#1031) * _ensure_pogo_topmost return proper Bool * _start_pogo: prevent silent eternal loop by adding a max retry threshold * reboot after failure of restarting pogo failure of restarting pogo indicates an issue with the device like freezing or improper operation of RGC. A reboot usually is the best way of handling situations like those. * update a few settings + remove old/unused settings (Map-A-Droid#1023) * enable screendetection by default * lower post_*_delay * enable device reboots * remove delay_after_hatch setting * reduce job_thread_count * re-enable empty settings * enable coords_spawns_known * fix tests * Combine arg cleanup + new default values into one (Map-A-Droid#1025) * Config Parser argument cleanup * Ensure arguments are in the same order for example config and argparser * Removed the following arguments post_screenshot_delay initial_restart delay_after_hatch last_scanned gym_scan_distance lure_duration unknown_gym_distance geofence_file_path auto_hatch auto_hatch_number gym_detection_value npmFrom npmValue clean_hash_database position_file raid_time * MADmin enabled by default * MADmin is a critical component that should be enabled by default. Only disabling should require a flag * Remove advanced_config * Argument that did not provide any value * flake8 cleanup Co-authored-by: Expl0dingBanana <[email protected]> * remove pogoassets + always write scanned locations to DB * remove arguments to globally disable webhook types * remove pogoasset leftovers Co-authored-by: Expl0dingBanana <[email protected]> * remove bad arguments (Map-A-Droid#1044) * fix shorthand version for disable_madmin * QuickFix for scanned location (Map-A-Droid#1047) scannedlocation was off by default and now it's on by default. People will old af databases schema has some strange CONSTRAINTS there, so let's just quickfix value from -1 to 0 before final decision what to do. https://discord.com/channels/465247740553592832/467318193141317659/768947899748843591 * Fix Travis - madmin enabled by default (Map-A-Droid#1048) * generate proper url for loading.gif in all places (Map-A-Droid#1050) * Quick fix for missing items in items I know @fosJoddie has PR for whole QUESTGEN GO FAST, but still not merged. Gonna put this there too... and update locales files later for items. * add 0.191.0 version codes * add debug logging for data processing times (Map-A-Droid#1055) * debug-log processing time in ms for incoming data * add extra logging for queue item processing * fix formatting * 0.191.1 version codes (Map-A-Droid#1056) * move debug logs for processing timings up a level * 0.191.2 version codes * Wizard validation (Map-A-Droid#1045) * GPlay validation * Validate the package sent by GPlay matches the expected version * Fix an issue where an incorrect log message would show * Timezones fix (Map-A-Droid#1039) * Timezones fix * Update DbWrapper.py * Adjust MITMBase to only open and close Questlog (Map-A-Droid#1051) * Update MITMBase.py * remove conditional for quest cleanup If getting a quest failed in some conditions, it could be benefitial to try and clear quests even in quest enhance mode. Co-authored-by: Joddie <[email protected]> * syntax fixes (Map-A-Droid#1059) * add missing item name + localization (Map-A-Droid#1053) * Update items.json * Update items.json * Update items.json * Create parse_items_for_items_json.py * fairer route splitting into subroutes (Map-A-Droid#1046) * add heatmap for non-IV encounter to mon stats (Map-A-Droid#1026) * Update DbStatsReader.py * Update statistics.py * Update mon_statistics.html * Update DbStatsReader.py * Update statistics.py * Travis is sometimes fun :D E226 missing whitespace around arithmetic operator * Update mon_statistics.html * Support for 0.193.0 32/64 bit * Support for 0.193.1 32/64 bit * Count up and restart on repeated spinnable check failures (Map-A-Droid#1034) * count up and restart on repeated spinnable check failures * rework spinnable checking * compare stop location to PD data location for location confirmation * make the recheck loop more straightforward * loop more often - PD 1.8.1 makes GMO come every 5 seconds, this can be "too fast" for the device still arriving at the stop * fix W504 * ensure fresh data for spinnable check, better log * timeout fetching new data is also a data failure * spinnable_data_failure logic fix ... finding the stop closeby is a defined result, so reset the counter. Not finding it closeby is an issue, increment counter in that case. * count up and restart on repeated spinnable check failures * rework spinnable checking * compare stop location to PD data location for location confirmation * make the recheck loop more straightforward * loop more often - PD 1.8.1 makes GMO come every 5 seconds, this can be "too fast" for the device still arriving at the stop * fix W504 * ensure fresh data for spinnable check, better log * timeout fetching new data is also a data failure * spinnable_data_failure logic fix ... finding the stop closeby is a defined result, so reset the counter. Not finding it closeby is an issue, increment counter in that case. * Fix Mega evolution flag for new PogoDroid (Map-A-Droid#1060) * Extend trs_quest.quest_reward length (Map-A-Droid#1062) * Create extend_trs_quest_pogodroid_190.py * Update __init__.py * Update extend_trs_quest_pogodroid_190.py one more empty line for Travis * Update rocketmap.sql * Support for 0.193.2 32/64 bit * Support for 0.193.3 32/64 bit * Development Workflow Improvements (Map-A-Droid#1065) * Create a build environment through docker and tox to ensure builds are checked the same * Implement Makefile to perform basic tasks for the build environment * Added a pytest env with basic fixtures * Move flake8 configuration into tox.ini * Revert "Development Workflow Improvements (Map-A-Droid#1065)" This reverts commit d017af4. * remove unused and conflicting dependency * Push unquested stops to PD * safer sql query * Tidy up wait for data (Map-A-Droid#1064) * Adjust location and data checks * Improve readability of code related to timestamps * Fixed several issues around waiting * Fixed an issue around finding data that was not close to actual location * Remove code that was not needed * Improve verbosity of logging in several areas * Implement stop auto-deletion based on distance and time since update * Move "{} not in GMO" logging to debug level * Workflow improvements (Map-A-Droid#1066) * Added Makefile to easily run tests and improve code quality * Fix build for MAD docker image * Update development build to use the MAD docker image * Logging / Flake8 Adjust warning and error logging as yellow and red appears to be evil Flake8 adjustments * Wizard support 0.195.0 32/64 bit * Update dev build to better support multi-os (Map-A-Droid#1069) * Update development build * Fixed an issue where the development build could use an incorrect uid / gid * Fix an issue where .python-version is in an incorrect version * Optimize build to install pyenv as the user * Reduce number of layers during build * plugins: handle exceptions in walk_package, ignore hidden directories (Map-A-Droid#1010) * plugins: handle exceptions in walk_package, ignore hidden directories * previously unhandled exceptions would stop loading subsequent plugins, now it'll be visible which plugin caused issues and why, and be able to continue with subsequent plugins * recursing into hidden directories caused an exception because the contruction of package names as (package + '.' + child_pkg) with child_pkg starting with a dot seems to have caused invalid package names. There should be no reason to recurse into directories that are hidden / starting with a dot. * exclude hidden files/folders from plugin zipping * 0.195.1 32/64 * Update WorkerQuests.py Reduce info to debug3 logging of WorkerQuests::_check_if_stop_was_nearby_and_update_location Co-authored-by: moltova <[email protected]> Co-authored-by: Sascha Ohms <[email protected]> Co-authored-by: JabLuszko <[email protected]> Co-authored-by: cec <{ID}+{username}@users.noreply.github.com> Co-authored-by: boby360 <[email protected]> Co-authored-by: Julien Lebosquain <[email protected]> Co-authored-by: Joddie <[email protected]> Co-authored-by: George Herbert <[email protected]> Co-authored-by: wraythex <[email protected]> Co-authored-by: cyphercris <[email protected]> Co-authored-by: ColdShadow80 <[email protected]> Co-authored-by: krzee <[email protected]> Co-authored-by: Sam Reed <[email protected]> Co-authored-by: Christian Betz <[email protected]> Co-authored-by: Anton Mu <[email protected]> Co-authored-by: Till Skrodzki <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.