Implement planned 0.4.0 protocol changes

[black-sliver]

Protocol changes

• Drop Print in favour of PrintJSON. At least multiclient.net can't handle arbitrary type yet, so version check is required.
• Drop support for missing items_handling in Connect
• Replace DataPackage per-game version by a hash
• Replace RoomInfo datapackage_versions by hashes
• Drop datapackage_version from RoomInfo and version from DataPackage
• Drop players from RoomInfo
• Change games in RoomInfo to be a Set, including "Archipelago"
• Drop exclusions from GetDataPackage
• Drop support for IgnoreGame tag

Implementation

There is no hard reason to PR or merge stages in order. Stages 1+2 could be implemented at the same time as 4+5 by testing against multiple branches.

Stage 1: Verify client lib support of revamped games in RoomInfo and missing players

• apclientpp
• apcpp
• java
• js
• net Fix for .net client failing to connect in AP 0.4 Archipelago.MultiClient.Net#54
• py Clients: prepare for removal of players key in RoomInfo #888

Stage 2: Update clients that require update from stage 1

insert more items here when we know

• Timespinner
• RL
• RoR2
• Subnautica
• HK
• Raft
• CommonClient - 0.3.5

Stage 3: Implement new features, in the server

• Use PrintJSON for Chat and Countdown - fall back to Print for old clients (Connect version: 0.3.5)
  [Core] Phase out Print packets and added Countdown type to print json #812
• Require items_handling in Connect for new clients (Connect version: TBD)
• Datapackage per-game checksum - in addition to version integer
  Deprecate data_version and introduce checksum for DataPackages. #684
• games revamp in RoomInfo (depends on stage1 and 2 being completed)
  Network: implement 0.4 marked compatibility removals #757

Stage 4: Implement new features in client libs, send new version

• apclientpp: black-sliver/apclientpp@4a31041...ce95812
• apcpp:
• java
• js
• net
• py: Deprecate data_version and introduce checksum for DataPackages. #684

Stage 5: Update clients to new libs

insert all games here

• CommonClient (TextClient, SNIClient, Adventure, Factorio, FF1, KH2, LADX, OoT, Pokemon R/B, SC2, Wargroove, Z1, Zillion)
• SoE - v0.3.9
• Meritous
• Witness
• Dark Souls III

Stage 6: Drop backwards-compat in server

• Drop fallback to Print
• Drop version check from items_handling requirement
  Network: implement 0.4 marked compatibility removals #757
• Drop DataPackage per-game version (replaced by hash)
• Drop RoomInfo datapackage_versions (replaced by hashes)
• Drop RoomInfo datapackage_version and DataPackage version (removed)
  Network: implement 0.4 marked compatibility removals #757
• Drop GetDataPackage exclusions (replaced by games)
• Drop support for IgnoreGame tag
• Update minimum required client version in server

Stage 7: Drop backwards-compat in client

At the discretion of client lib devs, but should not happen before TBD.

Random Notes

Stage 1/2 can be tested against a server running #757

[Berserker66]

A fair few py world changes are done in #757

[Jarno458]

changes for countdown by PrintJSON are in #812

[black-sliver]

• Fixed/split the datapackage version stuff above (it's still confusing...) with both version and versions.
• Added dropping exclusions from GetDataPackage. I already forgot that is still in :D

[Jarno458]

So regarding the .net client updates, the v4 was just released a couple of hours ago
Timespinner and Subnautica already use it
I'll gently poke the maintainers of the other .net games to see if they got time to update thiers

[KonoTyran]

can confirm Java library is compatible with stage 1. current Minecraft mod connects to games run with #757 without issue.

[Jarno458]

can confirm ArchipIDLE works just fine, both on removal of games aswel as receiving printJson instead of print

[Jarno458]

Raft is also updated so can be checked off

[Jarno458]

RL was also updated and can be marked off

[ThePhar]

RoR2 has been updated, so marked it off. May also want to add removing forced_auto_forfeit to this as all clients after the next RoR2 client update should no longer be dependent on it.

[Jarno458]

As an update for step 6 "Drop fallback to Print" was already merged

[Jarno458]

Checksum based datapackage where added in https://github.com/ArchipelagoMW/Archipelago.MultiClient.Net v5.0.0