Spacy English parser takes > 35 seconds to load in (0.101 -or- 1.5). Crashes in 1.5 with...

[enjoysmath]

Any way to use 0.101.0 and speed up load time, or fix the crash / load time in 1.5?

1.5 Crash after 30 seconds of loading english = English():

builtins.MemoryError: Error assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytesError assigning 16777216 bytes

Your Environment

• Operating System: Win7 64-bit
• Python Version Used: 3.5.2
• spaCy Version Used: 1.5
• Environment Information: python -m spacy.en.download all

[honnibal]

How much memory do you have?

[mattmacy]

@enjoysmath watch #788 - as it should dramatically reduce the amount of physical memory needed, at least for smaller data sets

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.