HTTP_PREFERENCES should be converted to utf8 on write

[kollivier]

https://sentry.io/learningequality/studio/issues/699325214/

UnicodeDecodeError: 'utf8' codec can't decode byte 0xf3 in position 24: invalid continuation byte
(2 additional frame(s) were not displayed)
...
  File "newrelic/hooks/framework_django.py", line 544, in wrapper
    return wrapped(*args, **kwargs)
  File "contentcuration/views/files.py", line 66, in file_create
    preferences = json.loads(request.META.get('HTTP_PREFERENCES') or "{}")
  File "json/__init__.py", line 339, in loads
    return _default_decoder.decode(s)
  File "json/decoder.py", line 364, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "json/decoder.py", line 380, in raw_decode
    obj, end = self.scan_once(s, idx)

UnicodeDecodeError: 'utf8' codec can't decode byte 0xf3 in position 24: invalid continuation byte

[ivanistheone]

That was probably me --- I tried to create some content nodes with cyrilic title + destription + channel settings like author, and copyright_holder through the studio web interface today (the BG translators pp; asked me to do a demo of Kolibri Studio during a teacher training sessino with math teachers) will try to reproduce and make this repeatable as soon as Im back maaan math teachers really love the idea of studio showed them these slides <https://docs.google.com/presentation/d/1zi5sdB7YuQ5qyfuDvQEgTwVhvqmmaatGDSC_nuV6gtU/edit#slide=id.g43594b1be3_0_932> and they were like "how do I install this thing on my coputer right now"

…

On Fri, Sep 28, 2018 at 5:29 PM Kevin Ollivier ***@***.***> wrote: https://sentry.io/learningequality/studio/issues/699325214/ UnicodeDecodeError: 'utf8' codec can't decode byte 0xf3 in position 24: invalid continuation byte (2 additional frame(s) were not displayed) ... File "newrelic/hooks/framework_django.py", line 544, in wrapper return wrapped(*args, **kwargs) File "contentcuration/views/files.py", line 66, in file_create preferences = json.loads(request.META.get('HTTP_PREFERENCES') or "{}") File "json/__init__.py", line 339, in loads return _default_decoder.decode(s) File "json/decoder.py", line 364, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "json/decoder.py", line 380, in raw_decode obj, end = self.scan_once(s, idx) UnicodeDecodeError: 'utf8' codec can't decode byte 0xf3 in position 24: invalid continuation byte — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#1004>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAKAfqtejhVo_l3EtkWYML2u1o9Zpr1Qks5ufjI_gaJpZM4W-nXE> .