UTF-8 encoding

[Ed McDonagh]

No description provided.

[Ed McDonagh]

Started implementing solution in commit eae4172

[Ed McDonagh]

Added Protocol name to those that pass the character set. Refs #434. Added in a load of spaces where suggested.

→ <<cset 796846090f10>>

[Ed McDonagh]

Added the smart_text function to all the strings. Refs #434

→ <<cset 8fde987562db>>

[Ed McDonagh]

Adding char_set information. From the bottom, got as far as _irradiationeventxraysourcedata. Refs #434

→ <<cset 43fa1e52ba1a>>

[Ed McDonagh]

Completed feeding character set through rdsr.py. Refs #434

→ <<cset 6811513a4324>>

[Ed McDonagh]

Started on ct_philips. Added charset to not_patient_indicator. Refs #434

→ <<cset 224a9b82c72a>>

[Ed McDonagh]

Finished ct_philips. Refs #434

→ <<cset 730a86b8f39c>>

[Ed McDonagh]

Adding in charset to dx.py. Refs #434, not complete. Changed an assignment for an augmented assignment, ie a = a100 to a = 100.

→ <<cset 20ffef3b8eac>>

[Ed McDonagh]

Added hashed version of mammo import ID check. UFT-8 strings need to be bytecode before hashing. Need to fix on other extractors too. Refs #427, #434

→ <<cset 0079f3ac4d3c>>

[Ed McDonagh]

Converted accession number hashing to use the django smart_bytes tool. Refs #434

→ <<cset a38ad5bf6625>>

[Ed McDonagh]

ct_philips name and ID now byte encoded before hashing. Refs #434

→ <<cset d767182137d8>>

[Ed McDonagh]

All extractors now use the common hash_id function with smart_bytes.. Refs #434

→ <<cset 8b06a4f6a92f>>

[Ed McDonagh]

Missed some passing of character sets. Refs #434

→ <<cset 380d634c7169>>

[Ed McDonagh]

Missed some passing of character sets. Refs #434

→ <<cset d87b7c1c7983>>

[Ed McDonagh]

Missed some passing of character sets. Refs #434

→ <<cset 64322ccb9b3c>>

[Ed McDonagh]

I think this is resolved now. Will continue to check when adding new tests. Particularly need to make sure I haven't messed up the latin-1 character sets that were previously fixed!

[Tim de Wit]

Just came across the following error message:

Traceback (most recent call last):
  File "/usr/local/bin/openrem_mg.py", line 23, in <module>
    mam(filename)
  File "/usr/local/lib/python2.7/dist-packages/celery/local.py", line 191, in __call__
    return self._get_current_object()(*a, **kw)
  File "/usr/local/lib/python2.7/dist-packages/celery/app/task.py", line 379, in __call__
    return self.run(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/openrem/remapp/extractors/mam.py", line 577, in mam
    _mammo2db(dataset)
  File "/usr/local/lib/python2.7/dist-packages/openrem/remapp/extractors/mam.py", line 492, in _mammo2db
    _create_event(dataset)
  File "/usr/local/lib/python2.7/dist-packages/openrem/remapp/extractors/mam.py", line 465, in _create_event
    _irradiationeventxraydata(dataset, same_study_uid.get().projectionxrayradiationdose_set.get())
TypeError: _irradiationeventxraydata() takes exactly 3 arguments (2 given)

Solution: replace line 465 in mam.py by the following:

    ch = get_value_kw('SpecificCharacterSet', dataset)
    _irradiationeventxraydata(dataset, same_study_uid.get().projectionxrayradiationdose_set.get(), ch)