Newer versions of Python3 have a problem with utf-8 encoding during installation

[Chris Richardson]

In cmake/scripts/generate-swig-interface.py and site-packages/dolfin_utils/documentation/extractdocumentation.py files need to opened correctly for utf-8 reading. Not clear whether to use 'rb' mode, or io.open().

[Prof Garth Wells]

What qualifies as 'newer'?

[Chris Richardson]

I encountered with Python3.6 in CentOS

[Chris Richardson]

So maybe OS related. @johannr also had same in debian.

[Johannes Ring]

Yes, but that was with Python 3.5.3.

[Prof Garth Wells]

I think the version is a red herring. Works fine for me under macOS with Python 3.6.

[Johannes Ring]

It can be reproduced in debian:unstable Docker container with the following commands:

apt-get update && \
apt-get -y install git python3-ply && \
git clone https://bitbucket.org/fenics-project/dolfin.git && \
cd dolfin && \
python3 cmake/scripts/generate-swig-interface.py

[Martin Sandve Alnæs]

Use io.open(name, encoding="utf8"), that's what we've done everywhere else.

[Johannes Ring]

I have made a fix in pull request #362, but there is now a problem with Python 2.

[Johannes Ring]

Fixed in a1529b0.