HTML input with supplemental chars not supported

[Former user]

Original [issue 30](https://code.google.com/p/okapi/issues/detail?id=30) created by @ysavourel on 2009-03-21T02:47:25.000Z:

It seems supplemental characters are not supported by Jericho: I've added this test as well as a supplemental.html file in the test folder.

I'll look more closely at the skeleton writer, but output to XLIFF (which does not use the skeleton writer also is losing the chars.

public void testSupplementalSupport() { String snippet = "<p>[&\#x20000;]=U+D840,U+DC00</p>"; assertEquals("<p>[
uD840,
uDC00]=U+D840,U+DC00</p>", generateOutput(getEvents(snippet), snippet, "en")); }

[Former user]

Comment [1.](https://code.google.com/p/okapi/issues/detail?id=30#c1) originally posted by @ysavourel on 2009-03-27T19:13:30.000Z:

[Former user]

Comment [2.](https://code.google.com/p/okapi/issues/detail?id=30#c2) originally posted by @ysavourel on 2009-03-30T16:58:35.000Z:

I reported this bug to Martin Jericho and it will be fixed with Jericho 3.0 Production.

[Former user]

Comment [3.](https://code.google.com/p/okapi/issues/detail?id=30#c3) originally posted by @ysavourel on 2009-03-30T17:30:16.000Z:

Martin Jericho sent me a patched file to fix the problem.

[Former user]

Comment [4.](https://code.google.com/p/okapi/issues/detail?id=30#c4) originally posted by @ysavourel on 2009-03-30T21:31:35.000Z:

I don't think it's fixed. I have the latest svn files and I get a null instead of the two supplementary characters. The HtmlSnippet also fails.

[Former user]

Comment [5.](https://code.google.com/p/okapi/issues/detail?id=30#c5) originally posted by @ysavourel on 2009-03-30T21:53:29.000Z:

The snippet test case passes for me. I did have to update the test case as it had a comma that I didn't think should be there.

[&\#x20000;] = [
uD840
uDC00]

The entity should be converted to a surrogate pair Correct? The above test does pass, which looks correct to me.

[Former user]

Comment [6.](https://code.google.com/p/okapi/issues/detail?id=30#c6) originally posted by @ysavourel on 2009-03-30T22:38:39.000Z: