Java Heap Error with XLIFF Splitter

[Former user]

Original [issue 147](https://code.google.com/p/okapi/issues/detail?id=147) created by micah... on 2010-10-19T16:17:41.000Z:

What steps will reproduce the problem? 1. check languages and encoding are set correctly 2. click on the green plus button on the toolbar (see step2.png). a file browser window will open. 3. select the xliff file you want to split. (use xliff with 3+ <file> elements) 4. In Rainbow, do Utilities > Edit / Execute Pipeline (see step5.png). 5. From the window that opens, click "Add step" button. a window will open with a list of available steps. 6. Select XLIFF Splitter near the bottom of the list (see step7.png) and click ok. 7. From the pipeline window, click "execute".

What is the expected output? What do you see instead? Should get no output on screen, and should see myxlf\_1.xlf, myxlf\_2.xlf, myxlf\_3.xlf (etc). What actually happens is a Java Heap Error message. See attachment.

What version of the product are you using? On what operating system? winXP. 6.0.10-snapshot java version 1.6.0\_11 See attachment for details.

Please provide any additional information below. Note: this works without error on OS X, using Rainbow 64bit snapshot. (see attachment).

[Former user]

Comment [1.](https://code.google.com/p/okapi/issues/detail?id=147#c1) originally posted by @ysavourel on 2010-10-19T16:59:20.000Z:

I have not been able to reproduce the error so far (with a 6 <file> XLIFF).

It is probably an issue related to the amount of memory allocated to the VM. The step uses the Jericho parser to process the file, which is largely done in memory.

Will try more test with larger files and see if the settings on the underlying parser can be changed.

Otherwise, changing the VM's memory is described here: http://www.opentag.com/okapi/wiki/index.php?title=How\_to\_Change\_the\_Java\_Parameters\_for\_Rainbow

[Former user]

Comment [2.](https://code.google.com/p/okapi/issues/detail?id=147#c2) originally posted by micah... on 2010-10-19T20:03:02.000Z:

We tried setting a VM of 60mbs, same result: heap error. Then we tried 65mb, and Rainbow no longer launches. That is with a winXP machine.

I tried another file today, 58mb .xlf, on OS X, and now I get the heap error.

It's kind of ironic that the reason we want to do the xliff splitting is because the files are too big to be operated on comfortably, but the splitter tool can't split them because they are too big for it! :)

[Former user]

Comment [3.](https://code.google.com/p/okapi/issues/detail?id=147#c3) originally posted by @ysavourel on 2010-10-19T23:58:32.000Z:

The irony of the situation didn't escape me :) We'll try to use a strem-based mechanism instead.

[Former user]

Comment [4.](https://code.google.com/p/okapi/issues/detail?id=147#c4) originally posted by @ysavourel on 2010-10-27T15:11:54.000Z:

[Former user]

Comment [5.](https://code.google.com/p/okapi/issues/detail?id=147#c5) originally posted by @ysavourel on 2010-10-27T15:17:16.000Z:

This problem will be resolved when comment 14\.6 is done.

[Former user]

Comment [6.](https://code.google.com/p/okapi/issues/detail?id=147#c6) originally posted by @ysavourel on 2010-11-06T14:06:11.000Z:

Using the option for large file should resolve this issue. The new step will be in the next snapshot (which may be available only in several days as other changes are not done yet).