Server halts on large text

Issue #7 on hold
Anonymous created an issue

I am trying to ssplit a large piece of text (approx 114000 characters). The server simply does not respond - I have to manually interrupt. Only tokenizer and ssplit modules are active and I have max memory set to '2g' since I have a 32-bit machine with only 2 gig RAM. Is this causing the problem? It works perfectly for smaller texts.

Please find attached the exact text file I am struggling with.

Thanks and great work!

Comments (2)

  1. Hiroyoshi Komatsu repo owner

    I'm sorry for late reply, would you need to help even now? This wrapper includes text input and file input, and its codes are independent. Please tell me using a kind of input (Text input or File input)

  2. Log in to comment