Issue #506 resolved

website hangs

vlotorev
created an issue

centos 6.4, scm-manager 1.34

after uptime 2-3 days web-site hangs, see attached image. log file is attached, note only website is defaced, while hg protocol is working. I extracted 2 latest errors from log on server, see attached log.

Comments (26)

  1. Sebastian Sdorra repo owner
    • changed status to open

    Do you https? Which java version do you use? Could you monitor the responses from the website with firebug or chrome developer tools? Please post the ouput of the following:

    jstack pidofscm-manager
    
  2. vlotorev reporter

    yes, i use https with self-signed certificate.

    I use java 1.6.0.

    I'll provide more information after 9th of january as currently I don't have access to server.

  3. Vladislav Bauer

    We have the same problem:

    CentOS release 6.2 (Final)

    Linux 2.6.32-220.23.1.el6.i686 #1 SMP Mon Jun 18 16:56:21 BST 2012 i686 i686 i386 GNU/Linux

    Java(TM) SE Runtime Environment (build 1.6.0_45-b06) (Java HotSpot(TM) Server VM, build 20.45-b01, mixed mode))

    Logs:

    19:49:27.110:WARN:/:Internal error during upload-pack org.eclipse.jetty.io.EofException: timeout at org.eclipse.jetty.http.AbstractGenerator.blockForOutput(AbstractGenerator.java:520) at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:170) at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107) at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105) at org.eclipse.jgit.util.TemporaryBuffer.write(TemporaryBuffer.java:138) at org.eclipse.jgit.transport.SideBandOutputStream.writeBuffer(SideBandOutputStream.java:171) at org.eclipse.jgit.transport.SideBandOutputStream.write(SideBandOutputStream.java:151) at org.eclipse.jgit.storage.pack.PackOutputStream.write(PackOutputStream.java:124) at org.eclipse.jgit.storage.file.PackFile.copyAsIs2(PackFile.java:522) at org.eclipse.jgit.storage.file.PackFile.copyAsIs(PackFile.java:346)

  4. Sebastian Sdorra repo owner

    Vladislav Bauer It looks like your are trying to push a big git repository. Is this correct? Which version of scm-manager do you use? Do you use the standalone server or an other application server? Hangs the complete website or just the push? Please post a jstack of your scm-manager process.

  5. Vladislav Bauer

    It looks like your are trying to push a big git repository. Is this correct?

    I'm not sure about the moment when it happens, just time to time (we have a lot of developers).

    Which version of scm-manager do you use?

    1.34. We have also tried 1.32 and earlier versions.

    Do you use the standalone server or an other application server?

    We use standalone server.

    Hangs the complete website or just the push?

    Complete website is hanged.

    Please post a jstack of your scm-manager process.

    I'll try to do it in next accident.

  6. vlotorev reporter

    sorry for delayed reply, only today scm-manager website hanged again. Here is the requested info: $ java -version

    java version "1.7.0_25" OpenJDK Runtime Environment (rhel-2.3.10.4.el6_4-x86_64) OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode)

    jstack attached as scm-manager-1.34-jstack.stdout

    Console output for chrome dev tools is attached as chrome-dev-tools.console-output I'll keep current hung scm-server state to collect more logs if requested.

  7. vlotorev reporter

    Could you try to access the resources without ssl (e.g.: http://yourserver:8080/scm/resources/958dd4be2e9ad45cee960de7c6b4d8d11c849068.css)?

    Sorry, in your case it is port 8081.

    My port is 8181 :)

    $ wget http://myserver:8181/scm/ gives following

    resources/958dd4be2e9ad45cee960de7c6b4d8d11c849068.css --2014-01-20 14:06:29-- http://myserver:8181/scm/resources/958dd4be2e9ad45cee960de7c6b4d8d11c849068.css Resolving myserver... 192.168.1.41 Connecting to myserver|192.168.1.41|:8181... connected. HTTP request sent, awaiting response... No data received. Retrying.

    --2014-01-20 14:06:30-- (try: 2) http://myserver:8181/scm/resources/958dd4be2e9ad45cee960de7c6b4d8d11c849068.css Connecting to myserver|192.168.1.41|:8181... connected. HTTP request sent, awaiting response... No data received. Retrying.

    ....... and so on...

  8. Sebastian Sdorra repo owner

    Ok, i think i've understand the problem. SCM-Manager versions before 1.35 uses the temp directory to extract the war file and some operating systems are cleaning the temp directory after a while. Since version 1.35 SCM-Manager uses a work directory. Please have a look at #464.

  9. vlotorev reporter

    ok, my website printscreen looks exactly like from #464. I'll update to 1.35, but it'll take a couple of weeks to wait for hanging. imho, issue can be closed

  10. Log in to comment