large file repositories (again)

Issue #580 resolved
Former user created an issue

when pushing a large repository through scm-manager i get an AssertionError.

if i edit the hgrc and remove the scm hooks, i can run hg serve directly and push into the repository successfully,

root@scmmanager:/repositories/hg/SFHS# hg serve Not trusting file /repositories/hg/SFHS/.hg/hgrc from untrusted user tomcat7, group tomcat7 Not trusting file /repositories/hg/SFHS/.hg/hgrc from untrusted user tomcat7, group tomcat7 Not trusting file /repositories/hg/SFHS/.hg/hgrc from untrusted user tomcat7, group tomcat7 listening at http://localhost:8000/ (bound to *:8000) 10.0.0.111 - - [09/May/2014 14:04:16] "GET /scm/hg/SFHS?cmd=capabilities HTTP/1.1" 404 - 10.0.0.111 - - [09/May/2014 14:04:41] "GET /?cmd=capabilities HTTP/1.1" 200 - 10.0.0.111 - - [09/May/2014 14:04:41] "GET /?cmd=batch HTTP/1.1" 200 - x-hgarg-1:cmds=heads+%3Bknown+nodes%3D1a03e412abf4c50c300daa5845f294e59cbeaa9e 10.0.0.111 - - [09/May/2014 14:15:20] "POST /?cmd=unbundle HTTP/1.1" 200 - x-hgarg-1:heads=686173686564+6768033e216468247bd031a0a2d9876d79818f8f 10.0.0.111 - - [09/May/2014 14:15:20] "GET /?cmd=listkeys HTTP/1.1" 200 - x-hgarg-1:namespace=phases 10.0.0.111 - - [09/May/2014 14:15:21] "GET /?cmd=listkeys HTTP/1.1" 200 - x-hgarg-1:namespace=bookmarks

Comments (12)

  1. Nicholas Craig

    no we are not using the large file extension, we have a few repositories that are acting this way. From what i can tell, there isn't anything significant in terms of files, some have large files, even up to 50Mb and thousands of files, but others have very small file sizes with few files in all.

    These are all imported from SVN repositories, we converted 30 repositories and 6 are doing this. If i do a clean import, some will import but others still have the same error.

  2. Nicholas Craig

    Not trusting file /repositories/hg/Acdelco/.hg/hgrc from untrusted user tomcat7, group tomcat7 Not trusting file /repositories/hg/Acdelco/.hg/hgrc from untrusted user tomcat7, group tomcat7 checking changesets checking manifests crosschecking files in changesets and manifests checking files 75969 files, 314 changesets, 78665 total revisions

  3. Sebastian Sdorra repo owner

    Are all files of the repositories are owned by user tomcat7 and group tomcat7? tomcat7 is the user which controls the tomcat process which runs scm-manager? Did you get the same error when you try a clone on the same machine which runs scm-manager?

  4. Nicholas Craig

    if i work directly with the repository through hg command line, everything works fine, its only when connecting through scm-manager that i get the errors

    root@scmmanager:/repositories/hg/Acdelco# ls -la
    total 12
    drwxr-xr-x  3 tomcat7 tomcat7 4096 May  1 15:11 .
    drwxr-xr-x 67 tomcat7 tomcat7 4096 May  9 13:04 ..
    drwxr-xr-x  4 tomcat7 tomcat7 4096 May 20 11:15 .hg
    root@scmmanager:/repositories/hg/Acdelco# cd .hg/
    root@scmmanager:/repositories/hg/Acdelco/.hg# ls -la
    total 44
    drwxr-xr-x 4 tomcat7 tomcat7 4096 May 20 11:15 .
    drwxr-xr-x 3 tomcat7 tomcat7 4096 May  1 15:11 ..
    -rw-r--r-- 1 tomcat7 tomcat7   57 May  1 15:11 00changelog.i
    drwxr-xr-x 2 root    root    4096 May  9 16:08 cache
    -rw-r--r-- 1 tomcat7 tomcat7  155 May  1 15:11 hgrc
    -rw-r--r-- 1 tomcat7 tomcat7    0 May 20 11:15 journal.bookmarks
    -rw-r--r-- 1 tomcat7 tomcat7    7 May 20 11:15 journal.branch
    -rw-r--r-- 1 tomcat7 tomcat7   43 May 20 11:15 journal.desc
    -rw-r--r-- 1 tomcat7 tomcat7    0 May 20 11:15 journal.dirstate
    -rw-r--r-- 1 tomcat7 tomcat7   33 May  1 15:11 requires
    drwxr-xr-x 4 tomcat7 tomcat7 4096 May 20 11:43 store
    -rw-r--r-- 1 root    root       0 May  9 15:57 undo.bookmarks
    -rw-r--r-- 1 root    root       7 May  9 15:57 undo.branch
    -rw-r--r-- 1 root    root      36 May  9 15:57 undo.desc
    -rw-r--r-- 1 root    root       0 May  9 15:57 undo.dirstate
    
    root@scmmanager:/repositories/test# hg clone http://scmmanager.thread.internal/scm/hg/Acdelco
    destination directory: Acdelco
    requesting all changes
    adding changesets
    adding manifests
    adding file changes
    added 314 changesets with 78665 changes to 75969 files
    updating to branch default
    58622 files updated, 0 files merged, 0 files removed, 0 files unresolved
    root@scmmanager:/repositories/test# cd Acdelco/
    root@scmmanager:/repositories/test/Acdelco# ls
    ASG  KIP  KIP_GN  Locator  Locator_DMA  PSC  SPO
    root@scmmanager:/repositories/test/Acdelco# touch test
    root@scmmanager:/repositories/test/Acdelco# hg add test
    root@scmmanager:/repositories/test/Acdelco# hg commit -m test
    root@scmmanager:/repositories/test/Acdelco# hg paths
    default = http://scmmanager.thread.internal/scm/hg/Acdelco
    root@scmmanager:/repositories/test/Acdelco# hg push default
    pushing to http://scmmanager.thread.internal/scm/hg/Acdelco
    searching for changes
    http authorization required
    realm: SONIA :: SCM Manager
    user: scmadmin
    password:
    abort: remote error:
    Mercurial/Python process ends with return code 1
    
  5. Sebastian Sdorra repo owner

    Your repository contains files which are owned by root and this files are not writeable by scm-manager which is running as tomcat7 user. You have to change the ownership.

  6. Log in to comment