OSError: [Errno 8] Exec format error
Hi Charlie,
I'm trying to use SVEngine. However, I got two kinds of error messages when running test_mf.sh. Could you give me some ideas on why those happen and how I can solve those issues. Thank you very much!
-
I got this for all testings, except "### testing output fasta" in var2fq... fakefq: processing 2 out of 190 regions Traceback (most recent call last): File "/share/ScratchGeneral/tingon/miniconda2/lib/python2.7/runpy.py", line 174, in _run_module_as_main "main", fname, loader, pkg_name) File "/share/ScratchGeneral/tingon/miniconda2/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/share/ScratchGeneral/tingon/svengine/svengine/mf/mutforge.py", line 1346, in <module> run() File "/share/ScratchGeneral/tingon/svengine/svengine/mf/mutforge.py", line 1343, in run main(args) File "/share/ScratchGeneral/tingon/svengine/svengine/mf/mutforge.py", line 335, in main ffq = var2fq(Bunch(dic)) File "/share/ScratchGeneral/tingon/svengine/svengine/mf/mutforge.py", line 522, in var2fq bedfqs.append(fakefq(hapit)) File "/share/ScratchGeneral/tingon/svengine/svengine/mf/mutforge.py", line 623, in fakefq wgs0 = fqwgs(parlist,nligation,reffile,nploidy,[seq0],lib,freq0,mergemax,outfastq) File "/share/ScratchGeneral/tingon/svengine/svengine/mf/mutforge.py", line 699, in fqwgs runcmd(wgs_cmd) #fastq file File "/share/ScratchGeneral/tingon/svengine/svengine/mf/mutforge.py", line 87, in runcmd run=subprocess.Popen(cmd.split(),env=os.environ,cwd=os.getcwd(),stderr=subprocess.PIPE,stdout=subprocess.PIPE) File "/share/ScratchGeneral/tingon/miniconda2/lib/python2.7/subprocess.py", line 390, in init errread, errwrite) File "/share/ScratchGeneral/tingon/miniconda2/lib/python2.7/subprocess.py", line 1025, in _execute_child raise child_exception OSError: [Errno 8] Exec format error
-
testing using a VAR file (.var) input
tmpdir= /home/tingon/svetmp_vEvz preparing simulation regions... done entering runmode 3 in file2var ... file2var done in var2bed ... done var2bed in var2fq... ERROR: feature 2 3708000 3708001 VAR_1 FINS_1 0.5 0 example.fas,fins1:1-1200,1,f 2 12000 13001 VAR_5 ITRA_1 0.5 1000 None 2 3722000 3722001 VAR_7 ITRA_1 0.5 0 example.fna,2:12001-13000,1,r 1 12000 13001 VAR_9 ITRA_2 0.5 1000 None 2 3736000 3736001 VAR_11 ITRA_2 0.5 0 example.fna,1:12001-13000,1,r 1 26000 28001 VAR_15 DEL_2 1.0 2000 None 2 26000 28001 VAR_17 DEL_3 1.0 2000 None 2 40000 41001 VAR_21 TRA_1 1.0 1000 None 1 40000 40001 VAR_23 TRA_1 0.5 0 example.fna,2:40001-41000,1,f 2 54000 54001 VAR_27 TRA_2 0.5 0 example.fna,2:138001-139000,1,f 2 3750000 3751001 VAR_29 INV_1 0.5 1000 example.fna,2:3750001-3751000,1,r 1 54000 55001 VAR_31 INV_2 0.5 1000 example.fna,1:54001-55000,1,r 1 1636000 1637001 VAR_33 IDUP_1 0.5 1000 example.fna,1:1636001-1637000,2,r 2 68000 69001 VAR_35 IDUP_2 0.5 1000 example.fna,2:68001-69000,2,r 1 68000 68001 VAR_37 DINS_1 0.5 0 example.fna,1:124001-125000,1,f 2 3764000 3764001 VAR_39 DINS_2 0.5 0 example.fna,2:152001-153000,1,f 1 82000 82001 VAR_41 IDINS_1 0.5 0 example.fna,2:82001-83000,1,r
not overlapping any simulation region, correct your input
Comments (9)
-
repo owner -
repo owner - changed status to on hold
cannot replicate
-
Hi Charlie,
Thank you for the quick reply. I'm working on the HPC cluster. Python used: virtual environment from python-2.7.9 installed and I also tried python-2.7.14 by miniconda2 I still got the error messages.
Sorry for the stupid question that what is Dockerfile and how can I use that for svengine? Do you mean the aws EC2 instance?
Thank you very much, Tingting
-
repo owner No, not any question is stupid. Briefly, you can understand Docker as a cross-platform virtual machine. It is available for Linux, Mac and MS Windows. https://www.docker.com
After you've install it on your local system and learn the basics. You've just need to download the Dockerfile from the SVEngine repo and put it in a directory say sve_docker, and then build a container from inside the directory: docker build
It will give you a container id and you can then access the SVEngine by running the container VM by: docker exec -it $your_container_id /bin/bash
-
Thank you very much for the help. I used another HPC platform and python 2.7.11. But I got the same error message: tmpdir= /home/913/tg2182/svetmp_LlRk preparing simulation regions... done entering runmode 1 output varcnt 48 in var2file... done var2file in var2bed ... done var2bed in var2fq... fakefq: processing 2 out of 192 regions Traceback (most recent call last): File "/apps/python/2.7.11/lib/python2.7/runpy.py", line 162, in _run_module_as_main "main", fname, loader, pkg_name) File "/apps/python/2.7.11/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/short/qa2/tg2182/svengine/svengine/mf/mutforge.py", line 1346, in <module> run() File "/short/qa2/tg2182/svengine/svengine/mf/mutforge.py", line 1343, in run main(args) File "/short/qa2/tg2182/svengine/svengine/mf/mutforge.py", line 335, in main ffq = var2fq(Bunch(dic)) File "/short/qa2/tg2182/svengine/svengine/mf/mutforge.py", line 522, in var2fq bedfqs.append(fakefq(hapit)) File "/short/qa2/tg2182/svengine/svengine/mf/mutforge.py", line 632, in fakefq wgs1 = fqwgs(parlist,nligation,reffile,nploidy,[seq1],lib,freq1,mergemax,outfastq) File "/short/qa2/tg2182/svengine/svengine/mf/mutforge.py", line 699, in fqwgs runcmd(wgs_cmd) #fastq file File "/short/qa2/tg2182/svengine/svengine/mf/mutforge.py", line 87, in runcmd run=subprocess.Popen(cmd.split(),env=os.environ,cwd=os.getcwd(),stderr=subprocess.PIPE,stdout=subprocess.PIPE) File "/apps/python/2.7.11/lib/python2.7/subprocess.py", line 710, in init errread, errwrite) File "/apps/python/2.7.11/lib/python2.7/subprocess.py", line 1335, in _execute_child raise child_exception OSError: [Errno 8] Exec format error
I have tested with fasta output sucessfully as following, but not fastq and bam. PYTHONPATH=$SVENGINEPATH python -m mf.mutforge -x fasta -n 1 -b 100000 -f 10000 -e 100000 -m test_mf.meta example.fna simple.par example.fna Could you give me some ideas about this? How -x bam or -x fastq work differently with -x fasta? What I may got wrong or miss?
Dockerfile: I tried to ran svengine in docker container on my mac. But got: Cloning into 'svengine'... error: RPC failed; curl 56 GnuTLS recv error (-9): A TLS packet with unexpected length was received. fatal: The remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed I will see how to solve that to make svengine work. Please let me know if you know what is wrong here.
Thank you.
-
repo owner Dear Tingting,
I saw your questions. I suggest using Docker as our first debug approach. That way I have a controllable platform.
For the TLS question, I found an stack overflow answer. The simplest would be changing https:// to ssh:// within the Docker file.
See if that works for you. I will update the repo if so. See here for other options: https://stackoverflow.com/questions/38378914/git-error-rpc-failed-curl-56-gnutls
-
repo owner Think I fixed the "Exec format error" issue. The reason is I only shipped a binary xwgsim with the package. I also fixed the "RPC error" thing. Thanks for catching the bug. Now you are free to use it either way.
-
repo owner - changed status to resolved
-
repo owner fixed issue
#1→ <<cset 62df2a46a979>>
- Log in to comment
Hi. I cannot replicate this on my ubuntu and mac with python 2.7. Can you let me know your system and python.
Note, if it is a platform or python distro specific issue, You can always use the Dockerfile provided to ran svengine in a docker container.