ET_2020_11 build issue

[Edwin]

I run ./simfactory/bin/sim -j2 --thornlist ../einsteintoolkit.th in orde to build the toolkit but get responses

There were 57 errors during execution of the CST
These must be corrected before compilation can proceed

Warnings were generated during execution of the CST

CST error in /home/zhaodingyi/Cactus/lib/sbin/CST (at 322)
-> Missing thorn ExternalLibraries/FFTW3

CST error in /home/zhaodingyi/Cactus/lib/sbin/CST (at 322)
-> Missing thorn ExternalLibraries/GSL

…

/home/zhaodingyi/Cactus/lib/make/make.configuration:212: recipe for target '/home/zhaodingyi/Cactus/configs/sim/config-data/make.thornlist' failed
make[1]: *** [/home/zhaodingyi/Cactus/configs/sim/config-data/make.thornlist] Error 1
Makefile:260: recipe for target 'sim' failed
make: *** [sim] Error 2

It seems I have missed some thorns but I do not know how to install them correctly！

‌

[Zach Etienne]

Hi Edwin

It seems that when you followed the Download instructions there were errors in downloading certain thorns (the errors you shared indicate they do not exist). I know this can happen if you are behind a firewall. Please follow the download instructions again, but first make sure you have the ability to clone the needed repositories. One thing you could first check is if you can access fftw.org .

‌

[Edwin]

Thank you very much!

I can access FFTW Home Page but still can not install all thorns correctly.

When I run ( in subsystem of win10 and Ubuntu 20.04 LTS)

./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_05/einsteintoolkit.th (The newest introductions on Download (einsteintoolkit.org)) in order to download again but get responses

Unable to process NRPyPN
Unable to process ExternalLibraries/libjpeg
Unable to process ExternalLibraries/zlib
Unable to process ExternalLibraries/FFTW3
Unable to process ExternalLibraries/pthreads
Unable to process ExternalLibraries/BLAS
Unable to process KrancNumericalTools/GenericFD
Unable to process ExternalLibraries/hwloc
Unable to process ExternalLibraries/LAPACK
Unable to process ExternalLibraries/OpenSSL
Unable to process ExternalLibraries/MPI
Unable to process ExternalLibraries/PETSc
Unable to process ExternalLibraries/GSL
Unable to process EinsteinExact/doc
Unable to process ExternalLibraries/OpenCL
Unable to process ExternalLibraries/HDF5

Summary of Warnings:

Could not checkout module NRPyPN

fatal: unable to access 'https://github.com/zachetienne/nrpytutorial.git/': GnuTLS recv error (-110): The TLS connection was non-properly terminated.

Could not checkout module ExternalLibraries/libjpeg
svn: E170013: Unable to connect to a repository at URL 'https://github.com/EinsteinToolkit/ExternalLibraries-libjpeg.git/branches/ET_2021_05'
svn: E000110: Error running context: Connection timed out

…

‌

[Zach Etienne]

Hi again Edwin. I am unable to reproduce the problems you find; after running the GetComponents command just now, the result is

296 components checked out successfully.

Perhaps your WSL configuration is not properly bypassing your firewall? For example it claims

https://github.com/zachetienne/nrpytutorial.git

is inaccessible. You could check to see if you can access this from your WSL.

[Edwin]

It’s indeed the problem of WSL. Thanks again!

[Edwin]

I have fixed this problem

[Edwin]

I have fixed the problem of firewall on WSL but there are still some components that I can not download !

Unable to process ExternalLibraries/pciutils Unable to process ExternalLibraries/LORENE Unable to process ExternalLibraries/FFTW3 Unable to process ExternalLibraries/hwloc Unable to process ExternalLibraries/HDF5 Unable to process ExternalLibraries/BLAS Unable to process ExternalLibraries/PETSc Unable to process ExternalLibraries/pthreads Summary of Warnings: Could not checkout module ExternalLibraries/pciutils svn: E170013: Unable to connect to a repository at URL 'https://github.com/EinsteinToolkit/ExternalLibraries-pciutils.git/branches/ET_2021_05' svn: E120108: Error running context: The server unexpectedly closed the connection. Could not checkout module ExternalLibraries/LORENE svn: E170013: Unable to connect to a repository at URL 'https://github.com/EinsteinToolkit/ExternalLibraries-LORENE.git/branches/ET_2021_05' svn: E000110: Error running context: Connection timed out '''

[Zach Etienne]

Again I cannot reproduce the problems you are seeing. Before reporting this problem again, first confirm that you can reproduce from a connection that is completely free from firewalls. I’d suggest creating a tarball from that connection and using that version from the firewalled connection.

[Roland Haas]

I have seen GItHub dropping connections when too many concurrent connections existed. Eg this happened on our tutorial server when a whole class of students tried to download at the same time. Possibly a similar situation exists for you.

You may see success by using --no-parallel instead of --parallel (simply removing the option may not be enough).

[Edwin]

Thanks again!

I run ./GetComponents --parallel https://bitbucket.org/einsteintoolkit/manifest/raw/ET_2021_05/einsteintoolkit.th  again and found the missing components are added automatically, even I have done nothing. And I have build the toolkit successfully and “Hello World” test is OK.