Skip to content

Instantly share code, notes, and snippets.

@bbpbuildbot
Created October 13, 2021 17:57
Show Gist options
  • Save bbpbuildbot/f76299e71571260bc8e82bf4510a2087 to your computer and use it in GitHub Desktop.
Save bbpbuildbot/f76299e71571260bc8e82bf4510a2087 to your computer and use it in GitHub Desktop.
Logfiles for GitLab pipeline https://bbpgitlab.epfl.ch/hpc/coreneuron/-/pipelines/19854 (:no_entry:) running on GitHub PR BlueBrain/CoreNeuron#634.
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634141705:resolve_secrets Resolving secrets
section_end:1634141705:resolve_secrets section_start:1634141705:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor413853823, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72582
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72582_PROD_P112_CP1_C1
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780594
job state: R
section_end:1634141758:prepare_executor section_start:1634141758:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634141760:prepare_script section_start:1634141760:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634141760:get_sources section_start:1634141760:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=274436 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1634141769:restore_cache section_start:1634141769:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (72576)...
Runtime platform  arch=amd64 os=linux pid=274500 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72576 responseStatus=200 OK token=wznhyWZn
section_end:1634141770:download_artifacts section_start:1634141770:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72582/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72582/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72582/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72582/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72582/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="7187ac5842413a6e4f050105d40e1f35bad3fac2"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index f138183..24a1854 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="7187ac5842413a6e4f050105d40e1f35bad3fac2")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211012', commit='846b3a6')
version('1.0.0.20210708', commit='d54a3aa')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+gpu+tests~legacy-unit~report build_type=RelWithDebInfo
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be ekzdtgq26p6y5mzmpphbjqbifw32enfk
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72582/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72582/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:16:21 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.31 / 0.51 (60.03 %)
Files: 12534
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'ekzdtgq26p6y5mzmpphbjqbifw32enfk'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit~report+tests build_type=RelWithDebInfo
Concretized
--------------------------------
- ekzdtgq coreneuron@develop%[email protected]~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 2ifshpf ^[email protected]%[email protected] patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] qu3qasv ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- gluy7kg ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] 4phgvnp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- prwvb2t ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] jop6mvp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- mddtpd5 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] v5gxu5s ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-2ifshpf6x23hf7ccztxnrrqdx4mxt3rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-qu3qasvmolllw4vbcf2maq2dz3hklz2r)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-gluy7kgf2wgh5bfrenva7x4mtnzhr6r4)
==> [email protected] : has external module in ['cuda/11.0.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.0.2-kb4wci (external cuda-11.0.2-4phgvnpeha2grh36f6f6w7ledwlpbcs3)
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-prwvb2t3p3bo5eivmcrvx2eyffvcwfqy)
==> [email protected] : has external module in ['hpe-mpi/2.22.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.22.hmpt-r52ypu (external hpe-mpi-2.22.hmpt-jop6mvp4dll4wazl3uc7ycyupteb34ia)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-mddtpd5kgds34dklkfm2prewsfy6becf)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-v5gxu5slpix24wzbfiyzo52rwso5gsaa)
==> Installing coreneuron-develop-ekzdtgq26p6y5mzmpphbjqbifw32enfk
==> No binary for coreneuron-develop-ekzdtgq26p6y5mzmpphbjqbifw32enfk found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.2/coreneuron-develop-ekzdtg
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72582/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72582/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:22:26 2021
Hits: 35 / 117 (29.91 %)
Direct: 19 / 117 (16.24 %)
Preprocessed: 16 / 98 (16.33 %)
Misses: 82
Direct: 98
Preprocessed: 82
Uncacheable: 18
Primary storage:
Hits: 143 / 234 (61.11 %)
Misses: 91
Cache size (GB): 0.31 / 0.51 (61.46 %)
Files: 12624
Uncacheable:
Called for linking: 15
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634142147:step_script section_start:1634142147:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=290683 revision=58ba2b95 version=14.2.0
ccache/: found 13185 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-5
Created cache
section_end:1634142171:archive_cache section_start:1634142171:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=290915 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72582 responseStatus=201 Created token=v7ZQqUy3
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=290936 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72582 responseStatus=201 Created token=v7ZQqUy3
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=290959 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72582 responseStatus=201 Created token=v7ZQqUy3
section_end:1634142173:upload_artifacts_on_success section_start:1634142173:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634142173:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634141545:resolve_secrets Resolving secrets
section_end:1634141545:resolve_secrets section_start:1634141545:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor360239805, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72580
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72580_PROD_P112_CP2_C9
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780563
job state: R
section_end:1634141567:prepare_executor section_start:1634141567:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634141569:prepare_script section_start:1634141569:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634141569:get_sources section_start:1634141569:restore_cache Restoring cache
Checking cache for coreneuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=267238 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1634141577:restore_cache section_start:1634141577:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (72576)...
Runtime platform  arch=amd64 os=linux pid=267462 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72576 responseStatus=200 OK token=wznhyWZn
section_end:1634141578:download_artifacts section_start:1634141578:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72580/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72580/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72580/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72580/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72580/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="7187ac5842413a6e4f050105d40e1f35bad3fac2"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index f138183..24a1854 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="7187ac5842413a6e4f050105d40e1f35bad3fac2")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211012', commit='846b3a6')
version('1.0.0.20210708', commit='d54a3aa')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+tests~legacy-unit build_type=Debug
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be amiea4vkblpwhetoty6thfkfrdug4p64
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72580/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72580/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:13:11 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.35 / 0.51 (68.24 %)
Files: 6697
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'amiea4vkblpwhetoty6thfkfrdug4p64'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+tests build_type=Debug
Concretized
--------------------------------
- amiea4v coreneuron@develop%[email protected]~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] pvpzjkl ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] qagbv7u ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kjhqfqv ^[email protected]%[email protected]~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] 2yojmmk ^[email protected]%[email protected]+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^[email protected]%[email protected]~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] icfhbit ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] zas5d2a ^[email protected]%[email protected]~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> [email protected] : has external module in ['hpe-mpi/2.22.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.22.hmpt-r52ypu (external hpe-mpi-2.22.hmpt-qagbv7uwlmxlmpab4m3ullbu7fxvkkpa)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-zas5d2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-2yojmm
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-kjhqfq
==> Installing coreneuron-develop-amiea4vkblpwhetoty6thfkfrdug4p64
==> No binary for coreneuron-develop-amiea4vkblpwhetoty6thfkfrdug4p64 found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72580/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72580/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:15:53 2021
Hits: 29 / 117 (24.79 %)
Direct: 13 / 118 (11.02 %)
Preprocessed: 16 / 105 (15.24 %)
Misses: 88
Direct: 105
Preprocessed: 89
Uncacheable: 20
Primary storage:
Hits: 131 / 236 (55.51 %)
Misses: 105
Cache size (GB): 0.37 / 0.51 (71.74 %)
Files: 6799
Uncacheable:
Called for linking: 16
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634141754:step_script section_start:1634141754:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=274281 revision=58ba2b95 version=14.2.0
ccache/: found 7360 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-5
Created cache
section_end:1634141775:archive_cache section_start:1634141775:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=274992 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72580 responseStatus=201 Created token=rycJUKMP
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=275015 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72580 responseStatus=201 Created token=rycJUKMP
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=275038 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72580 responseStatus=201 Created token=rycJUKMP
section_end:1634141776:upload_artifacts_on_success section_start:1634141776:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634141776:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634141777:resolve_secrets Resolving secrets
section_end:1634141777:resolve_secrets section_start:1634141777:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor915683793, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72581
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72581_PROD_P112_CP2_C9
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780606
job state: PD
job state: PD
job state: R
section_end:1634141827:prepare_executor section_start:1634141827:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634141829:prepare_script section_start:1634141829:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634141829:get_sources section_start:1634141829:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=276352 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1634141840:restore_cache section_start:1634141840:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:gpu (72578)...
Runtime platform  arch=amd64 os=linux pid=277228 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72578 responseStatus=200 OK token=TovGZrK8
section_end:1634141841:download_artifacts section_start:1634141841:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72581/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72581/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72581/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72581/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72581/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="7187ac5842413a6e4f050105d40e1f35bad3fac2"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index f138183..24a1854 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="7187ac5842413a6e4f050105d40e1f35bad3fac2")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211012', commit='846b3a6')
version('1.0.0.20210708', commit='d54a3aa')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+nmodl+gpu+tests~legacy-unit~report build_type=RelWithDebInfo ^/awi7vrm4eaiuzdafhedebwthgzxznx4j
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be aoe2ga6salt5qv6vqlldt23jmmxeb6d5
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72581/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72581/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:17:31 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.31 / 0.51 (60.03 %)
Files: 12534
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'aoe2ga6salt5qv6vqlldt23jmmxeb6d5'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit+nmodl~report+tests build_type=RelWithDebInfo
[+] ^nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
Concretized
--------------------------------
- aoe2ga6 coreneuron@develop%[email protected]~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 2ifshpf ^[email protected]%[email protected] patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] qu3qasv ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- gluy7kg ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] 4phgvnp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- prwvb2t ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] jop6mvp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- mddtpd5 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] awi7vrm ^nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] afnqqnp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] xpep3yw ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ujf2qes ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] v5gxu5s ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] rsay7hd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] 5pew2nu ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 6leiazm ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 373m5vr ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] hgzmzzz ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 2p3niph ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 444mrrp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ux4mwzh ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] tbbefeg ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] qywkw4y ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] rdab26o ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] dszppxf ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] lhwntcl ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] l3syz4z ^[email protected]%[email protected] arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-2ifshpf6x23hf7ccztxnrrqdx4mxt3rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-qu3qasvmolllw4vbcf2maq2dz3hklz2r)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-gluy7kgf2wgh5bfrenva7x4mtnzhr6r4)
==> [email protected] : has external module in ['cuda/11.0.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.0.2-kb4wci (external cuda-11.0.2-4phgvnpeha2grh36f6f6w7ledwlpbcs3)
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-prwvb2t3p3bo5eivmcrvx2eyffvcwfqy)
==> [email protected] : has external module in ['hpe-mpi/2.22.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.22.hmpt-r52ypu (external hpe-mpi-2.22.hmpt-jop6mvp4dll4wazl3uc7ycyupteb34ia)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-mddtpd5kgds34dklkfm2prewsfy6becf)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-v5gxu5slpix24wzbfiyzo52rwso5gsaa)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-attrs-20.3.0-373m5v
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-py-1.8.0-qywkw4
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-l3syz4
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-ujf2qe
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pluggy-0.13.0-tbbefe
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-5pew2n
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-six-1.16.0-ux4mwz
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-setuptools-50.3.2-rsay7h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-more-itertools-8.7.0-hgzmzz
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pyparsing-2.4.2-444mrr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-wcwidth-0.1.7-rdab26
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-dszppx
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-lhwntc
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-xpep3y
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-packaging-19.2-2p3nip
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-afnqqn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pytest-5.3.4-6leiaz
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.2/nmodl-develop-awi7vr
==> Installing coreneuron-develop-aoe2ga6salt5qv6vqlldt23jmmxeb6d5
==> No binary for coreneuron-develop-aoe2ga6salt5qv6vqlldt23jmmxeb6d5 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.2/coreneuron-develop-aoe2ga
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72581/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72581/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:25:07 2021
Hits: 15 / 95 (15.79 %)
Direct: 1 / 95 (1.05 %)
Preprocessed: 14 / 94 (14.89 %)
Misses: 80
Direct: 94
Preprocessed: 80
Uncacheable: 15
Primary storage:
Hits: 16 / 190 (8.42 %)
Misses: 174
Cache size (GB): 0.32 / 0.51 (61.69 %)
Files: 12707
Uncacheable:
Called for linking: 12
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634142308:step_script section_start:1634142308:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=295081 revision=58ba2b95 version=14.2.0
ccache/: found 13268 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-5
Created cache
section_end:1634142327:archive_cache section_start:1634142327:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=295557 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72581 responseStatus=201 Created token=JavNznfA
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=295586 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72581 responseStatus=201 Created token=JavNznfA
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=295616 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72581 responseStatus=201 Created token=JavNznfA
section_end:1634142328:upload_artifacts_on_success section_start:1634142328:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634142328:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634141860:resolve_secrets Resolving secrets
section_end:1634141860:resolve_secrets section_start:1634141860:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor865340219, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72579
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72579_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780608
job state: R
section_end:1634141890:prepare_executor section_start:1634141890:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634141892:prepare_script section_start:1634141892:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634141893:get_sources section_start:1634141893:restore_cache Restoring cache
Checking cache for coreneuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=280091 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-5
Successfully extracted cache
section_end:1634141902:restore_cache section_start:1634141902:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:intel (72577)...
Runtime platform  arch=amd64 os=linux pid=280485 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72577 responseStatus=200 OK token=JvBYxAgf
section_end:1634141903:download_artifacts section_start:1634141903:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72579/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72579/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72579/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72579/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72579/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="7187ac5842413a6e4f050105d40e1f35bad3fac2"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index f138183..24a1854 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="7187ac5842413a6e4f050105d40e1f35bad3fac2")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211012', commit='846b3a6')
version('1.0.0.20210708', commit='d54a3aa')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+nmodl+tests~legacy-unit build_type=Debug ^/lqyttqytclxdwwickak7uvjmb6a3au3g
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be fbjlykb4ys6kgbq2z2zyrw6ufddzw3ts
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72579/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72579/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:18:37 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.37 / 0.51 (71.74 %)
Files: 6799
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'fbjlykb4ys6kgbq2z2zyrw6ufddzw3ts'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+nmodl+tests build_type=Debug
[+] ^nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
Concretized
--------------------------------
- fbjlykb coreneuron@develop%[email protected]~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] pvpzjkl ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] qagbv7u ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kjhqfqv ^[email protected]%[email protected]~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] 2yojmmk ^[email protected]%[email protected]+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^[email protected]%[email protected]~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] yrbfda2 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] oe2c27i ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] icfhbit ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] oe2hrft ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] jo63uk3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kcyedyh ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] mikhjgq ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] hziuwhj ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] vpsqgcg ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] xgnwei3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] gc3zsis ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] 557icag ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] za7jmvs ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] chpzzlm ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] runxrmn ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] d6t5uhn ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] zas5d2a ^[email protected]%[email protected]~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> [email protected] : has external module in ['hpe-mpi/2.22.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.22.hmpt-r52ypu (external hpe-mpi-2.22.hmpt-qagbv7uwlmxlmpab4m3ullbu7fxvkkpa)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-zas5d2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-2yojmm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-kjhqfq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
==> Installing coreneuron-develop-fbjlykb4ys6kgbq2z2zyrw6ufddzw3ts
==> No binary for coreneuron-develop-fbjlykb4ys6kgbq2z2zyrw6ufddzw3ts found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72579/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72579/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:21:50 2021
Hits: 81 / 95 (85.26 %)
Direct: 0 / 96 (0.00 %)
Preprocessed: 81 / 96 (84.38 %)
Misses: 14
Direct: 96
Preprocessed: 15
Uncacheable: 17
Primary storage:
Hits: 81 / 192 (42.19 %)
Misses: 111
Cache size (GB): 0.37 / 0.51 (72.33 %)
Files: 6908
Uncacheable:
Called for linking: 13
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634142111:step_script section_start:1634142111:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=289238 revision=58ba2b95 version=14.2.0
ccache/: found 7469 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-5
Created cache
section_end:1634142129:archive_cache section_start:1634142129:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=289627 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72579 responseStatus=201 Created token=RFnsF-a5
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=289652 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72579 responseStatus=201 Created token=RFnsF-a5
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=289680 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72579 responseStatus=201 Created token=RFnsF-a5
section_end:1634142130:upload_artifacts_on_success section_start:1634142130:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634142131:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634142772:resolve_secrets Resolving secrets
section_end:1634142772:resolve_secrets section_start:1634142772:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor299977374, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72590
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72590_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780819
job state: R
section_end:1634142883:prepare_executor section_start:1634142883:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634142885:prepare_script section_start:1634142885:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634142887:get_sources section_start:1634142887:restore_cache Restoring cache
Checking cache for neuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=12585 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1634142939:restore_cache section_start:1634142939:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (72582)...
Runtime platform  arch=amd64 os=linux pid=13440 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72582 responseStatus=200 OK token=v7ZQqUy3
section_end:1634142940:download_artifacts section_start:1634142940:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72590/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72590/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72590/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72590/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72590/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for neuron is branch="master"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit ^/ekzdtgq26p6y5mzmpphbjqbifw32enfk^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be qdta367h6ly225azfnup34o2tpbkhbcb
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72590/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72590/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:35:59 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.51 / 0.51 (99.46 %)
Files: 73138
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'qdta367h6ly225azfnup34o2tpbkhbcb'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests
[+] ^coreneuron@develop%[email protected]~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- qdta367 neuron@develop%[email protected]+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- 2ifshpf ^[email protected]%[email protected] patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- gluy7kg ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] ekzdtgq ^coreneuron@develop%[email protected]~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] qu3qasv ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] 4phgvnp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] jop6mvp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- prwvb2t ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 5lqiecm ^[email protected]%[email protected]+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] id52ywi ^[email protected]%[email protected]+shared arch=linux-rhel7-x86_64
[^] o2ibs4c ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] hbvd5d6 ^[email protected]%[email protected]~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] nfl4mod ^[email protected]%[email protected] patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] qd22znx ^[email protected]%[email protected]~pic arch=linux-rhel7-x86_64
[^] riwuxjc ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ijdcmaa ^[email protected]%[email protected]~symlinks+termlib arch=linux-rhel7-x86_64
[^] tvukhb5 ^[email protected]%[email protected] patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- mddtpd5 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] eg6a4hu ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] rsay7hd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] v5gxu5s ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] i4mwhdw ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ottdmb2 ^[email protected]%[email protected]+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^[email protected]%[email protected]~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] 6leiazm ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 373m5vr ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] hgzmzzz ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 2p3niph ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 444mrrp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ux4mwzh ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] tbbefeg ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] zbwtznm ^[email protected]%[email protected]+toml arch=linux-rhel7-x86_64
[^] k3yba4y ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] qywkw4y ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] rdab26o ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] d32wle3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 2j2zh6h ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] pmg6zft ^[email protected]%[email protected] arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-2ifshpf6x23hf7ccztxnrrqdx4mxt3rj)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-gluy7kgf2wgh5bfrenva7x4mtnzhr6r4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-qu3qasvmolllw4vbcf2maq2dz3hklz2r)
==> [email protected] : has external module in ['cuda/11.0.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.0.2-kb4wci (external cuda-11.0.2-4phgvnpeha2grh36f6f6w7ledwlpbcs3)
==> [email protected] : has external module in ['hpe-mpi/2.22.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.22.hmpt-r52ypu (external hpe-mpi-2.22.hmpt-jop6mvp4dll4wazl3uc7ycyupteb34ia)
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-prwvb2t3p3bo5eivmcrvx2eyffvcwfqy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-id52ywihy7al2fabuv3lgb4rhoz2znfn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/libiconv-1.16-o2ibs4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/pkgconf-1.7.3-nfl4mo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/xz-5.2.5-qd22zn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-riwuxjcya5j363kxy7tgaac4r5qbijy7)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-ijdcmaauxxu3dblhx4qrqxsr5tmagbad)
[+] /usr (external tar-1.28-tvukhb5y7rnjiw2clctp4ds3uyk4stlp)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-mddtpd5kgds34dklkfm2prewsfy6becf)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-v5gxu5slpix24wzbfiyzo52rwso5gsaa)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-pmg6zftwkbtasfhlfscbmkdurshjk773)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.2/coreneuron-develop-ekzdtg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/libxml2-2.9.10-hbvd5d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-six-1.16.0-ux4mwz
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-setuptools-50.3.2-rsay7h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/gettext-0.21-5lqiec
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-toml-0.10.0-k3yba4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-wcwidth-0.1.7-rdab26
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-mpi4py-3.0.3-i4mwhd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-coverage-5.3-2j2zh6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-more-itertools-8.7.0-hgzmzz
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pyparsing-2.4.2-444mrr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-eg6a4h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-attrs-20.3.0-373m5v
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-setuptools-scm-4.1.2-zbwtzn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-packaging-19.2-2p3nip
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-ottdmb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-py-1.8.0-qywkw4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pluggy-0.13.0-tbbefe
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pytest-5.3.4-6leiaz
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pytest-cov-2.8.1-d32wle
==> Installing neuron-develop-qdta367h6ly225azfnup34o2tpbkhbcb
==> No binary for neuron-develop-qdta367h6ly225azfnup34o2tpbkhbcb found: installing from source
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
Session terminated, killing shell... ...killed.
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780819.4 ON r2i2n34 CANCELLED AT 2021-10-13T19:35:06 DUE TO TIME LIMIT ***
srun: error: r2i2n34: task 0: Terminated
section_end:1634146507:step_script ERROR: Job failed: execution took longer than 1h0m0s seconds

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634142131:resolve_secrets Resolving secrets
section_end:1634142131:resolve_secrets section_start:1634142131:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor945019245, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72588
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72588_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780694
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1634142195:prepare_executor section_start:1634142195:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634142196:prepare_script section_start:1634142196:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634142196:get_sources section_start:1634142196:restore_cache Restoring cache
Checking cache for neuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=291291 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-5
Successfully extracted cache
section_end:1634142257:restore_cache section_start:1634142257:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (72580)...
Runtime platform  arch=amd64 os=linux pid=293839 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72580 responseStatus=200 OK token=rycJUKMP
section_end:1634142258:download_artifacts section_start:1634142258:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for neuron is branch="master"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit ^/amiea4vkblpwhetoty6thfkfrdug4p64
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be l2cuclt2wvuiw4s54hywewweoywsqlpu
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72588/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72588/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:24:39 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.48 / 0.51 (93.76 %)
Files: 70996
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'l2cuclt2wvuiw4s54hywewweoywsqlpu'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests
[+] ^coreneuron@develop%[email protected]~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- l2cuclt neuron@develop%[email protected]+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- mxqypex ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] amiea4v ^coreneuron@develop%[email protected]~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] qagbv7u ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kjhqfqv ^[email protected]%[email protected]~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] 2yojmmk ^[email protected]%[email protected]+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^[email protected]%[email protected]~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] zas5d2a ^[email protected]%[email protected]~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^[email protected]%[email protected]+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^[email protected]%[email protected]+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 6lr2umn ^[email protected]%[email protected]~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] wzx3yy4 ^[email protected]%[email protected]~pic arch=linux-rhel7-x86_64
[^] nedfnju ^[email protected]%[email protected]~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^[email protected]%[email protected] patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] i3t5fut ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] xfgkmkd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] icfhbit ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] yg3vxts ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] l643i7a ^[email protected]%[email protected]+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^[email protected]%[email protected]~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] jo63uk3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kcyedyh ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] mikhjgq ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] hziuwhj ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] vpsqgcg ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] xgnwei3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] gc3zsis ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ze65gmo ^[email protected]%[email protected]+toml arch=linux-rhel7-x86_64
[^] p553wsa ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] 557icag ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] za7jmvs ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- zniig3b ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- 2v5wfwa ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kej56sd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> [email protected] : has external module in ['hpe-mpi/2.22.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.22.hmpt-r52ypu (external hpe-mpi-2.22.hmpt-qagbv7uwlmxlmpab4m3ullbu7fxvkkpa)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-zas5d2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-2yojmm
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-kjhqfq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
==> Installing py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk
==> No binary for py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk found: installing from source
==> Warning: Missing a source id for neuron@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/28/280baa8ec489c4f542f8940f9c4c2181f0306a8ee1a54eceba071a449fb870a0.tar.gz
==> py-coverage: Executing phase: 'build'
==> py-coverage: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-yg3vxt
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe
==> No binary for py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/cc/cc6742d8bac45070217169f5f72ceee1e0e55b0221f54bcf24845972d3a47f2b.tar.gz
==> py-pytest-cov: Executing phase: 'build'
==> py-pytest-cov: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
==> Installing neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu
==> No binary for neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu found: installing from source
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/neuron-develop-l2cucl
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72588/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72588/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:31:42 2021
Hits: 447 / 758 (58.97 %)
Direct: 10 / 767 (1.30 %)
Preprocessed: 437 / 751 (58.19 %)
Misses: 311
Direct: 757
Preprocessed: 314
Uncacheable: 133
Primary storage:
Hits: 471 / 1528 (30.82 %)
Misses: 1057
Cache size (GB): 0.49 / 0.51 (94.80 %)
Files: 70484
Cleanups: 10
Uncacheable:
Autoconf compile/link: 7
Called for linking: 110
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634142706:step_script section_start:1634142706:archive_cache Saving cache for successful job
Creating cache neuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=5923 revision=58ba2b95 version=14.2.0
ccache/: found 71045 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-5
Created cache
section_end:1634142769:archive_cache section_start:1634142769:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=7730 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72588 responseStatus=201 Created token=tJxPzVuY
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=7759 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72588 responseStatus=201 Created token=tJxPzVuY
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=7786 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72588 responseStatus=201 Created token=tJxPzVuY
section_end:1634142771:upload_artifacts_on_success section_start:1634142771:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634142772:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634142527:resolve_secrets Resolving secrets
section_end:1634142527:resolve_secrets section_start:1634142527:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor165075812, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72589
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72589_PROD_P112_CP1_C1
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780772
job state: PD
job state: R
section_end:1634142618:prepare_executor section_start:1634142618:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634142619:prepare_script section_start:1634142619:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634142620:get_sources section_start:1634142620:restore_cache Restoring cache
Checking cache for neuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=2613 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-5
Successfully extracted cache
section_end:1634142671:restore_cache section_start:1634142671:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (72581)...
Runtime platform  arch=amd64 os=linux pid=4784 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72581 responseStatus=200 OK token=JavNznfA
section_end:1634142672:download_artifacts section_start:1634142672:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for neuron is branch="master"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit ^/aoe2ga6salt5qv6vqlldt23jmmxeb6d5^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be o6xo3erzdudo5r5hse7yyvqm2vvvwzqt
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72589/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72589/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:31:32 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.51 / 0.51 (99.46 %)
Files: 73138
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'o6xo3erzdudo5r5hse7yyvqm2vvvwzqt'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests
[+] ^coreneuron@develop%[email protected]~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- o6xo3er neuron@develop%[email protected]+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- 2ifshpf ^[email protected]%[email protected] patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- gluy7kg ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] aoe2ga6 ^coreneuron@develop%[email protected]~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] qu3qasv ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] 4phgvnp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] jop6mvp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] awi7vrm ^nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] afnqqnp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] xpep3yw ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ujf2qes ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] v5gxu5s ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] rsay7hd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] 5pew2nu ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 6leiazm ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 373m5vr ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] hgzmzzz ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 2p3niph ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 444mrrp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ux4mwzh ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] tbbefeg ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] qywkw4y ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] rdab26o ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] dszppxf ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] lhwntcl ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] l3syz4z ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- prwvb2t ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 5lqiecm ^[email protected]%[email protected]+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] id52ywi ^[email protected]%[email protected]+shared arch=linux-rhel7-x86_64
[^] o2ibs4c ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] hbvd5d6 ^[email protected]%[email protected]~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] nfl4mod ^[email protected]%[email protected] patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] qd22znx ^[email protected]%[email protected]~pic arch=linux-rhel7-x86_64
[^] riwuxjc ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ijdcmaa ^[email protected]%[email protected]~symlinks+termlib arch=linux-rhel7-x86_64
[^] tvukhb5 ^[email protected]%[email protected] patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- mddtpd5 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] eg6a4hu ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] i4mwhdw ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ottdmb2 ^[email protected]%[email protected]+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^[email protected]%[email protected]~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] d32wle3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 2j2zh6h ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] pmg6zft ^[email protected]%[email protected] arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-2ifshpf6x23hf7ccztxnrrqdx4mxt3rj)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-gluy7kgf2wgh5bfrenva7x4mtnzhr6r4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-qu3qasvmolllw4vbcf2maq2dz3hklz2r)
==> [email protected] : has external module in ['cuda/11.0.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.0.2-kb4wci (external cuda-11.0.2-4phgvnpeha2grh36f6f6w7ledwlpbcs3)
==> [email protected] : has external module in ['hpe-mpi/2.22.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.22.hmpt-r52ypu (external hpe-mpi-2.22.hmpt-jop6mvp4dll4wazl3uc7ycyupteb34ia)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-v5gxu5slpix24wzbfiyzo52rwso5gsaa)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-prwvb2t3p3bo5eivmcrvx2eyffvcwfqy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-id52ywihy7al2fabuv3lgb4rhoz2znfn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/libiconv-1.16-o2ibs4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/pkgconf-1.7.3-nfl4mo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/xz-5.2.5-qd22zn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-riwuxjcya5j363kxy7tgaac4r5qbijy7)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-ijdcmaauxxu3dblhx4qrqxsr5tmagbad)
[+] /usr (external tar-1.28-tvukhb5y7rnjiw2clctp4ds3uyk4stlp)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-pmg6zftwkbtasfhlfscbmkdurshjk773)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-mddtpd5kgds34dklkfm2prewsfy6becf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-more-itertools-8.7.0-hgzmzz
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-attrs-20.3.0-373m5v
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-l3syz4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-setuptools-50.3.2-rsay7h
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-ujf2qe
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pyparsing-2.4.2-444mrr
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-5pew2n
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pluggy-0.13.0-tbbefe
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-wcwidth-0.1.7-rdab26
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-py-1.8.0-qywkw4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-six-1.16.0-ux4mwz
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-dszppx
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/libxml2-2.9.10-hbvd5d
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-lhwntc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-coverage-5.3-2j2zh6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-eg6a4h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-mpi4py-3.0.3-i4mwhd
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-xpep3y
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-packaging-19.2-2p3nip
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/gettext-0.21-5lqiec
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-ottdmb
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-afnqqn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pytest-5.3.4-6leiaz
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pytest-cov-2.8.1-d32wle
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.2/nmodl-develop-awi7vr
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.2/coreneuron-develop-aoe2ga
==> Installing neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt
==> No binary for neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt found: installing from source
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.2/neuron-develop-o6xo3e
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72589/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72589/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 19:09:31 2021
Hits: 518 / 751 (68.97 %)
Direct: 7 / 760 (0.92 %)
Preprocessed: 511 / 747 (68.41 %)
Misses: 233
Direct: 753
Preprocessed: 236
Uncacheable: 125
Primary storage:
Hits: 527 / 1514 (34.81 %)
Misses: 987
Cache size (GB): 0.51 / 0.51 (99.61 %)
Files: 72312
Cleanups: 15
Uncacheable:
Autoconf compile/link: 7
Called for linking: 102
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634144991:step_script section_start:1634144991:archive_cache Saving cache for successful job
Creating cache neuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=55709 revision=58ba2b95 version=14.2.0
ccache/: found 72873 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-5
Created cache
section_end:1634145078:archive_cache section_start:1634145078:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=56149 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72589 responseStatus=201 Created token=ueJBbsEw
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=56171 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72589 responseStatus=201 Created token=ueJBbsEw
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=56195 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72589 responseStatus=201 Created token=ueJBbsEw
section_end:1634145080:upload_artifacts_on_success section_start:1634145080:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634145080:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634142329:resolve_secrets Resolving secrets
section_end:1634142329:resolve_secrets section_start:1634142329:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor079249170, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72587
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72587_PROD_P112_CP2_C9
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780715
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1634142401:prepare_executor section_start:1634142401:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634142403:prepare_script section_start:1634142403:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634142403:get_sources section_start:1634142403:restore_cache Restoring cache
Checking cache for neuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=298545 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1634142474:restore_cache section_start:1634142474:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (72579)...
Runtime platform  arch=amd64 os=linux pid=301141 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72579 responseStatus=200 OK token=RFnsF-a5
section_end:1634142475:download_artifacts section_start:1634142475:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for neuron is branch="master"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit ^/fbjlykb4ys6kgbq2z2zyrw6ufddzw3ts
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be x5fc6bslh4t3tjgxm7245xtkkgztnyge
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72587/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72587/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:28:19 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.48 / 0.51 (93.76 %)
Files: 70996
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'x5fc6bslh4t3tjgxm7245xtkkgztnyge'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests
[+] ^coreneuron@develop%[email protected]~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ^[email protected]%[email protected]~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- x5fc6bs neuron@develop%[email protected]+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- mxqypex ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] fbjlykb ^coreneuron@develop%[email protected]~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^[email protected]%[email protected]+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] qagbv7u ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kjhqfqv ^[email protected]%[email protected]~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] 2yojmmk ^[email protected]%[email protected]+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^[email protected]%[email protected]+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^[email protected]%[email protected]~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] yrbfda2 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] oe2c27i ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] icfhbit ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] oe2hrft ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] jo63uk3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kcyedyh ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] mikhjgq ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] hziuwhj ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] vpsqgcg ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] xgnwei3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] gc3zsis ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] 557icag ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] za7jmvs ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] chpzzlm ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] runxrmn ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] d6t5uhn ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] zas5d2a ^[email protected]%[email protected]~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^[email protected]%[email protected]+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^[email protected]%[email protected]+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 6lr2umn ^[email protected]%[email protected]~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] wzx3yy4 ^[email protected]%[email protected]~pic arch=linux-rhel7-x86_64
[^] nedfnju ^[email protected]%[email protected]~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^[email protected]%[email protected] patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] i3t5fut ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] yg3vxts ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] l643i7a ^[email protected]%[email protected]+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^[email protected]%[email protected]~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] zniig3b ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[+] 2v5wfwa ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kej56sd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> [email protected] : has external module in ['hpe-mpi/2.22.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.22.hmpt-r52ypu (external hpe-mpi-2.22.hmpt-qagbv7uwlmxlmpab4m3ullbu7fxvkkpa)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-zas5d2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-2yojmm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-kjhqfq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-yg3vxt
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk
==> Installing neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge
==> No binary for neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/neuron-develop-x5fc6b
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72587/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72587/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:51:50 2021
Hits: 445 / 754 (59.02 %)
Direct: 6 / 763 (0.79 %)
Preprocessed: 439 / 751 (58.46 %)
Misses: 309
Direct: 757
Preprocessed: 312
Uncacheable: 132
Primary storage:
Hits: 453 / 1520 (29.80 %)
Misses: 1067
Cache size (GB): 0.48 / 0.51 (92.92 %)
Files: 68545
Cleanups: 10
Uncacheable:
Autoconf compile/link: 7
Called for linking: 109
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634143915:step_script section_start:1634143915:archive_cache Saving cache for successful job
Creating cache neuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=45795 revision=58ba2b95 version=14.2.0
ccache/: found 69106 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-5
Created cache
section_end:1634143982:archive_cache section_start:1634143982:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=46350 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72587 responseStatus=201 Created token=ps8N-M3y
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=46377 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72587 responseStatus=201 Created token=ps8N-M3y
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=46401 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72587 responseStatus=201 Created token=ps8N-M3y
section_end:1634143984:upload_artifacts_on_success section_start:1634143984:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634143984:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634141445:resolve_secrets Resolving secrets
section_end:1634141445:resolve_secrets section_start:1634141445:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor792155825, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72578
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72578_PROD_P112_CP1_C1
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780448
job state: R
section_end:1634141462:prepare_executor section_start:1634141462:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634141464:prepare_script section_start:1634141464:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634141465:get_sources section_start:1634141465:restore_cache Restoring cache
Checking cache for nmodl-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=265067 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-nvhpc-5
Successfully extracted cache
section_end:1634141480:restore_cache section_start:1634141480:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (72576)...
Runtime platform  arch=amd64 os=linux pid=265127 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72576 responseStatus=200 OK token=wznhyWZn
section_end:1634141481:download_artifacts section_start:1634141481:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72578/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72578/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72578/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72578/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72578/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl@develop%nvhpc~legacy-unit ^bison%gcc^flex%gcc^py-jinja2%gcc^py-sympy%gcc^py-pyyaml%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be awi7vrm4eaiuzdafhedebwthgzxznx4j
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72578/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72578/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:12:03 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.15 / 0.51 (29.94 %)
Files: 1151
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'awi7vrm4eaiuzdafhedebwthgzxznx4j'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl@develop%nvhpc~legacy-unit
- ^bison%gcc
- ^flex%gcc
- ^py-jinja2%gcc
- ^py-pyyaml%gcc
- ^py-sympy%gcc
Concretized
--------------------------------
- awi7vrm nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 2ifshpf ^[email protected]%[email protected] patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- gluy7kg ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- prwvb2t ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
- mddtpd5 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- afnqqnp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- xpep3yw ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- ujf2qes ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] rsay7hd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] v5gxu5s ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
- 5pew2nu ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 6leiazm ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 373m5vr ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] hgzmzzz ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 2p3niph ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] 444mrrp ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ux4mwzh ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] tbbefeg ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] zbwtznm ^[email protected]%[email protected]+toml arch=linux-rhel7-x86_64
[^] k3yba4y ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] qywkw4y ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] rdab26o ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- dszppxf ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- lhwntcl ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- l3syz4z ^[email protected]%[email protected] arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-2ifshpf6x23hf7ccztxnrrqdx4mxt3rj)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-gluy7kgf2wgh5bfrenva7x4mtnzhr6r4)
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-prwvb2t3p3bo5eivmcrvx2eyffvcwfqy)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-mddtpd5kgds34dklkfm2prewsfy6becf)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-v5gxu5slpix24wzbfiyzo52rwso5gsaa)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-setuptools-50.3.2-rsay7h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-six-1.16.0-ux4mwz
==> Installing py-mpmath-1.1.0-l3syz4zlt7jlkpe56wtyhdvsi5e5h2nj
==> No binary for py-mpmath-1.1.0-l3syz4zlt7jlkpe56wtyhdvsi5e5h2nj found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/fc/fc17abe05fbab3382b61a123c398508183406fa132e0223874578e20946499f6.tar.gz
==> py-mpmath: Executing phase: 'build'
==> py-mpmath: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-l3syz4
==> Installing py-pyyaml-5.3.1-dszppxfqapggdokpec7viw45xx62rjaf
==> No binary for py-pyyaml-5.3.1-dszppxfqapggdokpec7viw45xx62rjaf found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/b8/b8eac752c5e14d3eca0e6dd9199cd627518cb5ec06add0de9d32baeee6fe645d.tar.gz
==> py-pyyaml: Executing phase: 'build_ext'
==> py-pyyaml: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-dszppx
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-wcwidth-0.1.7-rdab26
==> Installing py-markupsafe-1.1.1-5pew2nu7kniwhdjc57ouymcgz3koo2qo
==> No binary for py-markupsafe-1.1.1-5pew2nu7kniwhdjc57ouymcgz3koo2qo found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/29/29872e92839765e546828bb7754a68c418d927cd064fd4708fab9fe9c8bb116b.tar.gz
==> py-markupsafe: Executing phase: 'build'
==> py-markupsafe: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-5pew2n
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-attrs-20.3.0-373m5v
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-more-itertools-8.7.0-hgzmzz
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pyparsing-2.4.2-444mrr
==> Installing py-pytz-2020.1-ujf2qesoetsxrgrnfr4i32d7aqx6ahnj
==> No binary for py-pytz-2020.1-ujf2qesoetsxrgrnfr4i32d7aqx6ahnj found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/c3/c35965d010ce31b23eeb663ed3cc8c906275d6be1a34393a1d73a41febf4a048.tar.gz
==> py-pytz: Executing phase: 'build'
==> py-pytz: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-ujf2qe
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-toml-0.10.0-k3yba4
==> Installing py-sympy-1.4-lhwntcljkmu6eptc4dzn2ibspkjvhvjw
==> No binary for py-sympy-1.4-lhwntcljkmu6eptc4dzn2ibspkjvhvjw found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/71/71a11e5686ae7ab6cb8feb5bd2651ef4482f8fd43a7c27e645a165e4353b23e1.tar.gz
==> py-sympy: Executing phase: 'build'
==> py-sympy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-lhwntc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-packaging-19.2-2p3nip
==> Installing py-babel-2.7.0-xpep3ywshdt2sumfvwl7xwr4iyharkla
==> No binary for py-babel-2.7.0-xpep3ywshdt2sumfvwl7xwr4iyharkla found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e8/e86135ae101e31e2c8ec20a4e0c5220f4eed12487d5cf3f78be7e98d3a57fc28.tar.gz
==> py-babel: Executing phase: 'build'
==> py-babel: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-xpep3y
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-setuptools-scm-4.1.2-zbwtzn
==> Installing py-jinja2-2.10.3-afnqqnpla6cdujgmlak32wyouz3gljv2
==> No binary for py-jinja2-2.10.3-afnqqnpla6cdujgmlak32wyouz3gljv2 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/9f/9fe95f19286cfefaa917656583d020be14e7859c6b0252588391e47db34527de.tar.gz
==> py-jinja2: Executing phase: 'build'
==> py-jinja2: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-afnqqn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-py-1.8.0-qywkw4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pluggy-0.13.0-tbbefe
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.2/py-pytest-5.3.4-6leiaz
==> Installing nmodl-develop-awi7vrm4eaiuzdafhedebwthgzxznx4j
==> No binary for nmodl-develop-awi7vrm4eaiuzdafhedebwthgzxznx4j found: installing from source
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.2/nmodl-develop-awi7vr
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72578/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72578/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:14:46 2021
Hits: 130 / 132 (98.48 %)
Direct: 122 / 132 (92.42 %)
Preprocessed: 8 / 10 (80.00 %)
Misses: 2
Direct: 10
Preprocessed: 2
Uncacheable: 26
Primary storage:
Hits: 258 / 264 (97.73 %)
Misses: 6
Cache size (GB): 0.15 / 0.51 (29.95 %)
Files: 1155
Uncacheable:
Called for linking: 26
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634141689:step_script section_start:1634141689:archive_cache Saving cache for successful job
Creating cache nmodl-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=272646 revision=58ba2b95 version=14.2.0
ccache/: found 1716 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-nvhpc-5
Created cache
section_end:1634141703:archive_cache section_start:1634141703:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=273183 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72578 responseStatus=201 Created token=TovGZrK8
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=273212 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72578 responseStatus=201 Created token=TovGZrK8
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=273257 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72578 responseStatus=201 Created token=TovGZrK8
section_end:1634141704:upload_artifacts_on_success section_start:1634141704:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634141704:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634141444:resolve_secrets Resolving secrets
section_end:1634141444:resolve_secrets section_start:1634141444:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor314345959, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72577
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72577_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780449
job state: R
section_end:1634141462:prepare_executor section_start:1634141462:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634141464:prepare_script section_start:1634141464:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634141465:get_sources section_start:1634141465:restore_cache Restoring cache
Checking cache for nmodl-intel-5...
Runtime platform  arch=amd64 os=linux pid=265046 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-intel-5
Successfully extracted cache
section_end:1634141490:restore_cache section_start:1634141490:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (72576)...
Runtime platform  arch=amd64 os=linux pid=265606 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72576 responseStatus=200 OK token=wznhyWZn
section_end:1634141491:download_artifacts section_start:1634141491:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72577/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72577/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72577/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72577/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72577/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = [email protected]:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = [email protected]:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl@develop%intel~legacy-unit
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be lqyttqytclxdwwickak7uvjmb6a3au3g
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72577/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72577/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:12:14 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.44 / 0.51 (85.34 %)
Files: 2362
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'lqyttqytclxdwwickak7uvjmb6a3au3g'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl@develop%intel~legacy-unit
Concretized
--------------------------------
- lqyttqy nmodl@develop%[email protected]~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ymcya3l ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- mxqypex ^[email protected]%[email protected]~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^[email protected]%[email protected]+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
- nayogh4 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- ubiktsv ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- yrbfda2 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] oe2c27i ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] xfgkmkd ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] icfhbit ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
- oe2hrft ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- jo63uk3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] kcyedyh ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- mikhjgq ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- hziuwhj ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] vpsqgcg ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] xgnwei3 ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- gc3zsis ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] ze65gmo ^[email protected]%[email protected]+toml arch=linux-rhel7-x86_64
[^] p553wsa ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- 557icag ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- za7jmvs ^[email protected]%[email protected] arch=linux-rhel7-x86_64
[^] chpzzlm ^[email protected]%[email protected]+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- runxrmn ^[email protected]%[email protected] arch=linux-rhel7-x86_64
- d6t5uhn ^[email protected]%[email protected] arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_JOB_CPUS_PER_NODE} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> [email protected] : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> [email protected] : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> [email protected] : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> [email protected] : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> [email protected] : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
==> Installing py-mpmath-1.1.0-d6t5uhnfv6vz76zvbq6dxzezju47q4b2
==> No binary for py-mpmath-1.1.0-d6t5uhnfv6vz76zvbq6dxzezju47q4b2 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/fc/fc17abe05fbab3382b61a123c398508183406fa132e0223874578e20946499f6.tar.gz
==> py-mpmath: Executing phase: 'build'
==> py-mpmath: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
==> Installing py-markupsafe-1.1.1-oe2hrfthehpamljikolcjblr7mt52724
==> No binary for py-markupsafe-1.1.1-oe2hrfthehpamljikolcjblr7mt52724 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/29/29872e92839765e546828bb7754a68c418d927cd064fd4708fab9fe9c8bb116b.tar.gz
==> py-markupsafe: Executing phase: 'build'
==> py-markupsafe: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
==> Installing py-more-itertools-8.7.0-mikhjgqoad5w4yqy27gs5e6resjbaofw
==> No binary for py-more-itertools-8.7.0-mikhjgqoad5w4yqy27gs5e6resjbaofw found: installing from source
==> Fetching https://pypi.io/packages/source/m/more-itertools/more-itertools-8.7.0.tar.gz
==> py-more-itertools: Executing phase: 'build'
==> py-more-itertools: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
==> Installing py-wcwidth-0.1.7-za7jmvshfdsnmghmumjvxfinateuen3k
==> No binary for py-wcwidth-0.1.7-za7jmvshfdsnmghmumjvxfinateuen3k found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/3d/3df37372226d6e63e1b1e1eda15c594bca98a22d33a23832a90998faa96bc65e.tar.gz
==> py-wcwidth: Executing phase: 'build'
==> py-wcwidth: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
==> Installing py-sympy-1.4-runxrmnc6ccdqey2sq7njyz4u4i2x7xw
==> No binary for py-sympy-1.4-runxrmnc6ccdqey2sq7njyz4u4i2x7xw found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/71/71a11e5686ae7ab6cb8feb5bd2651ef4482f8fd43a7c27e645a165e4353b23e1.tar.gz
==> py-sympy: Executing phase: 'build'
==> py-sympy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
==> Installing py-babel-2.7.0-yrbfda2telivet3ruvwscmtafc7zoys7
==> No binary for py-babel-2.7.0-yrbfda2telivet3ruvwscmtafc7zoys7 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e8/e86135ae101e31e2c8ec20a4e0c5220f4eed12487d5cf3f78be7e98d3a57fc28.tar.gz
==> py-babel: Executing phase: 'build'
==> py-babel: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
==> Installing py-packaging-19.2-hziuwhjrhckeozwekkhwxabvm4onfilt
==> No binary for py-packaging-19.2-hziuwhjrhckeozwekkhwxabvm4onfilt found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/28/28b924174df7a2fa32c1953825ff29c61e2f5e082343165438812f00d3a7fc47.tar.gz
==> py-packaging: Executing phase: 'build'
==> py-packaging: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
==> Installing py-jinja2-2.10.3-ubiktsvw22gxnvhwzsoloqliz7czyhab
==> No binary for py-jinja2-2.10.3-ubiktsvw22gxnvhwzsoloqliz7czyhab found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/9f/9fe95f19286cfefaa917656583d020be14e7859c6b0252588391e47db34527de.tar.gz
==> py-jinja2: Executing phase: 'build'
==> py-jinja2: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
==> Installing py-py-1.8.0-557icag4kia4rysswd2uxdettfkewclq
==> No binary for py-py-1.8.0-557icag4kia4rysswd2uxdettfkewclq found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/dc/dc639b046a6e2cff5bbe40194ad65936d6ba360b52b3c3fe1d08a82dd50b5e53.tar.gz
==> py-py: Executing phase: 'build'
==> py-py: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
==> Installing py-pluggy-0.13.0-gc3zsisoxxbiopoa44i536m232c65zb4
==> No binary for py-pluggy-0.13.0-gc3zsisoxxbiopoa44i536m232c65zb4 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/fa/fa5fa1622fa6dd5c030e9cad086fa19ef6a0cf6d7a2d12318e10cb49d6d68f34.tar.gz
==> py-pluggy: Executing phase: 'build'
==> py-pluggy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
==> Installing py-pytest-5.3.4-jo63uk3qcowoxe2ogccodpfmsdr2r557
==> No binary for py-pytest-5.3.4-jo63uk3qcowoxe2ogccodpfmsdr2r557 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/1d/1d122e8be54d1a709e56f82e2d85dcba3018313d64647f38a91aec88c239b600.tar.gz
==> py-pytest: Executing phase: 'build'
==> py-pytest: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing nmodl-develop-lqyttqytclxdwwickak7uvjmb6a3au3g
==> No binary for nmodl-develop-lqyttqytclxdwwickak7uvjmb6a3au3g found: installing from source
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72577/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72577/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Oct 13 18:16:18 2021
Hits: 121 / 132 (91.67 %)
Direct: 113 / 132 (85.61 %)
Preprocessed: 8 / 19 (42.11 %)
Misses: 11
Direct: 19
Preprocessed: 11
Uncacheable: 28
Primary storage:
Hits: 242 / 266 (90.98 %)
Misses: 24
Cache size (GB): 0.43 / 0.51 (84.41 %)
Files: 2375
Cleanups: 1
Uncacheable:
Called for linking: 28
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.22.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1634141779:step_script section_start:1634141779:archive_cache Saving cache for successful job
Creating cache nmodl-intel-5...
Runtime platform  arch=amd64 os=linux pid=275128 revision=58ba2b95 version=14.2.0
ccache/: found 2936 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-intel-5
Created cache
section_end:1634141798:archive_cache section_start:1634141798:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=275328 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72577 responseStatus=201 Created token=JvBYxAgf
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=275350 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=72577 responseStatus=201 Created token=JvBYxAgf
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=275374 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72577 responseStatus=201 Created token=JvBYxAgf
section_end:1634141800:upload_artifacts_on_success section_start:1634141800:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634141800:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634141387:resolve_secrets Resolving secrets
section_end:1634141387:resolve_secrets section_start:1634141387:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor912904754, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72576
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72576_PROD_P112_CP0_C0
Job parameters: memory=512M, cpus_per_task=1, duration=10:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780447
job state: R
section_end:1634141388:prepare_executor section_start:1634141388:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634141389:prepare_script section_start:1634141389:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634141389:get_sources section_start:1634141389:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ touch spack_clone_variables.env
$ if [[ "${PARSE_GITHUB_PR_DESCRIPTIONS}" == "true" && "${CI_PIPELINE_SOURCE}" == "external_pull_request_event" ]]; then
$ cat > parse_description.py << END_SCRIPT # collapsed multi-line command
$ cat parse_description.py
from __future__ import print_function
import os
import re
import requests
pr_info = requests.get("https://api.github.com/repos/{}/pulls/{}".format(
os.environ['CI_EXTERNAL_PULL_REQUEST_TARGET_REPOSITORY'],
os.environ['CI_EXTERNAL_PULL_REQUEST_IID']),
headers={'Accept': 'application/vnd.github.v3+json'})
pr_body = pr_info.json()["body"]
# match something like NEURON_BRANCH=foo/bar
pat = re.compile('^([A-Z0-9_]+)_([A-Z]+)=([A-Z0-9\-\_\/]+)$', re.IGNORECASE)
def parse_term(m):
ref_type = m.group(2).lower()
if ref_type not in {'branch', 'tag', 'ref'}: return
print('SPACK_PACKAGE_REF_' + m.group(1).lower() + '=' + ref_type + '="' + m.group(3) + '"')
if pr_body is not None:
for pr_body_line in pr_body.splitlines():
if not pr_body_line.startswith('CI_BRANCHES:'): continue
for config_term in pr_body_line[12:].split(','):
pat.sub(parse_term, config_term)
$ python parse_description.py > spack_clone_variables.env
$ cat spack_clone_variables.env
SPACK_PACKAGE_REF_neuron=branch="master"
$ fi
$ echo Using ${PWD} as a working directory common to the whole pipeline...
Using /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576 as a working directory common to the whole pipeline...
$ SPACK_BRANCH_PARSED=$(sed -n -e "s/^SPACK_PACKAGE_REF_spack=branch=\(['\"]\)\([^\1]\+\)\1/\2/p" spack_clone_variables.env)
$ SPACK_BRANCH=${SPACK_BRANCH_PARSED:-$SPACK_BRANCH}
$ echo Checking out the ${SPACK_BRANCH} of Spack...
Checking out the develop of Spack...
$ git clone --depth 1 --single-branch --branch ${SPACK_BRANCH} ${SPACK_URL} spack
Cloning into 'spack'...
Checking out files: 31% (2421/7694) Checking out files: 32% (2463/7694) Checking out files: 33% (2540/7694) Checking out files: 34% (2616/7694) Checking out files: 35% (2693/7694) Checking out files: 36% (2770/7694) Checking out files: 37% (2847/7694) Checking out files: 38% (2924/7694) Checking out files: 39% (3001/7694) Checking out files: 40% (3078/7694) Checking out files: 41% (3155/7694) Checking out files: 42% (3232/7694) Checking out files: 43% (3309/7694) Checking out files: 44% (3386/7694) Checking out files: 44% (3409/7694) Checking out files: 45% (3463/7694) Checking out files: 46% (3540/7694) Checking out files: 47% (3617/7694) Checking out files: 48% (3694/7694) Checking out files: 49% (3771/7694) Checking out files: 50% (3847/7694) Checking out files: 51% (3924/7694) Checking out files: 52% (4001/7694) Checking out files: 53% (4078/7694) Checking out files: 54% (4155/7694) Checking out files: 55% (4232/7694) Checking out files: 56% (4309/7694) Checking out files: 57% (4386/7694) Checking out files: 57% (4419/7694) Checking out files: 58% (4463/7694) Checking out files: 58% (4522/7694) Checking out files: 59% (4540/7694) Checking out files: 60% (4617/7694) Checking out files: 61% (4694/7694) Checking out files: 62% (4771/7694) Checking out files: 62% (4791/7694) Checking out files: 62% (4827/7694) Checking out files: 62% (4830/7694) Checking out files: 63% (4848/7694) Checking out files: 63% (4913/7694) Checking out files: 64% (4925/7694) Checking out files: 64% (4955/7694) Checking out files: 65% (5002/7694) Checking out files: 65% (5037/7694) Checking out files: 66% (5079/7694) Checking out files: 66% (5124/7694) Checking out files: 67% (5155/7694) Checking out files: 67% (5214/7694) Checking out files: 68% (5232/7694) Checking out files: 69% (5309/7694) Checking out files: 69% (5343/7694) Checking out files: 69% (5380/7694) Checking out files: 70% (5386/7694) Checking out files: 71% (5463/7694) Checking out files: 72% (5540/7694) Checking out files: 73% (5617/7694) Checking out files: 73% (5634/7694) Checking out files: 73% (5642/7694) Checking out files: 73% (5679/7694) Checking out files: 73% (5691/7694) Checking out files: 74% (5694/7694) Checking out files: 75% (5771/7694) Checking out files: 76% (5848/7694) Checking out files: 76% (5860/7694) Checking out files: 76% (5876/7694) Checking out files: 76% (5879/7694) Checking out files: 77% (5925/7694) Checking out files: 78% (6002/7694) Checking out files: 79% (6079/7694) Checking out files: 80% (6156/7694) Checking out files: 81% (6233/7694) Checking out files: 81% (6257/7694) Checking out files: 82% (6310/7694) Checking out files: 82% (6341/7694) Checking out files: 83% (6387/7694) Checking out files: 84% (6463/7694) Checking out files: 85% (6540/7694) Checking out files: 86% (6617/7694) Checking out files: 86% (6632/7694) Checking out files: 87% (6694/7694) Checking out files: 87% (6738/7694) Checking out files: 88% (6771/7694) Checking out files: 88% (6801/7694) Checking out files: 89% (6848/7694) Checking out files: 90% (6925/7694) Checking out files: 91% (7002/7694) Checking out files: 92% (7079/7694) Checking out files: 93% (7156/7694) Checking out files: 93% (7206/7694) Checking out files: 94% (7233/7694) Checking out files: 94% (7248/7694) Checking out files: 95% (7310/7694) Checking out files: 96% (7387/7694) Checking out files: 97% (7464/7694) Checking out files: 98% (7541/7694) Checking out files: 98% (7555/7694) Checking out files: 99% (7618/7694) Checking out files: 99% (7635/7694) Checking out files: 100% (7694/7694) Checking out files: 100% (7694/7694), done.
$ cp /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/config/*.yaml spack/etc/spack
$ SPACK_ROOT=${PWD}/spack
$ echo "SPACK_ROOT=${SPACK_ROOT}" >> spack_clone_variables.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ spack config --scope site add "config:ccache:true"
$ spack config get config
config:
install_tree:
projections:
all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
root: $spack/opt/spack
build_jobs: 36
ccache: true
template_dirs:
- $spack/share/spack/templates
# Locations where different types of modules should be installed.
module_roots:
tcl: $spack/share/spack/modules
lmod: $spack/share/spack/lmod
build_stage:
- $tempdir/$user/spack-stage
- ~/.spack/stage
# - $spack/var/spack/stage
# Directory in which to run tests and store test results.
# Tests will be stored in directories named by date/time and package
# name/hash.
test_stage: ~/.spack/test
source_cache: $spack/var/spack/cache
misc_cache: ~/.spack/cache
connect_timeout: 10
verify_ssl: true
suppress_gpg_warnings: false
install_missing_compilers: false
checksum: true
dirty: false
build_language: C
locks: true
concretizer: original
db_lock_timeout: 300
package_lock_timeout:
shared_linking: rpath
allow_sgid: true
debug: false
$ echo "SPACK_USE_CCACHE=true" >> spack_clone_variables.env
$ if [[ "${CI_PIPELINE_SOURCE}" == "pipeline" ]]; then
section_end:1634141438:step_script section_start:1634141438:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=264673 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=72576 responseStatus=201 Created token=wznhyWZn
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=264688 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=72576 responseStatus=201 Created token=wznhyWZn
section_end:1634141439:upload_artifacts_on_success section_start:1634141439:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634141439:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634142251:resolve_secrets Resolving secrets
section_end:1634142251:resolve_secrets section_start:1634142251:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor885379837, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72586
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72586_PROD_P112_CP1_C1
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod_p2,prod_p1,interactive
Submitted batch job 2780712
job state: R
section_end:1634142315:prepare_executor section_start:1634142315:prepare_script Preparing environment
Running on r2i3n6 via bbpv1.epfl.ch...
section_end:1634142316:prepare_script section_start:1634142316:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634142317:get_sources section_start:1634142317:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (72582)...
Runtime platform  arch=amd64 os=linux pid=13371 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72582 responseStatus=200 OK token=v7ZQqUy3
section_end:1634142318:download_artifacts section_start:1634142318:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r2i2n34
Build name: Linux-nvc++
Create new tag: 20211013-1625 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72582/spack-build/spack-stage-coreneuron-develop-ekzdtgq26p6y5mzmpphbjqbifw32enfk/spack-build-ekzdtgq
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #3: alignment_test ......................... Passed 1.60 sec
Start 7: ring_binqueue_TEST
2/18 Test #1: cmd_interface_test ..................... Passed 1.75 sec
3/18 Test #2: interleave_info_constructor_test ....... Passed 1.84 sec
Start 8: ring_multisend_TEST
4/18 Test #5: lfp_test ............................... Passed 1.94 sec
5/18 Test #4: queuing_test ........................... Passed 1.94 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #6: ring_TEST .............................. Passed 2.73 sec
Start 10: ring_permute1_TEST
7/18 Test #7: ring_binqueue_TEST ..................... Passed 7.51 sec
Start 11: ring_permute2_TEST
8/18 Test #9: ring_spike_buffer_TEST ................. Passed 7.27 sec
Start 12: ring_gap_TEST
9/18 Test #8: ring_multisend_TEST .................... Passed 8.50 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #10: ring_permute1_TEST ..................... Passed 7.67 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 5.43 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST .......................... Passed 5.54 sec
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST ................. Passed 10.79 sec
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #14: ring_gap_multisend_TEST ................ Passed 10.79 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST ................. Passed 12.10 sec
16/18 Test #16: ring_gap_permute2_TEST ................. Passed 11.93 sec
17/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 9.02 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 8.99 sec
100% tests passed, 0 tests failed out of 18
Total Test time (real) = 30.25 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1634142364:step_script section_start:1634142364:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=15175 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=72586 responseStatus=201 Created token=rjGDFzg8
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=15209 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=72586 responseStatus=201 Created token=rjGDFzg8
section_end:1634142365:upload_artifacts_on_success section_start:1634142365:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634142366:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634141801:resolve_secrets Resolving secrets
section_end:1634141801:resolve_secrets section_start:1634141801:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor175931376, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72584
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72584_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780605
job state: PD
job state: PD
job state: R
section_end:1634141827:prepare_executor section_start:1634141827:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634141829:prepare_script section_start:1634141829:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634141831:get_sources section_start:1634141831:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (72580)...
Runtime platform  arch=amd64 os=linux pid=276473 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72580 responseStatus=200 OK token=rycJUKMP
section_end:1634141832:download_artifacts section_start:1634141832:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r2i2n34
Build name: Linux-icpc
Create new tag: 20211013-1617 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72580/spack-build/spack-stage-coreneuron-develop-amiea4vkblpwhetoty6thfkfrdug4p64/spack-build-amiea4v
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #3: alignment_test ..................... Passed 1.82 sec
2/17 Test #17: reporting_1 ........................ Passed 1.85 sec
Start 7: ring_binqueue_TEST
3/17 Test #6: ring_TEST .......................... Passed 2.13 sec
Start 8: ring_multisend_TEST
4/17 Test #4: queuing_test ....................... Passed 2.62 sec
5/17 Test #2: interleave_info_constructor_test ... Passed 2.68 sec
Start 9: ring_spike_buffer_TEST
6/17 Test #1: cmd_interface_test ................. Passed 2.68 sec
7/17 Test #5: lfp_test ........................... Passed 2.68 sec
Start 10: ring_permute1_TEST
8/17 Test #7: ring_binqueue_TEST ................. Passed 0.87 sec
Start 11: ring_permute2_TEST
9/17 Test #8: ring_multisend_TEST ................ Passed 1.28 sec
Start 12: ring_gap_TEST
10/17 Test #9: ring_spike_buffer_TEST ............. Passed 3.65 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #10: ring_permute1_TEST ................. Passed 3.65 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 3.92 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #12: ring_gap_TEST ...................... Passed 3.25 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #13: ring_gap_binqueue_TEST ............. Passed 2.70 sec
15/17 Test #14: ring_gap_multisend_TEST ............ Passed 3.25 sec
16/17 Test #15: ring_gap_permute1_TEST ............. Passed 3.08 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 3.08 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 9.78 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1634141857:step_script section_start:1634141857:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=279147 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=72584 responseStatus=201 Created token=ETNWmDR7
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=279181 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=72584 responseStatus=201 Created token=ETNWmDR7
section_end:1634141858:upload_artifacts_on_success section_start:1634141858:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634141859:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634142367:resolve_secrets Resolving secrets
section_end:1634142367:resolve_secrets section_start:1634142367:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor888337510, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72585
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72585_PROD_P112_CP1_C1
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod_p2,prod_p1,interactive
chown: changing ownership of ‘/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/share/lib/python/neuron/rxd/geometry3d/_cmake_tmp_setup.py’: No such file or directory
ERROR: Preparation failed: exit status 2
Will be retried in 3s ...
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor476594426, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72585
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72585_PROD_P112_CP1_C1
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod_p2,prod_p1,interactive
Submitted batch job 2780729
job state: R
section_end:1634142478:prepare_executor section_start:1634142478:prepare_script Preparing environment
Running on r2i3n6 via bbpv1.epfl.ch...
section_end:1634142480:prepare_script section_start:1634142480:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634142480:get_sources section_start:1634142480:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (72581)...
Runtime platform  arch=amd64 os=linux pid=16145 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72581 responseStatus=200 OK token=JavNznfA
section_end:1634142481:download_artifacts section_start:1634142481:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r2i2n34
Build name: Linux-nvc++
Create new tag: 20211013-1628 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72581/spack-build/spack-stage-coreneuron-develop-aoe2ga6salt5qv6vqlldt23jmmxeb6d5/spack-build-aoe2ga6
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #1: cmd_interface_test ..................... Passed 1.71 sec
Start 7: ring_binqueue_TEST
2/18 Test #3: alignment_test ......................... Passed 1.71 sec
3/18 Test #4: queuing_test ........................... Passed 1.89 sec
Start 8: ring_multisend_TEST
4/18 Test #2: interleave_info_constructor_test ....... Passed 2.08 sec
5/18 Test #5: lfp_test ............................... Passed 2.09 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #6: ring_TEST .............................. Passed 2.93 sec
Start 10: ring_permute1_TEST
7/18 Test #9: ring_spike_buffer_TEST ................. Passed 8.70 sec
Start 11: ring_permute2_TEST
8/18 Test #7: ring_binqueue_TEST ..................... Passed 9.76 sec
Start 12: ring_gap_TEST
9/18 Test #8: ring_multisend_TEST .................... Passed 9.67 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #10: ring_permute1_TEST ..................... Passed 8.72 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 4.53 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST .......................... Passed 6.31 sec
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST ................. Passed 9.85 sec
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #14: ring_gap_multisend_TEST ................ Passed 9.86 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST ................. Passed 7.68 sec
16/18 Test #16: ring_gap_permute2_TEST ................. Passed 8.38 sec
17/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 7.67 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 7.60 sec
100% tests passed, 0 tests failed out of 18
Total Test time (real) = 29.15 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1634142525:step_script section_start:1634142525:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=18091 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=72585 responseStatus=201 Created token=YuZ1UCaY
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=18124 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=72585 responseStatus=201 Created token=YuZ1UCaY
section_end:1634142526:upload_artifacts_on_success section_start:1634142526:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634142526:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634142174:resolve_secrets Resolving secrets
section_end:1634142174:resolve_secrets section_start:1634142174:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor505661852, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72583
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72583_PROD_P112_CP1_C1
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780699
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1634142218:prepare_executor section_start:1634142218:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634142220:prepare_script section_start:1634142220:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634142221:get_sources section_start:1634142221:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (72579)...
Runtime platform  arch=amd64 os=linux pid=291547 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72579 responseStatus=200 OK token=RFnsF-a5
section_end:1634142222:download_artifacts section_start:1634142222:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r2i2n34
Build name: Linux-icpc
Create new tag: 20211013-1623 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72579/spack-build/spack-stage-coreneuron-develop-fbjlykb4ys6kgbq2z2zyrw6ufddzw3ts/spack-build-fbjlykb
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #17: reporting_1 ........................ Passed 1.79 sec
2/17 Test #6: ring_TEST .......................... Passed 1.80 sec
Start 7: ring_binqueue_TEST
3/17 Test #2: interleave_info_constructor_test ... Passed 2.13 sec
Start 8: ring_multisend_TEST
4/17 Test #3: alignment_test ..................... Passed 2.33 sec
5/17 Test #5: lfp_test ........................... Passed 2.33 sec
Start 9: ring_spike_buffer_TEST
6/17 Test #4: queuing_test ....................... Passed 2.54 sec
7/17 Test #1: cmd_interface_test ................. Passed 2.71 sec
Start 10: ring_permute1_TEST
8/17 Test #7: ring_binqueue_TEST ................. Passed 3.27 sec
Start 11: ring_permute2_TEST
9/17 Test #9: ring_spike_buffer_TEST ............. Passed 4.42 sec
Start 12: ring_gap_TEST
10/17 Test #10: ring_permute1_TEST ................. Passed 4.06 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #8: ring_multisend_TEST ................ Passed 4.96 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 2.02 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #15: ring_gap_permute1_TEST ............. Passed 3.43 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #13: ring_gap_binqueue_TEST ............. Passed 4.06 sec
15/17 Test #12: ring_gap_TEST ...................... Passed 4.06 sec
16/17 Test #14: ring_gap_multisend_TEST ............ Passed 3.78 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 0.63 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 11.18 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1634142249:step_script section_start:1634142249:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=293645 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=72583 responseStatus=201 Created token=G6oyajs3
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=293677 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=72583 responseStatus=201 Created token=G6oyajs3
section_end:1634142250:upload_artifacts_on_success section_start:1634142250:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634142251:cleanup_file_variables Job succeeded
Log was not fetched because job had status: skipped
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634143985:resolve_secrets Resolving secrets
section_end:1634143985:resolve_secrets section_start:1634143985:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor574804776, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72592
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72592_PROD_P112_CP2_C9
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780935
job state: R
section_end:1634144114:prepare_executor section_start:1634144114:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634144116:prepare_script section_start:1634144116:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634144117:get_sources section_start:1634144117:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:intel (72588)...
Runtime platform  arch=amd64 os=linux pid=47333 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72588 responseStatus=200 OK token=tJxPzVuY
section_end:1634144118:download_artifacts section_start:1634144118:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r2i2n34
Build name: Linux-icpc
Create new tag: 20211013-1657 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt
Start 28: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 35: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 41: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 47: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 51: testcorenrn_patstim::coreneuron_cpu_offline::preparation
1/94 Test #35: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 14.43 sec
Start 75: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/94 Test #41: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 15.48 sec
Start 81: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/94 Test #51: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 21.42 sec
Start 57: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
4/94 Test #47: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 22.51 sec
Start 69: testcorenrn_watch::coreneuron_cpu_offline::preparation
5/94 Test #81: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 14.69 sec
Start 24: external_ringtest::neuron
6/94 Test #75: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 16.67 sec
Start 31: testcorenrn_bbcore::neuron
7/94 Test #28: external_ringtest::coreneuron_cpu_mpi_offline::preparation .........***Failed 33.20 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
MPT ERROR: Rank 1(g:1) received signal SIGSEGV(11).
Process ID: 48847, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 48847: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/external_ringtest/coreneuron_cpu_mpi_offline
srun: error: r2i2n34: task 1: Segmentation fault (core dumped)
srun: Terminating job step 2780935.6
slurmstepd: error: *** STEP 2780935.6 ON r2i2n34 CANCELLED AT 2021-10-13T18:58:15 ***
srun: error: r2i2n34: task 0: Terminated
srun: Force Terminated job step 2780935.6
Start 25: external_ringtest::neuron_mpi
8/94 Test #57: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 15.72 sec
Start 26: external_ringtest::coreneuron_cpu_mpi
9/94 Test #69: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 17.23 sec
Start 27: external_ringtest::coreneuron_cpu_mpi_offline
10/94 Test #31: testcorenrn_bbcore::neuron ......................................... Passed 13.92 sec
Start 32: testcorenrn_bbcore::coreneuron_cpu_online
11/94 Test #27: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 8.96 sec
Start 29: external_ringtest::coreneuron_cpu_mpi_threads
12/94 Test #24: external_ringtest::neuron .......................................... Passed 21.38 sec
Start 33: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
13/94 Test #25: external_ringtest::neuron_mpi ...................................... Passed 23.30 sec
Start 34: testcorenrn_bbcore::coreneuron_cpu_offline
Start 37: testcorenrn_deriv::neuron
14/94 Test #26: external_ringtest::coreneuron_cpu_mpi ..............................***Failed 24.93 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
MPT ERROR: Rank 1(g:1) received signal SIGSEGV(11).
Process ID: 49394, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 49394: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/external_ringtest/coreneuron_cpu_mpi
srun: error: r2i2n34: task 1: Segmentation fault (core dumped)
srun: Terminating job step 2780935.15
slurmstepd: error: *** STEP 2780935.15 ON r2i2n34 CANCELLED AT 2021-10-13T18:58:44 ***
srun: error: r2i2n34: task 0: Terminated
srun: Force Terminated job step 2780935.15
Start 38: testcorenrn_deriv::coreneuron_cpu_online
Start 39: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
15/94 Test #34: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 8.06 sec
Start 40: testcorenrn_deriv::coreneuron_cpu_offline
16/94 Test #32: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 20.50 sec
Start 71: testcorenrn_conc::neuron
17/94 Test #37: testcorenrn_deriv::neuron .......................................... Passed 26.49 sec
Start 72: testcorenrn_conc::coreneuron_cpu_online
18/94 Test #40: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 21.92 sec
Start 73: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
19/94 Test #33: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 37.93 sec
Start 74: testcorenrn_conc::coreneuron_cpu_offline
20/94 Test #71: testcorenrn_conc::neuron ........................................... Passed 25.96 sec
Start 77: testcorenrn_kin::neuron
21/94 Test #29: external_ringtest::coreneuron_cpu_mpi_threads ......................***Failed 44.52 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
MPT ERROR: Rank 1(g:1) received signal SIGSEGV(11).
Process ID: 49545, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 49545: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/external_ringtest/coreneuron_cpu_mpi_threads
srun: error: r2i2n34: task 1: Segmentation fault (core dumped)
srun: Terminating job step 2780935.18
slurmstepd: error: *** STEP 2780935.18 ON r2i2n34 CANCELLED AT 2021-10-13T18:59:15 ***
srun: error: r2i2n34: task 0: Terminated
srun: Force Terminated job step 2780935.18
Start 43: testcorenrn_gf::neuron
22/94 Test #39: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 31.43 sec
Start 78: testcorenrn_kin::coreneuron_cpu_online
23/94 Test #38: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 33.84 sec
Start 79: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
24/94 Test #72: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 14.02 sec
Start 80: testcorenrn_kin::coreneuron_cpu_offline
25/94 Test #74: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 8.33 sec
Start 87: channel_benchmark_hippo::neuron
26/94 Test #77: testcorenrn_kin::neuron ............................................ Passed 12.04 sec
Start 88: channel_benchmark_hippo::coreneuron_cpu_online
27/94 Test #80: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 13.32 sec
Start 89: channel_benchmark_hippo::coreneuron_cpu_filemode
28/94 Test #73: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 29.27 sec
Start 91: channel_benchmark_sscx::neuron
29/94 Test #43: testcorenrn_gf::neuron ............................................. Passed 26.12 sec
Start 44: testcorenrn_gf::coreneuron_cpu_online
30/94 Test #78: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 30.95 sec
Start 92: channel_benchmark_sscx::coreneuron_cpu_online
31/94 Test #79: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 35.00 sec
Start 93: channel_benchmark_sscx::coreneuron_cpu_filemode
32/94 Test #87: channel_benchmark_hippo::neuron .................................... Passed 57.18 sec
Start 1: testneuron
33/94 Test #1: testneuron ......................................................... Passed 10.76 sec
Start 2: ringtest
34/94 Test #88: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 68.27 sec
Start 3: connect_dend
35/94 Test #2: ringtest ........................................................... Passed 17.71 sec
Start 4: pynrn_tests::basic_tests
36/94 Test #3: connect_dend ....................................................... Passed 20.18 sec
Start 5: rxdmod_tests::rxd_tests
37/94 Test #44: testcorenrn_gf::coreneuron_cpu_online ..............................***Failed 77.01 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testgf.hoc near line 48
1 prun("")
^
1 ParallelContext[0].psolve(100)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 50535, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780935.38 ON r2i2n34 CANCELLED AT 2021-10-13T19:00:57 ***
srun: error: r2i2n34: task 0: Killed
srun: Terminating job step 2780935.38
srun: error: r2i2n34: task 1: Exited with exit code 255
Start 45: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
38/94 Test #91: channel_benchmark_sscx::neuron ..................................... Passed 100.96 sec
Start 6: rxdmod_tests::rxd_mpi_tests
39/94 Test #89: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 108.71 sec
Start 7: parallel_tests
40/94 Test #92: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 104.64 sec
Start 8: parallel_partrans
41/94 Test #93: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 108.86 sec
Start 9: parallel_bas
42/94 Test #45: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate .............***Failed 49.49 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testgf.hoc near line 48
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 50986, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testgf.hoc near line 48
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780935.41 ON r2i2n34 CANCELLED AT 2021-10-13T19:01:48 ***
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780935.41
srun: error: r2i2n34: task 1: Killed
Start 46: testcorenrn_gf::coreneuron_cpu_offline
43/94 Test #46: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 19.83 sec
Start 49: testcorenrn_patstim::neuron
44/94 Test #8: parallel_partrans .................................................. Passed 41.43 sec
Start 10: coreneuron_modtests::direct_py
45/94 Test #7: parallel_tests ..................................................... Passed 57.27 sec
Start 11: coreneuron_modtests::direct_hoc
46/94 Test #49: testcorenrn_patstim::neuron ........................................ Passed 38.01 sec
Start 50: testcorenrn_patstim::coreneuron_cpu_offline
47/94 Test #11: coreneuron_modtests::direct_hoc .................................... Passed 27.71 sec
Start 12: coreneuron_modtests::spikes_py
48/94 Test #50: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 9.02 sec
Start 53: testcorenrn_vecplay::neuron
49/94 Test #10: coreneuron_modtests::direct_py .....................................***Failed 43.83 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/direct_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_direct.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7dd700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/direct_py/test/coreneuron/test_direct.py", line 52 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/direct_py/test/coreneuron/test_direct.py", line 70 in test_direct_memory_transfer
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 13: coreneuron_modtests::spikes_file_mode_py
50/94 Test #12: coreneuron_modtests::spikes_py .....................................***Failed 54.12 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/spikes_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_spikes.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7dd700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/spikes_py/test/coreneuron/test_spikes.py", line 95 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/spikes_py/test/coreneuron/test_spikes.py", line 127 in test_spikes
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 14: coreneuron_modtests::fornetcon_py
51/94 Test #53: testcorenrn_vecplay::neuron ........................................ Passed 54.14 sec
Start 54: testcorenrn_vecplay::coreneuron_cpu_online
52/94 Test #9: parallel_bas ....................................................... Passed 128.82 sec
Start 15: coreneuron_modtests::fast_imem_py
53/94 Test #4: pynrn_tests::basic_tests ........................................... Passed 190.60 sec
Start 16: coreneuron_modtests::datareturn_py
54/94 Test #13: coreneuron_modtests::spikes_file_mode_py ...........................***Failed 67.78 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/spikes_file_mode_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_spikes.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7dd700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/spikes_file_mode_py/test/coreneuron/test_spikes.py", line 95 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/spikes_file_mode_py/test/coreneuron/test_spikes.py", line 129 in test_spikes
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 17: coreneuron_modtests::test_units_py
55/94 Test #54: testcorenrn_vecplay::coreneuron_cpu_online .........................***Failed 24.64 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7d5
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testvecplay.hoc near line 54
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 52490, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7d5
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testvecplay.hoc near line 54
1 prun("")
^
1 ParallelContext[0].psolve(100)
1 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780935.50 ON r2i2n34 CANCELLED AT 2021-10-13T19:04:13 ***
srun: error: r2i2n34: task 0: Killed
srun: Terminating job step 2780935.50
srun: error: r2i2n34: task 1: Exited with exit code 255
Start 55: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
56/94 Test #14: coreneuron_modtests::fornetcon_py ..................................***Failed 39.68 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/fornetcon_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_fornetcon.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/fornetcon_py/test/coreneuron/test_fornetcon.py", line 65 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/fornetcon_py/test/coreneuron/test_fornetcon.py", line 97 in runassert
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/fornetcon_py/test/coreneuron/test_fornetcon.py", line 105 in test_fornetcon
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 18: coreneuron_modtests::test_netmove_py
57/94 Test #16: coreneuron_modtests::datareturn_py .................................***Failed 35.02 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/datareturn_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_datareturn.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7dd700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/datareturn_py/test/coreneuron/test_datareturn.py", line 151 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/datareturn_py/test/coreneuron/test_datareturn.py", line 181 in test_datareturn
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 19: coreneuron_modtests::test_watchrange_py
58/94 Test #15: coreneuron_modtests::fast_imem_py .................................. Passed 41.42 sec
Start 20: coreneuron_modtests::test_psolve_py
59/94 Test #55: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........***Failed 34.20 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7d5
/usr/lib64/libc.so.6 : ()+0x16f7d5
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testvecplay.hoc near line 54
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 52689, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testvecplay.hoc near line 54
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
slurmstepd: error: *** STEP 2780935.51 ON r2i2n34 CANCELLED AT 2021-10-13T19:04:48 ***
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780935.51
srun: error: r2i2n34: task 1: Killed
Start 56: testcorenrn_vecplay::coreneuron_cpu_offline
60/94 Test #17: coreneuron_modtests::test_units_py .................................***Failed 47.10 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_units_py
plugins: cov-2.8.1
collected 1 item
test/coreneuron/test_units.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_units_py/test/coreneuron/test_units.py", line 28 in test_units
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 21: coreneuron_modtests::test_natrans_py
61/94 Test #56: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 8.27 sec
Start 65: testcorenrn_watch::neuron
62/94 Test #18: coreneuron_modtests::test_netmove_py ...............................***Failed 38.11 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_netmove_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_netmove.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_netmove_py/test/coreneuron/test_netmove.py", line 69 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_netmove_py/test/coreneuron/test_netmove.py", line 89 in runassert
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_netmove_py/test/coreneuron/test_netmove.py", line 111 in test_netmove
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 30: external_ringtest::compare_results
63/94 Test #30: external_ringtest::compare_results .................................***Failed 3.84 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/external_ringtest/coreneuron_cpu_mpi/spk2.std'
Start 36: testcorenrn_bbcore::compare_results
64/94 Test #36: testcorenrn_bbcore::compare_results ................................***Failed 4.32 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_bbcore/coreneuron_cpu_online/outbbcore.dat'
Start 42: testcorenrn_deriv::compare_results
65/94 Test #65: testcorenrn_watch::neuron .......................................... Passed 14.97 sec
Start 66: testcorenrn_watch::coreneuron_cpu_online
66/94 Test #19: coreneuron_modtests::test_watchrange_py ............................***Failed 39.98 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_watchrange_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_watchrange.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_watchrange_py/test/coreneuron/test_watchrange.py", line 68 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_watchrange_py/test/coreneuron/test_watchrange.py", line 91 in runassert
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_watchrange_py/test/coreneuron/test_watchrange.py", line 141 in test_watchrange
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 48: testcorenrn_gf::compare_results
67/94 Test #20: coreneuron_modtests::test_psolve_py ................................***Failed 40.35 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_psolve_py
plugins: cov-2.8.1
numprocs=1
collected 2 items
test/coreneuron/test_psolve.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7dd700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_psolve_py/test/coreneuron/test_psolve.py", line 45 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_psolve_py/test/coreneuron/test_psolve.py", line 56 in test_psolve
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 52: testcorenrn_patstim::compare_results
68/94 Test #42: testcorenrn_deriv::compare_results .................................***Failed 6.81 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_deriv/coreneuron_cpu_online/outderiv.dat'
Start 58: testcorenrn_vecplay::compare_results
69/94 Test #48: testcorenrn_gf::compare_results ....................................***Failed 3.90 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_gf/coreneuron_cpu_online/outgf.dat'
Start 76: testcorenrn_conc::compare_results
70/94 Test #52: testcorenrn_patstim::compare_results ............................... Passed 4.06 sec
Start 82: testcorenrn_kin::compare_results
71/94 Test #58: testcorenrn_vecplay::compare_results ...............................***Failed 3.93 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_vecplay/coreneuron_cpu_online/outvecplay.dat'
Start 86: external_nrntest
72/94 Test #76: testcorenrn_conc::compare_results ..................................***Failed 3.36 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_conc/coreneuron_cpu_online/outconc.dat'
Start 90: channel_benchmark_hippo::compare_results
73/94 Test #82: testcorenrn_kin::compare_results ...................................***Failed 3.30 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_kin/coreneuron_cpu_online/outkin.dat'
Start 94: channel_benchmark_sscx::compare_results
74/94 Test #90: channel_benchmark_hippo::compare_results ...........................***Failed 6.37 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/channel_benchmark_hippo/coreneuron_cpu_online/out.dat'
75/94 Test #21: coreneuron_modtests::test_natrans_py ...............................***Failed 36.04 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_natrans_py
plugins: cov-2.8.1
collected 1 item
test/gjtests/test_natrans.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_natrans_py/test/gjtests/test_natrans.py", line 95 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/test_natrans_py/test/gjtests/test_natrans.py", line 114 in test_natrans
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 67: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
76/94 Test #94: channel_benchmark_sscx::compare_results ............................***Failed 9.21 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/channel_benchmark_sscx/coreneuron_cpu_online/out.dat'
77/94 Test #66: testcorenrn_watch::coreneuron_cpu_online ...........................***Failed 26.33 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testwatch.hoc near line 54
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 53106, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testwatch.hoc near line 54
1 prun("")
^
1 ParallelContext[0].psolve(100)
1 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780935.54 ON r2i2n34 CANCELLED AT 2021-10-13T19:05:37 ***
srun: error: r2i2n34: task 0: Killed
srun: Terminating job step 2780935.54
srun: error: r2i2n34: task 1: Exited with exit code 255
Start 68: testcorenrn_watch::coreneuron_cpu_offline
78/94 Test #68: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 9.57 sec
Start 83: testcorenrn_netstimdirect::direct_netstimdirect
79/94 Test #67: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate ..........***Failed 29.90 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testwatch.hoc near line 54
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 53249, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testwatch.hoc near line 54
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780935.55 ON r2i2n34 CANCELLED AT 2021-10-13T19:05:57 ***
srun: error: r2i2n34: task 0: Killed
srun: Terminating job step 2780935.55
srun: error: r2i2n34: task 1: Exited with exit code 255
Start 84: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
Start 70: testcorenrn_watch::compare_results
80/94 Test #70: testcorenrn_watch::compare_results .................................***Failed 3.73 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_watch/coreneuron_cpu_online/outwatch.dat'
81/94 Test #83: testcorenrn_netstimdirect::direct_netstimdirect ....................***Failed 28.62 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 0
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
10
10
psolve time 0.00999999
Vector[5]
Vector[6]
Vector[5]
Vector[6]
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testnetstimdirect.hoc near line 68
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 53545, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testnetstimdirect.hoc near line 68
1 prun("")
^
1 ParallelContext[0].psolve(100)
1 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780935.57 ON r2i2n34 CANCELLED AT 2021-10-13T19:06:15 ***
srun: error: r2i2n34: task 0: Killed
srun: Terminating job step 2780935.57
srun: error: r2i2n34: task 1: Exited with exit code 255
Start 22: coreneuron_modtests::spikes_mpi_py
82/94 Test #84: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ...***Failed 27.66 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 0
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
1
1
0
1
10
10
psolve time 0.00999999
Vector[5]
Vector[6]
Vector[5]
Vector[6]
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testnetstimdirect.hoc near line 68
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 53636, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testnetstimdirect.hoc near line 68
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
slurmstepd: error: *** STEP 2780935.58 ON r2i2n34 CANCELLED AT 2021-10-13T19:06:25 ***
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780935.58
srun: error: r2i2n34: task 1: Killed
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py
Start 85: testcorenrn_netstimdirect::compare_results
83/94 Test #85: testcorenrn_netstimdirect::compare_results .........................***Failed 4.35 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_netstimdirect/direct_netstimdirect/outnetstimdirect.dat'
84/94 Test #22: coreneuron_modtests::spikes_mpi_py .................................***Failed 31.51 sec
numprocs=2
MPT ERROR: Rank 1(g:1) received signal SIGSEGV(11).
Process ID: 53864, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/bin/python3.8
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/bin/python3.8, Rank 1, Process 53864: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/spikes_mpi_py
srun: error: r2i2n34: task 1: Segmentation fault (core dumped)
srun: Terminating job step 2780935.59
slurmstepd: error: *** STEP 2780935.59 ON r2i2n34 CANCELLED AT 2021-10-13T19:06:47 ***
srun: error: r2i2n34: task 0: Terminated
srun: Force Terminated job step 2780935.59
85/94 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py .......................***Failed 31.34 sec
numprocs=2
MPT ERROR: Rank 0(g:0) received signal SIGSEGV(11).
Process ID: 53997, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/bin/python3.8
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/bin/python3.8, Rank 0, Process 53997: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/coreneuron_modtests/spikes_mpi_file_mode_py
srun: error: r2i2n34: task 0: Segmentation fault (core dumped)
srun: Terminating job step 2780935.60
slurmstepd: error: *** STEP 2780935.60 ON r2i2n34 CANCELLED AT 2021-10-13T19:06:57 ***
srun: error: r2i2n34: task 1: Terminated
srun: Force Terminated job step 2780935.60
Start 63: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
86/94 Test #63: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 18.46 sec
Start 59: testcorenrn_vecevent::neuron
87/94 Test #59: testcorenrn_vecevent::neuron ....................................... Passed 18.18 sec
Start 60: testcorenrn_vecevent::coreneuron_cpu_online
88/94 Test #60: testcorenrn_vecevent::coreneuron_cpu_online ........................***Failed 24.31 sec
numprocs=4
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
1
1
0
1
1
1
0
1
10
10
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testvecevent.hoc near line 47
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 54765, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
3 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
3 in testvecevent.hoc near line 47
3 prun("")
^
3 ParallelContext[0].psolve(100)
3 prun("")
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testvecevent.hoc near line 47
1 prun("")
^
1 ParallelContext[0].psolve(100)
1 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780935.63 ON r2i2n34 CANCELLED AT 2021-10-13T19:07:56 ***
slurmstepd: error: *** STEP 2780935.63 ON r2i2n34 CANCELLED AT 2021-10-13T19:07:56 ***
srun: error: r2i2n34: tasks 0,2: Killed
srun: Terminating job step 2780935.63
srun: error: r2i2n34: tasks 1,3: Exited with exit code 255
Start 61: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
89/94 Test #61: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate .......***Failed 26.79 sec
numprocs=4
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
1
1
0
1
1
1
0
1
1
1
0
1
10
10
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-amiea4/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : ()+0x355deb
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testvecevent.hoc near line 47
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 54989, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testvecevent.hoc near line 47
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
3 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
3 in testvecevent.hoc near line 47
3 prun("")
^
3 ParallelContext[0].psolve(1)
3 prun("")
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
2 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
2 in testvecevent.hoc near line 47
2 prun("")
^
2 ParallelContext[0].psolve(1)
2 prun("")
slurmstepd: error: *** STEP 2780935.64 ON r2i2n34 CANCELLED AT 2021-10-13T19:08:23 ***
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
srun: error: r2i2n34: tasks 0,2-3: Exited with exit code 255
srun: Terminating job step 2780935.64
srun: error: r2i2n34: task 1: Killed
Start 62: testcorenrn_vecevent::coreneuron_cpu_offline
90/94 Test #62: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 8.50 sec
Start 64: testcorenrn_vecevent::compare_results
91/94 Test #64: testcorenrn_vecevent::compare_results ..............................***Failed 3.95 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72588/spack-build/spack-stage-neuron-develop-l2cuclt2wvuiw4s54hywewweoywsqlpu/spack-build-l2cuclt/test/testcorenrn_vecevent/coreneuron_cpu_online/outvecevent.dat'
92/94 Test #86: external_nrntest ................................................... Passed 794.97 sec
93/94 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 1340.74 sec
94/94 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 1488.46 sec
61% tests passed, 37 tests failed out of 94
Total Test time (real) = 1680.70 sec
The following tests FAILED:
10 - coreneuron_modtests::direct_py (Failed)
12 - coreneuron_modtests::spikes_py (Failed)
13 - coreneuron_modtests::spikes_file_mode_py (Failed)
14 - coreneuron_modtests::fornetcon_py (Failed)
16 - coreneuron_modtests::datareturn_py (Failed)
17 - coreneuron_modtests::test_units_py (Failed)
18 - coreneuron_modtests::test_netmove_py (Failed)
19 - coreneuron_modtests::test_watchrange_py (Failed)
20 - coreneuron_modtests::test_psolve_py (Failed)
21 - coreneuron_modtests::test_natrans_py (Failed)
22 - coreneuron_modtests::spikes_mpi_py (Failed)
23 - coreneuron_modtests::spikes_mpi_file_mode_py (Failed)
26 - external_ringtest::coreneuron_cpu_mpi (Failed)
28 - external_ringtest::coreneuron_cpu_mpi_offline::preparation (Failed)
29 - external_ringtest::coreneuron_cpu_mpi_threads (Failed)
30 - external_ringtest::compare_results (Failed)
36 - testcorenrn_bbcore::compare_results (Failed)
42 - testcorenrn_deriv::compare_results (Failed)
44 - testcorenrn_gf::coreneuron_cpu_online (Failed)
45 - testcorenrn_gf::coreneuron_cpu_online_psolve_alternate (Failed)
48 - testcorenrn_gf::compare_results (Failed)
54 - testcorenrn_vecplay::coreneuron_cpu_online (Failed)
55 - testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate (Failed)
58 - testcorenrn_vecplay::compare_results (Failed)
60 - testcorenrn_vecevent::coreneuron_cpu_online (Failed)
61 - testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate (Failed)
64 - testcorenrn_vecevent::compare_results (Failed)
66 - testcorenrn_watch::coreneuron_cpu_online (Failed)
67 - testcorenrn_watch::coreneuron_cpu_online_psolve_alternate (Failed)
70 - testcorenrn_watch::compare_results (Failed)
76 - testcorenrn_conc::compare_results (Failed)
82 - testcorenrn_kin::compare_results (Failed)
83 - testcorenrn_netstimdirect::direct_netstimdirect (Failed)
84 - testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate (Failed)
85 - testcorenrn_netstimdirect::compare_results (Failed)
90 - channel_benchmark_hippo::compare_results (Failed)
94 - channel_benchmark_sscx::compare_results (Failed)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: r2i2n34: task 0: Exited with exit code 1
section_end:1634145950:step_script section_start:1634145950:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=67205 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=72592 responseStatus=201 Created token=rwfjNtKi
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=67241 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=72592 responseStatus=201 Created token=rwfjNtKi
section_end:1634145951:upload_artifacts_on_failure section_start:1634145951:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634145952:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634145952:resolve_secrets Resolving secrets
section_end:1634145952:resolve_secrets section_start:1634145952:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor901133431, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72593
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72593_PROD_P112_CP2_C9
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod_p2,prod_p1,interactive
Submitted batch job 2780937
job state: R
section_end:1634146073:prepare_executor section_start:1634146073:prepare_script Preparing environment
Running on r2i3n6 via bbpv1.epfl.ch...
section_end:1634146075:prepare_script section_start:1634146075:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634146076:get_sources section_start:1634146076:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron+nmodl:gpu (72589)...
Runtime platform  arch=amd64 os=linux pid=27675 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72589 responseStatus=200 OK token=ueJBbsEw
section_end:1634146076:download_artifacts section_start:1634146076:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r2i2n34
Build name: Linux-nvc++
Create new tag: 20211013-1728 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er
Start 27: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 31: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 38: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 42: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 48: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 52: testcorenrn_deriv::coreneuron_cpu_offline::preparation
1/115 Test #38: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 2.18 sec
Start 66: testcorenrn_patstim::coreneuron_gpu_offline::preparation
2/115 Test #42: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.27 sec
Start 23: external_ringtest::neuron
3/115 Test #48: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 2.44 sec
Start 34: testcorenrn_bbcore::neuron
4/115 Test #52: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.44 sec
Start 35: testcorenrn_bbcore::coreneuron_gpu_online
5/115 Test #66: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 1.43 sec
Start 36: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
6/115 Test #23: external_ringtest::neuron .......................................... Passed 1.43 sec
Start 37: testcorenrn_bbcore::coreneuron_gpu_offline
7/115 Test #34: testcorenrn_bbcore::neuron ......................................... Passed 1.54 sec
Start 39: testcorenrn_bbcore::coreneuron_cpu_online
8/115 Test #37: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 2.53 sec
Start 40: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
9/115 Test #27: external_ringtest::coreneuron_cpu_mpi_offline::preparation .........***Failed 6.46 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 0 UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 0 UH��AWAVATSH��M��M�lj�L�%�I�
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 28546, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 0 UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 0 UH��AWAVATSH��M��M�lj�L�%�I�
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 28546: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/external_ringtest/coreneuron_cpu_mpi_offline
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.6
slurmstepd: error: *** STEP 2780937.6 ON r2i3n6 CANCELLED AT 2021-10-13T19:28:21 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.6
Start 58: testcorenrn_gf::coreneuron_gpu_offline::preparation
10/115 Test #31: external_ringtest::coreneuron_gpu_mpi_offline::preparation .........***Failed 6.38 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 0 UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 0 UH��AWAVATSH��M��M�lj�L�%�I�
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 0 UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 28585, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 0 UH��AWAVATSH��M��M�lj�L�%�I�
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 28585: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/external_ringtest/coreneuron_gpu_mpi_offline
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.9
slurmstepd: error: *** STEP 2780937.9 ON r2i3n6 CANCELLED AT 2021-10-13T19:28:21 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.9
Start 62: testcorenrn_gf::coreneuron_cpu_offline::preparation
11/115 Test #35: testcorenrn_bbcore::coreneuron_gpu_online ..........................***Failed 4.84 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
0
0
1
10
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 28764, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 28764: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_bbcore/coreneuron_gpu_online
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.12
Start 41: testcorenrn_bbcore::coreneuron_cpu_offline
12/115 Test #58: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 2.00 sec
Start 68: testcorenrn_patstim::coreneuron_cpu_offline::preparation
13/115 Test #62: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 2.00 sec
Start 74: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
14/115 Test #36: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate .........***Failed 5.31 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
0
0
1
10
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 28820, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 28820: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_bbcore/coreneuron_gpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.13
Start 44: testcorenrn_deriv::neuron
15/115 Test #41: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 1.67 sec
Start 45: testcorenrn_deriv::coreneuron_gpu_online
16/115 Test #39: testcorenrn_bbcore::coreneuron_cpu_online ..........................***Failed 5.50 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
0
0
1
10
nrncore_arg: | --tstop 100 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 28887, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 28887: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_bbcore/coreneuron_cpu_online
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.15
Start 46: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
17/115 Test #68: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 1.74 sec
Start 78: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
18/115 Test #74: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 1.74 sec
Start 94: testcorenrn_watch::coreneuron_gpu_offline::preparation
19/115 Test #44: testcorenrn_deriv::neuron .......................................... Passed 1.51 sec
Start 47: testcorenrn_deriv::coreneuron_gpu_offline
20/115 Test #40: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate .........***Failed 5.00 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
0
0
1
10
nrncore_arg: | --tstop 100 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 28971, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 28971: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_bbcore/coreneuron_cpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.16
Start 49: testcorenrn_deriv::coreneuron_cpu_online
21/115 Test #78: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 1.75 sec
Start 98: testcorenrn_watch::coreneuron_cpu_offline::preparation
22/115 Test #94: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 1.84 sec
Start 24: external_ringtest::neuron_mpi
23/115 Test #47: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 2.62 sec
Start 50: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
24/115 Test #98: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 1.85 sec
Start 25: external_ringtest::coreneuron_cpu_mpi
25/115 Test #45: testcorenrn_deriv::coreneuron_gpu_online ...........................***Failed 4.90 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 29256, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 29256: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_deriv/coreneuron_gpu_online
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.23
Start 51: testcorenrn_deriv::coreneuron_cpu_offline
26/115 Test #46: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate ..........***Failed 4.87 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 29304, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 29304: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_deriv/coreneuron_gpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.24
Start 65: testcorenrn_patstim::coreneuron_gpu_offline
27/115 Test #24: external_ringtest::neuron_mpi ...................................... Passed 2.76 sec
Start 26: external_ringtest::coreneuron_cpu_mpi_offline
28/115 Test #51: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 1.84 sec
Start 104: channel_benchmark_hippo::neuron
29/115 Test #49: testcorenrn_deriv::coreneuron_cpu_online ...........................***Failed 5.45 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
nrncore_arg: | --tstop 100 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 29481, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 29481: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_deriv/coreneuron_cpu_online
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.28
Start 105: channel_benchmark_hippo::coreneuron_gpu_online
30/115 Test #65: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 2.69 sec
Start 106: channel_benchmark_hippo::coreneuron_gpu_filemode
31/115 Test #26: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 3.16 sec
Start 28: external_ringtest::coreneuron_cpu_mpi_threads
32/115 Test #50: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate ..........***Failed 5.06 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
nrncore_arg: | --tstop 100 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 29710, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 29710: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_deriv/coreneuron_cpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.31
Start 107: channel_benchmark_hippo::coreneuron_cpu_online
33/115 Test #25: external_ringtest::coreneuron_cpu_mpi ..............................***Failed 6.65 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
CLI parsing error, see nrniv-core --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%�I�
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%�I�
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 29764, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 0, Process 29764: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/external_ringtest/coreneuron_cpu_mpi
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.32
slurmstepd: error: *** STEP 2780937.32 ON r2i3n6 CANCELLED AT 2021-10-13T19:28:35 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.32
Start 29: external_ringtest::coreneuron_gpu_mpi
34/115 Test #28: external_ringtest::coreneuron_cpu_mpi_threads ......................***Failed 9.06 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%�I�
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%�I�
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 30044, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 0, Process 30044: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/external_ringtest/coreneuron_cpu_mpi_threads
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.39
slurmstepd: error: *** STEP 2780937.39 ON r2i3n6 CANCELLED AT 2021-10-13T19:28:42 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.39
Start 30: external_ringtest::coreneuron_gpu_mpi_offline
35/115 Test #29: external_ringtest::coreneuron_gpu_mpi ..............................***Failed 9.37 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�I�
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 30119, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�I�
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 30119: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/external_ringtest/coreneuron_gpu_mpi
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.41
slurmstepd: error: *** STEP 2780937.41 ON r2i3n6 CANCELLED AT 2021-10-13T19:28:45 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.41
Start 32: external_ringtest::coreneuron_gpu_mpi_threads
36/115 Test #32: external_ringtest::coreneuron_gpu_mpi_threads ......................***Failed 8.70 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
CLI parsing error, see nrniv-core --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�I�
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�I�
terminate called after throwing an instance of 'CLI::ExtrasError'
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 30236, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�I�
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 0, Process 30236: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/external_ringtest/coreneuron_gpu_mpi_threads
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.43
slurmstepd: error: *** STEP 2780937.43 ON r2i3n6 CANCELLED AT 2021-10-13T19:28:53 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.43
Start 54: testcorenrn_gf::neuron
37/115 Test #30: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 16.79 sec
Start 55: testcorenrn_gf::coreneuron_gpu_online
38/115 Test #54: testcorenrn_gf::neuron ............................................. Passed 6.29 sec
Start 56: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
39/115 Test #55: testcorenrn_gf::coreneuron_gpu_online ..............................***Failed 7.56 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 30360, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 1, Process 30360: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_gf/coreneuron_gpu_online
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.45
slurmstepd: error: *** STEP 2780937.45 ON r2i3n6 CANCELLED AT 2021-10-13T19:29:06 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.45
Start 57: testcorenrn_gf::coreneuron_gpu_offline
40/115 Test #56: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate .............***Failed 9.31 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
10
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 30393, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 30393: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_gf/coreneuron_gpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.46
slurmstepd: error: *** STEP 2780937.46 ON r2i3n6 CANCELLED AT 2021-10-13T19:29:09 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.46
Start 59: testcorenrn_gf::coreneuron_cpu_online
41/115 Test #59: testcorenrn_gf::coreneuron_cpu_online ..............................***Failed 6.72 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 30511, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 1, Process 30511: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_gf/coreneuron_cpu_online
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.48
slurmstepd: error: *** STEP 2780937.48 ON r2i3n6 CANCELLED AT 2021-10-13T19:29:15 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.48
Start 60: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
42/115 Test #57: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 14.52 sec
Start 61: testcorenrn_gf::coreneuron_cpu_offline
43/115 Test #60: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate .............***Failed 9.28 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
1
1
0
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 30566, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 30566: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_gf/coreneuron_cpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.49
slurmstepd: error: *** STEP 2780937.49 ON r2i3n6 CANCELLED AT 2021-10-13T19:29:25 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.49
Start 64: testcorenrn_patstim::neuron
44/115 Test #64: testcorenrn_patstim::neuron ........................................ Passed 3.59 sec
Start 67: testcorenrn_patstim::coreneuron_cpu_offline
45/115 Test #61: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 12.13 sec
Start 70: testcorenrn_vecplay::neuron
46/115 Test #70: testcorenrn_vecplay::neuron ........................................ Passed 2.98 sec
Start 71: testcorenrn_vecplay::coreneuron_gpu_online
47/115 Test #67: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 8.76 sec
Start 72: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
48/115 Test #71: testcorenrn_vecplay::coreneuron_gpu_online .........................***Failed 7.46 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 30838, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 1, Process 30838: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecplay/coreneuron_gpu_online
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.54
slurmstepd: error: *** STEP 2780937.54 ON r2i3n6 CANCELLED AT 2021-10-13T19:29:43 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.54
Start 73: testcorenrn_vecplay::coreneuron_gpu_offline
49/115 Test #72: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........***Failed 9.28 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
10
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
CLI parsing error, see nrniv-core --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 30875, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 30875: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecplay/coreneuron_gpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.55
slurmstepd: error: *** STEP 2780937.55 ON r2i3n6 CANCELLED AT 2021-10-13T19:29:47 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.55
Start 75: testcorenrn_vecplay::coreneuron_cpu_online
50/115 Test #75: testcorenrn_vecplay::coreneuron_cpu_online .........................***Failed 6.98 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 30995, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 1, Process 30995: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecplay/coreneuron_cpu_online
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.57
slurmstepd: error: *** STEP 2780937.57 ON r2i3n6 CANCELLED AT 2021-10-13T19:29:53 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.57
Start 76: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
51/115 Test #73: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 15.26 sec
Start 77: testcorenrn_vecplay::coreneuron_cpu_offline
52/115 Test #105: channel_benchmark_hippo::coreneuron_gpu_online .....................***Failed 89.09 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./cacummb.mod" "./cacumm.mod" "./CaDynamics_DC0.mod" "./CaDynamics_E2.mod" "./cagk.mod" "./Ca_HVA2.mod" "./Ca_HVA.mod" "./cal2.mod" "./Ca_LVAst.mod" "./Ca.mod" "./can2.mod" "./cat.mod" "./CoreConfig.mod" "./gap.mod" "./halfgap.mod" "./h.mod" "./Ih.mod" "./Im.mod" "./kadist.mod" "./kaprox.mod" "./kca.mod" "./kd2.mod" "./kdb.mod" "./kd.mod" "./kdrbca1.mod" "./kdrca1.mod" "./KdShu2007.mod" "./kmb.mod" "./km.mod" "./K_Pst.mod" "./K_Tst.mod" "./na3n.mod" "./Nap_Et2.mod" "./NaTa_t.mod" "./NaTg.mod" "./NaTs2_t.mod" "./naxn.mod" "./netstim_inhpoisson.mod" "./new_calcium_channels.mod" "./ProbAMPANMDA_EMS.mod" "./ProbGABAAB_EMS.mod" "./ProfileHelper.mod" "./SK_E2.mod" "./SKv3_1.mod" "./TTXDynamicsSwitch.mod" "./VecStim.mod"
arg_tstop 10
arg_target_count 6
arg_model hippo
arg_coreneuron 1
arg_coreneuron_gpu 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_datapath benchmark/channels
arg_prcell_gid -1
1
Loading 6 templates
Instatiated 0 cell of type 0
Instatiated 1 cell of type 1
Instatiated 2 cell of type 2
Instatiated 3 cell of type 3
Instatiated 4 cell of type 4
Instatiated 5 cell of type 5
done cells
add report
Starting Simulation
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 29973, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special, Rank 0, Process 29973: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_hippo/coreneuron_gpu_online
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.37
Start 108: channel_benchmark_hippo::coreneuron_cpu_filemode
53/115 Test #106: channel_benchmark_hippo::coreneuron_gpu_filemode ...................***Failed 89.78 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./cacummb.mod" "./cacumm.mod" "./CaDynamics_DC0.mod" "./CaDynamics_E2.mod" "./cagk.mod" "./Ca_HVA2.mod" "./Ca_HVA.mod" "./cal2.mod" "./Ca_LVAst.mod" "./Ca.mod" "./can2.mod" "./cat.mod" "./CoreConfig.mod" "./gap.mod" "./halfgap.mod" "./h.mod" "./Ih.mod" "./Im.mod" "./kadist.mod" "./kaprox.mod" "./kca.mod" "./kd2.mod" "./kdb.mod" "./kd.mod" "./kdrbca1.mod" "./kdrca1.mod" "./KdShu2007.mod" "./kmb.mod" "./km.mod" "./K_Pst.mod" "./K_Tst.mod" "./na3n.mod" "./Nap_Et2.mod" "./NaTa_t.mod" "./NaTg.mod" "./NaTs2_t.mod" "./naxn.mod" "./netstim_inhpoisson.mod" "./new_calcium_channels.mod" "./ProbAMPANMDA_EMS.mod" "./ProbGABAAB_EMS.mod" "./ProfileHelper.mod" "./SK_E2.mod" "./SKv3_1.mod" "./TTXDynamicsSwitch.mod" "./VecStim.mod"
arg_tstop 10
arg_target_count 6
arg_model hippo
arg_coreneuron 1
arg_coreneuron_gpu 1
arg_coreneuron_filemode 1
arg_dump_coreneuron_model 0
arg_datapath benchmark/channels
arg_prcell_gid -1
1
Loading 6 templates
Instatiated 0 cell of type 0
Instatiated 1 cell of type 1
Instatiated 2 cell of type 2
Instatiated 3 cell of type 3
Instatiated 4 cell of type 4
Instatiated 5 cell of type 5
done cells
add report
Starting CoreNEURON data generation
Starting Simulation
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 30014, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special, Rank 0, Process 30014: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_hippo/coreneuron_gpu_filemode
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.38
Start 110: channel_benchmark_sscx::neuron
54/115 Test #76: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........***Failed 8.44 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
1
1
0
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 31049, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 1, Process 31049: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecplay/coreneuron_cpu_online_psolve_alternate
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.58
slurmstepd: error: *** STEP 2780937.58 ON r2i3n6 CANCELLED AT 2021-10-13T19:30:02 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.58
Start 90: testcorenrn_watch::neuron
55/115 Test #104: channel_benchmark_hippo::neuron .................................... Passed 91.43 sec
Start 111: channel_benchmark_sscx::coreneuron_gpu_online
56/115 Test #107: channel_benchmark_hippo::coreneuron_cpu_online .....................***Failed 89.36 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./cacummb.mod" "./cacumm.mod" "./CaDynamics_DC0.mod" "./CaDynamics_E2.mod" "./cagk.mod" "./Ca_HVA2.mod" "./Ca_HVA.mod" "./cal2.mod" "./Ca_LVAst.mod" "./Ca.mod" "./can2.mod" "./cat.mod" "./CoreConfig.mod" "./gap.mod" "./halfgap.mod" "./h.mod" "./Ih.mod" "./Im.mod" "./kadist.mod" "./kaprox.mod" "./kca.mod" "./kd2.mod" "./kdb.mod" "./kd.mod" "./kdrbca1.mod" "./kdrca1.mod" "./KdShu2007.mod" "./kmb.mod" "./km.mod" "./K_Pst.mod" "./K_Tst.mod" "./na3n.mod" "./Nap_Et2.mod" "./NaTa_t.mod" "./NaTg.mod" "./NaTs2_t.mod" "./naxn.mod" "./netstim_inhpoisson.mod" "./new_calcium_channels.mod" "./ProbAMPANMDA_EMS.mod" "./ProbGABAAB_EMS.mod" "./ProfileHelper.mod" "./SK_E2.mod" "./SKv3_1.mod" "./TTXDynamicsSwitch.mod" "./VecStim.mod"
arg_tstop 10
arg_target_count 6
arg_model hippo
arg_coreneuron 1
arg_coreneuron_gpu 0
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_datapath benchmark/channels
arg_prcell_gid -1
1
Loading 6 templates
Instatiated 0 cell of type 0
Instatiated 1 cell of type 1
Instatiated 2 cell of type 2
Instatiated 3 cell of type 3
Instatiated 4 cell of type 4
Instatiated 5 cell of type 5
done cells
add report
Starting Simulation
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 10 UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 10 UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 30078, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special, Rank 0, Process 30078: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_hippo/coreneuron_cpu_online
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.40
Start 112: channel_benchmark_sscx::coreneuron_gpu_filemode
57/115 Test #77: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 4.42 sec
Start 91: testcorenrn_watch::coreneuron_gpu_online
58/115 Test #90: testcorenrn_watch::neuron .......................................... Passed 3.01 sec
Start 92: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
59/115 Test #92: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate ..........***Failed 45.94 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
10
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
CLI parsing error, see nrniv-core --help for more information.
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 31486, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 31486: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_watch/coreneuron_gpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.66
slurmstepd: error: *** STEP 2780937.66 ON r2i3n6 CANCELLED AT 2021-10-13T19:30:51 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.66
Start 93: testcorenrn_watch::coreneuron_gpu_offline
60/115 Test #93: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 16.10 sec
Start 95: testcorenrn_watch::coreneuron_cpu_online
61/115 Test #95: testcorenrn_watch::coreneuron_cpu_online ...........................***Failed 5.80 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 31617, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 1, Process 31617: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_watch/coreneuron_cpu_online
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.68
slurmstepd: error: *** STEP 2780937.68 ON r2i3n6 CANCELLED AT 2021-10-13T19:31:13 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.68
Start 96: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
62/115 Test #111: channel_benchmark_sscx::coreneuron_gpu_online ......................***Failed 77.06 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./cacummb.mod" "./cacumm.mod" "./CaDynamics_DC0.mod" "./CaDynamics_E2.mod" "./cagk.mod" "./Ca_HVA2.mod" "./Ca_HVA.mod" "./cal2.mod" "./Ca_LVAst.mod" "./Ca.mod" "./can2.mod" "./cat.mod" "./CoreConfig.mod" "./gap.mod" "./halfgap.mod" "./h.mod" "./Ih.mod" "./Im.mod" "./kadist.mod" "./kaprox.mod" "./kca.mod" "./kd2.mod" "./kdb.mod" "./kd.mod" "./kdrbca1.mod" "./kdrca1.mod" "./KdShu2007.mod" "./kmb.mod" "./km.mod" "./K_Pst.mod" "./K_Tst.mod" "./na3n.mod" "./Nap_Et2.mod" "./NaTa_t.mod" "./NaTg.mod" "./NaTs2_t.mod" "./naxn.mod" "./netstim_inhpoisson.mod" "./new_calcium_channels.mod" "./ProbAMPANMDA_EMS.mod" "./ProbGABAAB_EMS.mod" "./ProfileHelper.mod" "./SK_E2.mod" "./SKv3_1.mod" "./TTXDynamicsSwitch.mod" "./VecStim.mod"
arg_tstop 10
arg_target_count 16
arg_model sscx
arg_coreneuron 1
arg_coreneuron_gpu 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_datapath benchmark/channels
arg_prcell_gid -1
1
Loading 16 templates
Instatiated 0 cell of type 0
Instatiated 1 cell of type 1
Instatiated 2 cell of type 2
Instatiated 3 cell of type 3
Instatiated 4 cell of type 4
Instatiated 5 cell of type 5
Instatiated 6 cell of type 6
Instatiated 7 cell of type 7
Instatiated 8 cell of type 8
Instatiated 9 cell of type 9
Instatiated 10 cell of type 10
Instatiated 11 cell of type 11
Instatiated 12 cell of type 12
Instatiated 13 cell of type 13
Instatiated 14 cell of type 14
Instatiated 15 cell of type 15
done cells
add report
Starting Simulation
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 31312, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special, Rank 0, Process 31312: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_sscx/coreneuron_gpu_online
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.63
Start 113: channel_benchmark_sscx::coreneuron_cpu_online
63/115 Test #112: channel_benchmark_sscx::coreneuron_gpu_filemode ....................***Failed 77.57 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./cacummb.mod" "./cacumm.mod" "./CaDynamics_DC0.mod" "./CaDynamics_E2.mod" "./cagk.mod" "./Ca_HVA2.mod" "./Ca_HVA.mod" "./cal2.mod" "./Ca_LVAst.mod" "./Ca.mod" "./can2.mod" "./cat.mod" "./CoreConfig.mod" "./gap.mod" "./halfgap.mod" "./h.mod" "./Ih.mod" "./Im.mod" "./kadist.mod" "./kaprox.mod" "./kca.mod" "./kd2.mod" "./kdb.mod" "./kd.mod" "./kdrbca1.mod" "./kdrca1.mod" "./KdShu2007.mod" "./kmb.mod" "./km.mod" "./K_Pst.mod" "./K_Tst.mod" "./na3n.mod" "./Nap_Et2.mod" "./NaTa_t.mod" "./NaTg.mod" "./NaTs2_t.mod" "./naxn.mod" "./netstim_inhpoisson.mod" "./new_calcium_channels.mod" "./ProbAMPANMDA_EMS.mod" "./ProbGABAAB_EMS.mod" "./ProfileHelper.mod" "./SK_E2.mod" "./SKv3_1.mod" "./TTXDynamicsSwitch.mod" "./VecStim.mod"
arg_tstop 10
arg_target_count 16
arg_model sscx
arg_coreneuron 1
arg_coreneuron_gpu 1
arg_coreneuron_filemode 1
arg_dump_coreneuron_model 0
arg_datapath benchmark/channels
arg_prcell_gid -1
1
Loading 16 templates
Instatiated 0 cell of type 0
Instatiated 1 cell of type 1
Instatiated 2 cell of type 2
Instatiated 3 cell of type 3
Instatiated 4 cell of type 4
Instatiated 5 cell of type 5
Instatiated 6 cell of type 6
Instatiated 7 cell of type 7
Instatiated 8 cell of type 8
Instatiated 9 cell of type 9
Instatiated 10 cell of type 10
Instatiated 11 cell of type 11
Instatiated 12 cell of type 12
Instatiated 13 cell of type 13
Instatiated 14 cell of type 14
Instatiated 15 cell of type 15
done cells
add report
Starting CoreNEURON data generation
Starting Simulation
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 31353, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special, Rank 0, Process 31353: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_sscx/coreneuron_gpu_filemode
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.64
Start 114: channel_benchmark_sscx::coreneuron_cpu_filemode
64/115 Test #108: channel_benchmark_hippo::coreneuron_cpu_filemode ...................***Failed 79.55 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./cacummb.mod" "./cacumm.mod" "./CaDynamics_DC0.mod" "./CaDynamics_E2.mod" "./cagk.mod" "./Ca_HVA2.mod" "./Ca_HVA.mod" "./cal2.mod" "./Ca_LVAst.mod" "./Ca.mod" "./can2.mod" "./cat.mod" "./CoreConfig.mod" "./gap.mod" "./halfgap.mod" "./h.mod" "./Ih.mod" "./Im.mod" "./kadist.mod" "./kaprox.mod" "./kca.mod" "./kd2.mod" "./kdb.mod" "./kd.mod" "./kdrbca1.mod" "./kdrca1.mod" "./KdShu2007.mod" "./kmb.mod" "./km.mod" "./K_Pst.mod" "./K_Tst.mod" "./na3n.mod" "./Nap_Et2.mod" "./NaTa_t.mod" "./NaTg.mod" "./NaTs2_t.mod" "./naxn.mod" "./netstim_inhpoisson.mod" "./new_calcium_channels.mod" "./ProbAMPANMDA_EMS.mod" "./ProbGABAAB_EMS.mod" "./ProfileHelper.mod" "./SK_E2.mod" "./SKv3_1.mod" "./TTXDynamicsSwitch.mod" "./VecStim.mod"
arg_tstop 10
arg_target_count 6
arg_model hippo
arg_coreneuron 1
arg_coreneuron_gpu 0
arg_coreneuron_filemode 1
arg_dump_coreneuron_model 0
arg_datapath benchmark/channels
arg_prcell_gid -1
1
Loading 6 templates
Instatiated 0 cell of type 0
Instatiated 1 cell of type 1
Instatiated 2 cell of type 2
Instatiated 3 cell of type 3
Instatiated 4 cell of type 4
Instatiated 5 cell of type 5
done cells
add report
Starting CoreNEURON data generation
Starting Simulation
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 10 UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 10 UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 31204, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special, Rank 0, Process 31204: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_hippo/coreneuron_cpu_filemode
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.60
Start 1: testneuron
65/115 Test #96: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate ..........***Failed 7.42 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 31671, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 31671: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_watch/coreneuron_cpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.69
slurmstepd: error: *** STEP 2780937.69 ON r2i3n6 CANCELLED AT 2021-10-13T19:31:20 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.69
Start 97: testcorenrn_watch::coreneuron_cpu_offline
66/115 Test #1: testneuron ......................................................... Passed 0.07 sec
Start 2: ringtest
67/115 Test #2: ringtest ........................................................... Passed 0.33 sec
Start 3: connect_dend
68/115 Test #3: connect_dend ....................................................... Passed 0.18 sec
Start 4: pynrn_tests::basic_tests
69/115 Test #110: channel_benchmark_sscx::neuron ..................................... Passed 79.16 sec
Start 5: rxdmod_tests::rxd_tests
70/115 Test #97: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 4.28 sec
Start 100: testcorenrn_netstimdirect::direct_netstimdirect
71/115 Test #100: testcorenrn_netstimdirect::direct_netstimdirect ....................***Failed 5.98 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 0
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
psolve time 0.04
Vector[5]
Vector[6]
Vector[5]
Vector[6]
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 31915, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 1, Process 31915: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_netstimdirect/direct_netstimdirect
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.73
slurmstepd: error: *** STEP 2780937.73 ON r2i3n6 CANCELLED AT 2021-10-13T19:31:30 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.73
Start 101: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
72/115 Test #101: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ...***Failed 7.94 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 0
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
10
psolve time 0.04
Vector[5]
Vector[5]
Vector[6]
Vector[6]
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32093, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 32093: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_netstimdirect/direct_netstimdirect_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.74
slurmstepd: error: *** STEP 2780937.74 ON r2i3n6 CANCELLED AT 2021-10-13T19:31:39 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.74
Start 6: rxdmod_tests::rxd_mpi_tests
Start 7: parallel_tests
73/115 Test #113: channel_benchmark_sscx::coreneuron_cpu_online ......................***Failed 42.54 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./cacummb.mod" "./cacumm.mod" "./CaDynamics_DC0.mod" "./CaDynamics_E2.mod" "./cagk.mod" "./Ca_HVA2.mod" "./Ca_HVA.mod" "./cal2.mod" "./Ca_LVAst.mod" "./Ca.mod" "./can2.mod" "./cat.mod" "./CoreConfig.mod" "./gap.mod" "./halfgap.mod" "./h.mod" "./Ih.mod" "./Im.mod" "./kadist.mod" "./kaprox.mod" "./kca.mod" "./kd2.mod" "./kdb.mod" "./kd.mod" "./kdrbca1.mod" "./kdrca1.mod" "./KdShu2007.mod" "./kmb.mod" "./km.mod" "./K_Pst.mod" "./K_Tst.mod" "./na3n.mod" "./Nap_Et2.mod" "./NaTa_t.mod" "./NaTg.mod" "./NaTs2_t.mod" "./naxn.mod" "./netstim_inhpoisson.mod" "./new_calcium_channels.mod" "./ProbAMPANMDA_EMS.mod" "./ProbGABAAB_EMS.mod" "./ProfileHelper.mod" "./SK_E2.mod" "./SKv3_1.mod" "./TTXDynamicsSwitch.mod" "./VecStim.mod"
arg_tstop 10
arg_target_count 16
arg_model sscx
arg_coreneuron 1
arg_coreneuron_gpu 0
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_datapath benchmark/channels
arg_prcell_gid -1
1
Loading 16 templates
Instatiated 0 cell of type 0
Instatiated 1 cell of type 1
Instatiated 2 cell of type 2
Instatiated 3 cell of type 3
Instatiated 4 cell of type 4
Instatiated 5 cell of type 5
Instatiated 6 cell of type 6
Instatiated 7 cell of type 7
Instatiated 8 cell of type 8
Instatiated 9 cell of type 9
Instatiated 10 cell of type 10
Instatiated 11 cell of type 11
Instatiated 12 cell of type 12
Instatiated 13 cell of type 13
Instatiated 14 cell of type 14
Instatiated 15 cell of type 15
done cells
add report
Starting Simulation
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 10 UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 10 UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 31766, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special, Rank 0, Process 31766: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_sscx/coreneuron_cpu_online
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.70
Start 8: parallel_partrans
74/115 Test #4: pynrn_tests::basic_tests ........................................... Passed 41.49 sec
Start 9: parallel_bas
75/115 Test #114: channel_benchmark_sscx::coreneuron_cpu_filemode ....................***Failed 43.08 sec
numprocs=1
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./cacummb.mod" "./cacumm.mod" "./CaDynamics_DC0.mod" "./CaDynamics_E2.mod" "./cagk.mod" "./Ca_HVA2.mod" "./Ca_HVA.mod" "./cal2.mod" "./Ca_LVAst.mod" "./Ca.mod" "./can2.mod" "./cat.mod" "./CoreConfig.mod" "./gap.mod" "./halfgap.mod" "./h.mod" "./Ih.mod" "./Im.mod" "./kadist.mod" "./kaprox.mod" "./kca.mod" "./kd2.mod" "./kdb.mod" "./kd.mod" "./kdrbca1.mod" "./kdrca1.mod" "./KdShu2007.mod" "./kmb.mod" "./km.mod" "./K_Pst.mod" "./K_Tst.mod" "./na3n.mod" "./Nap_Et2.mod" "./NaTa_t.mod" "./NaTg.mod" "./NaTs2_t.mod" "./naxn.mod" "./netstim_inhpoisson.mod" "./new_calcium_channels.mod" "./ProbAMPANMDA_EMS.mod" "./ProbGABAAB_EMS.mod" "./ProfileHelper.mod" "./SK_E2.mod" "./SKv3_1.mod" "./TTXDynamicsSwitch.mod" "./VecStim.mod"
arg_tstop 10
arg_target_count 16
arg_model sscx
arg_coreneuron 1
arg_coreneuron_gpu 0
arg_coreneuron_filemode 1
arg_dump_coreneuron_model 0
arg_datapath benchmark/channels
arg_prcell_gid -1
1
Loading 16 templates
Instatiated 0 cell of type 0
Instatiated 1 cell of type 1
Instatiated 2 cell of type 2
Instatiated 3 cell of type 3
Instatiated 4 cell of type 4
Instatiated 5 cell of type 5
Instatiated 6 cell of type 6
Instatiated 7 cell of type 7
Instatiated 8 cell of type 8
Instatiated 9 cell of type 9
Instatiated 10 cell of type 10
Instatiated 11 cell of type 11
Instatiated 12 cell of type 12
Instatiated 13 cell of type 13
Instatiated 14 cell of type 14
Instatiated 15 cell of type 15
done cells
add report
Starting CoreNEURON data generation
Starting Simulation
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 10 UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 10 UH��AWAVATSH��M��M�lj�L�%Bb�A�$H�:b���H�{���8��H�W���
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 31803, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/90ea78c38c7a4aacdb78ced8468c4c6dfd59890c8fe3ca5775c9632385aa661b/x86_64/special, Rank 0, Process 31803: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_sscx/coreneuron_cpu_filemode
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.71
Start 10: coreneuron_modtests::direct_py
76/115 Test #8: parallel_partrans .................................................. Passed 2.76 sec
Start 11: coreneuron_modtests::direct_hoc
77/115 Test #10: coreneuron_modtests::direct_py .....................................***Failed 4.47 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32430, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32430: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/direct_py
Child aborted
Start 12: coreneuron_modtests::spikes_py
78/115 Test #11: coreneuron_modtests::direct_hoc ....................................***Failed 4.05 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
nrncore_arg: | --gpu --tstop 5 --cell-permute 1 --verbose 2 --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32462, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32462: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/direct_hoc
Child aborted
Start 13: coreneuron_modtests::spikes_file_mode_py
79/115 Test #12: coreneuron_modtests::spikes_py .....................................***Failed 4.44 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32721, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32721: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/spikes_py
Child aborted
Start 14: coreneuron_modtests::fast_imem_py
80/115 Test #14: coreneuron_modtests::fast_imem_py .................................. Passed 0.98 sec
Start 15: coreneuron_modtests::datareturn_py
81/115 Test #13: coreneuron_modtests::spikes_file_mode_py ...........................***Failed 4.91 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32732, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32732: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/spikes_file_mode_py
Child aborted
Start 16: coreneuron_modtests::test_units_py
82/115 Test #16: coreneuron_modtests::test_units_py .................................***Failed 4.24 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32798, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32798: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/test_units_py
Child aborted
Start 17: coreneuron_modtests::test_netmove_py
83/115 Test #15: coreneuron_modtests::datareturn_py .................................***Failed 4.79 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32795, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32795: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/datareturn_py
Child aborted
Start 18: coreneuron_modtests::test_watchrange_py
84/115 Test #17: coreneuron_modtests::test_netmove_py ...............................***Failed 5.11 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32855, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32855: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/test_netmove_py
Child aborted
Start 19: coreneuron_modtests::test_psolve_py
85/115 Test #18: coreneuron_modtests::test_watchrange_py ............................***Failed 5.17 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32857, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32857: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/test_watchrange_py
Child aborted
Start 20: coreneuron_modtests::test_natrans_py
86/115 Test #20: coreneuron_modtests::test_natrans_py ...............................***Failed 4.37 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 0.1 UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 0.1 UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32910, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32910: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/test_natrans_py
Child aborted
Start 33: external_ringtest::compare_results
87/115 Test #33: external_ringtest::compare_results .................................***Failed 0.07 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/external_ringtest/coreneuron_cpu_mpi/spk2.std'
Start 43: testcorenrn_bbcore::compare_results
88/115 Test #43: testcorenrn_bbcore::compare_results ................................***Failed 0.07 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_bbcore/coreneuron_gpu_online/outbbcore.dat'
Start 53: testcorenrn_deriv::compare_results
89/115 Test #53: testcorenrn_deriv::compare_results .................................***Failed 0.07 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_deriv/coreneuron_gpu_online/outderiv.dat'
Start 63: testcorenrn_gf::compare_results
90/115 Test #63: testcorenrn_gf::compare_results ....................................***Failed 0.07 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_gf/coreneuron_gpu_online/outgf.dat'
Start 69: testcorenrn_patstim::compare_results
91/115 Test #69: testcorenrn_patstim::compare_results ............................... Passed 0.07 sec
Start 79: testcorenrn_vecplay::compare_results
92/115 Test #79: testcorenrn_vecplay::compare_results ...............................***Failed 0.07 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecplay/coreneuron_gpu_online/outvecplay.dat'
Start 102: testcorenrn_netstimdirect::compare_results
93/115 Test #102: testcorenrn_netstimdirect::compare_results .........................***Failed 0.07 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_netstimdirect/direct_netstimdirect/outnetstimdirect.dat'
Start 103: external_nrntest
94/115 Test #19: coreneuron_modtests::test_psolve_py ................................***Failed 5.20 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=1
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 32908, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 32908: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/test_psolve_py
Child aborted
Start 109: channel_benchmark_hippo::compare_results
95/115 Test #109: channel_benchmark_hippo::compare_results ...........................***Failed 0.09 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_hippo/coreneuron_gpu_online/out.dat'
Start 115: channel_benchmark_sscx::compare_results
96/115 Test #115: channel_benchmark_sscx::compare_results ............................***Failed 0.10 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/channel_benchmark_sscx/coreneuron_gpu_online/out.dat'
97/115 Test #9: parallel_bas ....................................................... Passed 246.39 sec
Start 21: coreneuron_modtests::spikes_mpi_py
98/115 Test #21: coreneuron_modtests::spikes_mpi_py .................................***Failed 6.52 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 34118, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 0, Process 34118: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/spikes_mpi_py
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.79
slurmstepd: error: *** STEP 2780937.79 ON r2i3n6 CANCELLED AT 2021-10-13T19:36:15 ***
srun: error: r2i3n6: task 1: Terminated
srun: Force Terminated job step 2780937.79
Start 22: coreneuron_modtests::spikes_mpi_file_mode_py
99/115 Test #22: coreneuron_modtests::spikes_mpi_file_mode_py .......................***Failed 6.91 sec
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./fornetcon.mod" "./invlfire.mod" "./natrans.mod" "./netmove.mod" "./sample.mod" "./unitstest.mod" "./watchrange.mod"
numprocs=2
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 34207, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%�Ъ
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/87e0f023d96a2fc751fdbc002b2c7723a84d67c26eba3f5f75ecc66f9e6c7d24/x86_64/special, Rank 1, Process 34207: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/coreneuron_modtests/spikes_mpi_file_mode_py
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.80
slurmstepd: error: *** STEP 2780937.80 ON r2i3n6 CANCELLED AT 2021-10-13T19:36:22 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.80
100/115 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 325.41 sec
101/115 Test #91: testcorenrn_watch::coreneuron_gpu_online ...........................***Failed 547.11 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 1(g:1) received signal SIGABRT/SIGIOT(6).
Process ID: 31385, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 1, Process 31385: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_watch/coreneuron_gpu_online
srun: error: r2i3n6: task 1: Aborted (core dumped)
srun: Terminating job step 2780937.65
slurmstepd: error: *** STEP 2780937.65 ON r2i3n6 CANCELLED AT 2021-10-13T19:39:09 ***
srun: error: r2i3n6: task 0: Terminated
srun: Force Terminated job step 2780937.65
Start 84: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
Start 99: testcorenrn_watch::compare_results
102/115 Test #99: testcorenrn_watch::compare_results .................................***Failed 0.14 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_watch/coreneuron_gpu_online/outwatch.dat'
103/115 Test #84: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 52.02 sec
Start 88: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
104/115 Test #88: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 3.56 sec
Start 80: testcorenrn_vecevent::neuron
105/115 Test #80: testcorenrn_vecevent::neuron ....................................... Passed 3.74 sec
Start 81: testcorenrn_vecevent::coreneuron_gpu_online
106/115 Test #81: testcorenrn_vecevent::coreneuron_gpu_online ........................***Failed 9.26 sec
numprocs=4
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
1
1
0
1
10
10
10
10
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 3(g:3) received signal SIGABRT/SIGIOT(6).
Process ID: 35241, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 3, Process 35241: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecevent/coreneuron_gpu_online
srun: error: r2i3n6: task 3: Aborted (core dumped)
srun: Terminating job step 2780937.87
slurmstepd: error: *** STEP 2780937.87 ON r2i3n6 CANCELLED AT 2021-10-13T19:40:18 ***
srun: error: r2i3n6: tasks 0-2: Terminated
srun: Force Terminated job step 2780937.87
Start 82: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
107/115 Test #82: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate .......***Failed 9.90 sec
numprocs=4
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 1
arg_pattern
arg_psolve_test_mode 3
1
1
1
1
0
1
0
1
10
10
10
10
nrncore_arg: | --gpu --tstop 100 --cell-permute 1 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 2(g:2) received signal SIGABRT/SIGIOT(6).
Process ID: 35306, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
CLI parsing error, see nrniv-core --help for more information.
The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following argument was not expected: UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 2, Process 35306: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecevent/coreneuron_gpu_online_psolve_alternate
srun: error: r2i3n6: task 2: Aborted (core dumped)
srun: Terminating job step 2780937.88
slurmstepd: error: *** STEP 2780937.88 ON r2i3n6 CANCELLED AT 2021-10-13T19:40:28 ***
srun: error: r2i3n6: tasks 0-1,3: Terminated
srun: Force Terminated job step 2780937.88
Start 83: testcorenrn_vecevent::coreneuron_gpu_offline
108/115 Test #83: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 90.76 sec
Start 85: testcorenrn_vecevent::coreneuron_cpu_online
109/115 Test #85: testcorenrn_vecevent::coreneuron_cpu_online ........................***Failed 9.26 sec
numprocs=4
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
1
1
0
1
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
10
10
10
10
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 3(g:3) received signal SIGABRT/SIGIOT(6).
Process ID: 35590, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 100 UH��AWAVATSH��M��M�lj�L�%"��
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 3, Process 35590: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecevent/coreneuron_cpu_online
srun: error: r2i3n6: task 3: Aborted (core dumped)
srun: Terminating job step 2780937.90
slurmstepd: error: *** STEP 2780937.90 ON r2i3n6 CANCELLED AT 2021-10-13T19:42:08 ***
srun: error: r2i3n6: tasks 0-1: Terminated
srun: error: r2i3n6: task 2: Terminated
srun: Force Terminated job step 2780937.90
Start 86: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
110/115 Test #86: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate .......***Failed 9.63 sec
numprocs=4
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
1
1
0
1
0
1
10
10
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT ERROR: Rank 0(g:0) received signal SIGABRT/SIGIOT(6).
Process ID: 35650, Host: r2i3n6, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
CLI parsing error, see nrniv-core --help for more information.
The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
Run with --help for more information.
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
terminate called after throwing an instance of 'CLI::ExtrasError'
what(): The following arguments were not expected: 1 UH��AWAVATSH��M��M�lj�L�%"��
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i3n6, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/nrnivmodl/84d22880dc943e3350fad1c781b03bdf5ce76d9b58479e17de3fe6a470f81e00/x86_64/special, Rank 0, Process 35650: Dumping core on signal SIGABRT/SIGIOT(6) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecevent/coreneuron_cpu_online_psolve_alternate
srun: error: r2i3n6: task 0: Aborted (core dumped)
srun: Terminating job step 2780937.91
slurmstepd: error: *** STEP 2780937.91 ON r2i3n6 CANCELLED AT 2021-10-13T19:42:18 ***
srun: error: r2i3n6: tasks 1-3: Terminated
srun: Force Terminated job step 2780937.91
Start 87: testcorenrn_vecevent::coreneuron_cpu_offline
111/115 Test #87: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 18.67 sec
Start 89: testcorenrn_vecevent::compare_results
112/115 Test #89: testcorenrn_vecevent::compare_results ..............................***Failed 0.08 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72589/spack-build/spack-stage-neuron-develop-o6xo3erzdudo5r5hse7yyvqm2vvvwzqt/spack-build-o6xo3er/test/testcorenrn_vecevent/coreneuron_gpu_online/outvecevent.dat'
113/115 Test #5: rxdmod_tests::rxd_tests ............................................***Timeout 1500.09 sec
114/115 Test #7: parallel_tests .....................................................***Timeout 1500.06 sec
numprocs=6
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
115/115 Test #103: external_nrntest ................................................... Passed 1465.43 sec
44% tests passed, 64 tests failed out of 115
Total Test time (real) = 1718.57 sec
The following tests FAILED:
5 - rxdmod_tests::rxd_tests (Timeout)
7 - parallel_tests (Timeout)
10 - coreneuron_modtests::direct_py (Failed)
11 - coreneuron_modtests::direct_hoc (Failed)
12 - coreneuron_modtests::spikes_py (Failed)
13 - coreneuron_modtests::spikes_file_mode_py (Failed)
15 - coreneuron_modtests::datareturn_py (Failed)
16 - coreneuron_modtests::test_units_py (Failed)
17 - coreneuron_modtests::test_netmove_py (Failed)
18 - coreneuron_modtests::test_watchrange_py (Failed)
19 - coreneuron_modtests::test_psolve_py (Failed)
20 - coreneuron_modtests::test_natrans_py (Failed)
21 - coreneuron_modtests::spikes_mpi_py (Failed)
22 - coreneuron_modtests::spikes_mpi_file_mode_py (Failed)
25 - external_ringtest::coreneuron_cpu_mpi (Failed)
27 - external_ringtest::coreneuron_cpu_mpi_offline::preparation (Failed)
28 - external_ringtest::coreneuron_cpu_mpi_threads (Failed)
29 - external_ringtest::coreneuron_gpu_mpi (Failed)
31 - external_ringtest::coreneuron_gpu_mpi_offline::preparation (Failed)
32 - external_ringtest::coreneuron_gpu_mpi_threads (Failed)
33 - external_ringtest::compare_results (Failed)
35 - testcorenrn_bbcore::coreneuron_gpu_online (Failed)
36 - testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate (Failed)
39 - testcorenrn_bbcore::coreneuron_cpu_online (Failed)
40 - testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate (Failed)
43 - testcorenrn_bbcore::compare_results (Failed)
45 - testcorenrn_deriv::coreneuron_gpu_online (Failed)
46 - testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate (Failed)
49 - testcorenrn_deriv::coreneuron_cpu_online (Failed)
50 - testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate (Failed)
53 - testcorenrn_deriv::compare_results (Failed)
55 - testcorenrn_gf::coreneuron_gpu_online (Failed)
56 - testcorenrn_gf::coreneuron_gpu_online_psolve_alternate (Failed)
59 - testcorenrn_gf::coreneuron_cpu_online (Failed)
60 - testcorenrn_gf::coreneuron_cpu_online_psolve_alternate (Failed)
63 - testcorenrn_gf::compare_results (Failed)
71 - testcorenrn_vecplay::coreneuron_gpu_online (Failed)
72 - testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate (Failed)
75 - testcorenrn_vecplay::coreneuron_cpu_online (Failed)
76 - testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate (Failed)
79 - testcorenrn_vecplay::compare_results (Failed)
81 - testcorenrn_vecevent::coreneuron_gpu_online (Failed)
82 - testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate (Failed)
85 - testcorenrn_vecevent::coreneuron_cpu_online (Failed)
86 - testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate (Failed)
89 - testcorenrn_vecevent::compare_results (Failed)
91 - testcorenrn_watch::coreneuron_gpu_online (Failed)
92 - testcorenrn_watch::coreneuron_gpu_online_psolve_alternate (Failed)
95 - testcorenrn_watch::coreneuron_cpu_online (Failed)
96 - testcorenrn_watch::coreneuron_cpu_online_psolve_alternate (Failed)
99 - testcorenrn_watch::compare_results (Failed)
100 - testcorenrn_netstimdirect::direct_netstimdirect (Failed)
101 - testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate (Failed)
102 - testcorenrn_netstimdirect::compare_results (Failed)
105 - channel_benchmark_hippo::coreneuron_gpu_online (Failed)
106 - channel_benchmark_hippo::coreneuron_gpu_filemode (Failed)
107 - channel_benchmark_hippo::coreneuron_cpu_online (Failed)
108 - channel_benchmark_hippo::coreneuron_cpu_filemode (Failed)
109 - channel_benchmark_hippo::compare_results (Failed)
111 - channel_benchmark_sscx::coreneuron_gpu_online (Failed)
112 - channel_benchmark_sscx::coreneuron_gpu_filemode (Failed)
113 - channel_benchmark_sscx::coreneuron_cpu_online (Failed)
114 - channel_benchmark_sscx::coreneuron_cpu_filemode (Failed)
115 - channel_benchmark_sscx::compare_results (Failed)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: r2i3n6: task 0: Exited with exit code 1
section_end:1634147815:step_script section_start:1634147815:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=37823 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=72593 responseStatus=201 Created token=bc9cEzFt
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=37855 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=72593 responseStatus=201 Created token=bc9cEzFt
section_end:1634147816:upload_artifacts_on_failure section_start:1634147816:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634147816:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1634145081:resolve_secrets Resolving secrets
section_end:1634145081:resolve_secrets section_start:1634145081:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor005193967, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 19854, build ref 7187ac5842413a6e4f050105d40e1f35bad3fac2, job ID 72591
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P19854
A slurm job will be created with name GL_J72591_PROD_P112_CP1_C1
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job eligible for phase1 and phase2, setting partition=prod_p2,prod_p1
Submitted batch job 2780936
job state: R
section_end:1634145207:prepare_executor section_start:1634145207:prepare_script Preparing environment
Running on r2i2n34 via bbpv1.epfl.ch...
section_end:1634145209:prepare_script section_start:1634145209:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1634145210:get_sources section_start:1634145210:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron+nmodl:intel (72587)...
Runtime platform  arch=amd64 os=linux pid=57514 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=72587 responseStatus=200 OK token=ps8N-M3y
section_end:1634145211:download_artifacts section_start:1634145211:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r2i2n34
Build name: Linux-icpc
Create new tag: 20211013-1715 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs
Start 28: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 35: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 41: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 47: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 51: testcorenrn_patstim::coreneuron_cpu_offline::preparation
1/94 Test #35: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 14.51 sec
Start 75: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/94 Test #41: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 15.03 sec
Start 81: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/94 Test #47: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 16.62 sec
Start 57: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
4/94 Test #51: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 17.16 sec
Start 69: testcorenrn_watch::coreneuron_cpu_offline::preparation
5/94 Test #75: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 12.30 sec
Start 24: external_ringtest::neuron
6/94 Test #81: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 12.53 sec
Start 31: testcorenrn_bbcore::neuron
7/94 Test #28: external_ringtest::coreneuron_cpu_mpi_offline::preparation .........***Failed 29.15 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
MPT ERROR: Rank 1(g:1) received signal SIGSEGV(11).
Process ID: 58920, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 58920: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/external_ringtest/coreneuron_cpu_mpi_offline
srun: error: r2i2n34: task 1: Segmentation fault (core dumped)
srun: Terminating job step 2780936.5
slurmstepd: error: *** STEP 2780936.5 ON r2i2n34 CANCELLED AT 2021-10-13T19:16:27 ***
srun: error: r2i2n34: task 0: Terminated
srun: Force Terminated job step 2780936.5
Start 25: external_ringtest::neuron_mpi
8/94 Test #69: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 12.96 sec
Start 26: external_ringtest::coreneuron_cpu_mpi
9/94 Test #57: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 15.86 sec
Start 27: external_ringtest::coreneuron_cpu_mpi_offline
10/94 Test #31: testcorenrn_bbcore::neuron ......................................... Passed 11.39 sec
Start 32: testcorenrn_bbcore::coreneuron_cpu_online
11/94 Test #27: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 8.08 sec
Start 29: external_ringtest::coreneuron_cpu_mpi_threads
12/94 Test #24: external_ringtest::neuron .......................................... Passed 20.03 sec
Start 33: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
13/94 Test #25: external_ringtest::neuron_mpi ...................................... Passed 21.17 sec
Start 34: testcorenrn_bbcore::coreneuron_cpu_offline
Start 37: testcorenrn_deriv::neuron
14/94 Test #26: external_ringtest::coreneuron_cpu_mpi ..............................***Failed 23.48 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
MPT ERROR: Rank 1(g:1) received signal SIGSEGV(11).
Process ID: 59438, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 59438: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/external_ringtest/coreneuron_cpu_mpi
srun: error: r2i2n34: task 1: Segmentation fault (core dumped)
srun: Terminating job step 2780936.15
slurmstepd: error: *** STEP 2780936.15 ON r2i2n34 CANCELLED AT 2021-10-13T19:16:52 ***
srun: error: r2i2n34: task 0: Terminated
srun: Force Terminated job step 2780936.15
Start 38: testcorenrn_deriv::coreneuron_cpu_online
Start 39: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
15/94 Test #34: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 6.53 sec
Start 40: testcorenrn_deriv::coreneuron_cpu_offline
16/94 Test #32: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 18.06 sec
Start 71: testcorenrn_conc::neuron
17/94 Test #37: testcorenrn_deriv::neuron .......................................... Passed 16.64 sec
Start 72: testcorenrn_conc::coreneuron_cpu_online
18/94 Test #40: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 11.33 sec
Start 73: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
19/94 Test #33: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 21.64 sec
Start 74: testcorenrn_conc::coreneuron_cpu_offline
20/94 Test #29: external_ringtest::coreneuron_cpu_mpi_threads ......................***Failed 30.09 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./halfgap.mod"
[10, 20] [1, 1]
nring=16
cell per ring=8
ncell_per_type=8
ntype=16
MPT ERROR: Rank 1(g:1) received signal SIGSEGV(11).
Process ID: 59610, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/a1a0868ba5fbf062eadf987374a3bd5f993d19721f5aae5f9b4bbd05b13fa17d/x86_64/special, Rank 1, Process 59610: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/external_ringtest/coreneuron_cpu_mpi_threads
srun: error: r2i2n34: task 1: Segmentation fault (core dumped)
srun: Terminating job step 2780936.18
slurmstepd: error: *** STEP 2780936.18 ON r2i2n34 CANCELLED AT 2021-10-13T19:17:09 ***
srun: error: r2i2n34: task 0: Terminated
srun: Force Terminated job step 2780936.18
Start 43: testcorenrn_gf::neuron
21/94 Test #71: testcorenrn_conc::neuron ........................................... Passed 13.90 sec
Start 77: testcorenrn_kin::neuron
22/94 Test #39: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 17.74 sec
Start 78: testcorenrn_kin::coreneuron_cpu_online
23/94 Test #74: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 7.32 sec
Start 79: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
24/94 Test #38: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 22.37 sec
Start 80: testcorenrn_kin::coreneuron_cpu_offline
25/94 Test #77: testcorenrn_kin::neuron ............................................ Passed 10.61 sec
Start 87: channel_benchmark_hippo::neuron
26/94 Test #43: testcorenrn_gf::neuron ............................................. Passed 15.04 sec
Start 44: testcorenrn_gf::coreneuron_cpu_online
27/94 Test #72: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 18.81 sec
Start 88: channel_benchmark_hippo::coreneuron_cpu_online
28/94 Test #80: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 9.79 sec
Start 89: channel_benchmark_hippo::coreneuron_cpu_filemode
29/94 Test #73: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 18.67 sec
Start 91: channel_benchmark_sscx::neuron
30/94 Test #78: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 19.34 sec
Start 92: channel_benchmark_sscx::coreneuron_cpu_online
31/94 Test #79: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 16.19 sec
Start 93: channel_benchmark_sscx::coreneuron_cpu_filemode
32/94 Test #44: testcorenrn_gf::coreneuron_cpu_online ..............................***Failed 44.12 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
10
10
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testgf.hoc near line 48
1 prun("")
^
1 ParallelContext[0].psolve(100)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 60465, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testgf.hoc near line 48
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.37 ON r2i2n34 CANCELLED AT 2021-10-13T19:18:04 ***
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780936.37
srun: error: r2i2n34: task 1: Killed
Start 45: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
33/94 Test #87: channel_benchmark_hippo::neuron .................................... Passed 63.64 sec
Start 1: testneuron
34/94 Test #1: testneuron ......................................................... Passed 12.77 sec
Start 2: ringtest
35/94 Test #2: ringtest ........................................................... Passed 18.78 sec
Start 3: connect_dend
36/94 Test #3: connect_dend ....................................................... Passed 14.26 sec
Start 4: pynrn_tests::basic_tests
37/94 Test #88: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 105.76 sec
Start 5: rxdmod_tests::rxd_tests
38/94 Test #89: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 112.88 sec
Start 6: rxdmod_tests::rxd_mpi_tests
39/94 Test #91: channel_benchmark_sscx::neuron ..................................... Passed 120.12 sec
Start 7: parallel_tests
40/94 Test #92: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 122.37 sec
Start 8: parallel_partrans
41/94 Test #93: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 121.43 sec
Start 9: parallel_bas
42/94 Test #45: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate .............***Failed 90.75 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
1
1
0
1
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testgf.hoc near line 48
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 60867, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testgf.hoc near line 48
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.41 ON r2i2n34 CANCELLED AT 2021-10-13T19:19:39 ***
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780936.41
srun: error: r2i2n34: task 1: Killed
Start 46: testcorenrn_gf::coreneuron_cpu_offline
43/94 Test #46: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 11.96 sec
Start 49: testcorenrn_patstim::neuron
44/94 Test #8: parallel_partrans .................................................. Passed 26.93 sec
Start 10: coreneuron_modtests::direct_py
45/94 Test #7: parallel_tests ..................................................... Passed 45.59 sec
Start 11: coreneuron_modtests::direct_hoc
46/94 Test #49: testcorenrn_patstim::neuron ........................................ Passed 27.45 sec
Start 50: testcorenrn_patstim::coreneuron_cpu_offline
47/94 Test #11: coreneuron_modtests::direct_hoc .................................... Passed 9.50 sec
Start 12: coreneuron_modtests::spikes_py
48/94 Test #50: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 6.95 sec
Start 53: testcorenrn_vecplay::neuron
49/94 Test #10: coreneuron_modtests::direct_py .....................................***Failed 46.63 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/direct_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_direct.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7de700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/direct_py/test/coreneuron/test_direct.py", line 52 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/direct_py/test/coreneuron/test_direct.py", line 70 in test_direct_memory_transfer
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 13: coreneuron_modtests::spikes_file_mode_py
50/94 Test #53: testcorenrn_vecplay::neuron ........................................ Passed 24.20 sec
Start 54: testcorenrn_vecplay::coreneuron_cpu_online
51/94 Test #9: parallel_bas ....................................................... Passed 83.75 sec
Start 14: coreneuron_modtests::fornetcon_py
52/94 Test #12: coreneuron_modtests::spikes_py .....................................***Failed 36.18 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/spikes_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_spikes.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7de700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/spikes_py/test/coreneuron/test_spikes.py", line 95 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/spikes_py/test/coreneuron/test_spikes.py", line 127 in test_spikes
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 15: coreneuron_modtests::fast_imem_py
53/94 Test #54: testcorenrn_vecplay::coreneuron_cpu_online .........................***Failed 21.82 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7d5
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testvecplay.hoc near line 54
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 62380, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.50 ON r2i2n34 CANCELLED AT 2021-10-13T19:21:11 ***
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780936.50
srun: error: r2i2n34: task 1: Killed
Start 55: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
54/94 Test #13: coreneuron_modtests::spikes_file_mode_py ...........................***Failed 32.86 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/spikes_file_mode_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_spikes.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7de700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/spikes_file_mode_py/test/coreneuron/test_spikes.py", line 95 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/spikes_file_mode_py/test/coreneuron/test_spikes.py", line 129 in test_spikes
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 16: coreneuron_modtests::datareturn_py
55/94 Test #14: coreneuron_modtests::fornetcon_py ..................................***Failed 28.04 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/fornetcon_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_fornetcon.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/fornetcon_py/test/coreneuron/test_fornetcon.py", line 65 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/fornetcon_py/test/coreneuron/test_fornetcon.py", line 97 in runassert
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/fornetcon_py/test/coreneuron/test_fornetcon.py", line 105 in test_fornetcon
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 17: coreneuron_modtests::test_units_py
56/94 Test #4: pynrn_tests::basic_tests ........................................... Passed 137.09 sec
Start 18: coreneuron_modtests::test_netmove_py
57/94 Test #55: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........***Failed 20.05 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7d5
/usr/lib64/libc.so.6 : ()+0x16f7d5
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testvecplay.hoc near line 54
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 62589, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testvecplay.hoc near line 54
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.51 ON r2i2n34 CANCELLED AT 2021-10-13T19:21:31 ***
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780936.51
srun: error: r2i2n34: task 1: Killed
Start 56: testcorenrn_vecplay::coreneuron_cpu_offline
58/94 Test #15: coreneuron_modtests::fast_imem_py .................................. Passed 36.78 sec
Start 19: coreneuron_modtests::test_watchrange_py
59/94 Test #56: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 7.45 sec
Start 65: testcorenrn_watch::neuron
60/94 Test #16: coreneuron_modtests::datareturn_py .................................***Failed 27.67 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/datareturn_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_datareturn.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7de700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/datareturn_py/test/coreneuron/test_datareturn.py", line 151 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/datareturn_py/test/coreneuron/test_datareturn.py", line 181 in test_datareturn
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 20: coreneuron_modtests::test_psolve_py
61/94 Test #65: testcorenrn_watch::neuron .......................................... Passed 11.77 sec
Start 66: testcorenrn_watch::coreneuron_cpu_online
62/94 Test #17: coreneuron_modtests::test_units_py .................................***Failed 28.82 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_units_py
plugins: cov-2.8.1
collected 1 item
test/coreneuron/test_units.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_units_py/test/coreneuron/test_units.py", line 28 in test_units
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 21: coreneuron_modtests::test_natrans_py
63/94 Test #18: coreneuron_modtests::test_netmove_py ...............................***Failed 26.31 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_netmove_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_netmove.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_netmove_py/test/coreneuron/test_netmove.py", line 69 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_netmove_py/test/coreneuron/test_netmove.py", line 89 in runassert
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_netmove_py/test/coreneuron/test_netmove.py", line 111 in test_netmove
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 30: external_ringtest::compare_results
64/94 Test #30: external_ringtest::compare_results .................................***Failed 3.34 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/external_ringtest/coreneuron_cpu_mpi/spk2.std'
Start 36: testcorenrn_bbcore::compare_results
65/94 Test #36: testcorenrn_bbcore::compare_results ................................***Failed 8.45 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_bbcore/coreneuron_cpu_online/outbbcore.dat'
Start 42: testcorenrn_deriv::compare_results
66/94 Test #19: coreneuron_modtests::test_watchrange_py ............................***Failed 33.24 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_watchrange_py
plugins: cov-2.8.1
numprocs=1
collected 1 item
test/coreneuron/test_watchrange.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_watchrange_py/test/coreneuron/test_watchrange.py", line 68 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_watchrange_py/test/coreneuron/test_watchrange.py", line 91 in runassert
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_watchrange_py/test/coreneuron/test_watchrange.py", line 141 in test_watchrange
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 48: testcorenrn_gf::compare_results
67/94 Test #42: testcorenrn_deriv::compare_results .................................***Failed 3.49 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_deriv/coreneuron_cpu_online/outderiv.dat'
Start 52: testcorenrn_patstim::compare_results
68/94 Test #48: testcorenrn_gf::compare_results ....................................***Failed 3.06 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_gf/coreneuron_cpu_online/outgf.dat'
Start 58: testcorenrn_vecplay::compare_results
69/94 Test #52: testcorenrn_patstim::compare_results ............................... Passed 2.68 sec
Start 76: testcorenrn_conc::compare_results
70/94 Test #58: testcorenrn_vecplay::compare_results ...............................***Failed 2.91 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_vecplay/coreneuron_cpu_online/outvecplay.dat'
Start 82: testcorenrn_kin::compare_results
71/94 Test #66: testcorenrn_watch::coreneuron_cpu_online ...........................***Failed 22.32 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testwatch.hoc near line 54
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 63055, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.54 ON r2i2n34 CANCELLED AT 2021-10-13T19:22:13 ***
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780936.54
srun: error: r2i2n34: task 1: Killed
Start 67: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
72/94 Test #76: testcorenrn_conc::compare_results ..................................***Failed 2.90 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_conc/coreneuron_cpu_online/outconc.dat'
Start 86: external_nrntest
73/94 Test #82: testcorenrn_kin::compare_results ...................................***Failed 2.79 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_kin/coreneuron_cpu_online/outkin.dat'
Start 90: channel_benchmark_hippo::compare_results
74/94 Test #20: coreneuron_modtests::test_psolve_py ................................***Failed 30.68 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_psolve_py
plugins: cov-2.8.1
numprocs=1
collected 2 items
test/coreneuron/test_psolve.py Fatal Python error: Segmentation fault
Thread 0x00002acacb7de700 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/python/neuron/gui.py", line 87 in run
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 932 in _bootstrap_inner
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/threading.py", line 890 in _bootstrap
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_psolve_py/test/coreneuron/test_psolve.py", line 45 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_psolve_py/test/coreneuron/test_psolve.py", line 56 in test_psolve
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
Start 94: channel_benchmark_sscx::compare_results
75/94 Test #90: channel_benchmark_hippo::compare_results ...........................***Failed 3.57 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/channel_benchmark_hippo/coreneuron_cpu_online/out.dat'
76/94 Test #94: channel_benchmark_sscx::compare_results ............................***Failed 3.56 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/channel_benchmark_sscx/coreneuron_cpu_online/out.dat'
Start 68: testcorenrn_watch::coreneuron_cpu_offline
77/94 Test #21: coreneuron_modtests::test_natrans_py ...............................***Failed 27.66 sec
============================= test session starts ==============================
platform linux -- Python 3.8.3, pytest-5.3.4, py-1.8.0, pluggy-0.13.0
rootdir: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_natrans_py
plugins: cov-2.8.1
collected 1 item
test/gjtests/test_natrans.py Fatal Python error: Segmentation fault
Current thread 0x00002aaaaab0f8c0 (most recent call first):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_natrans_py/test/gjtests/test_natrans.py", line 95 in run
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/test_natrans_py/test/gjtests/test_natrans.py", line 114 in test_natrans
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/python.py", line 1445 in runtest
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 134 in pytest_runtest_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 210 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 237 in from_call
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 209 in call_runtest_hook
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 185 in call_and_report
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 99 in runtestprotocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 271 in pytest_runtestloop
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 247 in _main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 197 in wrap_session
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/main.py", line 240 in pytest_cmdline_main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/callers.py", line 187 in _multicall
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 83 in <lambda>
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/manager.py", line 92 in _hookexec
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi/lib/python3.8/site-packages/pluggy/hooks.py", line 286 in __call__
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/_pytest/config/__init__.py", line 92 in main
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk/lib/python3.8/site-packages/pytest/__main__.py", line 7 in <module>
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 87 in _run_code
File "/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/lib/python3.8/runpy.py", line 194 in _run_module_as_main
Segmentation fault
78/94 Test #68: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 8.06 sec
Start 83: testcorenrn_netstimdirect::direct_netstimdirect
79/94 Test #67: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate ..........***Failed 25.93 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
1
1
0
1
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testwatch.hoc near line 54
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 63332, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testwatch.hoc near line 54
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.55 ON r2i2n34 CANCELLED AT 2021-10-13T19:22:39 ***
srun: error: r2i2n34: task 0: Killed
srun: Terminating job step 2780936.55
srun: error: r2i2n34: task 1: Exited with exit code 255
Start 84: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
Start 70: testcorenrn_watch::compare_results
80/94 Test #70: testcorenrn_watch::compare_results .................................***Failed 4.14 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_watch/coreneuron_cpu_online/outwatch.dat'
81/94 Test #83: testcorenrn_netstimdirect::direct_netstimdirect ....................***Failed 24.47 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 0
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
10
10
psolve time 0
Vector[5]
Vector[6]
Vector[5]
Vector[6]
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testnetstimdirect.hoc near line 68
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 63662, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testnetstimdirect.hoc near line 68
1 prun("")
^
1 ParallelContext[0].psolve(100)
1 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.57 ON r2i2n34 CANCELLED AT 2021-10-13T19:22:52 ***
srun: error: r2i2n34: task 0: Killed
srun: Terminating job step 2780936.57
srun: error: r2i2n34: task 1: Exited with exit code 255
Start 22: coreneuron_modtests::spikes_mpi_py
82/94 Test #84: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ...***Failed 18.33 sec
numprocs=2
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 0
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
1
1
0
1
10
10
psolve time 0.00999999
Vector[5]
Vector[5]
Vector[6]
Vector[6]
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testnetstimdirect.hoc near line 68
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 63823, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testnetstimdirect.hoc near line 68
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.58 ON r2i2n34 CANCELLED AT 2021-10-13T19:22:57 ***
srun: error: r2i2n34: task 0: Exited with exit code 255
srun: Terminating job step 2780936.58
srun: error: r2i2n34: task 1: Killed
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py
Start 85: testcorenrn_netstimdirect::compare_results
83/94 Test #85: testcorenrn_netstimdirect::compare_results .........................***Failed 3.14 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_netstimdirect/direct_netstimdirect/outnetstimdirect.dat'
84/94 Test #22: coreneuron_modtests::spikes_mpi_py .................................***Failed 25.83 sec
numprocs=2
MPT ERROR: Rank 0(g:0) received signal SIGSEGV(11).
Process ID: 64076, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/bin/python3.8
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/bin/python3.8, Rank 0, Process 64076: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/spikes_mpi_py
srun: error: r2i2n34: task 0: Segmentation fault (core dumped)
srun: Terminating job step 2780936.59
slurmstepd: error: *** STEP 2780936.59 ON r2i2n34 CANCELLED AT 2021-10-13T19:23:18 ***
srun: error: r2i2n34: task 1: Terminated
srun: Force Terminated job step 2780936.59
85/94 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py .......................***Failed 24.42 sec
numprocs=2
MPT ERROR: Rank 0(g:0) received signal SIGSEGV(11).
Process ID: 64158, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/bin/python3.8
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
MPT: -----stack traceback ends-----
MPT: On host r2i2n34, Program /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst/bin/python3.8, Rank 0, Process 64158: Dumping core on signal SIGSEGV(11) into directory /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/coreneuron_modtests/spikes_mpi_file_mode_py
srun: error: r2i2n34: task 0: Segmentation fault (core dumped)
srun: Terminating job step 2780936.60
slurmstepd: error: *** STEP 2780936.60 ON r2i2n34 CANCELLED AT 2021-10-13T19:23:22 ***
srun: error: r2i2n34: task 1: Terminated
srun: Force Terminated job step 2780936.60
Start 63: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
86/94 Test #63: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 12.93 sec
Start 59: testcorenrn_vecevent::neuron
87/94 Test #59: testcorenrn_vecevent::neuron ....................................... Passed 13.96 sec
Start 60: testcorenrn_vecevent::coreneuron_cpu_online
88/94 Test #60: testcorenrn_vecevent::coreneuron_cpu_online ........................***Failed 19.47 sec
numprocs=4
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 0
1
1
0
1
1
1
0
1
1
1
0
1
1
1
0
1
10
10
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testvecevent.hoc near line 47
0 prun("")
^
0 ParallelContext[0].psolve(100)
0 prun("")
MPT ERROR: Rank 0(g:0) is aborting with error code -1.
Process ID: 65183, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
MPT: ImportError: No module named site
Segmentation violation
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testvecevent.hoc near line 47
1 prun("")
^
1 ParallelContext[0].psolve(100)
1 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.63 ON r2i2n34 CANCELLED AT 2021-10-13T19:24:07 ***
srun: error: r2i2n34: tasks 0,2-3: Killed
srun: Terminating job step 2780936.63
srun: error: r2i2n34: task 1: Exited with exit code 255
Start 61: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
89/94 Test #61: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate .......***Failed 21.72 sec
numprocs=4
NEURON -- VERSION + master (89c74d3+) 2021-10-13
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2021
See http://neuron.yale.edu/neuron/credits
Additional mechanisms from files
"./Gfluct3.mod" "./hhderiv.mod" "./hhkin.mod" "./hhwatch.mod" "./nacum.mod" "./vecevent.mod"
arg_tstop 100
arg_coreneuron 1
arg_coreneuron_filemode 0
arg_dump_coreneuron_model 0
arg_coreneuron_gpu 0
arg_pattern
arg_psolve_test_mode 3
1
1
0
1
1
1
0
1
1
1
0
1
1
1
0
1
10
10
10
10
nrncore_arg: | --tstop 100 --verbose 2 --mpi --voltage 1000.|
Segmentation violation
Segmentation violation
Segmentation violation
Segmentation violation
Backtrace:
Backtrace:
Backtrace:
Backtrace:
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x36400
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/usr/lib64/libc.so.6 : ()+0x16f7b1
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/compilers/2021-01-06/linux-rhel7-x86_64/gcc-4.8.5/gcc-9.3.0-45gzrp/lib64/libstdc++.so.6 : _ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEC2EPKcRKS3_()+0x28
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72576/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-fbjlyk/lib/libcoreneuron.so : prepare_args()+0x5f
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/libcorenrnmech.so : corenrn_embedded_run()+0x9a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z11nrncore_runPKc()+0xf9
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z14nrncore_psolvedi()+0x101
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : ()+0x3560ab
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : hoc_call_ob_proc()+0x1ef
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
1 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
1 in testvecevent.hoc near line 47
1 prun("")
^
1 ParallelContext[0].psolve(1)
1 prun("")
MPT ERROR: Rank 1(g:1) is aborting with error code -1.
Process ID: 65512, Host: r2i2n34, Program: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special
MPT Version: HPE HMPT 2.22 03/31/20 16:17:35
MPT: --------stack traceback-------
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
3 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
3 in testvecevent.hoc near line 47
3 prun("")
^
3 ParallelContext[0].psolve(1)
3 prun("")
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
0 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
0 in testvecevent.hoc near line 47
0 prun("")
^
0 ParallelContext[0].psolve(1)
0 prun("")
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/lib/libnrniv.so : _Z20hoc_object_componentv()+0x81d
2 /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/nrnivmodl/16e59b413722fa2d993abf06fc2e64a772692803ff5913bd0eb34e9c8bd45725/x86_64/special: Aborting.
2 in testvecevent.hoc near line 47
2 prun("")
^
2 ParallelContext[0].psolve(1)
2 prun("")
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 2780936.64 ON r2i2n34 CANCELLED AT 2021-10-13T19:24:29 ***
slurmstepd: error: *** STEP 2780936.64 ON r2i2n34 CANCELLED AT 2021-10-13T19:24:29 ***
slurmstepd: error: *** STEP 2780936.64 ON r2i2n34 CANCELLED AT 2021-10-13T19:24:29 ***
srun: error: r2i2n34: tasks 0,2-3: Exited with exit code 255
srun: Terminating job step 2780936.64
srun: error: r2i2n34: task 1: Killed
Start 62: testcorenrn_vecevent::coreneuron_cpu_offline
90/94 Test #62: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 6.60 sec
Start 64: testcorenrn_vecevent::compare_results
91/94 Test #64: testcorenrn_vecevent::compare_results ..............................***Failed 2.89 sec
Traceback (most recent call last):
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 120, in <module>
results = [
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 121, in <listcomp>
check_compatibility(data_type=data_type, test_data=test_data)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 58, in check_compatibility
spike_data = load_ascii_spikes(data_path)
File "/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/compare_test_results.py", line 44, in load_ascii_spikes
with open(data_path, "r") as data_file:
FileNotFoundError: [Errno 2] No such file or directory: '/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P19854/72587/spack-build/spack-stage-neuron-develop-x5fc6bslh4t3tjgxm7245xtkkgztnyge/spack-build-x5fc6bs/test/testcorenrn_vecevent/coreneuron_cpu_online/outvecevent.dat'
92/94 Test #86: external_nrntest ................................................... Passed 528.49 sec
93/94 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 783.92 sec
94/94 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 832.25 sec
61% tests passed, 37 tests failed out of 94
Total Test time (real) = 1024.00 sec
The following tests FAILED:
10 - coreneuron_modtests::direct_py (Failed)
12 - coreneuron_modtests::spikes_py (Failed)
13 - coreneuron_modtests::spikes_file_mode_py (Failed)
14 - coreneuron_modtests::fornetcon_py (Failed)
16 - coreneuron_modtests::datareturn_py (Failed)
17 - coreneuron_modtests::test_units_py (Failed)
18 - coreneuron_modtests::test_netmove_py (Failed)
19 - coreneuron_modtests::test_watchrange_py (Failed)
20 - coreneuron_modtests::test_psolve_py (Failed)
21 - coreneuron_modtests::test_natrans_py (Failed)
22 - coreneuron_modtests::spikes_mpi_py (Failed)
23 - coreneuron_modtests::spikes_mpi_file_mode_py (Failed)
26 - external_ringtest::coreneuron_cpu_mpi (Failed)
28 - external_ringtest::coreneuron_cpu_mpi_offline::preparation (Failed)
29 - external_ringtest::coreneuron_cpu_mpi_threads (Failed)
30 - external_ringtest::compare_results (Failed)
36 - testcorenrn_bbcore::compare_results (Failed)
42 - testcorenrn_deriv::compare_results (Failed)
44 - testcorenrn_gf::coreneuron_cpu_online (Failed)
45 - testcorenrn_gf::coreneuron_cpu_online_psolve_alternate (Failed)
48 - testcorenrn_gf::compare_results (Failed)
54 - testcorenrn_vecplay::coreneuron_cpu_online (Failed)
55 - testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate (Failed)
58 - testcorenrn_vecplay::compare_results (Failed)
60 - testcorenrn_vecevent::coreneuron_cpu_online (Failed)
61 - testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate (Failed)
64 - testcorenrn_vecevent::compare_results (Failed)
66 - testcorenrn_watch::coreneuron_cpu_online (Failed)
67 - testcorenrn_watch::coreneuron_cpu_online_psolve_alternate (Failed)
70 - testcorenrn_watch::compare_results (Failed)
76 - testcorenrn_conc::compare_results (Failed)
82 - testcorenrn_kin::compare_results (Failed)
83 - testcorenrn_netstimdirect::direct_netstimdirect (Failed)
84 - testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate (Failed)
85 - testcorenrn_netstimdirect::compare_results (Failed)
90 - channel_benchmark_hippo::compare_results (Failed)
94 - channel_benchmark_sscx::compare_results (Failed)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: r2i2n34: task 0: Exited with exit code 1
section_end:1634146385:step_script section_start:1634146385:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=76966 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=72591 responseStatus=201 Created token=GiFoef-o
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=76999 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=72591 responseStatus=201 Created token=GiFoef-o
section_end:1634146386:upload_artifacts_on_failure section_start:1634146386:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1634146387:cleanup_file_variables ERROR: Job failed: exit status 1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment