[Trilinos-Users] FW: [EXTERNAL] compiling Trilinos

Thu Mar 24 11:39:20 EDT 2016

Hello Trilinos Users,

Anyone have a setup similar to Sergei's when building Trilinos and might know how to advise him?

-Ross

P.S. Forgot to CC Sergei

Dr. Roscoe A. Bartlett, PhD
Sandia National Laboratories
Trilinos Software Engineering and Integration Technologies Lead
Consortium for the Advanced Simulation of Light Water Reactors (CASL) Physics Integration Infrastructure Lead

> -----Original Message-----
> From: Ponomarev, Sergei Ya [mailto:sponomarev at WPI.EDU]
> Sent: Thursday, March 24, 2016 10:53 AM
> To: Bartlett, Roscoe A
> Subject: [EXTERNAL] compiling Trilinos
> 
> Dear Roscoe:
> 
> My name is Sergei, I am an HPC specialist at Worcester Polytechnic Institute. I
> am struggling compiling Trilinos on our test cluster...
> 
> Could you please give me some advice on how to compile it correctly with MPI
> support?
> 
> I am using a gcc compiler version version 4.8.2 which comes with devtoolset-2
> on RedHat 6.5 and a compiled version of PETSC 3.6.3 (I used "--download-
> mpich" option in configure for PETSC). I am trying to compile Trilinos based on
> PETSC mpich executables.
> 
> We also have a working OPENMPI package installed, but, I am getting the same
> 'The C compiler "path-to-mpi/mpicc" is not able to compile a simple test
> program.' error for both OPENMPI and PETSC MPICH distros. There is also a
> "/usr/bin/ld: cannot find -lmpi" error that comes from the linker and I am not
> sure if I define the MPI_LIB_PATH correctly in my make.sh Trilinos file. Here it is:
> 
> #!/bin/bash
> 
> rm -rf build
> mkdir build
> rm -rf CMakeCache.txt CMakeFiles/
> cd build
> 
> /home/user/Work/CMAKE/cmake-3.5.0-Linux-x86_64/bin/cmake \ -
> DCMAKE_BUILD_TYPE=DEBUG \ -DTrilinos_ENABLE_TESTS=ON \ -
> DTPL_ENABLE_MPI=ON \ -DMPI_BASE_DIR=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich \
> -DMPI_LIB_DIR='/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/lib/libmpi.a; /home/user/Work/PET      #This seems to have
> no effect on
> SC/petsc-3.6.3/build_mpich/lib/libmpicxx.a; /home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/lib/libmpi #configuring Trilinos
> fort.a' \
> #
> -DHAVE_FLAG_SEARCH_PATHS_FIRST=FALSE \
> -DCMAKE_C_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpicc \ -
> DCMAKE_CXX_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpiCC \
> -DCMAKE_Fortran_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpif90 \ -DTrilinos_ENABLE_ALL_PACKAGES=ON \ -
> DCMAKE_INSTALL_PATH=/home/user/Work/Trilinos/Trilinos/build \ -
> DTPL_BLAS_LIBRARIES=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/lib/libfblas.a \ -
> DTPL_LAPACK_LIBRARIES=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/lib/libflapack.a \ -DTPL_ENABLE_Boost=OFF \ -
> DTPL_ENABLE_Netcdf=OFF \ -DTPL_ENABLE_BoostLib=OFF \
> /home/user/Work/Trilinos/Trilinos
> 
> Part of the output:
> 
> Probing the environment ...
> 
> -- USE_XSDK_DEFAULTS='FALSE'
> -- CMAKE_BUILD_TYPE='DEBUG'
> -- BUILD_SHARED_LIBS='FALSE'
> -- MPI_BASE_DIR='/home/user/Work/PETSC/petsc-3.6.3/build_mpich'
> -- MPI_BIN_DIR='/home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin'
> -- MPI_USE_COMPILER_WRAPPERS='ON'
> -- Leaving current CMAKE_C_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpicc since it is already set!
> -- Leaving current CMAKE_CXX_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpiCC since it is already set!
> -- Leaving current CMAKE_Fortran_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpif90 since it is already set!
> -- MPI_EXEC='/home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin/mpiexec'
> -- The C compiler identification is GNU 4.8.2
> -- Check for working C compiler: /home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpicc
> -- Check for working C compiler: /home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpicc -- broken CMake Error at
> /home/user/Work/CMAKE/cmake-3.5.0-Linux-x86_64/share/cmake-
> 3.5/Modules/CMakeTestCCompiler.cmake:61 (message):
>   The C compiler
>   "/home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin/mpicc" is not able
>   to compile a simple test program.
> 
>   It fails with the following output:
> 
>    Change Dir: /home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeTmp
> 
> 
> 
>   Run Build Command:"/usr/bin/gmake" "cmTC_51ff4/fast"
> 
>   /usr/bin/gmake -f CMakeFiles/cmTC_51ff4.dir/build.make
>   CMakeFiles/cmTC_51ff4.dir/build
> 
>   gmake[1]: Entering directory
>   `/home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeTmp'
> 
>   Building C object CMakeFiles/cmTC_51ff4.dir/testCCompiler.c.o
> 
>   /home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin/mpicc -o
>   CMakeFiles/cmTC_51ff4.dir/testCCompiler.c.o -c
> 
> /home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeTmp/testCCompiler
> .c
> 
> 
>   Linking C executable cmTC_51ff4
> 
>   /home/user/Work/CMAKE/cmake-3.5.0-Linux-x86_64/bin/cmake -E
>   cmake_link_script CMakeFiles/cmTC_51ff4.dir/link.txt --verbose=1
> 
>   /home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin/mpicc
>   CMakeFiles/cmTC_51ff4.dir/testCCompiler.c.o -o cmTC_51ff4 -rdynamic
> 
>   /usr/bin/ld: cannot find -lmpi
> 
>   collect2: error: ld returned 1 exit status
> 
>   gmake[1]: *** [cmTC_51ff4] Error 1
> 
>   gmake[1]: Leaving directory
>   `/home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeTmp'
> 
>   gmake: *** [cmTC_51ff4/fast] Error 2
> 
> 
> 
> 
> 
>   CMake will not be able to correctly generate this project.
> Call Stack (most recent call first):
>   cmake/tribits/core/package_arch/TribitsGlobalMacros.cmake:1654
> (ENABLE_LANGUAGE)
>   cmake/tribits/core/package_arch/TribitsProjectImpl.cmake:188
> (TRIBITS_SETUP_ENV)
>   cmake/tribits/core/package_arch/TribitsProject.cmake:93
> (TRIBITS_PROJECT_IMPL)
>   CMakeLists.txt:93 (TRIBITS_PROJECT)
> 
> 
> -- Configuring incomplete, errors occurred!
> See also
> "/home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeOutput.log".
> See also
> "/home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeError.log".
> 
> Do you see anything pathological?
> 
> Thank you in advance,
> Sergei
> 
> *****************************************************************
> *
> Sincerely Yours,
> 
> Sergei Y. Ponomarev, PhD
> HPC Systems Integrator
> Worcester Polytechnic Institute
> Higgins Laboratories, HL232
> Phone: (508) 831-4676
> Email: sponomarev at wpi.edu
> Web: http://www.wpi.edu/offices/it/arc.html
> *****************************************************************