[Trilinos-Users] FW: [EXTERNAL] compiling Trilinos

Thu Mar 24 11:24:48 EDT 2016

Hello Trilinos Users,

Anyone have a setup similar to Sergei's when building Trilinos and might know how to advise him?

-Ross

> -----Original Message-----
> From: Ponomarev, Sergei Ya [mailto:sponomarev at WPI.EDU]
> Sent: Thursday, March 24, 2016 10:53 AM
> To: Bartlett, Roscoe A
> Subject: [EXTERNAL] compiling Trilinos
> 
> Dear Roscoe:
> 
> My name is Sergei, I am an HPC specialist at Worcester Polytechnic Institute. I
> am struggling compiling Trilinos on our test cluster...
> 
> Could you please give me some advice on how to compile it correctly with MPI
> support?
> 
> I am using a gcc compiler version version 4.8.2 which comes with devtoolset-2
> on RedHat 6.5 and a compiled version of PETSC 3.6.3 (I used "--download-
> mpich" option in configure for PETSC). I am trying to compile Trilinos based on
> PETSC mpich executables.
> 
> We also have a working OPENMPI package installed, but, I am getting the same
> 'The C compiler "path-to-mpi/mpicc" is not able to compile a simple test
> program.' error for both OPENMPI and PETSC MPICH distros. There is also a
> "/usr/bin/ld: cannot find -lmpi" error that comes from the linker and I am not
> sure if I define the MPI_LIB_PATH correctly in my make.sh Trilinos file. Here it is:
> 
> #!/bin/bash
> 
> rm -rf build
> mkdir build
> rm -rf CMakeCache.txt CMakeFiles/
> cd build
> 
> /home/user/Work/CMAKE/cmake-3.5.0-Linux-x86_64/bin/cmake \ -
> DCMAKE_BUILD_TYPE=DEBUG \ -DTrilinos_ENABLE_TESTS=ON \ -
> DTPL_ENABLE_MPI=ON \ -DMPI_BASE_DIR=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich \
> -DMPI_LIB_DIR='/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/lib/libmpi.a; /home/user/Work/PET      #This seems to have
> no effect on
> SC/petsc-3.6.3/build_mpich/lib/libmpicxx.a; /home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/lib/libmpi #configuring Trilinos
> fort.a' \
> #
> -DHAVE_FLAG_SEARCH_PATHS_FIRST=FALSE \
> -DCMAKE_C_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpicc \ -
> DCMAKE_CXX_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpiCC \
> -DCMAKE_Fortran_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpif90 \ -DTrilinos_ENABLE_ALL_PACKAGES=ON \ -
> DCMAKE_INSTALL_PATH=/home/user/Work/Trilinos/Trilinos/build \ -
> DTPL_BLAS_LIBRARIES=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/lib/libfblas.a \ -
> DTPL_LAPACK_LIBRARIES=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/lib/libflapack.a \ -DTPL_ENABLE_Boost=OFF \ -
> DTPL_ENABLE_Netcdf=OFF \ -DTPL_ENABLE_BoostLib=OFF \
> /home/user/Work/Trilinos/Trilinos
> 
> Part of the output:
> 
> Probing the environment ...
> 
> -- USE_XSDK_DEFAULTS='FALSE'
> -- CMAKE_BUILD_TYPE='DEBUG'
> -- BUILD_SHARED_LIBS='FALSE'
> -- MPI_BASE_DIR='/home/user/Work/PETSC/petsc-3.6.3/build_mpich'
> -- MPI_BIN_DIR='/home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin'
> -- MPI_USE_COMPILER_WRAPPERS='ON'
> -- Leaving current CMAKE_C_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpicc since it is already set!
> -- Leaving current CMAKE_CXX_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpiCC since it is already set!
> -- Leaving current CMAKE_Fortran_COMPILER=/home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpif90 since it is already set!
> -- MPI_EXEC='/home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin/mpiexec'
> -- The C compiler identification is GNU 4.8.2
> -- Check for working C compiler: /home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpicc
> -- Check for working C compiler: /home/user/Work/PETSC/petsc-
> 3.6.3/build_mpich/bin/mpicc -- broken CMake Error at
> /home/user/Work/CMAKE/cmake-3.5.0-Linux-x86_64/share/cmake-
> 3.5/Modules/CMakeTestCCompiler.cmake:61 (message):
>   The C compiler
>   "/home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin/mpicc" is not able
>   to compile a simple test program.
> 
>   It fails with the following output:
> 
>    Change Dir: /home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeTmp
> 
> 
> 
>   Run Build Command:"/usr/bin/gmake" "cmTC_51ff4/fast"
> 
>   /usr/bin/gmake -f CMakeFiles/cmTC_51ff4.dir/build.make
>   CMakeFiles/cmTC_51ff4.dir/build
> 
>   gmake[1]: Entering directory
>   `/home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeTmp'
> 
>   Building C object CMakeFiles/cmTC_51ff4.dir/testCCompiler.c.o
> 
>   /home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin/mpicc -o
>   CMakeFiles/cmTC_51ff4.dir/testCCompiler.c.o -c
> 
> /home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeTmp/testCCompiler
> .c
> 
> 
>   Linking C executable cmTC_51ff4
> 
>   /home/user/Work/CMAKE/cmake-3.5.0-Linux-x86_64/bin/cmake -E
>   cmake_link_script CMakeFiles/cmTC_51ff4.dir/link.txt --verbose=1
> 
>   /home/user/Work/PETSC/petsc-3.6.3/build_mpich/bin/mpicc
>   CMakeFiles/cmTC_51ff4.dir/testCCompiler.c.o -o cmTC_51ff4 -rdynamic
> 
>   /usr/bin/ld: cannot find -lmpi
> 
>   collect2: error: ld returned 1 exit status
> 
>   gmake[1]: *** [cmTC_51ff4] Error 1
> 
>   gmake[1]: Leaving directory
>   `/home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeTmp'
> 
>   gmake: *** [cmTC_51ff4/fast] Error 2
> 
> 
> 
> 
> 
>   CMake will not be able to correctly generate this project.
> Call Stack (most recent call first):
>   cmake/tribits/core/package_arch/TribitsGlobalMacros.cmake:1654
> (ENABLE_LANGUAGE)
>   cmake/tribits/core/package_arch/TribitsProjectImpl.cmake:188
> (TRIBITS_SETUP_ENV)
>   cmake/tribits/core/package_arch/TribitsProject.cmake:93
> (TRIBITS_PROJECT_IMPL)
>   CMakeLists.txt:93 (TRIBITS_PROJECT)
> 
> 
> -- Configuring incomplete, errors occurred!
> See also
> "/home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeOutput.log".
> See also
> "/home/user/Work/Trilinos/Trilinos/build/CMakeFiles/CMakeError.log".
> 
> Do you see anything pathological?
> 
> Thank you in advance,
> Sergei
> 
> *****************************************************************
> *
> Sincerely Yours,
> 
> Sergei Y. Ponomarev, PhD
> HPC Systems Integrator
> Worcester Polytechnic Institute
> Higgins Laboratories, HL232
> Phone: (508) 831-4676
> Email: sponomarev at wpi.edu
> Web: http://www.wpi.edu/offices/it/arc.html
> *****************************************************************