[Trilinos-Users] trilinos build problem on cray xe6 (mzlogin01e)

Meyer, Hal hxm at sandia.gov
Wed May 25 15:38:31 MDT 2011


Jim,

Yes, I started from scratch.

Disabling fortran seems to be working except I had to comment out "#undef unix" in aztecoo/src/az_c_reorder.c and az_c_util.c. Looks like trilinos is 90% done now.

I'll send more when it has finished.

Thanks,
Hal

________________________________________
From: Willenbring, James M
Sent: Wednesday, May 25, 2011 13:49
To: Bartlett, Roscoe A; Meyer, Hal; 'dorian.krause at usi.ch'; 'trilinos-users at software.sandia.gov'
Subject: RE: [Trilinos-Users] trilinos build problem on cray xe6 (mzlogin01e)

Hal,

After you added the option to not load omp libraries, did you remove the CMakeCache.txt file prior to configuring again?  Otherwise, the old configuration options may have been cached.

Jim

-----Original Message-----
From: trilinos-users-bounces at software.sandia.gov [mailto:trilinos-users-bounces at software.sandia.gov] On Behalf Of Bartlett, Roscoe A
Sent: Wednesday, May 25, 2011 1:09 PM
To: Meyer, Hal; 'dorian.krause at usi.ch'; 'trilinos-users at software.sandia.gov'
Subject: Re: [Trilinos-Users] trilinos build problem on cray xe6 (mzlogin01e)

-DTrilinos_ENABLE_Fortran=OFF

Sent from my android phone.


 -----Original Message-----
From:   Meyer, Hal [mailto:hxm at sandia.gov]
Sent:   Wednesday, May 25, 2011 01:02 PM Mountain Standard Time
To:     Dorian Krause; trilinos-users at software.sandia.gov
Subject:        Re: [Trilinos-Users] trilinos build problem on cray xe6 (mzlogin01e)

Dorian,

Upgrading to the cmake 3.8.4 fixed the broken ftn problem, thanks.

Now cmake is complaining:
-- Warning, cannot automatically determine Fortran mangling.
-- Detecting Fortran/C Interface
-- Detecting Fortran/C Interface - Failed to compile
-- Verifying Fortran/CXX Compiler Compatibility
-- Verifying Fortran/CXX Compiler Compatibility - Failed

The actual error is
    /opt/cray/cce/7.3.3/cray-binutils/x86_64-unknown-linux-gnu/bin/ld: cannot find -lomp_lib

I added -hnoomp to not load omp libraries, but this loader ignored it.

Questions:
   With the trilinos options I am using, see below, do I need fortran?
   How do I disable fortran with cmake?

Thanks,
Hal

________________________________________
From: trilinos-users-bounces at software.sandia.gov [trilinos-users-bounces at software.sandia.gov] on behalf of Dorian Krause [dorian.krause at usi.ch]
Sent: Wednesday, May 25, 2011 08:37
To: trilinos-users at software.sandia.gov
Subject: Re: [Trilinos-Users] trilinos build problem on cray xe6 (mzlogin01e)

Hi,

I remember having the same problems with cmake on a Cray (it's not a
problem particular to Trilinos). I solved it by updating cmake. Newer
versions recognize the Cray Compiler suite. I don't know if that's an
option for you?!

Best regards,
Dorian Krause

On Wed, 2011-05-25 at 14:24 +0000, Meyer, Hal wrote:
>
> I have successfully built trilinos 10.5 with the intel and pgi
> compilers on mzlogin01e (cray XE6). Cmake fails when I use the cray
> compilers with the following message:
>
> -- Check for working Fortran
> compiler: /opt/cray/xt-asyncpe/4.9/bin/ftn  -- broken
>   ftn-2191 crayftn: ERROR in command line
>     "ynamic" is an invalid argument to the "-r" option.
>
> "man crayftn" shows "-rdynamic" is not an option for the cray
> compilers. More details are below.
>
> I looked for sample cmake command lines but did not find any for a
> cray XE6 using the cray compilers.
>
> Any suggestions would be appreciated.
>
> Thanks,
> Hal Meyer
>
> ===================================================================================
> This is the cmake command:
> ===================================================================================
>  /panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/cmake-2.8.3/bin/cmake \
>                 -D
> CMAKE_INSTALL_PREFIX=/panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos10 \
>                 -D
> CMAKE_BINARY_DIR=/panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos_build \
>                 -D CMAKE_C_COMPILER:FILEPATH=cc \
>                 -D CMAKE_C_FLAGS:STRING="-DREALLOC_BUG -O3 -hfp3
> -hlist=m -DNDEBUG -DREDSTORM" \
>                 -D CMAKE_CXX_COMPILER:FILEPATH=CC \
>                 -D CMAKE_CXX_FLAGS:STRING="-DPAGESIZE=4096 -O3 -hfp3
> -hlist=m -DNDEBUG -DMPICH_IGNORE_CXX_SEEK -DREDSTORM" \
>                 -D CMAKE_Fortran_COMPILER:FILEPATH=ftn \
>                 -D CMAKE_Fortran_FLAGS:STRING="-O3 -DNDEBUG
> " \
>                 -D CMAKE_BUILD_TYPE:STRING=NONE \
>                 -D CMAKE_VERBOSE_MAKEFILE:BOOL=ON \
>                 -D CMAKE_SKIP_RULE_DEPENDENCY=ON \
>                 -D TPL_ENABLE_MPI:BOOL=ON \
>                 -D TPL_ENABLE_Netcdf:BOOL=ON \
>                 -D
> Netcdf_INCLUDE_DIRS:STRING=/panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/exodus/include \
>                 -D
> Netcdf_LIBRARY_DIRS:STRING=/panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/exodus/lib   \
>                 -D HAVE_STRING_H:BOOL=ON \
>                 -D Trilinos_ENABLE_DEBUG=OFF \
>                 -D Trilinos_ENABLE_ALL_PACKAGES:BOOL=OFF \
>                 -D Trilinos_ENABLE_ALL_FORWARD_DEP_PACKAGES=OFF \
>                 -D Trilinos_ENABLE_ALL_OPTIONAL_PACKAGES=OFF \
>                 -D Trilinos_ENABLE_TESTS:BOOL=OFF \
>                 -D Trilinos_ENABLE_Amesos:BOOL=ON \
>                 -D Trilinos_ENABLE_AztecOO:BOOL=ON \
>                 -D Trilinos_ENABLE_Belos:BOOL=ON \
>                 -D Trilinos_ENABLE_Ifpack:BOOL=ON \
>                 -D Trilinos_ENABLE_EpetraExt:BOOL=ON \
>                 -D Trilinos_ENABLE_ML:BOOL=ON \
>                 -D Trilinos_ENABLE_NOX:BOOL=ON \
>                 -D Trilinos_ENABLE_Trios:BOOL=ON \
>                 -D Trilinos_ENABLE_Zoltan:BOOL=ON \
>                 -D Trilinos_VERBOSE_CONFIGURE:BOOL=OFF \
>                 -D Trilinos_ENABLE_STRONG_CXX_COMPILE_WARNINGS=OFF \
>                 -D Trilinos_ENABLE_STRONG_C_COMPILE_WARNINGS=OFF \
>                 -D Trilinos_ENABLE_SHADOW_WARNINGS=OFF \
>                 -D NOX_ENABLE_ABSTRACT_IMPLEMENTATION_LAPACK=OFF \
>                 -D NOX_ENABLE_ABSTRACT_IMPLEMENTATION_EPETRA=ON \
>                 -D NOX_ENABLE_LOCA:BOOL=OFF \
>                 -D LAPACK_LIBRARY_DIRS:STRING= -D
> LAPACK_LIBRARY_NAMES:STRING= \
>                 -D BLAS_LIBRARY_DIRS:STRING=   -D
> BLAS_LIBRARY_NAMES:STRING= \
>                 /panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/common/Trilinos_a
>
> ===================================================================================
> These are the modules I have loaded:
> ===================================================================================
> Currently Loaded Modulefiles:
>   1) modules/3.2.6.6
>   2) xtpe-network-gemini
>   3) PrgEnv-cray/3.1.61
>   4) atp/1.1.2
>   5) xt-asyncpe/4.9
>   6) rca/1.0.0-2.0301.23101.14.211.gem
>   7) xe-sysroot/3.1.61
>   8) xpmem/0.1-2.0301.25333.20.2.gem
>   9) gni-headers/2.1-1.0301.2931.19.1.gem
>  10) dmapp/3.0-1.0301.2968.22.24.gem
>  11) pmi/2.1.1-1.0000.8296.10.8.gem
>  12) ugni/2.1-1.0301.2967.10.23.gem
>  13) udreg/2.2-1.0301.2966.16.2.gem
>  14) xt-mpich2/5.2.1
>  15) xt-libsci/10.5.0
>  16) acml/4.4.0
>  17) xt-totalview/8.8.0a
>  18) totalview-support/1.1.1
>  19) cce/7.3.3
>  20) eswrap/1.0.8
>  21) torque/2.4.11
>  22) moab/5.4.4
>  23) xtpe-mc8
>
> ===================================================================================
> This is a more detailed output:
> ===================================================================================
> .......
> -- Check for working CXX compiler: /opt/cray/xt-asyncpe/4.9/bin/CC --
> works
> -- Detecting CXX compiler ABI info
> -- Detecting CXX compiler ABI info - done
> -- CMAKE_CXX_COMPILER_ID=''
> -- The Fortran compiler identification is GNU
> -- Check for working Fortran
> compiler: /opt/cray/xt-asyncpe/4.9/bin/ftn
> -- Check for working Fortran
> compiler: /opt/cray/xt-asyncpe/4.9/bin/ftn  -- broken
> CMake Error
> at /panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/cmake-2.8.3/Modules/CMakeTestFortranCompiler.cmake:40 (MESSAGE):
>   The Fortran compiler "/opt/cray/xt-asyncpe/4.9/bin/ftn" is not able
> to
>   compile a simple test program.
>
>   It fails with the following output:
>
>    Change
> Dir: /panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos_build/CMakeFiles/CMakeTmp
>
>   Run Build Command:/usr/bin/gmake "cmTryCompileExec/fast"
>
>   gmake[1]: Entering directory
>
> `/panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos_build/CMakeFiles/CMakeTmp'
>
>   /usr/bin/gmake -f CMakeFiles/cmTryCompileExec.dir/build.make
>   CMakeFiles/cmTryCompileExec.dir/build
>
>   gmake[2]: Entering directory
>
> `/panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos_build/CMakeFiles/CMakeTmp'
>
>
>   /panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/cmake-2.8.3/bin/cmake
>   -E cmake_progress_report
>   /panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos_build/CMakeFiles/CMakeTmp/CMakeFiles
>   1
>
>   Building Fortran object
>   CMakeFiles/cmTryCompileExec.dir/testFortranCompiler.f.o
>
>   /opt/cray/xt-asyncpe/4.9/bin/ftn -o
>   CMakeFiles/cmTryCompileExec.dir/testFortranCompiler.f.o -O3 -DNDEBUG
> -c
>   /panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos_build/CMakeFiles/CMakeTmp/testFortranCompiler.f
>
>
>   Linking Fortran executable cmTryCompileExec
>
>
>   /panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/cmake-2.8.3/bin/cmake
>   -E cmake_link_script CMakeFiles/cmTryCompileExec.dir/link.txt
> --verbose=1
>
>   /opt/cray/xt-asyncpe/4.9/bin/ftn -O3 -DNDEBUG
>   CMakeFiles/cmTryCompileExec.dir/testFortranCompiler.f.o -o
> cmTryCompileExec
>  -rdynamic
>
>   ftn-2191 crayftn: ERROR in command line
>
>     "ynamic" is an invalid argument to the "-r" option.
>
>   ftn-2191 crayftn: ERROR in command line
>
>     "namic" is an invalid argument to the "-r" option.
>
>   gmake[2]: *** [cmTryCompileExec] Error 1
>
>   gmake[2]: Leaving directory
>
> `/panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos_build/CMakeFiles/CMakeTmp'
>
>
>   gmake[1]: *** [cmTryCompileExec/fast] Error 2
>
>   gmake[1]: Leaving directory
>
> `/panfs/scratch/projects/a/build/cielo/test_cray_compilers/a.2734/user/machines/cielo/trilinos_build/CMakeFiles/CMakeTmp'
>
>
>   CMake will not be able to correctly generate this project.
> Call Stack (most recent call first):
>   cmake/package_arch/PackageArchGlobalMacros.cmake:758
> (ENABLE_LANGUAGE)
>   CMakeLists.txt:164 (PACKAGE_ARCH_PRE_SETUP_ENV)
> -- Configuring incomplete, errors occurred!
>
>
> ===================================================================================
> >From CMakeFiles/CMakeError.log
> ===================================================================================
> .......
> /opt/cray/xt-asyncpe/4.9/bin/ftn     -O3 -DNDEBUG
> CMakeFiles/cmTryCompileExec.dir/testFortranCompiler.f.o  -o
> cmTryCompileExec -rdynamic
> ftn-2191 crayftn: ERROR in command line
>   "ynamic" is an invalid argument to the "-r" option.
> ftn-2191 crayftn: ERROR in command line
>   "namic" is an invalid argument to the "-r" option.
>
>
> -rdynamic is not an option for the cray compilers.
>
>
>
>
> _______________________________________________
> Trilinos-Users mailing list
> Trilinos-Users at software.sandia.gov
> http://software.sandia.gov/mailman/listinfo/trilinos-users


_______________________________________________
Trilinos-Users mailing list
Trilinos-Users at software.sandia.gov
http://software.sandia.gov/mailman/listinfo/trilinos-users

_______________________________________________
Trilinos-Users mailing list
Trilinos-Users at software.sandia.gov
http://software.sandia.gov/mailman/listinfo/trilinos-users

_______________________________________________
Trilinos-Users mailing list
Trilinos-Users at software.sandia.gov
http://software.sandia.gov/mailman/listinfo/trilinos-users



More information about the Trilinos-Users mailing list