[Trilinos-Users] [EXTERNAL] Re: Linker errors with static MUMPS

Mon Mar 28 14:34:15 EDT 2016

Dear Ross,

Joshua already pointed me to adding extra libs in
Trilinos_EXTRA_LINK_FLAGS, as described here
https://trilinos.org/docs/r12.6/packages/amesos2/doc/html/classAmesos2_1_1MUMPS.html
I will give it a go.
But strangely enough, i do have `-lgfortran` there, but not Fortran MPI libs.
I guess that’s the reason.

I do indeed not see any problems with shared libs and exactly the same CMake input params.

Kind regards,
Denis 

> On 28 Mar 2016, at 20:30, Bartlett, Roscoe A <rabartl at sandia.gov> wrote:
> 
> Have you tried adding 
> 
>   -DTrilinos_EXTRA_LINK_FLAGS="-lgfortran"
> 
> to your configure line?
> 
> Any general system libraries that need to get added can usually be added by listing them in Trilinos_EXTRA_LINK_FLAGS (which is a terrible CMake hack).  This is typically a problem with static libs that you rarely see with shared libs.
> 
> Cheers,
> 
> -Ross
> 
>> -----Original Message-----
>> From: Trilinos-Users [mailto:trilinos-users-bounces at trilinos.org] On Behalf Of
>> Booth, Joshua Dennis
>> Sent: Monday, March 28, 2016 11:00 AM
>> To: Denis Davydov; trilinos-users
>> Subject: Re: [Trilinos-Users] [EXTERNAL] Re: Linker errors with static MUMPS
>> 
>> Hi David,
>> 
>> I will give this a look today.  I build with static MUMPS all the time.  Most likely
>> issues off the top of my head are not explicitly linking to the fortran MPI library
>> or you are providing the library names in the wrong order.  If you send me the
>> cmake file to (jdbooth at sandia.gov) I can look at it and try to reproduce your
>> error sorry for the delay.
>> 
>> Joshua Booth
>> ________________________________________
>> From: Trilinos-Users <trilinos-users-bounces at trilinos.org> on behalf of Denis
>> Davydov <davydden at gmail.com>
>> Sent: Saturday, March 26, 2016 10:31 AM
>> To: trilinos-users
>> Subject: [EXTERNAL] Re: [Trilinos-Users] Linker errors with static MUMPS
>> 
>> p.s. PETSc builds fine against the same static build of MUMPS.
>> So it could be a configuration bug inside Trilinos somewhere...
>> 
>>> On 25 Mar 2016, at 00:30, Denis Davydov <davydden at gmail.com> wrote:
>>> 
>>> Dera all,
>>> 
>>> I am trying to build Trilinos as shared library compiled with static MUMPS and
>> get the linking errors below.
>>> MUMPS is built with -fPIC in OPTF, OPTC, and OPTL.
>>> For Trilinos CMake config i use:
>>> 
>>> -DTPL_ENABLE_MUMPS:BOOL=ON
>>> -DMUMPS_LIBRARY_DIRS=/path/to/mumps/lib
>>> -DMUMPS_LIBRARY_NAMES=dmumps;mumps_common;pord
>>> 
>>> Regards,
>>> Denis.
>>> 
>>> [ 34%] Linking CXX shared library libamesos.dylib Undefined symbols
>>> for architecture x86_64:
>>> "__gfortran_adjustl", referenced from:
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_dump_problem_ in libdmumps.a(dana_driver.o)
>>> "__gfortran_concat_string", referenced from:
>>>     _mumps_irealloc_ in libmumps_common.a(tools_common.o)
>>>     _mumps_srealloc_ in libmumps_common.a(tools_common.o)
>>>     _mumps_drealloc_ in libmumps_common.a(tools_common.o)
>>>     _mumps_crealloc_ in libmumps_common.a(tools_common.o)
>>>     _mumps_zrealloc_ in libmumps_common.a(tools_common.o)
>>>     _dmumps_dump_problem_ in libdmumps.a(dana_driver.o)
>>> "__gfortran_internal_pack", referenced from:
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     ___dmumps_load_MOD_dmumps_next_node in
>> libdmumps.a(dmumps_load.o)
>>>     _mumps_split_during_mapping.5101 in
>>> libmumps_common.a(mumps_static_mapping.o)
>>> "__gfortran_internal_unpack", referenced from:
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     ___dmumps_load_MOD_dmumps_next_node in
>> libdmumps.a(dmumps_load.o)
>>>     _mumps_split_during_mapping.5101 in
>>> libmumps_common.a(mumps_static_mapping.o)
>>> "__gfortran_os_error", referenced from:
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_ana_driver_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_treetab in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_send_buf in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_scotch_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ...
>>> "__gfortran_random_r8", referenced from:
>>>     _mumps_permute_rhs_am1_ in libmumps_common.a(mumps_sol_es.o)
>>>     _mumps_propmap.4939 in
>> libmumps_common.a(mumps_static_mapping.o)
>>>     _mumps_mod_propmap.4944 in
>>> libmumps_common.a(mumps_static_mapping.o)
>>> "__gfortran_runtime_error", referenced from:
>>>     _dmumps_ana_driver_ in libdmumps.a(dana_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_treetab in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_send_buf in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_scotch_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_ana_n_par_ in libdmumps.a(dana_aux.o)
>>>     ...
>>> "__gfortran_runtime_error_at", referenced from:
>>>     _dmumps_f77_ in libdmumps.a(dmumps_f77.o)
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     ___dmumps_ooc_MOD_dmumps_ooc_open_files_for_solve in
>> libdmumps.a(dmumps_ooc.o)
>>>     ___dmumps_ooc_MOD_dmumps_ooc_end_facto in
>> libdmumps.a(dmumps_ooc.o)
>>>     _dmumps_gather_matrix_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_ana_driver_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_end_driver_ in libdmumps.a(dend_driver.o)
>>>     ...
>>> "__gfortran_select_string", referenced from:
>>>     _mumps_parana_avail_ in libmumps_common.a(tools_common.o)
>>> "__gfortran_size0", referenced from:
>>>     _dmumps_size_in_struct_ in libdmumps.a(dtools.o)
>>> "__gfortran_st_close", referenced from:
>>>     _dmumps_dump_problem_ in libdmumps.a(dana_driver.o)
>>> "__gfortran_st_open", referenced from:
>>>     _dmumps_dump_problem_ in libdmumps.a(dana_driver.o)
>>> "__gfortran_st_write", referenced from:
>>>     _dmumps_f77_ in libdmumps.a(dmumps_f77.o)
>>>     _dmumps_print_icntl_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_print_keep_ in libdmumps.a(dmumps_driver.o)
>>>     _mumps_mem_centralize_ in libmumps_common.a(tools_common.o)
>>>     _mumps_irealloc_ in libmumps_common.a(tools_common.o)
>>>     _mumps_srealloc_ in libmumps_common.a(tools_common.o)
>>>     ...
>>> "__gfortran_st_write_done", referenced from:
>>>     _dmumps_f77_ in libdmumps.a(dmumps_f77.o)
>>>     _dmumps_print_icntl_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_print_keep_ in libdmumps.a(dmumps_driver.o)
>>>     _mumps_mem_centralize_ in libmumps_common.a(tools_common.o)
>>>     _mumps_irealloc_ in libmumps_common.a(tools_common.o)
>>>     _mumps_srealloc_ in libmumps_common.a(tools_common.o)
>>>     ...
>>> "__gfortran_stop_string", referenced from:
>>>     ___mumps_static_mapping_MOD_mumps_sort_msort in
>> libmumps_common.a(mumps_static_mapping.o)
>>>     ___dmumps_fac_par_m_MOD_dmumps_fac_par in
>>> libdmumps.a(dfac_par_m.o)  "__gfortran_string_len_trim", referenced from:
>>>     ___dmumps_ooc_MOD_dmumps_ooc_init_facto in
>> libdmumps.a(dmumps_ooc.o)
>>>     _dmumps_dump_rhs_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_dump_matrix_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_dump_problem_ in libdmumps.a(dana_driver.o)
>>> "__gfortran_string_trim", referenced from:
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_dump_problem_ in libdmumps.a(dana_driver.o)
>>> "__gfortran_transfer_array_write", referenced from:
>>>     ___dmumps_ooc_MOD_dmumps_ooc_open_files_for_solve in
>> libdmumps.a(dmumps_ooc.o)
>>>     ___dmumps_ooc_MOD_dmumps_ooc_end_solve in
>> libdmumps.a(dmumps_ooc.o)
>>>     ___dmumps_ooc_MOD_dmumps_get_bottom_area_space in
>> libdmumps.a(dmumps_ooc.o)
>>>     ___dmumps_ooc_MOD_dmumps_get_top_area_space in
>> libdmumps.a(dmumps_ooc.o)
>>>     ___dmumps_ooc_MOD_dmumps_solve_is_inode_in_mem in
>> libdmumps.a(dmumps_ooc.o)
>>>     ___dmumps_ooc_MOD_dmumps_update_read_req_node in
>> libdmumps.a(dmumps_ooc.o)
>>>     ___dmumps_ooc_MOD_dmumps_read_solve_block in
>> libdmumps.a(dmumps_ooc.o)
>>>     ...
>>> "__gfortran_transfer_character_write", referenced from:
>>>     _dmumps_f77_ in libdmumps.a(dmumps_f77.o)
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _mumps_mem_centralize_ in libmumps_common.a(tools_common.o)
>>>     _mumps_abort_on_overflow_ in libmumps_common.a(tools_common.o)
>>>     _mumps_sort_step_ in libmumps_common.a(tools_common.o)
>>>     _check_equal_ in libmumps_common.a(tools_common.o)
>>>     ___dmumps_ooc_MOD_dmumps_ooc_store_loru in
>> libdmumps.a(dmumps_ooc.o)
>>>     ...
>>> "__gfortran_transfer_integer_write", referenced from:
>>>     _dmumps_f77_ in libdmumps.a(dmumps_f77.o)
>>>     _dmumps_print_icntl_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_print_keep_ in libdmumps.a(dmumps_driver.o)
>>>     _check_equal_ in libmumps_common.a(tools_common.o)
>>>     ___dmumps_ooc_MOD_dmumps_ooc_store_loru in
>> libdmumps.a(dmumps_ooc.o)
>>>     ___dmumps_ooc_MOD_dmumps_ooc_open_files_for_solve in
>> libdmumps.a(dmumps_ooc.o)
>>>     ...
>>> "__gfortran_transfer_logical_write", referenced from:
>>>     ___dmumps_ooc_MOD_dmumps_ooc_store_loru in
>> libdmumps.a(dmumps_ooc.o)
>>>     _dmumps_alloc_cb_ in libdmumps.a(dfac_mem_alloc_cb.o)
>>>     _dmumps_fac_stack_ in libdmumps.a(dfac_mem_stack.o)
>>> "__gfortran_transfer_real_write", referenced from:
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_dump_rhs_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_dump_matrix_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_solve_driver_ in libdmumps.a(dsol_driver.o)
>>>     ___dmumps_load_MOD_dmumps_load_comp_maxmem_pool in
>> libdmumps.a(dmumps_load.o)
>>>     ___dmumps_load_MOD_dmumps_set_parti_flop_irr in
>> libdmumps.a(dmumps_load.o)
>>>     ...
>>> "_blacs_gridexit_", referenced from:
>>>     _dmumps_end_driver_ in libdmumps.a(dend_driver.o)
>>>     _dmumps_init_root_ana_ in libdmumps.a(dtype3_root.o)
>>> "_blacs_gridinfo_", referenced from:
>>>     _dmumps_init_root_ana_ in libdmumps.a(dtype3_root.o)
>>>     _dmumps_root_solve_ in libdmumps.a(dsol_root_parallel.o)
>>> "_blacs_gridinit_", referenced from:
>>>     _dmumps_init_root_ana_ in libdmumps.a(dtype3_root.o)
>>> "_descinit_", referenced from:
>>>     _dmumps_solve_2d_bcyclic_ in libdmumps.a(dsol_root_parallel.o)
>>>     _dmumps_facto_root_ in libdmumps.a(dfac_root_parallel.o)
>>> "_mpi_abort_", referenced from:
>>>     _mumps_abort_ in libmumps_common.a(tools_common.o)
>>> "_mpi_allgatherv_", referenced from:
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>>> libdmumps.a(dana_aux_par.o)  "_mpi_allreduce_", referenced from:
>>>     _dmumps_set_infog_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _mumps_allreducei8_ in libmumps_common.a(tools_common.o)
>>>     ___dmumps_ooc_MOD_dmumps_ooc_init_solve in
>> libdmumps.a(dmumps_ooc.o)
>>>     _dmumps_dump_problem_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_ana_driver_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     ...
>>> "_mpi_alltoall_", referenced from:
>>>     ___dmumps_parallel_analysis_MOD_dmumps_send_buf in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_scotch_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_numvolsndrcv_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_numvolsndrcvsym_ in
>>> libdmumps.a(dfac_scalings_simScale_util.o)
>>> "_mpi_barrier_", referenced from:
>>>     _dmumps_finish_recv_ in libdmumps.a(dend_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_sol_c_ in libdmumps.a(dsol_c.o)
>>>     ___dmumps_fac_par_m_MOD_dmumps_fac_par in
>> libdmumps.a(dfac_par_m.o)
>>>     _dmumps_setupcomms_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_setupcommssym_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_mpi_cancel_ in libdmumps.a(dfac_process_message.o)
>>>     ...
>>> "_mpi_bcast_", referenced from:
>>>     _dmumps_f77_ in libdmumps.a(dmumps_f77.o)
>>>     _dmumps_set_infog_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _mumps_bcast_i8_ in libmumps_common.a(tools_common.o)
>>>     _dmumps_ana_driver_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_ini_driver_ in libdmumps.a(dini_driver.o)
>>>     ...
>>> "_mpi_cancel_", referenced from:
>>>     ___dmumps_comm_buffer_MOD_buf_deall in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>    (maybe you meant: _dmumps_mpi_cancel_)  "_mpi_comm_dup_",
>>> referenced from:
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_ini_driver_ in libdmumps.a(dini_driver.o)
>>> "_mpi_comm_free_", referenced from:
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_end_driver_ in libdmumps.a(dend_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>>> libdmumps.a(dana_aux_par.o)  "_mpi_comm_rank_", referenced from:
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_ini_driver_ in libdmumps.a(dini_driver.o)
>>>     ___dmumps_load_MOD_dmumps_load_init in
>> libdmumps.a(dmumps_load.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_send_buf in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_scotch_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ...
>>> "_mpi_comm_size_", referenced from:
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_ini_driver_ in libdmumps.a(dini_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_send_buf in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_scotch_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>>> libdmumps.a(dana_aux_par.o)  "_mpi_comm_split_", referenced from:
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_ini_driver_ in libdmumps.a(dini_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>>> libdmumps.a(dana_aux_par.o)  "_mpi_gather_", referenced from:
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>>> libdmumps.a(dana_aux_par.o)  "_mpi_gatherv_", referenced from:
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>>> libdmumps.a(dana_aux_par.o)  "_mpi_get_count_", referenced from:
>>>     _dmumps_finish_recv_ in libdmumps.a(dend_driver.o)
>>>     ___dmumps_load_MOD_dmumps_load_recv_msgs in
>> libdmumps.a(dmumps_load.o)
>>>     _dmumps_scatter_rhs_ in libdmumps.a(dsol_c.o)
>>>     _dmumps_elt_distrib_ in libdmumps.a(dfac_distrib_ELT.o)
>>>     _dmumps_recv_and_treat_ in libdmumps.a(dfac_process_message.o)
>>>     _dmumps_try_recvtreat_ in libdmumps.a(dfac_process_message.o)
>>>     _dmumps_backslv_recv_and_treat_ in libdmumps.a(dsol_bwd_aux.o)
>>>     ...
>>> "_mpi_get_processor_name_", referenced from:
>>>     ___mumps_static_mapping_MOD_mumps_init_arch_parameters in
>>> libmumps_common.a(mumps_static_mapping.o)
>>> "_mpi_initialized_", referenced from:
>>>     _dmumps_ in libdmumps.a(dmumps_driver.o)  "_mpi_iprobe_",
>>> referenced from:
>>>     _dmumps_finish_recv_ in libdmumps.a(dend_driver.o)
>>>     ___dmumps_load_MOD_dmumps_load_recv_msgs in
>> libdmumps.a(dmumps_load.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_send_buf in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_scotch_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_dist_fill_buffer_ in libdmumps.a(dfac_distrib_distentry.o)
>>>     _dmumps_redistribution_ in libdmumps.a(dfac_distrib_distentry.o)
>>>     ...
>>> "_mpi_irecv_", referenced from:
>>>     _dmumps_gather_matrix_ in libdmumps.a(dana_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_setupcomms_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_docomminf_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_docomm1n_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_setupcommssym_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_try_recvtreat_ in libdmumps.a(dfac_process_message.o)
>>>     ...
>>> "_mpi_isend_", referenced from:
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_bcast_array in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_not_mstr in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_fils in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_broadcast in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_update_load in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_backvec in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_root2slave in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ...
>>> "_mpi_op_create_", referenced from:
>>>     _dmumps_deter_reduction_ in libdmumps.a(dfac_determinant.o)
>>>     _dmumps_createpartvec_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_createpartvecsym_ in
>>> libdmumps.a(dfac_scalings_simScale_util.o)
>>> "_mpi_op_free_", referenced from:
>>>     _dmumps_deter_reduction_ in libdmumps.a(dfac_determinant.o)
>>>     _dmumps_createpartvec_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_createpartvecsym_ in
>>> libdmumps.a(dfac_scalings_simScale_util.o)
>>> "_mpi_pack_", referenced from:
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_bcast_array in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_not_mstr in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_fils in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_broadcast in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_update_load in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_backvec in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_contrib_type3 in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ...
>>> "_mpi_pack_size_", referenced from:
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_bcast_array in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_not_mstr in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_fils in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_broadcast in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_update_load in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_backvec in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_send_contrib_type3 in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ...
>>> "_mpi_probe_", referenced from:
>>>     _dmumps_elt_distrib_ in libdmumps.a(dfac_distrib_ELT.o)
>>>     _dmumps_try_recvtreat_ in libdmumps.a(dfac_process_message.o)
>>>     _dmumps_backslv_recv_and_treat_ in libdmumps.a(dsol_bwd_aux.o)
>>>     _dmumps_solve_recv_and_treat_ in libdmumps.a(dsol_fwd_aux.o)
>>> "_mpi_recv_", referenced from:
>>>     _dmumps_gather_matrix_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_ana_driver_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_finish_recv_ in libdmumps.a(dend_driver.o)
>>>     _dmumps_extract_schur_redrhs_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_solve_driver_ in libdmumps.a(dsol_driver.o)
>>>     ___dmumps_load_MOD_dmumps_load_recv_msgs in
>> libdmumps.a(dmumps_load.o)
>>>     ...
>>> "_mpi_reduce_", referenced from:
>>>     _mumps_mem_centralize_ in libmumps_common.a(tools_common.o)
>>>     _mumps_reducei8_ in libmumps_common.a(tools_common.o)
>>>     _dmumps_avgmax_stat8_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_solve_driver_ in libdmumps.a(dsol_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_scotch_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_anorminf_ in libdmumps.a(dfac_scalings.o)
>>>     ...
>>> "_mpi_reduce_scatter_", referenced from:
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_scotch_graph in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_build_loc_graph in
>>> libdmumps.a(dana_aux_par.o)  "_mpi_request_free_", referenced from:
>>>     ___dmumps_comm_buffer_MOD_buf_deall in
>>> libdmumps.a(dmumps_comm_buffer.o)  "_mpi_send_", referenced from:
>>>     _dmumps_gather_matrix_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_ana_driver_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_extract_schur_redrhs_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_solve_driver_ in libdmumps.a(dsol_driver.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_arrow_finish_send_buf_ in libdmumps.a(darrowheads.o)
>>>     ...
>>> "_mpi_ssend_", referenced from:
>>>     _dmumps_scatter_root_ in libdmumps.a(dtype3_root.o)
>>>     _dmumps_gather_root_ in libdmumps.a(dtype3_root.o)  "_mpi_test_",
>>> referenced from:
>>>     ___dmumps_comm_buffer_MOD_buf_look in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_size_available in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_buf_deall in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_comm_buffer_MOD_dmumps_buf_try_free_cb in
>> libdmumps.a(dmumps_comm_buffer.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_send_buf in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_dist_fill_buffer_ in libdmumps.a(dfac_distrib_distentry.o)
>>>     _dmumps_try_recvtreat_ in libdmumps.a(dfac_process_message.o)
>>>     ...
>>> "_mpi_type_commit_", referenced from:
>>>     _dmumps_deter_reduction_ in libdmumps.a(dfac_determinant.o)
>>> "_mpi_type_contiguous_", referenced from:
>>>     _dmumps_deter_reduction_ in libdmumps.a(dfac_determinant.o)
>>> "_mpi_type_free_", referenced from:
>>>     _dmumps_deter_reduction_ in libdmumps.a(dfac_determinant.o)
>>> "_mpi_unpack_", referenced from:
>>>     ___dmumps_load_MOD_dmumps_load_process_message in
>> libdmumps.a(dmumps_load.o)
>>>     _dmumps_gather_solution_ in libdmumps.a(dsol_c.o)
>>>     _dmumps_gather_solution_am1_ in libdmumps.a(dsol_c.o)
>>>     _dmumps_traiter_message_ in libdmumps.a(dfac_process_message.o)
>>>     _dmumps_backslv_traiter_message_ in libdmumps.a(dsol_bwd_aux.o)
>>>     _dmumps_process_blfac_slave_ in
>> libdmumps.a(dfac_process_blfac_slave.o)
>>>     _dmumps_process_blocfacto_ in libdmumps.a(dfac_process_blocfacto.o)
>>>     ...
>>> "_mpi_wait_", referenced from:
>>>     ___dmumps_parallel_analysis_MOD_dmumps_send_buf in
>> libdmumps.a(dana_aux_par.o)
>>>     ___dmumps_parallel_analysis_MOD_dmumps_ana_f_par in
>> libdmumps.a(dana_aux_par.o)
>>>     _dmumps_dist_fill_buffer_ in libdmumps.a(dfac_distrib_distentry.o)
>>>     _dmumps_redistribution_ in libdmumps.a(dfac_distrib_distentry.o)
>>>     _dmumps_try_recvtreat_ in libdmumps.a(dfac_process_message.o)
>>>     _dmumps_mpi_cancel_ in libdmumps.a(dfac_process_message.o)
>>> "_mpi_waitall_", referenced from:
>>>     _dmumps_setupcomms_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_docomminf_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_docomm1n_ in libdmumps.a(dfac_scalings_simScale_util.o)
>>>     _dmumps_setupcommssym_ in
>>> libdmumps.a(dfac_scalings_simScale_util.o)
>>> "_mpi_waitany_", referenced from:
>>>     _dmumps_gather_matrix_ in libdmumps.a(dana_driver.o)
>>> "_mpi_wtime_", referenced from:
>>>     _mumps_secdeb_ in libmumps_common.a(tools_common.o)
>>>     _mumps_secfin_ in libmumps_common.a(tools_common.o)
>>>     _dmumps_solve_driver_ in libdmumps.a(dsol_driver.o)
>>>     _dmumps_compre_new_ in libdmumps.a(dfac_mem_compress_cb.o)
>>> "_numroc_", referenced from:
>>>     _dmumps_ana_driver_ in libdmumps.a(dana_driver.o)
>>>     _dmumps_fac_driver_ in libdmumps.a(dfac_driver.o)
>>>     _dmumps_facto_send_arrowheads_ in libdmumps.a(darrowheads.o)
>>>     _dmumps_facto_recv_arrowhd2_ in libdmumps.a(darrowheads.o)
>>>     _dmumps_redistribution_ in libdmumps.a(dfac_distrib_distentry.o)
>>>     _dmumps_elt_distrib_ in libdmumps.a(dfac_distrib_ELT.o)
>>>     _dmumps_root_alloc_static_ in libdmumps.a(dtype3_root.o)
>>>     ...
>>> "_pdgetrf_", referenced from:
>>>     _dmumps_facto_root_ in libdmumps.a(dfac_root_parallel.o)
>>> "_pdgetrs_", referenced from:
>>>     _dmumps_solve_2d_bcyclic_ in libdmumps.a(dsol_root_parallel.o)
>>> "_pdpotrf_", referenced from:
>>>     _dmumps_facto_root_ in libdmumps.a(dfac_root_parallel.o)
>>> "_pdpotrs_", referenced from:
>>>     _dmumps_solve_2d_bcyclic_ in libdmumps.a(dsol_root_parallel.o)
>>> ld: symbol(s) not found for architecture x86_64
>>> clang: error: linker command failed with exit code 1 (use -v to see
>>> invocation)
>>> 
>>> 
>> 
>> _______________________________________________
>> Trilinos-Users mailing list
>> Trilinos-Users at trilinos.org
>> https://trilinos.org/mailman/listinfo/trilinos-users
>> _______________________________________________
>> Trilinos-Users mailing list
>> Trilinos-Users at trilinos.org
>> https://trilinos.org/mailman/listinfo/trilinos-users