[Trilinos-Users] Zoltan rcb bug?
Biddiscombe, John A.
biddisco at cscs.ch
Tue Jun 21 05:58:49 MDT 2011
This is the output when it doesn't crash. Recompute box off.
ZOLTAN Parameter IMBALANCE_TOL[0] = 1.100000
ZOLTAN Parameter AUTO_MIGRATE = TRUE
ZOLTAN Parameter MIGRATE_ONLY_PROC_CHANGES = 1
ZOLTAN Parameter OBJ_WEIGHT_DIM = 0
ZOLTAN Parameter EDGE_WEIGHT_DIM = 0
ZOLTAN Parameter DEBUG_LEVEL = 2
ZOLTAN Parameter DEBUG_PROCESSOR = 0
ZOLTAN Parameter DETERMINISTIC = TRUE
ZOLTAN Parameter TIMER = 1 (wall)
ZOLTAN Parameter NUM_GID_ENTRIES = 1
ZOLTAN Parameter NUM_LID_ENTRIES = 1
ZOLTAN Parameter RETURN_LISTS = IMPORT AND EXPORT
ZOLTAN Parameter NUM_GLOBAL_PARTS = 32
ZOLTAN Parameter NUM_LOCAL_PARTS = -1
ZOLTAN Parameter REMAP = 1
ZOLTAN Parameter SEED = 123456789 (123456789)
ZOLTAN Parameter LB_APPROACH = REPARTITION
ZOLTAN Parameter USE_MACHINE_DESC = 0
ZOLTAN Parameter MACHINE_DESC_FILE = /etc/local/Zoltan_Machine_Desc
ZOLTAN Parameter RCB_OVERALLOC = 1.200000
ZOLTAN Parameter RCB_REUSE = 0
ZOLTAN Parameter CHECK_GEOM = 1
ZOLTAN Parameter RCB_OUTPUT_LEVEL = 2
ZOLTAN Parameter KEEP_CUTS = 1
ZOLTAN Parameter RCB_LOCK_DIRECTIONS = 0
ZOLTAN Parameter RCB_SET_DIRECTIONS = 0
ZOLTAN Parameter RCB_RECTILINEAR_BLOCKS = 1
ZOLTAN Parameter OBJ_WEIGHTS_COMPARABLE = 0
ZOLTAN Parameter RCB_MULTICRITERIA_NORM = 1
ZOLTAN Parameter RCB_MAX_ASPECT_RATIO = 10.000000
ZOLTAN Parameter AVERAGE_CUTS = 0
ZOLTAN Parameter RANDOM_PIVOTS = 0
ZOLTAN Parameter RCB_RECOMPUTE_BOX = 0
ZOLTAN Parameter REDUCE_DIMENSIONS = 0
ZOLTAN Parameter DEGENERATE_RATIO = 0.000000
ZOLTAN Parameter FINAL_OUTPUT = 0
ZOLTAN Parameter KEEP_CUTS = 1
ZOLTAN Parameter REDUCE_DIMENSIONS = 0
ZOLTAN Parameter DEGENERATE_RATIO = 10.000000
there's a lot of other debug stuff, some of which I've included below
thanks
JB
Partitioning total time: 3.30546 (secs)
Partitioning Statistics:
Total weight of dots = 4.16812e+06
Weight on each proc: ave = 130254, max = 130366, min = 130153
Proc 0 has weight = 130247
Proc 3 has weight = 130192
Proc 6 has weight = 130296
Proc 10 has weight = 130246
Proc 13 has weight = 130153
Proc 15 has weight = 130242
Proc 16 has weight = 130292
Proc 17 has weight = 130263
Proc 18 has weight = 130233
Proc 21 has weight = 130245
Proc 11 has weight = 130223
Proc 30 has weight = 130262
Proc 1 has weight = 130280
Proc 8 has weight = 130273
Proc 9 has weight = 130248
Proc 12 has weight = 130295
Proc 20 has weight = 130246
Proc 14 has weight = 130241
Proc 27 has weight = 130366
Proc 22 has weight = 130279
Proc 24 has weight = 130246
Proc 19 has weight = 130193
Proc 26 has weight = 130282
Proc 25 has weight = 130154
Proc 4 has weight = 130265
Proc 5 has weight = 130263
Proc 7 has weight = 130297
Proc 31 has weight = 130243
Proc 29 has weight = 130266
Proc 23 has weight = 130245
Proc 28 has weight = 130263
Proc 2 has weight = 130280
Maximum weight of single dot = 1
Proc 0 max weight = 1
Proc 2 max weight = 1
Proc 4 max weight = 1
Proc 5 max weight = 1
Proc 8 max weight = 1
Proc 9 max weight = 1
Proc 10 max weight = 1
Proc 1 max weight = 1
Proc 3 max weight = 1
Proc 6 max weight = 1
Proc 7 max weight = 1
Proc 22 max weight = 1
Proc 23 max weight = 1
Proc 24 max weight = 1
Proc 25 max weight = 1
Proc 26 max weight = 1
Proc 27 max weight = 1
Proc 28 max weight = 1
Proc 29 max weight = 1
Proc 30 max weight = 1
Proc 31 max weight = 1
Proc 11 max weight = 1
Proc 12 max weight = 1
Proc 13 max weight = 1
Proc 14 max weight = 1
Proc 15 max weight = 1
Proc 16 max weight = 1
Proc 17 max weight = 1
Proc 18 max weight = 1
Proc 19 max weight = 1
Proc 20 max weight = 1
Proc 21 max weight = 1
Send count: ave = 427986, min = 164109, max = 737764
Proc 0 send count = 467801
Proc 1 send count = 407855
Proc 2 send count = 613068
Proc 3 send count = 737764
Proc 4 send count = 489472
Proc 5 send count = 473088
Proc 6 send count = 353091
Proc 7 send count = 323929
Proc 8 send count = 318513
Proc 9 send count = 164109
Proc 10 send count = 438260
Proc 11 send count = 282747
Proc 12 send count = 226638
Proc 13 send count = 487763
Proc 14 send count = 381356
Proc 15 send count = 371550
Proc 16 send count = 410856
Proc 17 send count = 357076
Proc 18 send count = 441617
Proc 19 send count = 383678
Proc 20 send count = 389516
Proc 21 send count = 417805
Proc 22 send count = 550211
Proc 23 send count = 539294
Proc 24 send count = 311689
Proc 25 send count = 411977
Proc 26 send count = 346382
Proc 27 send count = 450992
Proc 28 send count = 419707
Proc 29 send count = 460854
Proc 30 send count = 603492
Proc 31 send count = 663414
Recv count: ave = 427986, min = 242962, max = 623558
Proc 0 recv count = 328482
Proc 1 recv count = 242962
Proc 2 recv count = 424687
Proc 3 recv count = 404280
Proc 4 recv count = 406069
Proc 5 recv count = 458705
Proc 6 recv count = 444103
Proc 7 recv count = 408982
Proc 8 recv count = 401862
Proc 9 recv count = 256677
Proc 10 recv count = 450231
Proc 22 recv count = 545161
Proc 23 recv count = 623558
Proc 24 recv count = 394579
Proc 25 recv count = 450816
Proc 26 recv count = 411390
Proc 27 recv count = 493711
Proc 28 recv count = 506142
Proc 29 recv count = 523262
Proc 30 recv count = 279928
Proc 31 recv count = 414476
Proc 11 recv count = 284520
Proc 12 recv count = 268486
Proc 13 recv count = 520850
Proc 14 recv count = 442930
Proc 15 recv count = 454121
Proc 16 recv count = 496446
Proc 17 recv count = 435226
Proc 18 recv count = 515891
Proc 19 recv count = 479061
Proc 20 recv count = 463379
Proc 21 recv count = 464591
Max dots: ave = 177191, min = 130243, max = 463676
Proc 11 max dots = 130271
Proc 12 max dots = 130296
Proc 13 max dots = 130296
Proc 14 max dots = 130295
Proc 15 max dots = 130297
Proc 16 max dots = 130292
Proc 17 max dots = 130263
Proc 18 max dots = 130245
Proc 19 max dots = 130243
Proc 20 max dots = 130246
Proc 21 max dots = 130245
Proc 22 max dots = 135329
Proc 23 max dots = 130245
Proc 24 max dots = 130246
Proc 25 max dots = 130246
Proc 26 max dots = 130282
Proc 27 max dots = 130366
Proc 28 max dots = 130263
Proc 29 max dots = 130266
Proc 30 max dots = 453826
Proc 31 max dots = 379181
Proc 0 max dots = 269568
Proc 1 max dots = 295173
Proc 2 max dots = 318662
Proc 4 max dots = 213668
Proc 5 max dots = 144646
Proc 6 max dots = 130296
Proc 7 max dots = 130366
Proc 8 max dots = 130273
Proc 9 max dots = 130272
Proc 10 max dots = 130273
Proc 3 max dots = 463676
Max memory: ave = 212086, min = 141931, max = 556412
Proc 0 max memory = 323480
Proc 1 max memory = 354208
Proc 2 max memory = 382394
Proc 3 max memory = 556412
Proc 4 max memory = 256402
Proc 5 max memory = 173576
Proc 6 max memory = 156315
Proc 7 max memory = 156314
Proc 8 max memory = 156326
Proc 9 max memory = 156326
Proc 10 max memory = 141931
Proc 22 max memory = 162395
Proc 23 max memory = 156260
Proc 24 max memory = 156295
Proc 25 max memory = 156295
Proc 26 max memory = 156295
Proc 27 max memory = 156294
Proc 28 max memory = 156315
Proc 29 max memory = 156315
Proc 30 max memory = 544592
Proc 31 max memory = 455018
Proc 11 max memory = 154141
Proc 12 max memory = 156325
Proc 13 max memory = 156325
Proc 14 max memory = 156325
Proc 15 max memory = 156325
Proc 16 max memory = 156261
Proc 17 max memory = 156261
Proc 18 max memory = 156261
Proc 19 max memory = 156261
Proc 20 max memory = 156261
Proc 21 max memory = 156261
# of OverAlloc: ave = 1.15625, min = 0, max = 2
Proc 0 # of OverAlloc = 0
Proc 19 # of OverAlloc = 2
Proc 8 # of OverAlloc = 2
Proc 23 # of OverAlloc = 2
Proc 24 # of OverAlloc = 2
Proc 30 # of OverAlloc = 0
Proc 31 # of OverAlloc = 0
Proc 26 # of OverAlloc = 2
Proc 28 # of OverAlloc = 2
Proc 22 # of OverAlloc = 0
Proc 25 # of OverAlloc = 1
Proc 27 # of OverAlloc = 1
Proc 29 # of OverAlloc = 2
Proc 13 # of OverAlloc = 1
Proc 12 # of OverAlloc = 1
Proc 16 # of OverAlloc = 2
Proc 21 # of OverAlloc = 1
Proc 20 # of OverAlloc = 2
Proc 17 # of OverAlloc = 2
Proc 11 # of OverAlloc = 0
Proc 14 # of OverAlloc = 2
Proc 15 # of OverAlloc = 2
Proc 18 # of OverAlloc = 2
Proc 9 # of OverAlloc = 2
Proc 2 # of OverAlloc = 0
Proc 3 # of OverAlloc = 0
Proc 4 # of OverAlloc = 0
Proc 7 # of OverAlloc = 2
Proc 5 # of OverAlloc = 0
Proc 6 # of OverAlloc = 2
Proc 10 # of OverAlloc = 0
Proc 1 # of OverAlloc = 0
Median find iteration counts:
Serial iterations per process: avg 0.000000 min 0 max 0
Parallel iterations:
Per process: avg 139.125000 min 70 max 207
Total for all parallel cuts: 909
Detail of first cuts:
Level 1 cut count: avg 18.000000 variance 0.000000 actual: 18
Level 2 cut count: avg 37.000000 variance 0.724138 actual: 58 16
Level 3 cut count: avg 17.000000 variance 0.210526 actual: 15 19 16 18
Level 4 cut count: avg 40.625000 variance 0.833333 actual: 38 47 14 67 26 29 84 20
Level 5 cut count: avg 26.500000 variance 0.956522 actual: 12 18 9 6 6 26 22 138 39 7 29 17 7 26 34 28
Start-up time %: ave = 3.98669, min = 3.97956, max = 3.99953
Proc 0 start-up time = 0.131633
Proc 1 start-up time = 0.131637
Proc 2 start-up time = 0.131637
Proc 3 start-up time = 0.131638
Proc 4 start-up time = 0.131636
Proc 5 start-up time = 0.131638
Proc 6 start-up time = 0.131636
Proc 7 start-up time = 0.131636
Proc 8 start-up time = 0.131638
Proc 9 start-up time = 0.131635
Proc 10 start-up time = 0.131636
Proc 22 start-up time = 0.132186
Proc 23 start-up time = 0.132187
Proc 24 start-up time = 0.132186
Proc 25 start-up time = 0.132203
Proc 26 start-up time = 0.132185
Proc 27 start-up time = 0.132186
Proc 28 start-up time = 0.132187
Proc 30 start-up time = 0.132185
Proc 31 start-up time = 0.132186
Proc 29 start-up time = 0.132186
Proc 11 start-up time = 0.131543
Proc 12 start-up time = 0.131547
Proc 13 start-up time = 0.131552
Proc 14 start-up time = 0.13155
Proc 15 start-up time = 0.131547
Proc 16 start-up time = 0.13155
Proc 17 start-up time = 0.131552
Proc 19 start-up time = 0.13155
Proc 20 start-up time = 0.131552
Proc 21 start-up time = 0.131548
Proc 18 start-up time = 0.131549
Pre-median time %: ave = 1.16053, min = 0.632366, max = 2.12311
Proc 11 pre-median time = 0.0350401
Proc 12 pre-median time = 0.0317228
Proc 13 pre-median time = 0.02705
Proc 14 pre-median time = 0.0309472
Proc 15 pre-median time = 0.0292027
Proc 16 pre-median time = 0.0372889
Proc 17 pre-median time = 0.0365443
Proc 19 pre-median time = 0.0325701
Proc 20 pre-median time = 0.0334101
Proc 21 pre-median time = 0.038518
Proc 18 pre-median time = 0.0369565
Proc 22 pre-median time = 0.0357182
Proc 23 pre-median time = 0.0282283
Proc 24 pre-median time = 0.0438416
Proc 25 pre-median time = 0.0407486
Proc 26 pre-median time = 0.0439434
Proc 27 pre-median time = 0.0406442
Proc 28 pre-median time = 0.0414739
Proc 29 pre-median time = 0.0428872
Proc 30 pre-median time = 0.0701785
Proc 31 pre-median time = 0.0519538
Proc 0 pre-median time = 0.0631931
Proc 2 pre-median time = 0.0579889
Proc 3 pre-median time = 0.0374572
Proc 4 pre-median time = 0.0405519
Proc 5 pre-median time = 0.0381799
Proc 6 pre-median time = 0.028049
Proc 7 pre-median time = 0.0209026
Proc 8 pre-median time = 0.02685
Proc 9 pre-median time = 0.025737
Proc 10 pre-median time = 0.0332549
Proc 1 pre-median time = 0.0465152
Median time %: ave = 19.0769, min = 11.5292, max = 27.7542
Proc 0 median time = 0.659403
Proc 1 median time = 0.676004
Proc 2 median time = 0.67258
Proc 3 median time = 0.693356
Proc 4 median time = 0.65958
Proc 5 median time = 0.661578
Proc 6 median time = 0.646815
Proc 7 median time = 0.653316
Proc 8 median time = 0.786142
Proc 9 median time = 0.787013
Proc 10 median time = 0.896341
Proc 11 median time = 0.895195
Proc 12 median time = 0.652565
Proc 13 median time = 0.657566
Proc 14 median time = 0.67803
Proc 15 median time = 0.680102
Proc 16 median time = 0.459695
Proc 17 median time = 0.460878
Proc 19 median time = 0.518198
Proc 20 median time = 0.511608
Proc 21 median time = 0.506149
Proc 18 median time = 0.513308
Proc 22 median time = 0.640442
Proc 23 median time = 0.647681
Proc 24 median time = 0.381092
Proc 25 median time = 0.383753
Proc 26 median time = 0.914571
Proc 27 median time = 0.917406
Proc 28 median time = 0.551289
Proc 29 median time = 0.550274
Proc 30 median time = 0.424462
Proc 31 median time = 0.442131
Comm time %: ave = 61.9709, min = 56.946, max = 67.8527
Proc 0 comm time = 2.01519
RCB sub-domain boxes:
Proc 1 comm time = 2.01481
Proc 2 comm time = 2.00557
Proc 3 comm time = 2.00525
Proc 4 comm time = 2.01315
Proc 5 comm time = 2.01295
Proc 6 comm time = 2.00599
Proc 7 comm time = 2.00614
Proc 8 comm time = 2.11588
Proc 9 comm time = 2.11557
Proc 10 comm time = 2.24285
Proc 11 comm time = 2.24284
Proc 12 comm time = 2.07799
Proc 13 comm time = 2.07748
Proc 14 comm time = 2.07892
Proc 15 comm time = 2.07933
Proc 16 comm time = 2.09551
Proc 19 comm time = 2.10016
Proc 20 comm time = 2.22808
Proc 21 comm time = 2.22874
Proc 17 comm time = 2.09538
Proc 18 comm time = 2.10055
Proc 22 comm time = 2.22562
Proc 23 comm time = 2.22551
Proc 24 comm time = 1.89636
Proc 25 comm time = 1.89679
Proc 26 comm time = 1.88233
Proc 27 comm time = 1.88235
Proc 28 comm time = 1.90044
Proc 29 comm time = 1.89971
Proc 30 comm time = 1.89105
Proc 31 comm time = 1.89116
Dimension 1
Proc = 11: Box = 0.567758 0.567798
Proc = 12: Box = 8.80841e-07 0.21409
Proc = 13: Box = 0.21409 0.521018
Proc = 14: Box = 0.521018 0.567798
Proc = 15: Box = 0.521018 0.567798
Proc = 16: Box = 0.567798 1
Proc = 19: Box = 0.567798 1
Proc = 20: Box = 0.567798 1
Proc = 21: Box = 0.567798 1
Proc = 17: Box = 0.567798 1
Proc = 18: Box = 0.567798 1
Proc = 22: Box = 0.567798 0.567824
Proc = 23: Box = 0.567824 1
Proc = 24: Box = 0.567798 1
Proc = 25: Box = 0.567798 1
Proc = 26: Box = 0.567798 1
Proc = 27: Box = 0.567798 1
Proc = 28: Box = 0.567798 0.57245
Proc = 29: Box = 0.57245 1
Proc = 30: Box = 0.567798 0.753294
Proc = 31: Box = 0.753294 1
Proc = 0: Box = 8.80841e-07 0.343548
Proc = 2: Box = 8.80841e-07 0.557707
Proc = 3: Box = 0.557707 0.567798
Proc = 4: Box = 8.80841e-07 0.466387
Proc = 5: Box = 0.466387 0.55772
Proc = 6: Box = 0.55772 0.567798
Proc = 7: Box = 0.55772 0.567798
Proc = 8: Box = 8.80841e-07 0.224786
Proc = 9: Box = 0.224786 0.567798
Proc = 10: Box = 8.80841e-07 0.567758
Proc = 1: Box = 0.343548 0.567798
Dimension 2
Proc = 11: Box = 0.567553 0.586051
Proc = 12: Box = 0.586051 0.999999
Proc = 13: Box = 0.586051 0.999999
Proc = 14: Box = 0.586051 0.999999
Proc = 15: Box = 0.586051 0.999999
Proc = 16: Box = 8.49928e-07 0.456941
Proc = 17: Box = 8.49928e-07 0.456941
Proc = 19: Box = 0.456941 0.586045
Proc = 20: Box = 0.586045 0.999999
Proc = 21: Box = 0.586045 0.999999
Proc = 18: Box = 0.456941 0.586045
Proc = 22: Box = 0.586045 0.999999
Proc = 23: Box = 0.586045 0.999999
Proc = 24: Box = 8.49928e-07 0.278636
Proc = 25: Box = 0.278636 0.454215
Proc = 26: Box = 0.454215 0.586056
Proc = 27: Box = 0.454215 0.586056
Proc = 28: Box = 0.586056 0.999999
Proc = 29: Box = 0.586056 0.999999
Proc = 30: Box = 0.586056 0.999999
Proc = 31: Box = 0.586056 0.999999
Proc = 0: Box = 8.49928e-07 0.531519
Proc = 2: Box = 0.531519 0.581149
Proc = 3: Box = 0.531519 0.581149
Proc = 4: Box = 0.581149 0.999999
Proc = 5: Box = 0.581149 0.999999
Proc = 6: Box = 0.581149 0.999999
Proc = 7: Box = 0.581149 0.999999
Proc = 8: Box = 8.49928e-07 0.567553
Proc = 9: Box = 8.49928e-07 0.567553
Proc = 10: Box = 0.567553 0.586051
Proc = 1: Box = 8.49928e-07 0.531519
Dimension 3
Proc = 11: Box = 0.553934 1
Proc = 12: Box = 0.553934 1
Proc = 13: Box = 0.553934 1
Proc = 14: Box = 0.553934 0.560352
Proc = 15: Box = 0.560352 1
Proc = 16: Box = 1.14935e-06 0.275204
Proc = 17: Box = 0.275204 0.55916
Proc = 19: Box = 0.551002 0.55916
Proc = 20: Box = 1.14935e-06 0.266269
Proc = 21: Box = 0.266269 0.517387
Proc = 0: Box = 1.14935e-06 0.553934
Proc = 1: Box = 1.14935e-06 0.553934
Proc = 2: Box = 1.14935e-06 0.553934
Proc = 3: Box = 1.14935e-06 0.553934
Proc = 4: Box = 1.14935e-06 0.553934
Proc = 5: Box = 1.14935e-06 0.553934
Proc = 6: Box = 1.14935e-06 0.552555
Proc = 7: Box = 0.552555 0.553934
Proc = 8: Box = 0.553934 1
Proc = 9: Box = 0.553934 1
Proc = 10: Box = 0.553934 1
Proc = 22: Box = 0.517387 0.55916
Proc = 23: Box = 0.517387 0.55916
Proc = 24: Box = 0.55916 1
Proc = 25: Box = 0.55916 1
Proc = 26: Box = 0.55916 0.559351
Proc = 27: Box = 0.559351 1
Proc = 28: Box = 0.55916 0.585308
Proc = 29: Box = 0.55916 0.585308
Proc = 30: Box = 0.585308 1
Proc = 31: Box = 0.585308 1
Proc = 18: Box = 1.14935e-06 0.551002
STATS Runs 1 bal CURRENT 1.000862 MAX 1.000862 MIN 1.000862 AVG 1.000862
STATS Runs 1 moveVol CURRENT 92126468.000000 MAX 92126468.000000 MIN 92126468.000000 AVG 92126468.000000
More information about the Trilinos-Users
mailing list