应用程序会有长达仅20秒的停顿

Question

应用程序会有长达仅20秒的停顿，哪位高手帮忙分析下。java  -Xms1024m -Xmx2048m -Xmn256m  -verbose:gc -XX:+PrintGCDetails -Xloggc:gc.log -XX:NewRatio=2 -XX:SurvivorRatio=65535 -XX:MaxTenuringThreshold=0 -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:+CMSIncrementalPacing -XX:CMSIncrementalDutyCycleMin=0 -XX:CMSIncrementalDutyCycle=10 com.lj.main.Service gc.log如下：(部分高耗时的CMS-re)
283702.856: [GC[YG occupancy: 136243 K (262080 K)]283702.857: [Rescan (parallel) , 0.1694080 secs]283703.026: [weak refs processing, 0.0269230 secs] [1 CMS-re: 684012K(1248344K)] 820255K(1510424K), 0.1991230 secs] [Times: user=0.03 sys=0.00, real=0.19 secs] 
 [1 CMS-re: 1581596K(1590872K)] 1731895K(1852952K), 5.5778410 secs] [Times: user=5.33 sys=0.01, real=5.57 secs] 
424334.482: [GC[YG occupancy: 130289 K (262080 K)]424334.482: [Rescan (parallel) , 0.1427750 secs]424334.625: [weak refs processing, 0.0054560 secs] [1 CMS-re: 163910K(1654044K)] 294200K(1916124K), 0.1488410 secs] [Times: user=0.01 sys=0.00, real=0.14 secs] 
 [1 CMS-re: 1597569K(1654044K)] 1730326K(1916124K), 5.8872310 secs] [Times: user=5.72 sys=0.00, real=5.89 secs] 
510582.012: [GC[YG occupancy: 124462 K (262080 K)]510582.012: [Rescan (parallel) , 0.1385270 secs]510582.151: [weak refs processing, 0.0037960 secs] [1 CMS-re: 164407K(1654236K)] 288869K(1916316K), 0.1427760 secs] [Times: user=0.00 sys=0.00, real=0.14 secs] 
 [1 CMS-re: 1622905K(1654236K)] 1754396K(1916316K), 5.8088150 secs] [Times: user=5.68 sys=0.00, real=5.80 secs] 
683570.566: [GC[YG occupancy: 128587 K (262080 K)]683570.566: [Rescan (parallel) , 0.1442510 secs]683570.711: [weak refs processing, 0.0067340 secs] [1 CMS-re: 163972K(1835008K)] 292560K(2097088K), 0.1514970 secs] [Times: user=0.01 sys=0.00, real=0.15 secs] 
 [1 CMS-re: 1789263K(1835008K)] 1923608K(2097088K), 6.3413010 secs] [Times: user=6.21 sys=0.00, real=6.34 secs] 
828326.832: [GC[YG occupancy: 127254 K (262080 K)]828326.832: [Rescan (parallel) , 0.1657690 secs]828326.998: [weak refs processing, 0.0000830 secs] [1 CMS-re: 1801715K(1835008K)] 1928969K(2097088K), 0.1660610 secs] [Times: user=0.00 sys=0.00, real=0.17 secs] 
 [1 CMS-re: 1819191K(1835008K)] 1950221K(2097088K), 6.0530960 secs] [Times: user=5.92 sys=0.00, real=6.05 secs] 
911380.546: [GC[YG occupancy: 132015 K (262080 K)]911380.546: [Rescan (parallel) , 0.1492010 secs]911380.695: [weak refs processing, 0.0002880 secs] [1 CMS-re: 1805468K(1835008K)] 1937484K(2097088K), 0.1496680 secs] [Times: user=0.01 sys=0.00, real=0.15 secs] 
 [1 CMS-re: 1828090K(1835008K)] 1960373K(2097088K), 6.2945720 secs] [Times: user=6.15 sys=0.00, real=6.29 secs] 
919927.379: [GC[YG occupancy: 126189 K (262080 K)]919927.379: [Rescan (parallel) , 0.1496420 secs]919927.528: [weak refs processing, 0.0173540 secs] [1 CMS-re: 968545K(1835008K)] 1094734K(2097088K), 0.1688230 secs] [Times: user=0.02 sys=0.00, real=0.17 secs] 
 [1 CMS-re: 1822335K(1835008K)] 1957601K(2097088K), 6.0291510 secs] [Times: user=5.87 sys=0.00, real=6.02 secs] 
989367.593: [GC[YG occupancy: 127736 K (262080 K)]989367.593: [Rescan (parallel) , 0.1505960 secs]989367.744: [weak refs processing, 0.0279220 secs] [1 CMS-re: 945130K(1835008K)] 1072867K(2097088K), 0.1814700 secs] [Times: user=0.03 sys=0.00, real=0.18 secs] 
 [1 CMS-re: 1823206K(1835008K)] 1956764K(2097088K), 6.2923340 secs] [Times: user=6.11 sys=0.00, real=6.29 secs] (部分高耗时的CMS-concurrent-)
254.464: [CMS-concurrent-: 1.286/220.282 secs] [Times: user=1.28 sys=0.00, real=220.28 secs] 
21329.558: [CMS-concurrent-: 1.963/56.001 secs] [Times: user=1.94 sys=0.00, real=56.00 secs] 
21533.017: [CMS-concurrent-: 1.217/117.005 secs] [Times: user=1.18 sys=0.00, real=117.01 secs] 
38076.582: [CMS-concurrent-: 2.040/46.507 secs] [Times: user=2.01 sys=0.00, real=46.51 secs] 
47634.826: [CMS-concurrent-: 1.759/23.013 secs] [Times: user=1.76 sys=0.00, real=23.01 secs] 
47761.628: [CMS-concurrent-: 1.223/40.294 secs] [Times: user=1.22 sys=0.00, real=40.29 secs] 
78000.474: [CMS-concurrent-: 2.143/7.815 secs] [Times: user=2.09 sys=0.00, real=7.81 secs] 
78076.271: [CMS-concurrent-: 1.516/26.965 secs] [Times: user=1.50 sys=0.00, real=26.97 secs] 
78196.795: [CMS-concurrent-: 1.200/45.527 secs] [Times: user=1.20 sys=0.00, real=45.52 secs] 
108624.550: [CMS-concurrent-: 2.172/74.034 secs] [Times: user=2.13 sys=0.00, real=74.04 secs] 
120206.005: [CMS-concurrent-: 1.875/19.948 secs] [Times: user=1.88 sys=0.00, real=19.95 secs] 
120342.170: [CMS-concurrent-: 1.369/43.014 secs] [Times: user=1.36 sys=0.00, real=43.01 secs] 
140638.162: [CMS-concurrent-: 2.282/54.947 secs] [Times: user=2.31 sys=0.00, real=54.95 secs] 
183123.817: [CMS-concurrent-: 2.085/25.971 secs] [Times: user=2.01 sys=0.00, real=25.97 secs] 
183236.524: [CMS-concurrent-: 1.272/14.480 secs] [Times: user=1.27 sys=0.00, real=14.48 secs] 
208414.965: [CMS-concurrent-: 2.577/44.810 secs] [Times: user=2.54 sys=0.00, real=44.82 secs] 
208662.843: [CMS-concurrent-: 1.457/141.520 secs] [Times: user=1.46 sys=0.00, real=141.52 secs] 
232731.133: [CMS-concurrent-: 2.650/46.593 secs] [Times: user=2.64 sys=0.00, real=46.59 secs] 
232913.785: [CMS-concurrent-: 1.340/67.884 secs] [Times: user=1.37 sys=0.00, real=67.88 secs] 
283429.788: [CMS-concurrent-: 2.751/48.747 secs] [Times: user=2.72 sys=0.00, real=48.75 secs] 
283683.942: [CMS-concurrent-: 1.504/134.728 secs] [Times: user=1.49 sys=0.00, real=134.73 secs] 
337181.127: [CMS-concurrent-: 3.644/61.952 secs] [Times: user=3.64 sys=0.00, real=61.96 secs] 
337225.693: [CMS-concurrent-: 5.412/9.712 secs] [Times: user=5.34 sys=0.00, real=9.71 secs] 
337246.645: [CMS-concurrent-: 4.093/10.091 secs] [Times: user=4.13 sys=0.00, real=10.09 secs] 
337265.230: [CMS-concurrent-: 1.350/5.656 secs] [Times: user=1.36 sys=0.00, real=5.66 secs] 
337295.859: [CMS-concurrent-: 1.803/6.327 secs] [Times: user=1.80 sys=0.00, real=6.33 secs] 
337361.055: [CMS-concurrent-: 1.587/20.782 secs] [Times: user=1.55 sys=0.00, real=20.77 secs] 
337422.170: [CMS-concurrent-: 1.470/10.354 secs] [Times: user=1.48 sys=0.00, real=10.36 secs] 
337497.492: [CMS-concurrent-: 1.741/22.312 secs] [Times: user=1.73 sys=0.00, real=22.31 secs] 
337602.729: [CMS-concurrent-: 1.819/53.540 secs] [Times: user=1.82 sys=0.00, real=53.54 secs] 
386950.084: [CMS-concurrent-: 3.163/66.834 secs] [Times: user=3.20 sys=0.00, real=66.83 secs] 
423584.604: [CMS-concurrent-: 2.806/10.134 secs] [Times: user=2.81 sys=0.00, real=10.13 secs] 
423620.848: [CMS-concurrent-: 1.610/3.936 secs] [Times: user=1.60 sys=0.00, real=3.93 secs] 
423644.022: [CMS-concurrent-: 1.461/5.532 secs] [Times: user=1.46 sys=0.00, real=5.53 secs] 
423704.305: [CMS-concurrent-: 1.758/6.856 secs] [Times: user=1.79 sys=0.00, real=6.85 secs] 
423769.123: [CMS-concurrent-: 1.390/1.390 secs] [Times: user=1.38 sys=0.00, real=1.39 secs] 
423879.721: [CMS-concurrent-: 1.382/1.382 secs] [Times: user=1.37 sys=0.00, real=1.39 secs] 
424006.148: [CMS-concurrent-: 1.504/1.504 secs] [Times: user=1.50 sys=0.00, real=1.50 secs] 
424270.634: [CMS-concurrent-: 1.407/142.950 secs] [Times: user=1.38 sys=0.00, real=142.95 secs] 
479095.084: [CMS-concurrent-: 3.440/111.529 secs] [Times: user=3.47 sys=0.00, real=111.53 secs] 
509996.144: [CMS-concurrent-: 2.296/10.779 secs] [Times: user=2.30 sys=0.00, real=10.78 secs] 
510195.033: [CMS-concurrent-: 1.505/1.505 secs] [Times: user=1.49 sys=0.00, real=1.51 secs] 
510341.926: [CMS-concurrent-: 1.405/1.405 secs] [Times: user=1.40 sys=0.00, real=1.41 secs] 
510507.933: [CMS-concurrent-: 1.395/1.395 secs] [Times: user=1.39 sys=0.00, real=1.40 secs] 
580176.878: [CMS-concurrent-: 3.495/77.605 secs] [Times: user=3.47 sys=0.01, real=77.60 secs] 
682844.374: [CMS-concurrent-: 8.446/47354.016 secs] [Times: user=8.37 sys=0.00, real=47353.71 secs] 
682871.664: [CMS-concurrent-: 2.597/14.279 secs] [Times: user=2.63 sys=0.00, real=14.28 secs] 
682944.718: [CMS-concurrent-: 4.017/22.161 secs] [Times: user=3.96 sys=0.00, real=22.16 secs] 
683029.594: [CMS-concurrent-: 1.362/1.362 secs] [Times: user=1.37 sys=0.00, real=1.36 secs] 
683170.837: [CMS-concurrent-: 1.374/1.374 secs] [Times: user=1.37 sys=0.00, real=1.38 secs] 
683342.532: [CMS-concurrent-: 1.445/1.445 secs] [Times: user=1.41 sys=0.00, real=1.44 secs] 
683495.384: [CMS-concurrent-: 1.365/1.365 secs] [Times: user=1.36 sys=0.00, real=1.36 secs] 
750007.317: [CMS-concurrent-: 3.624/117.322 secs] [Times: user=3.62 sys=0.00, real=117.33 secs] 
828311.971: [CMS-concurrent-: 12.497/59034.389 secs] [Times: user=12.39 sys=0.01, real=59034.01 secs] 
833066.509: [CMS-concurrent-: 3.454/79.582 secs] [Times: user=3.41 sys=0.00, real=79.58 secs] 
911368.759: [CMS-concurrent-: 11.627/38175.767 secs] [Times: user=11.54 sys=0.00, real=38175.52 secs] 
919727.087: [CMS-concurrent-: 3.557/45.795 secs] [Times: user=3.49 sys=0.00, real=45.80 secs] 
919914.540: [CMS-concurrent-: 1.401/40.831 secs] [Times: user=1.37 sys=0.00, real=40.83 secs] 
989166.183: [CMS-concurrent-: 3.516/47.588 secs] [Times: user=3.48 sys=0.00, real=47.59 secs] 
989355.867: [CMS-concurrent-: 1.555/53.018 secs] [Times: user=1.55 sys=0.00, real=53.01 secs] 
1062174.845: [CMS-concurrent-: 3.923/63.100 secs] [Times: user=3.71 sys=0.00, real=63.10 secs] 
1062421.889: [CMS-concurrent-: 1.471/82.821 secs] [Times: user=1.42 sys=0.00, real=82.82 secs] 
1114827.766: [CMS-concurrent-: 6.412/51.367 secs] [Times: user=6.41 sys=0.00, real=51.37 secs] 
1114857.616: [CMS-concurrent-: 1.597/7.936 secs] [Times: user=1.59 sys=0.00, real=7.94 secs]

Answer 1

23.182: [CMS-concurrent-sweep: 0.117/0.121 secs] [Times: user=0.13 sys=0.00, real=0.12 secs] 
307.387: [CMS-concurrent-sweep: 0.373/0.381 secs] [Times: user=0.37 sys=0.00, real=0.38 secs] 
21405.487: [CMS-concurrent-sweep: 3.544/61.964 secs] [Times: user=3.48 sys=0.00, real=61.97 secs] 
21910.455: [CMS-concurrent-sweep: 3.457/355.842 secs] [Times: user=3.44 sys=0.00, real=355.84 secs] 
38157.916: [CMS-concurrent-sweep: 3.722/68.482 secs] [Times: user=3.59 sys=0.00, real=68.48 secs] 
47711.479: [CMS-concurrent-sweep: 5.089/62.760 secs] [Times: user=5.10 sys=0.00, real=62.76 secs] 
47864.519: [CMS-concurrent-sweep: 2.762/93.930 secs] [Times: user=2.70 sys=0.00, real=93.93 secs] 
78047.573: [CMS-concurrent-sweep: 4.058/25.375 secs] [Times: user=4.02 sys=0.00, real=25.38 secs] 
78123.064: [CMS-concurrent-sweep: 3.144/41.274 secs] [Times: user=3.12 sys=0.00, real=41.27 secs] 
78336.995: [CMS-concurrent-sweep: 0.817/75.358 secs] [Times: user=0.81 sys=0.00, real=75.36 secs] 
108749.958: [CMS-concurrent-sweep: 3.532/112.426 secs] [Times: user=3.58 sys=0.00, real=112.42 secs] 
120288.346: [CMS-concurrent-sweep: 5.282/70.863 secs] [Times: user=5.30 sys=0.00, real=70.86 secs] 
120435.423: [CMS-concurrent-sweep: 2.646/84.005 secs] [Times: user=2.64 sys=0.00, real=84.01 secs] 
140797.687: [CMS-concurrent-sweep: 4.273/131.691 secs] [Times: user=4.27 sys=0.00, real=131.69 secs] 
183197.044: [CMS-concurrent-sweep: 6.071/59.263 secs] [Times: user=5.93 sys=0.00, real=59.26 secs] 
183313.934: [CMS-concurrent-sweep: 3.237/64.786 secs] [Times: user=3.21 sys=0.00, real=64.79 secs] 
208512.403: [CMS-concurrent-sweep: 5.394/85.818 secs] [Times: user=5.35 sys=0.00, real=85.81 secs] 
209204.556: [CMS-concurrent-sweep: 5.011/521.639 secs] [Times: user=5.12 sys=0.00, real=521.64 secs] 
232832.186: [CMS-concurrent-sweep: 5.673/84.079 secs] [Times: user=5.72 sys=0.00, real=84.07 secs] 
233182.661: [CMS-concurrent-sweep: 5.294/256.098 secs] [Times: user=5.22 sys=0.00, real=256.09 secs] 
283539.735: [CMS-concurrent-sweep: 5.601/95.055 secs] [Times: user=5.55 sys=0.01, real=95.05 secs] 
284210.325: [CMS-concurrent-sweep: 5.202/507.269 secs] [Times: user=5.25 sys=0.01, real=507.26 secs] 
337214.758: [CMS-concurrent-sweep: 7.797/12.291 secs] [Times: user=7.64 sys=0.00, real=12.29 secs] 
337235.123: [CMS-concurrent-sweep: 4.254/7.963 secs] [Times: user=4.23 sys=0.00, real=7.96 secs] 
337258.139: [CMS-concurrent-sweep: 3.962/9.911 secs] [Times: user=3.93 sys=0.00, real=9.91 secs] 
337286.585: [CMS-concurrent-sweep: 4.756/13.946 secs] [Times: user=4.74 sys=0.00, real=13.94 secs] 
337310.798: [CMS-concurrent-sweep: 2.770/2.770 secs] [Times: user=2.67 sys=0.00, real=2.77 secs] 
337383.298: [CMS-concurrent-sweep: 1.169/1.169 secs] [Times: user=1.17 sys=0.00, real=1.17 secs] 
337455.383: [CMS-concurrent-sweep: 1.032/1.032 secs] [Times: user=1.01 sys=0.00, real=1.03 secs] 
337537.330: [CMS-concurrent-sweep: 0.885/9.439 secs] [Times: user=0.88 sys=0.00, real=9.44 secs] 
337747.863: [CMS-concurrent-sweep: 1.056/123.941 secs] [Times: user=1.07 sys=0.00, real=123.94 secs] 
387151.641: [CMS-concurrent-sweep: 7.148/177.081 secs] [Times: user=7.10 sys=0.02, real=177.08 secs] 
423615.478: [CMS-concurrent-sweep: 10.346/21.703 secs] [Times: user=10.19 sys=0.01, real=21.70 secs] 
423637.011: [CMS-concurrent-sweep: 4.711/12.230 secs] [Times: user=4.70 sys=0.00, real=12.23 secs] 
423666.072: [CMS-concurrent-sweep: 2.691/19.627 secs] [Times: user=2.66 sys=0.00, real=19.63 secs] 
423736.458: [CMS-concurrent-sweep: 1.235/15.808 secs] [Times: user=1.26 sys=0.00, real=15.80 secs] 
423817.010: [CMS-concurrent-sweep: 0.977/42.637 secs] [Times: user=0.98 sys=0.00, real=42.63 secs] 
423931.354: [CMS-concurrent-sweep: 0.748/0.748 secs] [Times: user=0.73 sys=0.00, real=0.75 secs] 
424070.998: [CMS-concurrent-sweep: 0.753/0.753 secs] [Times: user=0.75 sys=0.00, real=0.75 secs] 
424461.213: [CMS-concurrent-sweep: 0.911/126.582 secs] [Times: user=0.92 sys=0.01, real=126.58 secs] 
479288.670: [CMS-concurrent-sweep: 7.730/174.915 secs] [Times: user=7.65 sys=0.00, real=174.91 secs] 
510096.960: [CMS-concurrent-sweep: 9.663/92.956 secs] [Times: user=9.71 sys=0.00, real=92.96 secs] 
510261.469: [CMS-concurrent-sweep: 3.035/3.035 secs] [Times: user=3.05 sys=0.00, real=3.03 secs] 
510429.944: [CMS-concurrent-sweep: 0.936/82.800 secs] [Times: user=0.94 sys=0.00, real=82.80 secs] 
510650.513: [CMS-concurrent-sweep: 0.776/68.357 secs] [Times: user=0.79 sys=0.00, real=68.36 secs] 
580377.061: [CMS-concurrent-sweep: 7.410/172.588 secs] [Times: user=7.44 sys=0.00, real=172.57 secs] 
682853.102: [CMS-concurrent-sweep: 3.510/3.510 secs] [Times: user=3.52 sys=0.00, real=3.51 secs] 
682920.942: [CMS-concurrent-sweep: 6.511/39.954 secs] [Times: user=6.11 sys=0.00, real=39.95 secs] 
682986.906: [CMS-concurrent-sweep: 6.313/29.911 secs] [Times: user=6.28 sys=0.00, real=29.91 secs] 
683101.376: [CMS-concurrent-sweep: 2.316/66.547 secs] [Times: user=2.33 sys=0.00, real=66.55 secs] 
683251.774: [CMS-concurrent-sweep: 0.830/75.704 secs] [Times: user=0.86 sys=0.00, real=75.70 secs] 
683410.355: [CMS-concurrent-sweep: 0.813/62.597 secs] [Times: user=0.81 sys=0.00, real=62.59 secs] 
683642.300: [CMS-concurrent-sweep: 0.825/71.581 secs] [Times: user=0.83 sys=0.00, real=71.58 secs] 
750188.439: [CMS-concurrent-sweep: 8.793/159.386 secs] [Times: user=8.72 sys=0.00, real=159.39 secs] 
828353.682: [CMS-concurrent-sweep: 0.994/26.683 secs] [Times: user=0.97 sys=0.00, real=26.68 secs] 
833278.408: [CMS-concurrent-sweep: 9.471/190.157 secs] [Times: user=9.46 sys=0.01, real=190.16 secs] 
911456.070: [CMS-concurrent-sweep: 2.211/75.374 secs] [Times: user=2.20 sys=0.00, real=75.37 secs] 
919859.172: [CMS-concurrent-sweep: 10.363/114.622 secs] [Times: user=10.29 sys=0.00, real=114.62 secs] 
920265.541: [CMS-concurrent-sweep: 12.454/337.993 secs] [Times: user=12.42 sys=0.00, real=337.99 secs] 
989292.661: [CMS-concurrent-sweep: 9.302/109.838 secs] [Times: user=9.43 sys=0.00, real=109.84 secs] 
989707.712: [CMS-concurrent-sweep: 9.866/339.937 secs] [Times: user=9.83 sys=0.00, real=339.94 secs] 
1062325.385: [CMS-concurrent-sweep: 8.985/132.490 secs] [Times: user=8.89 sys=0.00, real=132.49 secs] 
1062934.397: [CMS-concurrent-sweep: 10.243/500.776 secs] [Times: user=10.13 sys=0.01, real=500.76 secs] 
1114848.288: [CMS-concurrent-sweep: 4.280/17.784 secs] [Times: user=4.24 sys=0.00, real=17.78 secs] 
1114879.735: [CMS-concurrent-sweep: 3.900/18.331 secs] [Times: user=3.94 sys=0.00, real=18.33 secs] 
1115023.096: [CMS-concurrent-sweep: 1.390/65.914 secs] [Times: user=1.38 sys=0.00, real=65.91 secs] 
1115179.848: [CMS-concurrent-sweep: 0.777/0.777 secs] [Times: user=0.78 sys=0.00, real=0.78 secs] 
1115416.473: [CMS-concurrent-sweep: 0.670/69.306 secs] [Times: user=0.67 sys=0.00, real=69.30 secs]