dmcs

Experiments

Log-IC 2011 experimental results for streaming dmcs

Test name#answersDMCSOPTDMCS STREAMING
k=0k=10k=100
tree(10,10,5,5) 181.210.240.396.80
3087.460.340.270.65
tree(50,10,5,5) 328.982.283.22139.83
245.922.271.80156.18
tree(100,10,5,5) 1624.879.105.43
413.956.9486.26
tree(10,40,20,20) 0.150.76
0.140.68
tree(50,40,20,20) 1.668.45
1.648.04
tree(100,40,20,20) 5.0427.84
5.0026.30
ring(10,10,5,5) 122.170.992.44
163.113.310.17143.83
ring(50,10,5,5) 2115.4913.43
1210.306.43
ring(10,40,20,20) 0.866.27
0.515.66
ring(50,40,20,20) 3.0629.81
4.2943.94

Experimental Results for dynamic dmcs

Running with inequality atoms

Test nameHeuristicsRunning time (secs)SizeDensityQuality
rand(100, 4974) None0.225100.604167
H16.169180.45
H20.18480.605263
H32.3926540.975491
H41.428160.859375
rand(100, 4886) None0.187140.642857
H11.019180.603571
H20.196120.584211
H36.6517340.97541
H40.368160.703846
rand(200, 19953) None0.626120.584
H12.237140.48
H20.46120.588
H38.9244910.995732
H40.827140.851613
rand(200, 19896) None1.026120.51
H10.846120.604545
H21.126120.51
H318.8837760.998611
H41.297140.793548
Test nameHeuristicsRunning time (secs)SizeDensityQuality
rake(100, 5575) None10.61991980.529282
H1135700.529458
H21.0110200.509091
H37.6528570.983333
H40.4810200.908333
rake(100, 5597) None22.761002000.557895
H11.0126520.514852
H21.2910200.497619
H30.9622450.937931
H41.519180.866667
rake(200, 22579) None230.11973940.540533
H117.11731460.507042
H20.829180.517647
H364.24591190.998734
H40.885110.790476
rake(200, 22510) None277.041993980.54967
H14.84541080.579188
H21.659180.520513
H34.436720.993939
H40.749180.746154
Test nameHeuristicsRunning time (secs)SizeDensityQuality
grid(10 x 10, 279) None1.821001980.54
H11.6661300.567811
H24.021001980.544789
H32.87741540.630233
H42.02641280.735556
grid(20 x 5, 274) None2.521001980.562431
H11.84571120.564878
H25.05821620.557432
H32.38671340.622951
H42.04521040.723936
grid(25 x 4, 270) None3.441001980.5192
H11.8150980.534408
H28.641001980.527467
H31.4650980.591398
H41.94551090.623415
grid(20 x 10, 569) None5.322003980.543836
H16.91302580.540812
H225.622003980.550548
H39.11523230.631351
H49.861042060.677445
grid(25 x 8, 566) None6.782003980.562888
H110.61422820.563428
H231.542003980.55668
H32.61871780.62263
H410.15831640.704761
grid(40 x 5, 554) None8.442003980.557206
H15.11022020.577102
H229.461623220.570833
H35.351032150.629737
H45.88911840.686319

Running without inequality atoms

Test nameHeuristicsRunning time (secs)SizeDensityQuality
rand(100, 4974) None0.39220.566667
H10.46330.638461
H20.37220.566667
H32.6123440.981522
H40.37440.764706
rand(100, 4886) None0.43330.572727
H10.47330.572727
H20.15330.572727
H39.7417330.977049
H40.46440.833333
rand(200, 19953) None0.38220.711111
H10.78550.415789
H20.1220.711111
H38.1342800.99557
H40.13330.630769
rand(200, 19896) None0.39220.483333
H10.46220.466667
H20.43220.483333
H336.5836700.998561
H40.2330.685714
Test nameHeuristicsRunning time (secs)SizeDensityQuality
rake(100, 5575) None3.0891910.521365
H10.5232320.533058
H20.34660.366667
H38.4627490.983505
H40.08550.74375
rake(100, 5597) None3.1590900.567638
H10.2522220.508139
H20.69550.445
H30.8220380.95065
H40.16330.681818
rake(200, 22579) None11.71741740.550709
H11.0966660.490804
H20.42440.494737
H339.95571110.998696
H40.64440.815385
rake(200, 22510) None6.041731730.540757
H10.8148480.592737
H22.91440.48125
H34.4736720.993939
H40.55330.666667
Test nameHeuristicsRunning time (secs)SizeDensityQuality
grid(10 x 10, 279) None0.1319180.557971
H10.1316160.553571
H20.1219180.557971
H30.7320250.588571
H40.117170.591525
grid(20 x 5, 274) None0.1724230.597368
H10.1928280.547525
H20.1624230.597368
H31.130370.598148
H40.1624230.658441
grid(25 x 4, 270) None0.2228270.528972
H10.2231310.579032
H20.228270.528972
H31.4237500.622759
H40.2534340.616279
grid(20 x 10, 569) None0.229280.479808
H10.2130300.459048
H20.229280.479808
H31.5449610.605759
H40.226250.711905
grid(25 x 8, 566) None0.2532310.565854
H10.2632320.592126
H20.2532310.565854
H31.7335410.637857
H40.9128280.616667
grid(40 x 5, 554) None0.4944430.538194
H10.8546460.535152
H20.3744430.538194
H32.0253650.627778
H40.5353520.630435

Experimental Results for ordinary dmcs

We present some results for a SAT-solver based prototype implementation of DMCS and DMCSOPT under Ubuntu Linux 9.10, written in C++. The host system was using a Pentium Core2 Duo 2.53GHz processor with 4GB RAM. We used clasp 1.3.3 as a SAT solver, which accepts DIMACS CNF as input. Specifically, all generated instantiations of MCS systems have contexts with ASP logics. The translation defined in defk2010-kr is used to create SAT instances at all contexts and clasp builds all models.

For initial experimentation, we created random MCS instances of fixed topologies generalizing the diamond, ring, zig-zag, and house. A parameter setting P=(n,s,b,r) specifies

JELIA 2010 experimental results

The tables below show some experimental results for parameter settings (n,10,5,5), where n varies between 9 and 301, with the respective topologies. Each row displays the number of answers/models, the running time for tasks such as local solving, projection, combination, transfering models between contexts, and the total running time, in the cases of DMCS and DMCSOPT.

Diamond

A diamond stack combines multiple diamonds in a row (stacking m diamonds in a tower of 3m+1 contexts).

DMCS DMCSOPT
Test#answerslsolveprojectioncombinetransfertotal#answerslsolveprojectioncombinetransfertotal
10-10-5-5 87040.3930.0113.5570.015 4.09 2560.3740.0050.0050.001 0.43
26880.3750.0091.6820.024 2.16 240.3550.0090.0010.003 0.41
3840.5350.0170.0220 0.62 140.5230.01700 0.57
6720.3250.0040.3430.006 0.72 90.2880.00300 0.32
15360.4310.0090.6110.009 1.11 640.4130.0020.0010.002 0.47
25200.19100.2770.014 0.54 420.179000 0.23
7680.3380.0050.1220.002 0.51 320.3050.00300 0.35
1980.2940.0030.0150 0.38 90.270.00200 0.30
8320.4070.0140.1630.013 0.64 320.3910.0040.0020 0.45
4800.4060.0090.0140.004 0.48 1280.4470.00500 0.49
13-10-5-5 26880.9860.0371.7420.024 2.90 401.280.0210.0040 1.38
252001.430.082112.5240.171 114.57 140.9740.0360.0020.001 1.09
31360.6960.0218.6420.073 9.54 361.3640.0460.0170 1.52
53760.7390.0243.7690.051 4.73 40.7230.0190.0010 0.81
12960.8990.0490.5980.017 1.64 240.7020.00400 0.78
61440.7940.02110.2490.06 11.25 721.0010.0150.0060 1.19
115200.6380.01217.610.038 18.47 160.910.04500 1.02
321.0150.0310.0040 1.12
480.7980.01700 0.88
960.6230.0080.0040 0.70
25-10-5-5 413.280.710.1790 15.32
1210.9960.2850.0640.002 12.39
5612.3790.8220.0950 14.38
488.0520.1650.0430.016 9.30
89.8410.2320.130.002 11.35
3210.1290.4670.060.001 11.77
2211.540.2670.0590.001 12.89
5613.7540.6610.2240 16.01
1210.850.5110.1360.001 12.51
9010.5530.2790.0880.012 11.98
31-10-5-5 48035.9730.9550.1930.013 41.14
12056.0033.3540.3080.005 63.79
6857.1885.9980.5990.016 68.79
2446.1881.9430.6140.01 53.46
17651.9093.380.2850.009 59.81
1260.9843.0851.3580.007 71.03
16108.08813.3710.9780.01 127.74
4855.3464.7930.6860.006 65.33
9642.5961.7860.3290.014 49.17
9638.6981.3450.2540.015 44.57

Ring

A ring of n contexts is a cycle in which context i queries context i+1 for 1 ≤ i ≤ n-1, and context n queries context 1.

DMCS DMCSOPT
Test#answerslsolveprojectioncombinetransfertotal#answerslsolveprojectioncombinetransfertotal
10-10-5-5 2160.12300.0290.033 0.20 120.073000 0.09
24000.08500.0960.084 0.30 70.056000.004 0.09
1920.0840.0010.0070.008 0.12 20.080.00100.004 0.12
1920.06100.0040.005 0.09 20.099000 0.12
3840.0700.0020.013 0.11 40.077000 0.09
600.07800.0080.008 0.11 10.076000 0.09
6400.06800.0160.029 0.14 60.062000 0.08
43200.1590.0030.3820.201 0.80 30.134000.003 0.18
8800.09700.0910.064 0.32 120.098000.005 0.14
10080.09600.0910.074 0.29 90.09800.0010.008 0.18
13-10-5-5 708400.12507.2628.718 17.26 240.124000.001 0.17
105600.13100.3560.643 1.27 70.106000.001 0.14
2800.09300.0370.026 0.19 60.083000 0.10
147200.1280.0012.2282.869 5.51 80.107000 0.14
63840.10300.1720.274 0.67 40.101000.001 0.14
9984000.1460110.61971.125 196.01 70.12000.004 0.18
30240.2040.0020.560.558 1.38 60.160.00200.002 0.20
4160.11200.0380.143 0.36 30.094000 0.11
116160.09300.7451.511 2.55 80.106000 0.14
37440.10900.3940.452 1.09 60.103000 0.13
301-10-5-5 43.6740.3140.0762.744 12.14
103.1040.03601.612 5.94
25.5080.0480.0041.705 11.55
83.4330.0590.0011.626 6.13
185.2980.0730.0162.097 11.98
84.7650.1840.0031.687 8.67
64.0550.0750.0222.159 9.85
283.6360.0740.0872.881 12.79
164.4820.0840.1322.988 18.48
163.6250.1820.0142.067 8.52

Zig-zag

This topology is incremented from the diamond topology by adding an edge between two middle contexts.

DMCS DMCSOPT
Test#answerslsolveprojectioncombinetransfertotal#answerslsolveprojectioncombinetransfertotal
10-10-5-5 2400.5870.0060.0370.005 0.74 400.113000 0.13
32640.9950.0491.9140.011 3.08 1920.2450.0140.0030 0.29
61441.2010.10212.7850.021 14.24 720.4260.0730.0040 0.53
1100.7760.0230.0360.002 0.91 100.1930.01200 0.23
62403.4220.63710.9070.035 15.18 880.8110.180.0190.002 1.04
5281.710.2290.0540.006 2.10 240.3620.05100 0.44
8642.4710.320.9170.029 3.83 160.3140.0230.0020 0.36
11202.5130.2720.1430.006 3.04 480.4060.04700 0.47
46082.470.4253.640.034 6.69 480.40.0490.0010 0.48
12601.9270.4391.6370.014 4.11 210.2330.04200 0.30
13-10-5-5 537610.1122.3462.2110.027 14.99 1280.7590.130.0030.001 0.92
30245.7920.9244.0550.024 11.05 1080.4950.0680.0020 0.60
38407.0451.3851.8010.034 10.54 360.4770.0850.0060 0.60
14403.0880.1380.2580.012 3.72 320.4780.0670.0010.001 0.58
13443.9040.3760.4080.005 4.91 2881.0480.2090.0130.003 1.32
39206.4160.9528.3040.121 16.16 480.2290.0080.0030.009 0.28
102484.5380.43826.3130.079 31.72 160.710.1170.0070 0.87
1120.4070.0390.0020 0.49
90.8970.1770.0020.001 1.11
280.3760.02600 0.43
70-10-5-5 484.9414.8090.0540.09 10.26
245.0335.3450.0150.074 10.64
564.2044.2780.0710.094 9.49
643.5943.5910.0550.085 7.51
323.3112.5510.040.082 6.16
964.3746.7040.0950.098 11.48
244.867.9820.1160.106 13.28
2565.38511.1510.0770.112 16.93
65.4017.6690.0730.081 13.42
1605.04217.0920.2740.12 22.86
151-10-5-5 727.98118.510.1810.486 27.60
609.7816.6140.170.387 27.43
86.7128.9640.1040.422 16.62
49.58242.1390.3060.435 52.92
809.25815.8620.2220.448 26.28
107.63112.2030.2090.449 20.96
608.99134.0290.1880.458 44.13
569.45624.580.1810.456 35.43
6729.64526.8490.2580.416 37.74
89.01428.1050.3270.469 38.41

House

A house consists of 5 nodes with 6 edges (the ridge context has directed edges to the two middle contexts, which form with the two base contexts a cycle with 4 edges); house stacks are subsequently built up by using the basement nodes as ridges for the next houses (thus, m houses have 4m+1 contexts).

DMCS DMCSOPT
Test#answerslsolveprojectioncombinetransfertotal#answerslsolveprojectioncombinetransfertotal
9-10-5-5 13440.4460.040.1730.014 0.68 1120.2050.0390.0040 0.28
5280.6220.0580.1130.007 0.83 120.1270.0040.0050.004 0.22
13521.5510.4330.3260.01 2.31 240.2250.0160.0020 0.27
25600.7760.0990.4750.008 1.41 320.2290.0350.0030.001 0.30
130562.171.57525.360.295 29.48 1440.1730.0030.0180.004 0.27
8401.2510.5630.2420.013 2.05 400.170.0150.0040.003 0.23
721.2520.6580.0220.004 1.92 240.1450.00400 0.17
2960.4870.020.1190.003 0.65 40.1160.0030.0010.001 0.15
4081.1550.3690.1760.027 1.67 630.150.0060.0070.002 0.20
44161.9121.3451.9910.044 5.30 1440.1850.0150.0080.002 0.26
13-10-5-5 192003.7867.81140.8470.315 53.33 1200.3540.0840.0230.006 0.52
102401.5510.47411.3540.18 13.72 5120.4670.0270.040.016 0.71
18481.4750.3250.8290.144 2.78 640.1190.0010.0010.002 0.16
51205.78415.8783.8410.052 25.68 40.1310.00200.001 0.16
900.1850.0080.0040.002 0.31
240.2710.0330.010.009 0.39
2880.4140.1210.0350.002 0.62
440.3530.0460.0270.006 0.50
2080.3820.0430.0160.005 0.49
6240.2790.0280.0340.004 0.44
41-10-5-5 800.9070.1330.0380.056 1.54
240.690.0160.0170.041 0.94
160.7930.0140.0070.04 1.04
960.6460.0160.0220.03 0.87
640.560.0160.010.025 0.74
80.7780.0150.0050.023 0.94
280.5840.0090.0120.043 1.27
640.8050.1030.0190.033 1.13
120.6030.0260.0140.036 0.84
560.6990.0320.0150.036 0.95
101-10-5-5 221.7760.2460.1940.309 7.02
481.6690.1590.0980.238 2.97
641.9760.120.0750.297 3.64
271.9320.1880.1270.287 3.55
481.7670.080.0440.198 2.74
3841.8080.1490.1830.272 3.69
1361.9860.2350.1380.244 3.21
2721.780.1730.1010.243 3.05
561.2580.0990.0790.254 3.35
401.3380.080.1630.292 6.47

Binary Tree

DMCS DMCSOPT
Test#answerslsolveprojectioncombinetransfertotal#answerslsolveprojectioncombinetransfertotal
100-9-4-4 80.667000.108 0.95
60.7790.00300.101 1.06
100.666000.105 0.94
80.677000.1 0.94
80.576000.107 0.86
560.8160.00300.102 1.10
140.8070.00200.108 1.09
80.583000.105 0.85
160.625000.101 0.90
640.601000.107 0.88
200-9-4-4 81.2990.03900.409 2.30
61.7630.01100.419 2.76
241.3830.00300.405 2.30
561.3770.00800.417 2.40
81.6290.00200.436 2.86
321.30.00500.407 2.17
321.5820.0100.408 2.63
161.5280.00900.425 2.38
101.6510.00700.413 2.69
91.3920.00400.41 2.57
400-9-4-4 322.7990.04101.669 5.36
242.5860.03601.706 5.19
322.3480.02601.657 4.86
62.70.03101.704 5.29
62.9950.05201.716 5.64
82.8850.04101.75 5.55
642.7380.0380.0011.762 5.41
42.7570.03901.728 5.37
42.6360.03301.75 5.25
282.7330.04401.667 5.30
600-9-4-4 434.461.6310.57316.445 175.59

KR 2010 experimental results

The table below shows the experimental result in defk2010-kr. We experemented on two topologies, namely diamond (D) and ring (R). For each topology and each of the two set of parameters P1 and P2, there are 5 test cases. Each row of the table reports the total running time and number of models/answers for the respective test cases.

TopoloyP1=(7, 8, 4, 4)#answersP2=(10, 12, 6, 6)#answers
D10.248101419.5201944
D20.129563.3615240
D30.1593218.94815088
D40.12134846.24914596
D50.0851211.2895220
R10.10917633.020120736
R20.1062082.28510548
R30.185800.6372200
R40.13511112.17698656
R50.32021196.87019388

$Id: experiments.html 2967 2011-05-04 14:00:52Z mmsc $

Streaming DMCS experiment
Dynamic DMCS experiment
DMCSOPT experiment
DMCS experiment