SimultaneousClickDetectionDiscriminationMoreTests
From SeedWiki
Revision as of 04:23, 15 February 2009 by Matus Telgarsky (Talk | contribs)
See SimultaneousClickDetectionDiscrimination for some explanations. the table was organized to make sorting useful. NOTE that k-way tests are upon provided clicks only--that explains how a classifier can make >50% errors on its class, but the combined k-way classifier can have error <5%!
| Features | Algorithm | Strategy | Species | Lo Train | Lo Test | Tt Train | Tt Test | Dd Train | Dd Test | k-way train | k-way test |
|---|---|---|---|---|---|---|---|---|---|---|---|
| fft(64) | pegasos | singly | LoTtDd | 51.434426% | 51.825749% | 3.875099% | 2.703788% | 10.984665% | 9.014475% | 23.894975% | 15.970750% |
| fft(64) | pegasos | combined | LoTtDd | 16.189883% | 16.059458% | 1.291643% | 0.901222% | 5.227053% | 3.186664% | 96.581035% | 98.908436% |
| fft(64) | pegasos | singly | LoTt | 51.434426% | 51.825749% | 3.875099% | 2.703788% | - | - | 6.790052% | 4.848194% |
| fft(64) | pegasos | combined | LoTt | 24.285069% | 24.089432% | 1.937486% | 1.351849% | - | - | 99.005205% | 99.231969% |
| fft(64) | winnow | singly | LoTtDd | 4.845709% | 7.023513% | 1.161870% | 1.820372% | 11.259080% | 27.624166% | 52.313940% | 51.409496% |
| fft(64) | winnow | combined | LoTtDd | 22.513962% | 22.863971% | 1.311447% | 0.919068% | 7.048316% | 7.384509% | 57.546279% | 54.217889% |
| fft(64) | winnow | singly | LoTt | 8.353423% | 10.911963% | 0.805387% | 1.532593% | - | - | 35.338346% | 29.737189% |
| fft(64) | winnow | combined | LoTt | 24.851590% | 24.703059% | 5.997293% | 6.264012% | - | - | 64.233661% | 65.270611% |
| fft(64) | perceptron | singly | LoTtDd | 3.947686% | 5.929886% | 3.617639% | 4.530853% | 57.845036% | 74.230736% | 69.125425% | 76.303518% |
| fft(64) | perceptron | combined | LoTtDd | 43.328378% | 45.501124% | 1.291643% | 0.901222% | 45.453567% | 57.758646% | 56.847374% | 61.159390% |
| fft(64) | perceptron | singly | LoTt | 10.866683% | 11.580290% | 0.798785% | 1.479052% | - | - | 68.883748% | 66.374655% |
| fft(64) | perceptron | combined | LoTt | 27.852946% | 28.992375% | 1.957290% | 1.371926% | - | - | 38.600347% | 36.361454% |
| poly2(fft(64)) | pegasos | singly | LoTtDd | 5.882353% | 5.225105% | 2.356747% | 2.308928% | 15.552865% | 9.560544% | 23.885531% | 15.970750% |
| poly2(fft(64)) | pegasos | combined | LoTtDd | 16.189883% | 16.059458% | 1.291643% | 0.901222% | 5.227053% | 3.186664% | 82.017378% | 85.862654% |
| poly2(fft(64)) | pegasos | singly | LoTt | 5.882353% | 5.231181% | 2.356747% | 2.308928% | - | - | 6.778485% | 4.848194% |
| poly2(fft(64)) | pegasos | combined | LoTt | 24.285069% | 24.089432% | 1.937486% | 1.351849% | - | - | 96.946212% | 95.919837% |
| poly2(fft(64)) | winnow | singly | LoTtDd | 0.922131% | 2.527493% | 0.118828% | 0.421630% | 5.601291% | 2.132270% | 32.687949% | 34.431963% |
| poly2(fft(64)) | winnow | combined | LoTtDd | 22.423561% | 22.653355% | 1.689918% | 1.128759% | 6.408049% | 3.227111% | 69.465433% | 73.823654% |
| poly2(fft(64)) | winnow | singly | LoTt | 1.241562% | 2.120420% | 0.006602% | 0.214161% | - | - | 47.773279% | 47.425897% |
| poly2(fft(64)) | winnow | combined | LoTt | 25.237306% | 25.687293% | 1.937486% | 1.351849% | - | - | 30.711394% | 29.701188% |
| poly2(fft(64)) | perceptron | singly | LoTtDd | 0.873915% | 2.223707% | 0.000000% | 0.207469% | 8.038741% | 7.575626% | 24.773328% | 25.869012% |
| poly2(fft(64)) | perceptron | combined | LoTtDd | 30.575756% | 30.845096% | 1.359856% | 0.923530% | 6.004520% | 3.212666% | 27.361164% | 24.671471% |
| poly2(fft(64)) | perceptron | singly | LoTt | 2.332449% | 2.758369% | 0.006602% | 0.220854% | - | - | 24.731058% | 28.369135% |
| poly2(fft(64)) | perceptron | combined | LoTt | 24.351364% | 24.204866% | 1.937486% | 1.351849% | - | - | 50.225564% | 50.654026% |
| fft(128) | pegasos | singly | LoTtDd | 70.232789% | 71.428571% | 0.178302% | 0.493692% | 6.233062% | 0.327238% | 16.566404% | 3.023388% |
| fft(128) | pegasos | combined | LoTtDd | 9.926815% | 9.528344% | 0.059429% | 0.164549% | 2.077437% | 0.109065% | 96.390560% | 99.828865% |
| fft(128) | pegasos | singly | LoTt | 70.232789% | 71.428571% | 0.178302% | 0.493692% | - | - | 0.715859% | 2.073733% |
| fft(128) | pegasos | combined | LoTt | 14.890631% | 14.292917% | 0.089145% | 0.246829% | - | - | 99.944934% | 99.884793% |
| fft(128) | winnow | singly | LoTtDd | 2.245336% | 5.025210% | 0.027431% | 0.438837% | 10.352304% | 28.662175% | 16.658954% | 9.811751% |
| fft(128) | winnow | combined | LoTtDd | 15.429483% | 15.421241% | 0.082286% | 0.219398% | 3.305835% | 0.487586% | 20.129570% | 15.288078% |
| fft(128) | winnow | singly | LoTt | 1.849100% | 4.521008% | 0.246880% | 0.699397% | - | - | 33.920705% | 33.813364% |
| fft(128) | winnow | combined | LoTt | 15.385885% | 15.082766% | 0.089145% | 0.246829% | - | - | 17.125551% | 15.725806% |
| fft(128) | perceptron | singly | LoTtDd | 1.452864% | 4.016807% | 0.000000% | 0.342841% | 5.889792% | 24.831569% | 27.996298% | 22.646891% |
| fft(128) | perceptron | combined | LoTtDd | 22.489407% | 22.910598% | 0.059429% | 0.164549% | 7.406515% | 6.883942% | 11.013420% | 4.962921% |
| fft(128) | perceptron | singly | LoTt | 1.617963% | 4.756303% | 0.013716% | 0.342841% | - | - | 13.876652% | 11.693548% |
| fft(128) | perceptron | combined | LoTt | 14.890631% | 14.292917% | 0.089145% | 0.246829% | - | - | 56.993392% | 54.435484% |
| poly2(fft(128)) | pegasos | singly | LoTtDd | 7.644048% | 5.260504% | 0.164586% | 0.493692% | 5.763324% | 0.327238% | 15.455807% | 3.194524% |
| poly2(fft(128)) | pegasos | combined | LoTtDd | 9.926815% | 9.528344% | 0.059429% | 0.164549% | 2.077437% | 0.109065% | 95.002314% | 98.973189% |
| poly2(fft(128)) | pegasos | singly | LoTt | 7.644048% | 5.260504% | 0.164586% | 0.493692% | - | - | 0.715859% | 2.073733% |
| poly2(fft(128)) | pegasos | combined | LoTt | 14.890631% | 14.292917% | 0.089145% | 0.246829% | - | - | 97.852423% | 97.062212% |
| poly2(fft(128)) | winnow | singly | LoTtDd | 0.759452% | 1.680672% | 0.013716% | 0.027427% | 2.944896% | 1.713186% | 38.176770% | 38.505419% |
| poly2(fft(128)) | winnow | combined | LoTtDd | 10.328509% | 9.954067% | 0.109714% | 0.191974% | 2.252062% | 0.128312% | 75.937066% | 86.366229% |
| poly2(fft(128)) | winnow | singly | LoTt | 0.891530% | 1.613445% | 0.000000% | 0.041141% | - | - | 9.251101% | 11.463134% |
| poly2(fft(128)) | winnow | combined | LoTt | 15.171275% | 14.662633% | 0.089145% | 0.246829% | - | - | 18.226872% | 18.894009% |
| poly2(fft(128)) | perceptron | singly | LoTtDd | 0.396236% | 1.563025% | 0.000000% | 0.000000% | 0.921409% | 0.173244% | 38.176770% | 44.609241% |
| poly2(fft(128)) | perceptron | combined | LoTtDd | 11.720685% | 11.410486% | 0.068571% | 0.169120% | 2.553140% | 0.121896% | 80.333179% | 86.822590% |
| poly2(fft(128)) | perceptron | singly | LoTt | 1.320786% | 1.747899% | 0.000000% | 0.013714% | - | - | 85.903084% | 88.421659% |
| poly2(fft(128)) | perceptron | combined | LoTt | 15.039208% | 14.561802% | 0.089145% | 0.246829% | - | - | 29.735683% | 33.755760% |
