The Evolutionary Pre-Processor (version 3.0)
Batch Run Report

 

Batch Details
Batch run name satimage_3
Description Satimage 3 on Cortex
This report file justincase/satimage_3/satimage_3_report.html
data file /home/cssip/jsherrah/EPrep3/data/satimage_3.dat
Time of completion Sat Jun 13 12:02:05 1998
Duration of Batch 113 hours, 52 minutes, 18 seconds
Random Seed 573057194 (from clock)
Average generations per run 51.00
Average failed feature creations per run 6839.30
Average fitness evalutions per run 83724.10
Test Set Improvement 4.97 %
 
 

Data Partition
 
Class Training Validation Test Total
0 767 382 384 1533
1 351 175 177 703
2 679 341 338 1358
3 313 156 157 626
4 353 176 178 707
5 754 378 376 1508
Total 3217 1608 1610 6435

Summary of Results

  Original Classification Errors (%)
Classifier Training Validation Test
Parallelepiped(PPD) 32.30 33.02 33.23
Min. Distance to Means(MDTM) 22.66 23.26 20.31

  EPrep Best-of-run Classification Errors (%)
Run
Training
Validation
Test
McNemar confidence
# Features
# Inputs
# Nodes
Classifier
1 17.13 17.29 17.39 0.644 8 23 67 MDTM
2 14.64 16.98 18.01 0.540 15 36 791 PPD
3 16.35 17.85 16.46 0.992 11 14 38 MDTM
4 15.60 16.85 14.91 1.000 21 33 205 MDTM
5 15.82 17.35 20.06 0.051 12 35 322 PPD
6 17.03 17.35 16.02 0.997 11 25 106 MDTM
7 17.28 16.79 15.34 0.999 9 18 49 MDTM
8 17.53 18.10 16.34 0.992 6 35 459 MDTM
9 15.54 17.10 20.43 0.015 27 36 5073 PPD
10 17.72 18.03 15.65 0.999 9 28 115 MDTM
Ave. 16.47 (0.97 ) 17.37 (0.45 ) 17.06 (1.82 ) 0.72 (0.38 ) 12.90 (6.16 ) 28.30 (7.62 ) 722.50(1467.31) MDTM

  Confusion matrix for Best Ever Individual from run 7
Class
Predicted
Total
1
2
3
4
5
6
Ground Truth
1
362 0 1 2 19 0 384
2
6 156 0 1 13 1 177
3
8 0 295 35 0 0 338
4
2 0 15 112 2 26 157
5
10 0 1 3 132 32 178
6
0 0 3 63 4 306 376
Total
388 156 315 216 170 365 1610

Average Operator Probabilities
Operator Average Probability
Delete-Feature Mutation 0.099
Add-Feature Mutation 0.096
Hoist Mutation 0.107
Truncate Mutation 0.087
Swap Mutation 0.097
One-Symbol Mutation 0.097
All-Nodes Mutation 0.099
One-Node Mutation 0.099
Grow Mutation 0.104
High-Level Crossover 0.114
 

Number of Run Terminations attributed to each Criterion
Termination Criterion Number of Terminations
TP Criterion 0
GL Criterion 0
Max. Generations 10
Client Abort 0
Zero Validation Error 0
Total 10
 
 

Related Data Files
Description Filename
satimage_3_gen.m Matlab plot generation function
satimage_3_bogf_ave.{eps,gif} Best-of-generation Fitness, averaged over 10 runs
satimage_3_bogv_ave.{eps,gif} Best-of-generation Validation Set Error, averaged over 10 runs
satimage_3_avef_ave.{eps,gif} Average fitness, averaged over 10 runs
satimage_3_stdf_ave.{eps,gif} Standard deviation of fitness, averaged over 10 runs
satimage_3_nftr_ave.{eps,gif} Average number of features per individual, averaged over 10 runs
satimage_3_nnode_ave.{eps,gif} Average number of nodes per individual, averaged over 10 runs
satimage_3_nint_ave.{eps,gif} Average number of introns per individual, averaged over 10 runs
satimage_3_ntrl_ave.{eps,gif} Average number of RAT trials per individual, averaged over 10 runs
satimage_3_optimp_ave.{eps,gif} Average improvement in fitness due to optimisation, averaged over 10 runs
satimage_3_opprob_ave.{eps,gif} Average probability of each genetic operator, averaged over 10 runs
satimage_3_run_x.dat Binary data file containing results of run x (read by Matlab functions)
satimage_3_bor_x.prep 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Best-of-run individual for run x
satimage_3_run_x.corr 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Feature correlation file for run x
satimage_3_tst_bor_x.pred 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Test set predictions for best-of-run individual from run x
satimage_3_bogf_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Best-of-generation Fitness for run x
satimage_3_bogv_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Best-of-generation Validation Set Error for run x
satimage_3_avef_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average fitness for run x
satimage_3_stdf_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Standard deviation of fitness for run x
satimage_3_nftr_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average number of features per individual for run x
satimage_3_nnode_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average number of nodes per individual for run x
satimage_3_nint_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average number of introns per individual for run x
satimage_3_ntrl_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average number of RAT trials per individual for run x
satimage_3_optimp_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average improvement in fitness due to optimisation for run x
satimage_3_opprob_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average probability of each genetic operator for run x