edu.illinois.cs.cogcomp.lbjava.classify

Class TestReal

java.lang.Object

edu.illinois.cs.cogcomp.lbjava.classify.TestReal

public class TestReal
extends Object

This class is a program that can evaluate any Classifier against an oracle Classifier on the objects returned from a Parser, with different statistical metrics. In particular, this class is for real type, i.e. regression. For discrete type, refer class TestDiscrete.

Author:

Yiming Jiang

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.commons.math3.stat.descriptive.DescriptiveStatistics	goldStats
protected org.apache.commons.math3.stat.descriptive.DescriptiveStatistics	goldSubtractPredictionAbsoluteStats
protected org.apache.commons.math3.stat.descriptive.DescriptiveStatistics	goldSubtractPredictionStats
protected double	sumOfSquareOfGoldSubtractPrediction

Constructor Summary

Constructors

Constructor and Description
TestReal()

Method Summary

Modifier and Type	Method and Description
void	printPerformace(PrintStream out, int processed) Write to PrintStream, with statistical information
void	reportPrediction(double prediction, double gold) Update internal book keeping of each prediction and gold
static void	testReal(TestReal tester, Classifier classifier, Classifier oracle, Parser parser, boolean output, int outputGranularity) Tests the given real classifier against the given oracle using the given Parser to provide the real labeled testing data.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sumOfSquareOfGoldSubtractPrediction

protected double sumOfSquareOfGoldSubtractPrediction

goldSubtractPredictionStats

protected org.apache.commons.math3.stat.descriptive.DescriptiveStatistics goldSubtractPredictionStats

goldSubtractPredictionAbsoluteStats

protected org.apache.commons.math3.stat.descriptive.DescriptiveStatistics goldSubtractPredictionAbsoluteStats

goldStats

protected org.apache.commons.math3.stat.descriptive.DescriptiveStatistics goldStats

Constructor Detail

TestReal

public TestReal()

Method Detail

testReal

public static void testReal(TestReal tester,
                            Classifier classifier,
                            Classifier oracle,
                            Parser parser,
                            boolean output,
                            int outputGranularity)

Tests the given real classifier against the given oracle using the given Parser to provide the real labeled testing data. This method uses root-mean-square error as the evaluation criteria.

Parameters:

tester - An object of this class

classifier - The classifier to be tested.

oracle - The classifier to test against.

parser - The parser supplying the labeled example objects.

output - Whether or not to produce output on stdout.

outputGranularity - The number of examples processed in between time stamp messages.

reportPrediction

public void reportPrediction(double prediction,
                             double gold)

Update internal book keeping of each prediction and gold

Parameters:

prediction - prediction value

gold - gold value

printPerformace

public void printPerformace(PrintStream out,
                            int processed)

Write to PrintStream, with statistical information

Parameters:

out - printstream

processed - number of testing examples