edu.illinois.cs.cogcomp.comma

Class ClassifierComparison

java.lang.Object

edu.illinois.cs.cogcomp.comma.ClassifierComparison

public class ClassifierComparison
extends Object

Run this first. It will print out the prediction performance of all the different models evaluated through 5 fold cval

Author:

navari

Constructor Summary

Constructors

Constructor and Description
ClassifierComparison()

Method Summary

Modifier and Type	Method and Description
static EvaluateDiscrete	getBayraktarBaselinePerformance(edu.illinois.cs.cogcomp.lbjava.parse.Parser parser, boolean testOnGold) prints Bayraktar baseline performance based on only those commas whose Bayraktar patterns have been annotated
static EvaluateDiscrete	localCVal(boolean trainOnGold, boolean testOnGold, edu.illinois.cs.cogcomp.lbjava.parse.Parser parser, int learningRounds, double learningRate, double threshold, double thickness, boolean testOnTrain)
static void	main(String[] args)
static void	printConstrainedClassifierPerformance(edu.illinois.cs.cogcomp.lbjava.parse.Parser parser)
static void	reasonForBelievingThatStructuredIsPerformingWorseDueToOverfitting(edu.illinois.cs.cogcomp.lbjava.parse.Parser parser, boolean useGoldFeatures) Structured's higher performance on the train set and lower performance on test set is indicative of overfitting
static EvaluateDiscrete	structuredCVal(StructuredCommaClassifier model, edu.illinois.cs.cogcomp.lbjava.parse.Parser parser, boolean useGoldFeatures, boolean testOnTrain)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ClassifierComparison

public ClassifierComparison()

Method Detail

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception

printConstrainedClassifierPerformance

public static void printConstrainedClassifierPerformance(edu.illinois.cs.cogcomp.lbjava.parse.Parser parser)

structuredCVal

public static EvaluateDiscrete structuredCVal(StructuredCommaClassifier model,
                                              edu.illinois.cs.cogcomp.lbjava.parse.Parser parser,
                                              boolean useGoldFeatures,
                                              boolean testOnTrain)
                                       throws Exception

Throws:

Exception

localCVal

public static EvaluateDiscrete localCVal(boolean trainOnGold,
                                         boolean testOnGold,
                                         edu.illinois.cs.cogcomp.lbjava.parse.Parser parser,
                                         int learningRounds,
                                         double learningRate,
                                         double threshold,
                                         double thickness,
                                         boolean testOnTrain)

getBayraktarBaselinePerformance

public static EvaluateDiscrete getBayraktarBaselinePerformance(edu.illinois.cs.cogcomp.lbjava.parse.Parser parser,
                                                               boolean testOnGold)

prints Bayraktar baseline performance based on only those commas whose Bayraktar patterns have been annotated

reasonForBelievingThatStructuredIsPerformingWorseDueToOverfitting

public static void reasonForBelievingThatStructuredIsPerformingWorseDueToOverfitting(edu.illinois.cs.cogcomp.lbjava.parse.Parser parser,
                                                                                     boolean useGoldFeatures)
                                                                              throws Exception

Structured's higher performance on the train set and lower performance on test set is indicative of overfitting

Throws:

Exception