edu.illinois.cs.cogcomp.nlp.agreement

Class PairwiseBennettS

java.lang.Object

edu.illinois.cs.cogcomp.nlp.agreement.AnnotatorAgreement

edu.illinois.cs.cogcomp.nlp.agreement.PairwiseAgreement

edu.illinois.cs.cogcomp.nlp.agreement.PairwiseBennettS

public class PairwiseBennettS
extends PairwiseAgreement

This coefficient is computed by assuming that each label is equally likely. It was first descriebd in (Bennett, Alpert and Goldstein, 1954).

Note: The coefficient S is problematic in many respects. The value of the coefficient can be artifically increased by adding spurious categories. For more discussion, refer to (Artstein and Poesio, 2008).

Author:

Vivek Srikumar

Field Summary

Fields inherited from class edu.illinois.cs.cogcomp.nlp.agreement.AnnotatorAgreement

annotation, nck, nik, nk, numAnnotators, numItems, numLabels

Constructor Summary

Constructors

Constructor and Description
PairwiseBennettS(int numItems, int numLabels)

Method Summary

Modifier and Type	Method and Description
double	getExpectedAgreement()

Methods inherited from class edu.illinois.cs.cogcomp.nlp.agreement.PairwiseAgreement

getObservedAgreement, main, printAgreementMatrix

Methods inherited from class edu.illinois.cs.cogcomp.nlp.agreement.AnnotatorAgreement

addAnnotation, getAgreementCoefficient, getObservedDisagreement

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PairwiseBennettS

public PairwiseBennettS(int numItems,
                        int numLabels)

Method Detail

getExpectedAgreement

public double getExpectedAgreement()

Specified by:

getExpectedAgreement in class AnnotatorAgreement