meka.core

Class MLEvalUtils

java.lang.Object

meka.core.MLEvalUtils

public abstract class MLEvalUtils
extends Object

MLEvalUtils - Utility functions for Evaluation.

Version:

March 2014

Author:

Jesse Read

See Also:

Metrics

Constructor Summary

Constructors

Constructor and Description
MLEvalUtils()

Method Summary

Modifier and Type	Method and Description
static Result	averageResults(Result[] folds) Deprecated.
static Result	combinePredictions(Result[] folds) Combine Predictions - Combine together various results (for example, from cross-validation) into one, simply by appending predictions and true values together, and averaging together their 'vals'.
static HashMap<String,Object>	getMLStats(double[][] Rpred, int[][] Y, double[] t, String vop) GetMLStats - Given predictions and corresponding true values and a threshold string, retreive statistics.
static HashMap<String,Object>	getMLStats(double[][] Rpred, int[][] Y, String t, String vop) GetMLStats - Given predictions and corresponding true values and a threshold string, retreive statistics.
static HashMap<String,Object>	getMTStats(double[][] Rpred, int[][] Y, String vop) GetMTStats - Given multi-target predictions and corresponding true values, retreive evaluation statistics.
static String	getThreshold(ArrayList<double[]> Y, weka.core.Instances D, String top) GetThreshold - Get a threshold from a Threshold OPtion string 'top'.
static void	main(String[] args) Main - can use this function for writing tests during development.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MLEvalUtils

public MLEvalUtils()

Method Detail

getThreshold

public static String getThreshold(ArrayList<double[]> Y,
                                  weka.core.Instances D,
                                  String top)
                           throws Exception

GetThreshold - Get a threshold from a Threshold OPtion string 'top'.

Parameters:

Y - label space; for calculating a threshold with PCut

D - training data; for calculating a threshold with PCut

top - Threshold OPtion (either "PCut1", "PCutL" or a real value e.g. "0.5" or L real values e.g. "[0.1, 0.2, 0.8]" for L = 3

Throws:

Exception

getMLStats

public static HashMap<String,Object> getMLStats(double[][] Rpred,
                                                int[][] Y,
                                                String t,
                                                String vop)

GetMLStats - Given predictions and corresponding true values and a threshold string, retreive statistics.

Parameters:

Rpred - predictions (may be real-valued confidences)

Y - corresponding true values

t - a threshold string, e.g. "0.387"

vop - the verbosity option, e.g. "5"

Returns:

the evaluation statistics

getMLStats

public static HashMap<String,Object> getMLStats(double[][] Rpred,
                                                int[][] Y,
                                                double[] t,
                                                String vop)

GetMLStats - Given predictions and corresponding true values and a threshold string, retreive statistics.

Parameters:

Rpred - predictions (may be double-valued confidences in the multi-label case)

Y - corresponding true values

t - a vector of thresholds, e.g. [0.1,0.1,0.1] or [0.1,0.5,0.4,0.001]

Returns:

the evaluation statistics

getMTStats

public static HashMap<String,Object> getMTStats(double[][] Rpred,
                                                int[][] Y,
                                                String vop)

GetMTStats - Given multi-target predictions and corresponding true values, retreive evaluation statistics.

Parameters:

Rpred - predictions

Y - corresponding true values

Returns:

the evaluation statistics

combinePredictions

public static Result combinePredictions(Result[] folds)

Combine Predictions - Combine together various results (for example, from cross-validation) into one, simply by appending predictions and true values together, and averaging together their 'vals'.

Parameters:

folds - an array of Results

Returns:

a combined Result

averageResults

@Deprecated
public static Result averageResults(Result[] folds)

Deprecated.

AverageResults - Create a Result with the average of an array of Results by taking the average +/- standand deviation.

Parameters:

folds - array of Results (e.g., from CV-validation)

Returns:

A result reporting the average of these folds.

main

public static void main(String[] args)

Main - can use this function for writing tests during development.

Parameters:

args - command line arguments