nncf.quantization.range_estimator

Classes

StatisticsType	Enumeration of different types of statistics that are used to collect per sample
AggregatorType	Enumeration of different types of aggregators that are used to aggregate per sample
StatisticsCollectorParameters	Contains parameters for collecting statistics for activations and weights of the model.
RangeEstimatorParameters	Contains parameters for estimating the range of activations and weights of the model.

class nncf.quantization.range_estimator.StatisticsType

Bases: enum.Enum

Enumeration of different types of statistics that are used to collect per sample statistics for activations and weights of the model.

Parameters:

• MAX – The maximum value in a tensor.

• MIN – The minimum value in a tensor.

• ABS_MAX – The maximum absolute value in a tensor.

• QUANTILE – A specific quantile value in a tensor.

• ABS_QUANTILE – A specific quantile value in the absolute tensor.

• MEAN – The mean value of a tensor.

class nncf.quantization.range_estimator.AggregatorType

Bases: enum.Enum

Enumeration of different types of aggregators that are used to aggregate per sample statistics for activations and weights of the model.

Parameters:

• MEAN – The mean value of a set of tensors.

• MAX – The maximum value of a set of tensors.

• MIN – The minimum value of a set of tensors.

• MEDIAN – The median value of a set of tensors.

• MEAN_NO_OUTLIERS – The mean value of a set of tensors with outliers removed.

• MEDIAN_NO_OUTLIERS – The median value of a set of tensors with outliers removed.

class nncf.quantization.range_estimator.StatisticsCollectorParameters

Contains parameters for collecting statistics for activations and weights of the model.

Parameters:

• statistics_type (Optional[nncf.quantization.range_estimator.StatisticsType]) – The type of per sample statistics to collect.

• aggregator_type (Optional[nncf.quantization.range_estimator.AggregatorType]) – The type of aggregator of per sample statistics.

• clipping_value (Optional[float]) – The value to use for clipping the input tensors before collecting statistics.

• quantile_outlier_prob (float) – The outlier probability for quantile statistics.

class nncf.quantization.range_estimator.RangeEstimatorParameters

Contains parameters for estimating the range of activations and weights of the model.

Parameters:

• min (nncf.quantization.range_estimator.StatisticsCollectorParameters) – The parameters for estimating the lower bound of the range.

• max (nncf.quantization.range_estimator.StatisticsCollectorParameters) – The Parameters for estimating the upper bound of the range.