开发者:上海品职教育科技有限公司 隐私政策详情

应用版本:4.2.11(IOS)|3.2.5(安卓)APP下载

eaglexps · 2023年04月13日

您好。老师

NO.PZ2021083101000007

问题如下:

Select performance data from the cross- validation set confusion matrices is presented in Exhibit 1:


Azarov and Bector evaluate the Dataset XYZ performance metrics for Confusion Matrices A, B, and C in Exhibit 1. Azarov says, “For Ganymede’s purposes, we should be most concerned with the cost of Type I errors. ”

Based on Exhibit 1, which confusion matrix demonstrates the most favorable value of the performance metric that best addresses Azarov’s concern?

选项:

A.

Confusion Matrix A

B.

Confusion Matrix B

C.

Confusion Matrix C

解释:

A is correct.

Precision is the ratio of correctly predicted positive classes to all predicted positive classes and is useful in situations where the cost of false positives or Type I errors is high.

Confusion Matrix A has the highest precision and therefore demonstrates the most favorable value of the performance metric that best addresses Azarov’s concern about the cost of Type I errors.

Confusion Matrix A has a precision score of 0.95, which is higher than the precision scores of Confusion Matrix B (0.93) and Confusion Matrix C (0.86).

B is incorrect because precision, not accuracy, is the performance measure that best addresses Azarov’s concern about the cost of Type I errors.

Confusion Matrix B demonstrates the most favorable value for the accuracy score (0.92), which is higher than the accuracy scores of Confusion Matrix A (0.91) and Confusion Matrix C (0.91).

Accuracy is a performance measure that gives equal weight to false positives and false negatives and is considered an appropriate performance measure when the class distribution in the dataset is equal (a balanced dataset).

However, Azarov is most concerned with the cost of false positives, or Type I errors, and not with finding the equilibrium between precision and recall.

Furthermore, Dataset XYZ has an unequal (unbalanced) class distribution between positive sentiment and negative sentiment sentences.

C is incorrect because precision, not recall or F1 score, is the performance measure that best addresses Azarov’s concern about the cost of Type I errors.

Confusion Matrix C demonstrates the most favorable value for the recall score (0.97), which is higher than the recall scores of Confusion Matrix A (0.87) and Confusion Matrix B (0.90).

Recall is the ratio of correctly predicted positive classes to all actual positive classes and is useful in situations where the cost of false negatives, or Type II errors, is high.

However, Azarov is most concerned with the cost of Type I errors, not Type II errors.

F1 score is more appropriate (than accuracy) when there is unequal class distribution in the dataset and it is necessary to measure the equilibrium of precision and recall.

Confusion Matrix C demonstrates the most favorable value for the F1 score (0.92), which is higher than the F1 scores of Confusion Matrix A (0.91) and Confusion Matrix B (0.91).

Although Dataset XYZ has an unequal class distribution between positive sentiment and negative sentiment sentences, Azarov is most concerned with the cost of false positives, or Type I errors, and not with finding the equilibrium between precision and recall.

考点:Model Training - Performance Evaluation

这道题我想问下,我做的时候知道用precison,但是他说worried about cost of Typ 1 error, 那不应该是FP比较大的时候,Type I error会比较大吗,那么prcesion小的时候,不应该是选C吗?还是说我哪里理解错了,谢谢

1 个答案

星星_品职助教 · 2023年04月13日

同学你好,

Type I error和cost of FP大的时候,都应选用Precision这个指标。

所以,“ the most favorable value”就是选Precision最大的confusion matrix,不需要考虑Precision小的情况。

  • 1

    回答
  • 1

    关注
  • 364

    浏览
相关问题

NO.PZ2021083101000007 问题如下 Seleperformanta from the cross- valition set confusion matrices is presentein Exhibit 1:Azarov anBector evaluate the taset XYZ performanmetrifor Confusion Matrices anC in Exhibit 1. Azarov says, “For Ganyme’s purposes, we shoulmost concernewith the cost of Type I errors. ”Baseon Exhibit 1, whiconfusion matrix monstrates the most favorable value of the performanmetric thbest aresses Azarov’s concern? A.Confusion Matrix B.Confusion Matrix C.Confusion Matrix A is correct. Precision is the ratio of correctly prectepositive classes to all prectepositive classes anis useful in situations where the cost of false positives or Type I errors is high. Confusion Matrix A hthe highest precision antherefore monstrates the most favorable value of the performanmetric thbest aresses Azarov’s concern about the cost of Type I errors.Confusion Matrix A ha precision score of 0.95, whiis higher ththe precision scores of Confusion Matrix B (0.93) anConfusion Matrix C (0.86).B is incorrebecause precision, not accuracy, is the performanmeasure thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix B monstrates the most favorable value for the accurascore (0.92), whiis higher ththe accurascores of Confusion Matrix A (0.91) anConfusion Matrix C (0.91). Accurais a performanmeasure thgives equweight to false positives anfalse negatives anis consireappropriate performanmeasure when the class stribution in the taset is equ(a balancetaset). However, Azarov is most concernewith the cost of false positives, or Type I errors, annot with finng the equilibrium between precision anrecall. Furthermore, taset XYZ hunequ(unbalance class stribution between positive sentiment annegative sentiment sentences.C is incorrebecause precision, not recall or F1 score, is the performanmeasure thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix C monstrates the most favorable value for the recall score (0.97), whiis higher ththe recall scores of Confusion Matrix A (0.87) anConfusion Matrix B (0.90). Recall is the ratio of correctly prectepositive classes to all actupositive classes anis useful in situations where the cost of false negatives, or Type II errors, is high. However, Azarov is most concernewith the cost of Type I errors, not Type II errors.F1 score is more appropriate (thaccuracy) when there is unequclass stribution in the taset anit is necessary to measure the equilibrium of precision anrecall. Confusion Matrix C monstrates the most favorable value for the F1 score (0.92), whiis higher ththe F1 scores of Confusion Matrix A (0.91) anConfusion Matrix B (0.91). Although taset XYZ hunequclass stribution between positive sentiment annegative sentiment sentences, Azarov is most concernewith the cost of false positives, or Type I errors, annot with finng the equilibrium between precision anrecall. 考点Mol Training - PerformanEvaluation 如果F1、Precision、recall、AUC值如果互相冲突怎么办,哪个优先级更高

2024-03-18 16:21 1 · 回答

Confusion Matrix B Confusion Matrix C A is correct. Precision is the ratio of correctly prectepositive classes to all prectepositive classes anis useful in situations where the cost of false positives or Type I errors is high. Confusion Matrix A hthe highest precision antherefore monstrates the most favorable value of the performanmetric thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix A ha precision score of 0.95, whiis higher ththe precision scores of Confusion Matrix B (0.93) anConfusion Matrix C (0.86). B is incorrebecause precision, not accuracy, is the performanmeasure thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix B monstrates the most favorable value for the accurascore (0.92), whiis higher ththe accurascores of Confusion Matrix A (0.91) anConfusion Matrix C (0.91). Accurais a performanmeasure thgives equweight to false positives anfalse negatives anis consireappropriate performanmeasure when the class stribution in the taset is equ(a balancetaset). However, Azarov is most concernewith the cost of false positives, or Type I errors, annot with finng the equilibrium between precision anrecall. Furthermore, taset XYZ hunequ(unbalance class stribution between positive sentiment annegative sentiment sentences. C is incorrebecause precision, not recall or F1 score, is the performanmeasure thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix C monstrates the most favorable value for the recall score (0.97), whiis higher ththe recall scores of Confusion Matrix A (0.87) anConfusion Matrix B (0.90). Recall is the ratio of correctly prectepositive classes to all actupositive classes anis useful in situations where the cost of false negatives, or Type II errors, is high. However, Azarov is most concernewith the cost of Type I errors, not Type II errors. F1 score is more appropriate (thaccuracy) when there is unequclass stribution in the taset anit is necessary to measure the equilibrium of precision anrecall. Confusion Matrix C monstrates the most favorable value for the F1 score (0.92), whiis higher ththe F1 scores of Confusion Matrix A (0.91) anConfusion Matrix B (0.91). Although taset XYZ hunequclass stribution between positive sentiment annegative sentiment sentences, Azarov is most concernewith the cost of false positives, or Type I errors, annot with finng the equilibrium between precision anrecall. 考点Mol Training - PerformanEvaluation 老师好,不太明白这题的意思,当valition的p低的时候,valition更有可能被认为是positive的吧……所以B的Type I Error概率就很大,最应该担心B。。。。难道不是么?

2022-05-29 23:52 1 · 回答

NO.PZ2021083101000007问题如下 Seleperformanta from the cross- valition set confusion matrices is presentein Exhibit 1:Azarov anBector evaluate the taset XYZ performanmetrifor Confusion Matrices anC in Exhibit 1. Azarov says, “For Ganyme’s purposes, we shoulmost concernewith the cost of Type I errors. ”Baseon Exhibit 1, whiconfusion matrix monstrates the most favorable value of the performanmetric thbest aresses Azarov’s concern? A.Confusion Matrix B.Confusion Matrix C.Confusion Matrix A is correct. Precision is the ratio of correctly prectepositive classes to all prectepositive classes anis useful in situations where the cost of false positives or Type I errors is high. Confusion Matrix A hthe highest precision antherefore monstrates the most favorable value of the performanmetric thbest aresses Azarov’s concern about the cost of Type I errors.Confusion Matrix A ha precision score of 0.95, whiis higher ththe precision scores of Confusion Matrix B (0.93) anConfusion Matrix C (0.86).B is incorrebecause precision, not accuracy, is the performanmeasure thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix B monstrates the most favorable value for the accurascore (0.92), whiis higher ththe accurascores of Confusion Matrix A (0.91) anConfusion Matrix C (0.91). Accurais a performanmeasure thgives equweight to false positives anfalse negatives anis consireappropriate performanmeasure when the class stribution in the taset is equ(a balancetaset). However, Azarov is most concernewith the cost of false positives, or Type I errors, annot with finng the equilibrium between precision anrecall. Furthermore, taset XYZ hunequ(unbalance class stribution between positive sentiment annegative sentiment sentences.C is incorrebecause precision, not recall or F1 score, is the performanmeasure thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix C monstrates the most favorable value for the recall score (0.97), whiis higher ththe recall scores of Confusion Matrix A (0.87) anConfusion Matrix B (0.90). Recall is the ratio of correctly prectepositive classes to all actupositive classes anis useful in situations where the cost of false negatives, or Type II errors, is high. However, Azarov is most concernewith the cost of Type I errors, not Type II errors.F1 score is more appropriate (thaccuracy) when there is unequclass stribution in the taset anit is necessary to measure the equilibrium of precision anrecall. Confusion Matrix C monstrates the most favorable value for the F1 score (0.92), whiis higher ththe F1 scores of Confusion Matrix A (0.91) anConfusion Matrix B (0.91). Although taset XYZ hunequclass stribution between positive sentiment annegative sentiment sentences, Azarov is most concernewith the cost of false positives, or Type I errors, annot with finng the equilibrium between precision anrecall. 考点Mol Training - PerformanEvaluation Azarov anBector evaluate the taset XYZ performanmetrifor Confusion Matrices anC in Exhibit 1. Azarov says, “For Ganyme’s purposes, we shoulmost concernewith the cost of Type I errors. ”Baseon Exhibit 1, whiconfusion matrix monstrates the most favorable value of the performanmetric thbest aresses Azarov’s concern?就是最关心的是type I error。然后题目问的是哪个confusion matrix能够最好的表现出Azarov的担忧,不过,显示出来的是最好的值?就是最让他可以不用担忧吗?感觉题目的表述好难理解。不用担忧就是Precision越接近于1越好,所以是A,是这样吗?

2022-03-28 22:34 2 · 回答

NO.PZ2021083101000007 Confusion Matrix B Confusion Matrix C A is correct. Precision is the ratio of correctly prectepositive classes to all prectepositive classes anis useful in situations where the cost of false positives or Type I errors is high. Confusion Matrix A hthe highest precision antherefore monstrates the most favorable value of the performanmetric thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix A ha precision score of 0.95, whiis higher ththe precision scores of Confusion Matrix B (0.93) anConfusion Matrix C (0.86). B is incorrebecause precision, not accuracy, is the performanmeasure thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix B monstrates the most favorable value for the accurascore (0.92), whiis higher ththe accurascores of Confusion Matrix A (0.91) anConfusion Matrix C (0.91). Accurais a performanmeasure thgives equweight to false positives anfalse negatives anis consireappropriate performanmeasure when the class stribution in the taset is equ(a balancetaset). However, Azarov is most concernewith the cost of false positives, or Type I errors, annot with finng the equilibrium between precision anrecall. Furthermore, taset XYZ hunequ(unbalance class stribution between positive sentiment annegative sentiment sentences. C is incorrebecause precision, not recall or F1 score, is the performanmeasure thbest aresses Azarov’s concern about the cost of Type I errors. Confusion Matrix C monstrates the most favorable value for the recall score (0.97), whiis higher ththe recall scores of Confusion Matrix A (0.87) anConfusion Matrix B (0.90). Recall is the ratio of correctly prectepositive classes to all actupositive classes anis useful in situations where the cost of false negatives, or Type II errors, is high. However, Azarov is most concernewith the cost of Type I errors, not Type II errors. F1 score is more appropriate (thaccuracy) when there is unequclass stribution in the taset anit is necessary to measure the equilibrium of precision anrecall. Confusion Matrix C monstrates the most favorable value for the F1 score (0.92), whiis higher ththe F1 scores of Confusion Matrix A (0.91) anConfusion Matrix B (0.91). Although taset XYZ hunequclass stribution between positive sentiment annegative sentiment sentences, Azarov is most concernewith the cost of false positives, or Type I errors, annot with finng the equilibrium between precision anrecall. 考点Mol Training - PerformanEvaluation p值高和拒真怎么联系?

2021-10-27 23:30 1 · 回答