TimeX¶
Testy na zbiorze kpwr-1.2.3-time
Reguły na zbiorze tune.
====================================================================================== # Exact match evaluation -- annotation span and types evaluation ====================================================================================== Annotation & TP & FP & FN & Precision & Recall & F$_1$ \\ \hline t3_date & 668 & 70 & 81 & 90,51% & 89,19% & 89,85% \\ t3_duration & 72 & 32 & 41 & 69,23% & 63,72% & 66,36% \\ t3_set & 10 & 14 & 6 & 41,67% & 62,50% & 50,00% \\ t3_time & 37 & 12 & 13 & 75,51% & 74,00% & 74,75% \\ \hline *TOTAL* & 787 & 128 & 141 & 86,01% & 84,81% & 85,40% \\ ====================================================================================== # Annotation span evaluation (annotation types are ignored) ====================================================================================== Annotation & TP & FP & FN & Precision & Recall & F$_1$ \\ \hline *TOTAL* & 795 & 120 & 133 & 86,89% & 85,67% & 86,27% \\ ====================================================================================== # MUC match evaluation ====================================================================================== Annotation & COR & ACT & POS & Precision & Recall & F$_1$ \\ \hline t3_date & 1359 & 117 & 141 & 92,07% & 90,60% & 91,33% \\ t3_duration & 152 & 56 & 75 & 73,08% & 66,96% & 69,89% \\ t3_set & 23 & 25 & 9 & 47,92% & 71,88% & 57,50% \\ t3_time & 77 & 21 & 23 & 78,57% & 77,00% & 77,78% \\ \hline *TOTAL* & 1611 & 219 & 248 & 88,03% & 86,66% & 87,34%
Model statystyczny uczony na train, testowany na test
====================================================================================== # Exact match evaluation -- annotation span and types evaluation ====================================================================================== Annotation & TP & FP & FN & Precision & Recall & F$_1$ \\ \hline t3_date & 651 & 59 & 98 & 91,69% & 86,92% & 89,24% \\ t3_duration & 60 & 21 & 53 & 74,07% & 53,10% & 61,86% \\ t3_set & 6 & 2 & 10 & 75,00% & 37,50% & 50,00% \\ t3_time & 19 & 10 & 31 & 65,52% & 38,00% & 48,10% \\ \hline *TOTAL* & 736 & 92 & 192 & 88,89% & 79,31% & 83,83% \\ ====================================================================================== # Annotation span evaluation (annotation types are ignored) ====================================================================================== Annotation & TP & FP & FN & Precision & Recall & F$_1$ \\ \hline *TOTAL* & 744 & 84 & 184 & 89,86% & 80,17% & 84,74% \\ ====================================================================================== # MUC match evaluation ====================================================================================== Annotation & COR & ACT & POS & Precision & Recall & F$_1$ \\ \hline t3_date & 1323 & 97 & 177 & 93,17% & 88,20% & 90,62% \\ t3_duration & 129 & 33 & 97 & 79,63% & 57,08% & 66,49% \\ t3_set & 12 & 4 & 20 & 75,00% & 37,50% & 50,00% \\ t3_time & 45 & 13 & 55 & 77,59% & 45,00% & 56,96% \\ \hline *TOTAL* & 1509 & 147 & 349 & 91,12% & 81,22% & 85,89%
Połączenie reguł i modelu statystycznego
====================================================================================== # Exact match evaluation -- annotation span and types evaluation ====================================================================================== Annotation & TP & FP & FN & Precision & Recall & F$_1$ \\ \hline t3_date & 668 & 70 & 81 & 90,51% & 89,19% & 89,85% \\ t3_duration & 72 & 32 & 41 & 69,23% & 63,72% & 66,36% \\ t3_set & 10 & 14 & 6 & 41,67% & 62,50% & 50,00% \\ t3_time & 37 & 12 & 13 & 75,51% & 74,00% & 74,75% \\ \hline *TOTAL* & 787 & 128 & 141 & 86,01% & 84,81% & 85,40% \\ ====================================================================================== # Annotation span evaluation (annotation types are ignored) ====================================================================================== Annotation & TP & FP & FN & Precision & Recall & F$_1$ \\ \hline *TOTAL* & 795 & 120 & 133 & 86,89% & 85,67% & 86,27% \\ ====================================================================================== # MUC match evaluation ====================================================================================== Annotation & COR & ACT & POS & Precision & Recall & F$_1$ \\ \hline t3_date & 1359 & 117 & 141 & 92,07% & 90,60% & 91,33% \\ t3_duration & 152 & 56 & 75 & 73,08% & 66,96% & 69,89% \\ t3_set & 23 & 25 & 9 & 47,92% & 71,88% & 57,50% \\ t3_time & 77 & 21 & 23 & 78,57% & 77,00% & 77,78% \\ \hline *TOTAL* & 1611 & 219 & 248 & 88,03% & 86,66% & 87,34%