diff --git a/data/logs/results-success2.tsv b/data/logs/results-success2.tsv new file mode 100644 index 0000000..4ab4c03 --- /dev/null +++ b/data/logs/results-success2.tsv @@ -0,0 +1,57 @@ +function analyzer tokenizer run no mean absolute error mean squared error perfects recall 1 recall 2 recall 3 recall 4 recall 5 precision 1 precision 2 precision 3 precision 4 precision 5 +sample_reviews_polar ThreeCheat PlainTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat LowercaseTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat NLTKWordTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizerWithNegation 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat HuggingBertTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar NLTKSentimentAnalyzer PlainTokenizer 1 0.864 3.456 784 0.694 inf inf inf 0.874 0.8463414634146341 inf inf inf 0.7406779661016949 +sample_reviews_polar NLTKSentimentAnalyzer LowercaseTokenizer 1 1.088 4.352 728 0.614 inf inf inf 0.842 0.7953367875647669 inf inf inf 0.6856677524429967 +sample_reviews_polar NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.064 4.256 734 0.624 inf inf inf 0.844 0.8 inf inf inf 0.6918032786885245 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizer 1 0.884 3.536 779 0.69 inf inf inf 0.868 0.8394160583941606 inf inf inf 0.7368421052631579 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.076 4.304 731 0.598 inf inf inf 0.864 0.8147138964577657 inf inf inf 0.6824644549763034 +sample_reviews_polar NLTKSentimentAnalyzer HuggingBertTokenizer 1 0.976 3.904 756 0.662 inf inf inf 0.85 0.8152709359605911 inf inf inf 0.7154882154882155 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 1 0.66 2.64 835 0.818 inf inf inf 0.852 0.8467908902691511 inf inf inf 0.8239845261121856 +sample_reviews_polar TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 0.512 2.048 872 0.868 inf inf inf 0.876 0.875 inf inf inf 0.8690476190476191 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 0.552 2.208 862 0.864 inf inf inf 0.86 0.8605577689243028 inf inf inf 0.8634538152610441 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizer 2 0.536 2.144 866 0.896 inf inf inf 0.836 0.8452830188679246 inf inf inf 0.8893617021276595 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 0.46 1.84 885 0.93 inf inf inf 0.84 0.8532110091743119 inf inf inf 0.9230769230769231 +sample_reviews_polar TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 0.504 2.016 874 0.892 inf inf inf 0.856 0.861003861003861 inf inf inf 0.8879668049792531 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PlainTokenizer 1 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PlainTokenizer 2 0.54 2.16 865 0.91 inf inf inf 0.82 0.8348623853211009 inf inf inf 0.9010989010989011 +sample_reviews_polar TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 0.5 2.0 875 0.888 inf inf inf 0.862 0.8654970760233918 inf inf inf 0.8850102669404517 +sample_reviews_polar TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 0.524 2.096 869 0.922 inf inf inf 0.816 0.833634719710669 inf inf inf 0.912751677852349 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 1 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 2 0.532 2.128 867 0.862 inf inf inf 0.872 0.8707070707070707 inf inf inf 0.8633663366336634 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 0.52 2.08 870 0.842 inf inf inf 0.898 0.8919491525423728 inf inf inf 0.8503787878787878 +sample_reviews_polar TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.456 1.824 886 0.878 inf inf inf 0.894 0.8922764227642277 inf inf inf 0.8799212598425197 +sample_reviews_varied ThreeCheat PlainTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat LowercaseTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat NLTKWordTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizerWithNegation 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat HuggingBertTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied NLTKSentimentAnalyzer PlainTokenizer 1 1.341 3.443 328 0.345 0.31 0.185 0.1 0.7 0.5227272727272727 0.32460732984293195 0.3557692307692308 0.3225806451612903 0.273972602739726 +sample_reviews_varied NLTKSentimentAnalyzer LowercaseTokenizer 1 1.221 2.967 350 0.45 0.21 0.235 0.135 0.72 0.5521472392638037 0.2876712328767123 0.36153846153846153 0.36 0.2962962962962963 +sample_reviews_varied NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.281 3.281 347 0.365 0.315 0.215 0.125 0.715 0.5069444444444444 0.38650306748466257 0.33076923076923076 0.32894736842105265 0.2936344969199179 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizer 1 1.244 3.022 338 0.44 0.255 0.11 0.14 0.745 0.5116279069767442 0.2463768115942029 0.24175824175824176 0.4745762711864407 0.31634819532908703 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.252 3.024 327 0.38 0.255 0.19 0.085 0.725 0.4 0.3493150684931507 0.2550335570469799 0.3148148148148148 0.31453362255965295 +sample_reviews_varied NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.37 3.612 324 0.285 0.275 0.14 0.225 0.695 0.5277777777777778 0.30726256983240224 0.4 0.41284403669724773 0.2602996254681648 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 2 1.294 3.176 334 0.81 0.0 0.0 0.0 0.86 0.34394904458598724 inf inf inf 0.32514177693761814 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 2 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 3 1.28 3.12 331 0.84 0.0 0.0 0.0 0.815 0.3421588594704684 inf inf inf 0.32023575638506874 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 1.208 2.832 349 0.825 0.0 0.0 0.0 0.92 0.3900709219858156 inf inf inf 0.3188908145580589 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizer 1 1.224 2.896 336 0.9 0.0 0.0 0.0 0.78 0.32786885245901637 inf inf inf 0.3458980044345898 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 1.172 2.688 350 0.84 0.0 0.0 0.0 0.91 0.37168141592920356 inf inf inf 0.33211678832116787 +sample_reviews_varied TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 1.258 3.032 337 0.875 0.0 0.0 0.0 0.81 0.3141831238779174 inf inf inf 0.3656884875846501 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.887 1.583 366 0.27 0.455 0.585 0.165 0.355 0.5346534653465347 0.2808641975308642 0.3103448275862069 0.38823529411764707 0.6283185840707964 +sample_reviews_varied TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer LowercaseTokenizer 2 0.803 1.467 429 0.48 0.56 0.275 0.425 0.405 0.5517241379310345 0.37966101694915255 0.3741496598639456 0.34274193548387094 0.5955882352941176 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 0.813 1.373 408 0.545 0.3 0.455 0.32 0.42 0.5265700483091788 0.3821656050955414 0.3273381294964029 0.3333333333333333 0.5060240963855421 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 1 0.779 1.527 476 0.485 0.445 0.51 0.41 0.53 0.563953488372093 0.43842364532019706 0.379182156133829 0.4880952380952381 0.5638297872340425 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 2 0.831 1.417 392 0.41 0.34 0.43 0.355 0.425 0.6307692307692307 0.29310344827586204 0.3233082706766917 0.3271889400921659 0.5483870967741935 +sample_reviews_varied TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.872 1.63 399 0.545 0.275 0.26 0.45 0.465 0.461864406779661 0.3055555555555556 0.2826086956521739 0.36 0.62 diff --git a/data/logs/results-success3.tsv b/data/logs/results-success3.tsv new file mode 100644 index 0000000..081b130 --- /dev/null +++ b/data/logs/results-success3.tsv @@ -0,0 +1,63 @@ +function analyzer tokenizer run no mean absolute error mean squared error perfects recall 1 recall 2 recall 3 recall 4 recall 5 precision 1 precision 2 precision 3 precision 4 precision 5 +sample_reviews_polar ThreeCheat PlainTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat LowercaseTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat NLTKWordTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizerWithNegation 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat HuggingBertTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar NLTKSentimentAnalyzer PlainTokenizer 1 1.108 4.432 723 0.622 inf inf inf 0.824 0.7794486215538847 inf inf inf 0.6855241264559068 +sample_reviews_polar NLTKSentimentAnalyzer LowercaseTokenizer 1 0.928 3.712 768 0.67 inf inf inf 0.866 0.8333333333333334 inf inf inf 0.7240802675585284 +sample_reviews_polar NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.032 4.128 742 0.636 inf inf inf 0.848 0.8071065989847716 inf inf inf 0.6996699669966997 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizer 1 1.004 4.016 749 0.654 inf inf inf 0.844 0.8074074074074075 inf inf inf 0.7092436974789916 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.128 4.512 718 0.59 inf inf inf 0.846 0.793010752688172 inf inf inf 0.6735668789808917 +sample_reviews_polar NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.224 4.896 694 0.554 inf inf inf 0.834 0.7694444444444445 inf inf inf 0.6515625 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 2 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 3 0.512 2.048 872 0.89 inf inf inf 0.854 0.859073359073359 inf inf inf 0.8858921161825726 +sample_reviews_polar TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 0.444 1.776 889 0.898 inf inf inf 0.88 0.8821218074656189 inf inf inf 0.8961303462321792 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 0.536 2.144 866 0.944 inf inf inf 0.788 0.8166089965397924 inf inf inf 0.933649289099526 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizer 1 0.468 1.872 883 0.942 inf inf inf 0.824 0.8425760286225402 inf inf inf 0.9342403628117913 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 2 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 3 0.448 1.792 888 0.91 inf inf inf 0.866 0.8716475095785441 inf inf inf 0.9058577405857741 +sample_reviews_polar TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 0.512 2.048 872 0.852 inf inf inf 0.892 0.8875 inf inf inf 0.8576923076923076 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.504 2.016 874 0.874 inf inf inf 0.874 0.874 inf inf inf 0.874 +sample_reviews_polar TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_polar TensorflowCategorySentimentAnalyzer LowercaseTokenizer 2 0.488 1.952 878 0.894 inf inf inf 0.862 0.8662790697674418 inf inf inf 0.890495867768595 +sample_reviews_polar TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 0.564 2.256 859 0.844 inf inf inf 0.874 0.8701030927835052 inf inf inf 0.8485436893203884 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 1 0.432 1.728 892 0.924 inf inf inf 0.86 0.868421052631579 inf inf inf 0.9188034188034188 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 0.48 1.92 880 0.862 inf inf inf 0.898 0.8941908713692946 inf inf inf 0.8667953667953668 +sample_reviews_polar TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.488 1.952 878 0.908 inf inf inf 0.848 0.8566037735849057 inf inf inf 0.902127659574468 +sample_reviews_varied ThreeCheat PlainTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat LowercaseTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat NLTKWordTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizerWithNegation 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat HuggingBertTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied NLTKSentimentAnalyzer PlainTokenizer 1 1.301 3.171 308 0.36 0.31 0.075 0.095 0.7 0.496551724137931 0.2616033755274262 0.19480519480519481 0.3064516129032258 0.29227557411273486 +sample_reviews_varied NLTKSentimentAnalyzer LowercaseTokenizer 1 1.285 3.297 352 0.385 0.285 0.18 0.19 0.72 0.4666666666666667 0.2835820895522388 0.3564356435643564 0.5135135135135135 0.3137254901960784 +sample_reviews_varied NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.242 3.052 335 0.405 0.225 0.175 0.11 0.76 0.4308510638297872 0.2631578947368421 0.35714285714285715 0.36065573770491804 0.3153526970954357 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizer 1 1.256 3.024 328 0.445 0.155 0.3 0.075 0.665 0.4734042553191489 0.31 0.2803738317757009 0.3125 0.29555555555555557 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.345 3.415 315 0.35 0.205 0.14 0.11 0.77 0.4268292682926829 0.23699421965317918 0.3010752688172043 0.3548387096774194 0.3031496062992126 +sample_reviews_varied NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.263 3.127 334 0.36 0.24 0.2 0.1 0.77 0.4675324675324675 0.35555555555555557 0.26143790849673204 0.3125 0.3117408906882591 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 2 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 3 1.282 3.128 333 0.925 0.0 0.0 0.0 0.74 0.3140916808149406 inf inf inf 0.36009732360097324 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 1.242 2.968 335 0.87 0.0 0.0 0.0 0.805 0.3246268656716418 inf inf inf 0.34698275862068967 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 2 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 3 1.198 2.792 347 0.84 0.0 0.0 0.0 0.895 0.3605150214592275 inf inf inf 0.3352059925093633 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizer 2 1.224 2.896 342 0.8 0.0 0.0 0.0 0.91 0.3686635944700461 inf inf inf 0.3215547703180212 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 1.202 2.808 342 0.925 0.0 0.0 0.0 0.785 0.29983792544570503 inf inf inf 0.40992167101827676 +sample_reviews_varied TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 1.186 2.744 353 0.865 0.0 0.0 0.0 0.9 0.36041666666666666 inf inf inf 0.34615384615384615 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.864 1.446 373 0.49 0.395 0.225 0.405 0.35 0.5798816568047337 0.30859375 0.22277227722772278 0.32661290322580644 0.56 +sample_reviews_varied TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer LowercaseTokenizer 2 0.856 1.754 445 0.63 0.25 0.42 0.38 0.545 0.5185185185185185 0.44642857142857145 0.38009049773755654 0.3486238532110092 0.529126213592233 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 0.779 1.257 418 0.43 0.18 0.505 0.465 0.51 0.688 0.3076923076923077 0.2961876832844575 0.3576923076923077 0.6496815286624203 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 2 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 3 0.805 1.473 443 0.535 0.455 0.42 0.365 0.44 0.5846994535519126 0.4008810572687225 0.3514644351464435 0.3476190476190476 0.624113475177305 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 2 0.901 1.833 413 0.435 0.28 0.355 0.415 0.58 0.46774193548387094 0.3660130718954248 0.3776595744680851 0.33739837398373984 0.5110132158590308 +sample_reviews_varied TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.817 1.453 425 0.535 0.34 0.4 0.31 0.54 0.5376884422110553 0.3333333333333333 0.32786885245901637 0.389937106918239 0.5567010309278351 diff --git a/data/logs/results-success4.tsv b/data/logs/results-success4.tsv new file mode 100644 index 0000000..2cd46e6 --- /dev/null +++ b/data/logs/results-success4.tsv @@ -0,0 +1,59 @@ +function analyzer tokenizer run no mean absolute error mean squared error perfects recall 1 recall 2 recall 3 recall 4 recall 5 precision 1 precision 2 precision 3 precision 4 precision 5 +sample_reviews_polar ThreeCheat PlainTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat LowercaseTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat NLTKWordTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizerWithNegation 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat HuggingBertTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar NLTKSentimentAnalyzer PlainTokenizer 1 0.932 3.728 767 0.676 inf inf inf 0.858 0.8264058679706602 inf inf inf 0.7258883248730964 +sample_reviews_polar NLTKSentimentAnalyzer LowercaseTokenizer 1 1.06 4.24 735 0.61 inf inf inf 0.86 0.8133333333333334 inf inf inf 0.688 +sample_reviews_polar NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.108 4.432 723 0.608 inf inf inf 0.838 0.7896103896103897 inf inf inf 0.6813008130081301 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizer 1 1.076 4.304 731 0.62 inf inf inf 0.842 0.7969151670951157 inf inf inf 0.6890343698854338 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.196 4.784 701 0.582 inf inf inf 0.82 0.7637795275590551 inf inf inf 0.6623586429725363 +sample_reviews_polar NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.056 4.224 736 0.598 inf inf inf 0.874 0.8259668508287292 inf inf inf 0.6849529780564263 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 2 0.568 2.272 858 0.87 inf inf inf 0.846 0.849609375 inf inf inf 0.8668032786885246 +sample_reviews_polar TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 0.488 1.952 878 0.844 inf inf inf 0.912 0.9055793991416309 inf inf inf 0.8539325842696629 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 0.46 1.84 885 0.872 inf inf inf 0.898 0.8952772073921971 inf inf inf 0.8752436647173489 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizer 2 0.496 1.984 876 0.858 inf inf inf 0.894 0.8900414937759336 inf inf inf 0.862934362934363 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 0.512 2.048 872 0.856 inf inf inf 0.888 0.8842975206611571 inf inf inf 0.8604651162790697 +sample_reviews_polar TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 0.488 1.952 878 0.9 inf inf inf 0.856 0.8620689655172413 inf inf inf 0.895397489539749 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.492 1.968 877 0.89 inf inf inf 0.864 0.8674463937621832 inf inf inf 0.8870636550308009 +sample_reviews_polar TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 0.544 2.176 864 0.892 inf inf inf 0.836 0.8446969696969697 inf inf inf 0.885593220338983 +sample_reviews_polar TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 +sample_reviews_polar TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 2 0.496 1.984 876 0.866 inf inf inf 0.886 0.8836734693877552 inf inf inf 0.8686274509803922 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 1 0.476 1.904 881 0.872 inf inf inf 0.89 0.8879837067209776 inf inf inf 0.8742632612966601 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 0.444 1.776 889 0.882 inf inf inf 0.896 0.8945233265720081 inf inf inf 0.883629191321499 +sample_reviews_polar TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.56 2.24 860 0.854 inf inf inf 0.866 0.8643724696356275 inf inf inf 0.8557312252964426 +sample_reviews_varied ThreeCheat PlainTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat LowercaseTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat NLTKWordTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizerWithNegation 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat HuggingBertTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied NLTKSentimentAnalyzer PlainTokenizer 1 1.228 3.07 364 0.385 0.27 0.25 0.155 0.76 0.5620437956204379 0.4186046511627907 0.3067484662576687 0.4025974025974026 0.3076923076923077 +sample_reviews_varied NLTKSentimentAnalyzer LowercaseTokenizer 1 1.322 3.384 322 0.3 0.205 0.245 0.1 0.76 0.46875 0.31297709923664124 0.3475177304964539 0.2898550724637681 0.2862523540489642 +sample_reviews_varied NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.223 2.863 329 0.485 0.185 0.15 0.14 0.685 0.4041666666666667 0.29838709677419356 0.21428571428571427 0.345679012345679 0.3301204819277108 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizer 1 1.3 3.272 328 0.39 0.25 0.22 0.065 0.715 0.46987951807228917 0.31446540880503143 0.3333333333333333 0.2653061224489796 0.2894736842105263 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.262 3.148 338 0.35 0.28 0.12 0.14 0.8 0.48951048951048953 0.3076923076923077 0.34782608695652173 0.3181818181818182 0.3088803088803089 +sample_reviews_varied NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.37 3.576 317 0.265 0.305 0.185 0.105 0.725 0.4774774774774775 0.291866028708134 0.3394495412844037 0.38181818181818183 0.2810077519379845 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 1 1.268 3.072 329 0.835 0.0 0.0 0.0 0.81 0.3280943025540275 inf inf inf 0.329938900203666 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 2 1.268 3.072 336 0.95 0.0 0.0 0.0 0.73 0.2954898911353033 inf inf inf 0.40896358543417366 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 2 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 3 1.262 3.048 334 0.835 0.0 0.0 0.0 0.835 0.35084033613445376 inf inf inf 0.3187022900763359 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizer 2 1.198 2.792 347 0.875 0.0 0.0 0.0 0.86 0.32710280373831774 inf inf inf 0.36989247311827955 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 1.26 3.04 337 0.78 0.0 0.0 0.0 0.905 0.37681159420289856 inf inf inf 0.30887372013651876 +sample_reviews_varied TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 1.166 2.664 353 0.885 0.0 0.0 0.0 0.88 0.33270676691729323 inf inf inf 0.37606837606837606 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.898 1.814 412 0.465 0.285 0.4 0.46 0.45 0.5470588235294118 0.3275862068965517 0.33755274261603374 0.36507936507936506 0.5389221556886228 +sample_reviews_varied TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 0.802 1.4 427 0.49 0.4 0.385 0.425 0.435 0.5632183908045977 0.40404040404040403 0.3181818181818182 0.34274193548387094 0.6304347826086957 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 0.818 1.5 434 0.64 0.335 0.305 0.35 0.54 0.5161290322580645 0.335 0.3674698795180723 0.3645833333333333 0.5567010309278351 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 2 0.818 1.508 431 0.535 0.265 0.315 0.375 0.665 0.5944444444444444 0.38405797101449274 0.3058252427184466 0.33783783783783783 0.5236220472440944 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 2 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 3 0.811 1.505 447 0.565 0.43 0.38 0.31 0.55 0.5330188679245284 0.4321608040201005 0.3958333333333333 0.3229166666666667 0.5365853658536586 +sample_reviews_varied TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.782 1.446 449 0.495 0.295 0.46 0.475 0.52 0.5210526315789473 0.38562091503267976 0.3484848484848485 0.4148471615720524 0.6341463414634146 diff --git a/data/logs/results-success5.tsv b/data/logs/results-success5.tsv new file mode 100644 index 0000000..c4fea72 --- /dev/null +++ b/data/logs/results-success5.tsv @@ -0,0 +1,61 @@ +function analyzer tokenizer run no mean absolute error mean squared error perfects recall 1 recall 2 recall 3 recall 4 recall 5 precision 1 precision 2 precision 3 precision 4 precision 5 +sample_reviews_polar ThreeCheat PlainTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat LowercaseTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat NLTKWordTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizerWithNegation 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat HuggingBertTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar NLTKSentimentAnalyzer PlainTokenizer 1 1.112 4.448 722 0.6 inf inf inf 0.844 0.7936507936507936 inf inf inf 0.6784565916398714 +sample_reviews_polar NLTKSentimentAnalyzer LowercaseTokenizer 1 0.844 3.376 789 0.732 inf inf inf 0.846 0.8261851015801355 inf inf inf 0.7594254937163375 +sample_reviews_polar NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.016 4.064 746 0.636 inf inf inf 0.856 0.8153846153846154 inf inf inf 0.7016393442622951 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizer 1 0.876 3.504 781 0.676 inf inf inf 0.886 0.8556962025316456 inf inf inf 0.7322314049586777 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.14 4.56 715 0.588 inf inf inf 0.842 0.7882037533512064 inf inf inf 0.671451355661882 +sample_reviews_polar NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.256 5.024 686 0.566 inf inf inf 0.806 0.7447368421052631 inf inf inf 0.65 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 1 0.592 2.368 852 0.882 inf inf inf 0.822 0.8320754716981132 inf inf inf 0.874468085106383 +sample_reviews_polar TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer LowercaseTokenizer 2 0.54 2.16 865 0.892 inf inf inf 0.838 0.8462998102466793 inf inf inf 0.8858350951374208 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 2 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 3 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 4 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 5 0.532 2.128 867 0.832 inf inf inf 0.902 0.8946236559139785 inf inf inf 0.8429906542056075 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizer 1 0.532 2.128 867 0.882 inf inf inf 0.852 0.8563106796116505 inf inf inf 0.8783505154639175 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 0.456 1.824 886 0.878 inf inf inf 0.894 0.8922764227642277 inf inf inf 0.8799212598425197 +sample_reviews_polar TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 0.632 2.528 842 0.894 inf inf inf 0.79 0.8097826086956522 inf inf inf 0.8816964285714286 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.508 2.032 873 0.896 inf inf inf 0.85 0.8565965583173997 inf inf inf 0.8909853249475891 +sample_reviews_polar TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 0.552 2.208 862 0.838 inf inf inf 0.886 0.8802521008403361 inf inf inf 0.8454198473282443 +sample_reviews_polar TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 0.52 2.08 870 0.87 inf inf inf 0.87 0.87 inf inf inf 0.87 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 1 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 2 0.468 1.872 883 0.908 inf inf inf 0.858 0.8647619047619047 inf inf inf 0.9031578947368422 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 0.576 2.304 856 0.814 inf inf inf 0.898 0.888646288209607 inf inf inf 0.8284132841328413 +sample_reviews_polar TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.58 2.32 855 0.864 inf inf inf 0.846 0.8487229862475442 inf inf inf 0.8615071283095723 +sample_reviews_varied ThreeCheat PlainTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat LowercaseTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat NLTKWordTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizerWithNegation 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat HuggingBertTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied NLTKSentimentAnalyzer PlainTokenizer 1 1.294 3.25 324 0.295 0.25 0.215 0.145 0.715 0.3959731543624161 0.33557046979865773 0.30935251798561153 0.3670886075949367 0.29545454545454547 +sample_reviews_varied NLTKSentimentAnalyzer LowercaseTokenizer 1 1.168 2.712 340 0.45 0.22 0.205 0.165 0.66 0.40358744394618834 0.3333333333333333 0.27702702702702703 0.35106382978723405 0.32754342431761785 +sample_reviews_varied NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.285 3.131 319 0.395 0.22 0.15 0.14 0.69 0.45664739884393063 0.2732919254658385 0.28846153846153844 0.34146341463414637 0.2875 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizer 1 1.225 3.039 360 0.395 0.3 0.195 0.18 0.73 0.5096774193548387 0.35294117647058826 0.35454545454545455 0.43373493975903615 0.3029045643153527 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.317 3.321 318 0.36 0.1 0.275 0.11 0.745 0.4864864864864865 0.2564102564102564 0.3005464480874317 0.2857142857142857 0.2898832684824903 +sample_reviews_varied NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.389 3.683 322 0.24 0.3 0.185 0.12 0.765 0.45714285714285713 0.3488372093023256 0.3557692307692308 0.3582089552238806 0.27717391304347827 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 2 1.296 3.184 332 0.755 0.0 0.0 0.0 0.905 0.3813131313131313 inf inf inf 0.2996688741721854 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 1.26 3.04 340 0.835 0.0 0.0 0.0 0.865 0.3599137931034483 inf inf inf 0.32276119402985076 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 2 1.314 3.256 331 0.805 0.0 0.0 0.0 0.85 0.3425531914893617 inf inf inf 0.32075471698113206 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizer 1 1.222 2.888 344 0.89 0.0 0.0 0.0 0.83 0.3531746031746032 inf inf inf 0.3346774193548387 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 2 1.224 2.896 339 0.84 0.0 0.0 0.0 0.855 0.33399602385685884 inf inf inf 0.3440643863179074 +sample_reviews_varied TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 1.198 2.792 343 0.845 0.0 0.0 0.0 0.87 0.3373253493013972 inf inf inf 0.3486973947895792 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.875 1.557 396 0.44 0.335 0.32 0.31 0.575 0.5432098765432098 0.3544973544973545 0.2570281124497992 0.3229166666666667 0.5528846153846154 +sample_reviews_varied TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer LowercaseTokenizer 2 0.831 1.577 421 0.455 0.32 0.44 0.44 0.45 0.5833333333333334 0.40764331210191085 0.3548387096774194 0.34108527131782945 0.4972375690607735 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 2 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 3 0.845 1.547 422 0.58 0.26 0.395 0.43 0.445 0.4773662551440329 0.42276422764227645 0.3278008298755187 0.36134453781512604 0.5741935483870968 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 1 0.817 1.385 406 0.48 0.46 0.29 0.34 0.46 0.5303867403314917 0.33454545454545453 0.30851063829787234 0.35051546391752575 0.5679012345679012 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 0.822 1.42 412 0.62 0.37 0.24 0.305 0.525 0.5511111111111111 0.296 0.4067796610169492 0.28773584905660377 0.5384615384615384 +sample_reviews_varied TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.835 1.581 434 0.49 0.315 0.31 0.435 0.62 0.593939393939394 0.375 0.34831460674157305 0.3283018867924528 0.5535714285714286 diff --git a/data/logs/results-success6.tsv b/data/logs/results-success6.tsv new file mode 100644 index 0000000..bd10fb9 --- /dev/null +++ b/data/logs/results-success6.tsv @@ -0,0 +1,64 @@ +function analyzer tokenizer run no mean absolute error mean squared error perfects recall 1 recall 2 recall 3 recall 4 recall 5 precision 1 precision 2 precision 3 precision 4 precision 5 +sample_reviews_polar ThreeCheat PlainTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat LowercaseTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat NLTKWordTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat PottsTokenizerWithNegation 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar ThreeCheat HuggingBertTokenizer 1 2.0 4.0 0 0.0 inf inf inf 0.0 inf inf 0.0 inf inf +sample_reviews_polar NLTKSentimentAnalyzer PlainTokenizer 1 1.06 4.24 735 0.636 inf inf inf 0.834 0.7930174563591023 inf inf inf 0.6961602671118531 +sample_reviews_polar NLTKSentimentAnalyzer LowercaseTokenizer 1 0.984 3.936 754 0.676 inf inf inf 0.832 0.8009478672985783 inf inf inf 0.7197231833910035 +sample_reviews_polar NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.212 4.848 697 0.57 inf inf inf 0.824 0.7640750670241286 inf inf inf 0.6570972886762361 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizer 1 1.084 4.336 729 0.598 inf inf inf 0.86 0.8102981029810298 inf inf inf 0.6814580031695721 +sample_reviews_polar NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 0.996 3.984 751 0.644 inf inf inf 0.858 0.8193384223918575 inf inf inf 0.7067545304777595 +sample_reviews_polar NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.08 4.32 730 0.626 inf inf inf 0.834 0.7904040404040404 inf inf inf 0.6903973509933775 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 2 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 3 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PlainTokenizer 4 0.532 2.128 867 0.908 inf inf inf 0.826 0.8391866913123844 inf inf inf 0.8997821350762527 +sample_reviews_polar TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer LowercaseTokenizer 2 0.624 2.496 844 0.894 inf inf inf 0.794 0.8127272727272727 inf inf inf 0.8822222222222222 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 2 0.588 2.352 853 0.842 inf inf inf 0.864 0.8609406952965235 inf inf inf 0.8454011741682974 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizer 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizer 2 0.48 1.92 880 0.84 inf inf inf 0.92 0.9130434782608695 inf inf inf 0.8518518518518519 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 +sample_reviews_polar TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 2 0.448 1.792 888 0.914 inf inf inf 0.862 0.8688212927756654 inf inf inf 0.9092827004219409 +sample_reviews_polar TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 0.496 1.984 876 0.874 inf inf inf 0.878 0.8775100401606426 inf inf inf 0.8745019920318725 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.472 1.888 882 0.886 inf inf inf 0.878 0.878968253968254 inf inf inf 0.8850806451612904 +sample_reviews_polar TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 0.488 1.952 878 0.882 inf inf inf 0.874 0.875 inf inf inf 0.8810483870967742 +sample_reviews_polar TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 0.428 1.712 893 0.896 inf inf inf 0.89 0.8906560636182903 inf inf inf 0.8953722334004024 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 1 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 2 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 3 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizer 4 0.54 2.16 865 0.886 inf inf inf 0.844 0.8502879078694817 inf inf inf 0.8810020876826722 +sample_reviews_polar TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 0.544 2.176 864 0.89 inf inf inf 0.838 0.8460076045627376 inf inf inf 0.8839662447257384 +sample_reviews_polar TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.564 2.256 859 0.858 inf inf inf 0.86 0.8597194388777555 inf inf inf 0.8582834331337326 +sample_reviews_varied ThreeCheat PlainTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat LowercaseTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat NLTKWordTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat PottsTokenizerWithNegation 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied ThreeCheat HuggingBertTokenizer 1 1.2 2.0 200 0.0 0.0 1.0 0.0 0.0 inf inf 0.2 inf inf +sample_reviews_varied NLTKSentimentAnalyzer PlainTokenizer 1 1.107 2.545 375 0.535 0.37 0.185 0.11 0.675 0.4592274678111588 0.3627450980392157 0.30327868852459017 0.36065573770491804 0.35526315789473684 +sample_reviews_varied NLTKSentimentAnalyzer LowercaseTokenizer 1 1.376 3.58 310 0.295 0.275 0.135 0.14 0.705 0.4338235294117647 0.3125 0.28421052631578947 0.45161290322580644 0.2655367231638418 +sample_reviews_varied NLTKSentimentAnalyzer NLTKWordTokenizer 1 1.305 3.255 315 0.28 0.28 0.16 0.14 0.715 0.35 0.3027027027027027 0.3368421052631579 0.358974358974359 0.2966804979253112 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizer 1 1.289 3.285 340 0.36 0.295 0.155 0.175 0.715 0.5714285714285714 0.34104046242774566 0.2980769230769231 0.35714285714285715 0.2865731462925852 +sample_reviews_varied NLTKSentimentAnalyzer PottsTokenizerWithNegation 1 1.222 2.91 333 0.365 0.175 0.31 0.11 0.705 0.5140845070422535 0.3181818181818182 0.2627118644067797 0.39285714285714285 0.3092105263157895 +sample_reviews_varied NLTKSentimentAnalyzer HuggingBertTokenizer 1 1.309 3.207 310 0.37 0.235 0.17 0.105 0.67 0.5211267605633803 0.2883435582822086 0.2809917355371901 0.3181818181818182 0.2637795275590551 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PlainTokenizer 1 1.296 3.184 332 0.875 0.0 0.0 0.0 0.785 0.30973451327433627 inf inf inf 0.36091954022988504 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer LowercaseTokenizer 2 1.256 3.024 344 0.795 0.0 0.0 0.0 0.925 0.3975 inf inf inf 0.30833333333333335 +sample_reviews_varied TensorflowPolarSentimentAnalyzer NLTKWordTokenizer 1 1.276 3.104 336 0.775 0.0 0.0 0.0 0.905 0.3530751708428246 inf inf inf 0.3226381461675579 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizer 1 1.22 2.88 346 0.885 0.0 0.0 0.0 0.845 0.31494661921708184 inf inf inf 0.3858447488584475 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 1 +sample_reviews_varied TensorflowPolarSentimentAnalyzer PottsTokenizerWithNegation 2 1.286 3.144 329 0.81 0.0 0.0 0.0 0.835 0.3432203389830508 inf inf inf 0.3162878787878788 +sample_reviews_varied TensorflowPolarSentimentAnalyzer HuggingBertTokenizer 1 1.234 2.936 342 0.82 0.0 0.0 0.0 0.89 0.3234714003944773 inf inf inf 0.36105476673427994 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PlainTokenizer 1 0.806 1.516 442 0.49 0.36 0.48 0.395 0.485 0.5414364640883977 0.36 0.375 0.398989898989899 0.5878787878787879 +sample_reviews_varied TensorflowCategorySentimentAnalyzer LowercaseTokenizer 1 0.812 1.418 420 0.555 0.13 0.405 0.565 0.445 0.5577889447236181 0.33766233766233766 0.3103448275862069 0.3610223642172524 0.5933333333333334 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 2 +sample_reviews_varied TensorflowCategorySentimentAnalyzer NLTKWordTokenizer 3 0.812 1.554 452 0.46 0.46 0.355 0.435 0.55 0.6216216216216216 0.3898305084745763 0.3879781420765027 0.3717948717948718 0.5527638190954773 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 1 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizer 2 0.741 1.313 466 0.535 0.4 0.505 0.43 0.46 0.5631578947368421 0.40816326530612246 0.404 0.3926940639269406 0.6344827586206897 +sample_reviews_varied TensorflowCategorySentimentAnalyzer PottsTokenizerWithNegation 1 0.828 1.406 404 0.57 0.21 0.5 0.335 0.405 0.504424778761062 0.3925233644859813 0.3067484662576687 0.3401015228426396 0.5625 +sample_reviews_varied TensorflowCategorySentimentAnalyzer HuggingBertTokenizer 1 0.801 1.453 428 0.375 0.33 0.465 0.4 0.57 0.6302521008403361 0.35294117647058826 0.34572490706319703 0.37735849056603776 0.5352112676056338 diff --git a/data/logs/run-success1.tsv b/data/logs/run-success1.tsv new file mode 100644 index 0000000..b5a364f --- /dev/null +++ b/data/logs/run-success1.tsv @@ -0,0 +1,571 @@ +2023-04-14 02:07:26,695 __main__ INFO Started unimore-bda-6 in DEBUG mode! +2023-04-14 02:07:26,696 __main__ DEBUG Validating configuration... +2023-04-14 02:07:26,698 __main__ DEBUG Ensuring there are no leftover caches... +2023-04-14 02:07:26,720 __main__.sample_reviews_polar DEBUG Selected sample_func: sample_reviews_polar +2023-04-14 02:07:26,720 __main__.sample_reviews_polar.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer +2023-04-14 02:07:26,720 __main__ DEBUG Running garbage collection... +2023-04-14 02:07:26,867 __main__ DEBUG Collected 19 pieces of garbage! +2023-04-14 02:07:26,867 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-04-14 02:07:26,868 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-04-14 02:07:26,868 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... +2023-04-14 02:07:41,386 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:10:19,246 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-04-14 02:10:19,246 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:11:26,941 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.848 mean absolute error, 3.392 mean squared error, 0.692 recall of 1.0, 0.8564356435643564 precision of 1.0, 0.884 recall of 5.0, 0.7416107382550335 precision of 5.0, 788 perfect matches. +2023-04-14 02:11:27,571 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.848 mean absolute error, 3.392 mean squared error, 0.692 recall of 1.0, 0.8564356435643564 precision of 1.0, 0.884 recall of 5.0, 0.7416107382550335 precision of 5.0, 788 perfect matches. +2023-04-14 02:11:27,572 __main__ DEBUG Running garbage collection... +2023-04-14 02:11:27,670 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 02:11:27,670 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-04-14 02:11:27,671 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-04-14 02:11:27,671 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... +2023-04-14 02:11:36,419 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:13:36,021 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-04-14 02:13:36,021 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:14:30,293 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.88 mean absolute error, 3.52 mean squared error, 0.682 recall of 1.0, 0.8482587064676617 precision of 1.0, 0.878 recall of 5.0, 0.7341137123745819 precision of 5.0, 780 perfect matches. +2023-04-14 02:14:30,425 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.88 mean absolute error, 3.52 mean squared error, 0.682 recall of 1.0, 0.8482587064676617 precision of 1.0, 0.878 recall of 5.0, 0.7341137123745819 precision of 5.0, 780 perfect matches. +2023-04-14 02:14:30,426 __main__ DEBUG Running garbage collection... +2023-04-14 02:14:30,528 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 02:14:30,529 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-04-14 02:14:30,529 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-04-14 02:14:30,529 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 02:14:39,156 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:17:18,585 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-04-14 02:17:18,585 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:18:28,715 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.748 mean absolute error, 2.992 mean squared error, 0.776 recall of 1.0, 0.838012958963283 precision of 1.0, 0.85 recall of 5.0, 0.7914338919925512 precision of 5.0, 813 perfect matches. +2023-04-14 02:18:28,861 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.748 mean absolute error, 2.992 mean squared error, 0.776 recall of 1.0, 0.838012958963283 precision of 1.0, 0.85 recall of 5.0, 0.7914338919925512 precision of 5.0, 813 perfect matches. +2023-04-14 02:18:28,862 __main__ DEBUG Running garbage collection... +2023-04-14 02:18:28,969 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 02:18:28,969 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-04-14 02:18:28,970 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-04-14 02:18:28,970 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... +2023-04-14 02:18:38,174 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:20:49,210 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-04-14 02:20:49,210 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:21:47,287 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.636 mean absolute error, 2.544 mean squared error, 0.778 recall of 1.0, 0.8901601830663616 precision of 1.0, 0.904 recall of 5.0, 0.8028419182948491 precision of 5.0, 841 perfect matches. +2023-04-14 02:21:47,424 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.636 mean absolute error, 2.544 mean squared error, 0.778 recall of 1.0, 0.8901601830663616 precision of 1.0, 0.904 recall of 5.0, 0.8028419182948491 precision of 5.0, 841 perfect matches. +2023-04-14 02:21:47,425 __main__ DEBUG Running garbage collection... +2023-04-14 02:21:47,540 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 02:21:47,541 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-04-14 02:21:47,541 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-04-14 02:21:47,541 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 02:21:55,677 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:24:21,987 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-04-14 02:24:21,988 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:25:25,939 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.868 mean absolute error, 3.472 mean squared error, 0.684 recall of 1.0, 0.8528678304239401 precision of 1.0, 0.882 recall of 5.0, 0.7362270450751253 precision of 5.0, 783 perfect matches. +2023-04-14 02:25:26,088 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.868 mean absolute error, 3.472 mean squared error, 0.684 recall of 1.0, 0.8528678304239401 precision of 1.0, 0.882 recall of 5.0, 0.7362270450751253 precision of 5.0, 783 perfect matches. +2023-04-14 02:25:26,089 __main__ DEBUG Running garbage collection... +2023-04-14 02:25:26,229 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 02:25:26,230 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-04-14 02:25:26,230 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-04-14 02:25:26,230 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... +2023-04-14 02:25:35,178 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:28:05,080 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-04-14 02:28:05,080 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:29:09,808 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.932 mean absolute error, 3.728 mean squared error, 0.642 recall of 1.0, 0.856 precision of 1.0, 0.892 recall of 5.0, 0.7136 precision of 5.0, 767 perfect matches. +2023-04-14 02:29:09,937 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.932 mean absolute error, 3.728 mean squared error, 0.642 recall of 1.0, 0.856 precision of 1.0, 0.892 recall of 5.0, 0.7136 precision of 5.0, 767 perfect matches. +2023-04-14 02:29:09,938 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer +2023-04-14 02:29:09,938 __main__ DEBUG Running garbage collection... +2023-04-14 02:29:10,036 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 02:29:10,037 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-04-14 02:29:10,037 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-04-14 02:29:10,037 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 02:29:19,203 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:35:29,078 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-04-14 02:35:29,079 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:36:40,858 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.896 recall of 1.0, 0.8699029126213592 precision of 1.0, 0.866 recall of 5.0, 0.8927835051546392 precision of 5.0, 881 perfect matches. +2023-04-14 02:36:41,005 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.896 recall of 1.0, 0.8699029126213592 precision of 1.0, 0.866 recall of 5.0, 0.8927835051546392 precision of 5.0, 881 perfect matches. +2023-04-14 02:36:41,006 __main__ DEBUG Running garbage collection... +2023-04-14 02:36:41,115 __main__ DEBUG Collected 14481 pieces of garbage! +2023-04-14 02:36:41,120 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-04-14 02:36:41,120 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-04-14 02:36:41,120 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-04-14 02:36:49,377 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:37:29,450 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 02:37:29,603 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 +2023-04-14 02:37:29,603 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-04-14 02:37:37,599 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:43:50,896 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-04-14 02:43:50,917 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:45:02,727 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.916 recall of 1.0, 0.8544776119402985 precision of 1.0, 0.844 recall of 5.0, 0.9094827586206896 precision of 5.0, 880 perfect matches. +2023-04-14 02:45:03,221 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.916 recall of 1.0, 0.8544776119402985 precision of 1.0, 0.844 recall of 5.0, 0.9094827586206896 precision of 5.0, 880 perfect matches. +2023-04-14 02:45:03,222 __main__ DEBUG Running garbage collection... +2023-04-14 02:45:03,354 __main__ DEBUG Collected 17374 pieces of garbage! +2023-04-14 02:45:03,361 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-04-14 02:45:03,361 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-04-14 02:45:03,361 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 02:45:12,281 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:46:13,004 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 02:46:13,319 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 +2023-04-14 02:46:13,320 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 02:46:21,650 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:48:01,137 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 02:48:01,400 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Run #3 +2023-04-14 02:48:01,401 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 02:48:10,130 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:49:33,320 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 02:49:33,512 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Run #4 +2023-04-14 02:49:33,513 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 02:49:41,342 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:55:48,568 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Training succeeded! +2023-04-14 02:55:48,568 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 02:56:59,685 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.492 mean absolute error, 1.968 mean squared error, 0.908 recall of 1.0, 0.8549905838041432 precision of 1.0, 0.846 recall of 5.0, 0.9019189765458422 precision of 5.0, 877 perfect matches. +2023-04-14 02:56:59,830 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.492 mean absolute error, 1.968 mean squared error, 0.908 recall of 1.0, 0.8549905838041432 precision of 1.0, 0.846 recall of 5.0, 0.9019189765458422 precision of 5.0, 877 perfect matches. +2023-04-14 02:56:59,830 __main__ DEBUG Running garbage collection... +2023-04-14 02:57:00,002 __main__ DEBUG Collected 39114 pieces of garbage! +2023-04-14 02:57:00,006 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-04-14 02:57:00,007 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-04-14 02:57:00,007 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 02:57:08,032 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:58:22,273 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 02:58:22,405 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 +2023-04-14 02:58:22,406 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 02:58:30,418 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:59:21,741 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 02:59:21,871 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 DEBUG Run #3 +2023-04-14 02:59:21,872 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 02:59:30,063 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 02:59:59,644 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 02:59:59,795 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.4 DEBUG Run #4 +2023-04-14 02:59:59,795 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 03:00:08,298 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:01:06,431 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.4 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:01:06,590 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.5 DEBUG Run #5 +2023-04-14 03:01:06,591 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.5 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 03:01:14,562 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.5 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:02:11,267 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.5 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:02:11,405 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.6 DEBUG Run #6 +2023-04-14 03:02:11,405 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.6 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 03:02:19,868 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.6 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:04:03,096 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.6 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:04:03,229 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 DEBUG Run #7 +2023-04-14 03:04:03,230 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 03:04:12,163 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:10:18,531 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Training succeeded! +2023-04-14 03:10:18,531 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 03:11:30,141 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.946 recall of 1.0, 0.8431372549019608 precision of 1.0, 0.824 recall of 5.0, 0.9384965831435079 precision of 5.0, 885 perfect matches. +2023-04-14 03:11:30,268 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.946 recall of 1.0, 0.8431372549019608 precision of 1.0, 0.824 recall of 5.0, 0.9384965831435079 precision of 5.0, 885 perfect matches. +2023-04-14 03:11:30,268 __main__ DEBUG Running garbage collection... +2023-04-14 03:11:30,514 __main__ DEBUG Collected 80413 pieces of garbage! +2023-04-14 03:11:30,536 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-04-14 03:11:30,543 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-04-14 03:11:30,547 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 03:11:38,102 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:11:50,429 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:11:50,565 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 +2023-04-14 03:11:50,565 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 03:11:58,297 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:14:05,622 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:14:05,821 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Run #3 +2023-04-14 03:14:05,821 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 03:14:38,382 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:21:02,076 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training succeeded! +2023-04-14 03:21:02,079 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 03:22:56,464 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.352 mean absolute error, 1.408 mean squared error, 0.914 recall of 1.0, 0.9103585657370518 precision of 1.0, 0.91 recall of 5.0, 0.9136546184738956 precision of 5.0, 912 perfect matches. +2023-04-14 03:22:56,761 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.352 mean absolute error, 1.408 mean squared error, 0.914 recall of 1.0, 0.9103585657370518 precision of 1.0, 0.91 recall of 5.0, 0.9136546184738956 precision of 5.0, 912 perfect matches. +2023-04-14 03:22:56,761 __main__ DEBUG Running garbage collection... +2023-04-14 03:22:57,030 __main__ DEBUG Collected 60127 pieces of garbage! +2023-04-14 03:22:57,051 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-04-14 03:22:57,056 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-04-14 03:22:57,059 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... +2023-04-14 03:23:10,637 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:29:33,070 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-04-14 03:29:33,070 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 03:30:43,505 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.852 recall of 1.0, 0.9122055674518201 precision of 1.0, 0.918 recall of 5.0, 0.8611632270168855 precision of 5.0, 885 perfect matches. +2023-04-14 03:30:43,637 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.852 recall of 1.0, 0.9122055674518201 precision of 1.0, 0.918 recall of 5.0, 0.8611632270168855 precision of 5.0, 885 perfect matches. +2023-04-14 03:30:43,637 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer +2023-04-14 03:30:43,637 __main__ DEBUG Running garbage collection... +2023-04-14 03:30:43,824 __main__ DEBUG Collected 18820 pieces of garbage! +2023-04-14 03:30:43,831 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-04-14 03:30:43,831 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-04-14 03:30:43,831 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-04-14 03:30:52,433 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:31:20,342 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:31:20,473 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 +2023-04-14 03:31:20,473 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-04-14 03:31:28,781 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:32:11,843 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:32:11,976 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.3 DEBUG Run #3 +2023-04-14 03:32:11,977 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-04-14 03:32:19,909 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:33:33,315 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:33:33,453 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.4 DEBUG Run #4 +2023-04-14 03:33:33,453 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.4 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-04-14 03:33:41,627 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:34:05,939 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.4 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:34:06,079 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.5 DEBUG Run #5 +2023-04-14 03:34:06,080 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.5 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-04-14 03:34:14,346 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.5 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:35:38,755 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.5 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:35:38,918 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.6 DEBUG Run #6 +2023-04-14 03:35:38,919 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.6 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-04-14 03:35:46,938 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.6 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:36:39,339 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.6 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:36:39,477 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 DEBUG Run #7 +2023-04-14 03:36:39,477 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-04-14 03:36:47,466 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:43:26,463 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Training succeeded! +2023-04-14 03:43:26,464 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 03:44:39,601 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.924 recall of 1.0, 0.850828729281768 precision of 1.0, 0.838 recall of 5.0, 0.9168490153172867 precision of 5.0, 881 perfect matches. +2023-04-14 03:44:39,737 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.924 recall of 1.0, 0.850828729281768 precision of 1.0, 0.838 recall of 5.0, 0.9168490153172867 precision of 5.0, 881 perfect matches. +2023-04-14 03:44:39,737 __main__ DEBUG Running garbage collection... +2023-04-14 03:44:40,038 __main__ DEBUG Collected 52887 pieces of garbage! +2023-04-14 03:44:40,050 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-04-14 03:44:40,051 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-04-14 03:44:40,052 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-04-14 03:44:48,729 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:51:06,107 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-04-14 03:51:06,107 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 03:52:14,645 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.898 recall of 1.0, 0.8752436647173489 precision of 1.0, 0.872 recall of 5.0, 0.8952772073921971 precision of 5.0, 885 perfect matches. +2023-04-14 03:52:14,773 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.898 recall of 1.0, 0.8752436647173489 precision of 1.0, 0.872 recall of 5.0, 0.8952772073921971 precision of 5.0, 885 perfect matches. +2023-04-14 03:52:14,774 __main__ DEBUG Running garbage collection... +2023-04-14 03:52:14,990 __main__ DEBUG Collected 8694 pieces of garbage! +2023-04-14 03:52:14,992 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-04-14 03:52:14,993 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-04-14 03:52:14,993 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 03:52:22,820 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 03:53:34,894 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 03:53:35,087 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 +2023-04-14 03:53:35,088 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 03:53:43,136 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:00:25,276 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training succeeded! +2023-04-14 04:00:25,277 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:01:34,638 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.898 recall of 1.0, 0.8821218074656189 precision of 1.0, 0.88 recall of 5.0, 0.8961303462321792 precision of 5.0, 889 perfect matches. +2023-04-14 04:01:34,773 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.898 recall of 1.0, 0.8821218074656189 precision of 1.0, 0.88 recall of 5.0, 0.8961303462321792 precision of 5.0, 889 perfect matches. +2023-04-14 04:01:34,773 __main__ DEBUG Running garbage collection... +2023-04-14 04:01:35,019 __main__ DEBUG Collected 28229 pieces of garbage! +2023-04-14 04:01:35,024 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-04-14 04:01:35,025 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-04-14 04:01:35,025 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-04-14 04:01:42,831 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:03:12,088 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 04:03:12,222 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 +2023-04-14 04:03:12,222 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-04-14 04:03:20,096 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:03:38,086 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 04:03:38,263 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 DEBUG Run #3 +2023-04-14 04:03:38,264 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-04-14 04:03:46,055 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:04:11,099 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 04:04:11,530 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 DEBUG Run #4 +2023-04-14 04:04:11,531 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-04-14 04:04:19,473 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:04:46,680 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 ERROR Training failed, trying again with a different dataset... +2023-04-14 04:04:47,232 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 DEBUG Run #5 +2023-04-14 04:04:47,232 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-04-14 04:04:54,934 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:11:15,368 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Training succeeded! +2023-04-14 04:11:15,382 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:12:23,245 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.452 mean absolute error, 1.808 mean squared error, 0.874 recall of 1.0, 0.8973305954825462 precision of 1.0, 0.9 recall of 5.0, 0.8771929824561403 precision of 5.0, 887 perfect matches. +2023-04-14 04:12:23,746 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.452 mean absolute error, 1.808 mean squared error, 0.874 recall of 1.0, 0.8973305954825462 precision of 1.0, 0.9 recall of 5.0, 0.8771929824561403 precision of 5.0, 887 perfect matches. +2023-04-14 04:12:23,747 __main__ DEBUG Running garbage collection... +2023-04-14 04:12:24,081 __main__ DEBUG Collected 86213 pieces of garbage! +2023-04-14 04:12:24,104 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-04-14 04:12:24,110 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-04-14 04:12:24,116 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 04:12:31,693 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:18:38,833 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-04-14 04:18:38,857 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:19:46,151 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.42 mean absolute error, 1.68 mean squared error, 0.868 recall of 1.0, 0.9175475687103594 precision of 1.0, 0.922 recall of 5.0, 0.8747628083491461 precision of 5.0, 895 perfect matches. +2023-04-14 04:19:46,513 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.42 mean absolute error, 1.68 mean squared error, 0.868 recall of 1.0, 0.9175475687103594 precision of 1.0, 0.922 recall of 5.0, 0.8747628083491461 precision of 5.0, 895 perfect matches. +2023-04-14 04:19:46,513 __main__ DEBUG Running garbage collection... +2023-04-14 04:19:46,848 __main__ DEBUG Collected 87213 pieces of garbage! +2023-04-14 04:19:46,866 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-04-14 04:19:46,869 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-04-14 04:19:46,871 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... +2023-04-14 04:19:54,868 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:26:18,101 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-04-14 04:26:18,124 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:27:25,055 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.91 recall of 1.0, 0.8733205374280231 precision of 1.0, 0.868 recall of 5.0, 0.906054279749478 precision of 5.0, 889 perfect matches. +2023-04-14 04:27:25,605 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.91 recall of 1.0, 0.8733205374280231 precision of 1.0, 0.868 recall of 5.0, 0.906054279749478 precision of 5.0, 889 perfect matches. +2023-04-14 04:27:25,606 __main__.sample_reviews_varied DEBUG Selected sample_func: sample_reviews_varied +2023-04-14 04:27:25,606 __main__.sample_reviews_varied.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer +2023-04-14 04:27:25,606 __main__ DEBUG Running garbage collection... +2023-04-14 04:27:26,012 __main__ DEBUG Collected 87197 pieces of garbage! +2023-04-14 04:27:26,019 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-04-14 04:27:26,021 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-04-14 04:27:26,022 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... +2023-04-14 04:27:43,719 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:30:37,000 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-04-14 04:30:37,000 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:33:04,724 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.065 mean absolute error, 2.343 mean squared error, 0.68 recall of 1.0, 0.43037974683544306 precision of 1.0, 0.235 recall of 2.0, 0.34057971014492755 precision of 2.0, 0.2 recall of 3.0, 0.32786885245901637 precision of 3.0, 0.165 recall of 4.0, 0.3707865168539326 precision of 4.0, 0.61 recall of 5.0, 0.3641791044776119 precision of 5.0, 378 perfect matches. +2023-04-14 04:33:04,999 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.065 mean absolute error, 2.343 mean squared error, 0.68 recall of 1.0, 0.43037974683544306 precision of 1.0, 0.235 recall of 2.0, 0.34057971014492755 precision of 2.0, 0.2 recall of 3.0, 0.32786885245901637 precision of 3.0, 0.165 recall of 4.0, 0.3707865168539326 precision of 4.0, 0.61 recall of 5.0, 0.3641791044776119 precision of 5.0, 378 perfect matches. +2023-04-14 04:33:05,000 __main__ DEBUG Running garbage collection... +2023-04-14 04:33:05,275 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 04:33:05,276 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-04-14 04:33:05,276 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-04-14 04:33:05,276 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... +2023-04-14 04:33:23,054 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:36:09,314 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-04-14 04:36:09,315 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:38:31,038 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.146 mean absolute error, 2.712 mean squared error, 0.52 recall of 1.0, 0.4642857142857143 precision of 1.0, 0.33 recall of 2.0, 0.3815028901734104 precision of 2.0, 0.22 recall of 3.0, 0.33587786259541985 precision of 3.0, 0.1 recall of 4.0, 0.3389830508474576 precision of 4.0, 0.655 recall of 5.0, 0.3171912832929782 precision of 5.0, 365 perfect matches. +2023-04-14 04:38:31,166 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.146 mean absolute error, 2.712 mean squared error, 0.52 recall of 1.0, 0.4642857142857143 precision of 1.0, 0.33 recall of 2.0, 0.3815028901734104 precision of 2.0, 0.22 recall of 3.0, 0.33587786259541985 precision of 3.0, 0.1 recall of 4.0, 0.3389830508474576 precision of 4.0, 0.655 recall of 5.0, 0.3171912832929782 precision of 5.0, 365 perfect matches. +2023-04-14 04:38:31,167 __main__ DEBUG Running garbage collection... +2023-04-14 04:38:31,443 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 04:38:31,443 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-04-14 04:38:31,444 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-04-14 04:38:31,444 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 04:38:49,170 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:42:07,945 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-04-14 04:42:07,945 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:44:49,844 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.213 mean absolute error, 2.921 mean squared error, 0.5 recall of 1.0, 0.45662100456621 precision of 1.0, 0.235 recall of 2.0, 0.34558823529411764 precision of 2.0, 0.175 recall of 3.0, 0.25 precision of 3.0, 0.145 recall of 4.0, 0.42028985507246375 precision of 4.0, 0.69 recall of 5.0, 0.3165137614678899 precision of 5.0, 349 perfect matches. +2023-04-14 04:44:50,310 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.213 mean absolute error, 2.921 mean squared error, 0.5 recall of 1.0, 0.45662100456621 precision of 1.0, 0.235 recall of 2.0, 0.34558823529411764 precision of 2.0, 0.175 recall of 3.0, 0.25 precision of 3.0, 0.145 recall of 4.0, 0.42028985507246375 precision of 4.0, 0.69 recall of 5.0, 0.3165137614678899 precision of 5.0, 349 perfect matches. +2023-04-14 04:44:50,311 __main__ DEBUG Running garbage collection... +2023-04-14 04:44:52,556 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 04:44:52,556 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-04-14 04:44:52,557 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-04-14 04:44:52,557 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... +2023-04-14 04:45:16,474 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:47:56,326 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-04-14 04:47:56,326 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:50:02,739 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.019 mean absolute error, 2.195 mean squared error, 0.695 recall of 1.0, 0.4633333333333333 precision of 1.0, 0.125 recall of 2.0, 0.2840909090909091 precision of 2.0, 0.29 recall of 3.0, 0.31521739130434784 precision of 3.0, 0.15 recall of 4.0, 0.4918032786885246 precision of 4.0, 0.69 recall of 5.0, 0.3760217983651226 precision of 5.0, 390 perfect matches. +2023-04-14 04:50:02,868 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.019 mean absolute error, 2.195 mean squared error, 0.695 recall of 1.0, 0.4633333333333333 precision of 1.0, 0.125 recall of 2.0, 0.2840909090909091 precision of 2.0, 0.29 recall of 3.0, 0.31521739130434784 precision of 3.0, 0.15 recall of 4.0, 0.4918032786885246 precision of 4.0, 0.69 recall of 5.0, 0.3760217983651226 precision of 5.0, 390 perfect matches. +2023-04-14 04:50:02,868 __main__ DEBUG Running garbage collection... +2023-04-14 04:50:03,147 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 04:50:03,147 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-04-14 04:50:03,147 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-04-14 04:50:03,147 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 04:50:20,955 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:53:26,986 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-04-14 04:53:26,987 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 04:55:58,484 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.104 mean absolute error, 2.508 mean squared error, 0.61 recall of 1.0, 0.44525547445255476 precision of 1.0, 0.235 recall of 2.0, 0.29012345679012347 precision of 2.0, 0.21 recall of 3.0, 0.33070866141732286 precision of 3.0, 0.125 recall of 4.0, 0.43103448275862066 precision of 4.0, 0.68 recall of 5.0, 0.35883905013192613 precision of 5.0, 372 perfect matches. +2023-04-14 04:55:58,610 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.104 mean absolute error, 2.508 mean squared error, 0.61 recall of 1.0, 0.44525547445255476 precision of 1.0, 0.235 recall of 2.0, 0.29012345679012347 precision of 2.0, 0.21 recall of 3.0, 0.33070866141732286 precision of 3.0, 0.125 recall of 4.0, 0.43103448275862066 precision of 4.0, 0.68 recall of 5.0, 0.35883905013192613 precision of 5.0, 372 perfect matches. +2023-04-14 04:55:58,611 __main__ DEBUG Running garbage collection... +2023-04-14 04:55:58,891 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 04:55:58,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-04-14 04:55:58,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-04-14 04:55:58,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... +2023-04-14 04:56:17,158 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 04:59:43,480 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-04-14 04:59:43,480 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 05:02:19,881 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.086 mean absolute error, 2.492 mean squared error, 0.645 recall of 1.0, 0.48134328358208955 precision of 1.0, 0.31 recall of 2.0, 0.4305555555555556 precision of 2.0, 0.165 recall of 3.0, 0.28695652173913044 precision of 3.0, 0.13 recall of 4.0, 0.35135135135135137 precision of 4.0, 0.675 recall of 5.0, 0.3383458646616541 precision of 5.0, 385 perfect matches. +2023-04-14 05:02:20,029 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.086 mean absolute error, 2.492 mean squared error, 0.645 recall of 1.0, 0.48134328358208955 precision of 1.0, 0.31 recall of 2.0, 0.4305555555555556 precision of 2.0, 0.165 recall of 3.0, 0.28695652173913044 precision of 3.0, 0.13 recall of 4.0, 0.35135135135135137 precision of 4.0, 0.675 recall of 5.0, 0.3383458646616541 precision of 5.0, 385 perfect matches. +2023-04-14 05:02:20,029 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer +2023-04-14 05:02:20,029 __main__ DEBUG Running garbage collection... +2023-04-14 05:02:20,310 __main__ DEBUG Collected 0 pieces of garbage! +2023-04-14 05:02:20,311 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-04-14 05:02:20,311 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-04-14 05:02:20,311 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 05:02:38,449 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:04:30,196 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:04:30,499 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 +2023-04-14 05:04:30,499 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 05:04:48,396 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:06:47,932 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:06:48,068 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Run #3 +2023-04-14 05:06:48,069 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 05:07:06,116 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:07:40,525 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:07:40,658 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 DEBUG Run #4 +2023-04-14 05:07:40,658 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 05:07:58,697 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:09:04,576 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:09:04,720 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.5 DEBUG Run #5 +2023-04-14 05:09:04,721 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.5 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 05:09:22,459 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.5 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:09:51,742 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.5 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:09:51,872 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.6 DEBUG Run #6 +2023-04-14 05:09:51,872 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.6 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 05:10:09,649 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.6 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:10:28,862 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.6 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:10:28,991 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.7 DEBUG Run #7 +2023-04-14 05:10:28,992 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.7 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 05:10:46,596 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.7 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:11:45,240 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.7 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:11:45,375 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 DEBUG Run #8 +2023-04-14 05:11:45,375 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-04-14 05:12:03,548 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:17:43,566 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Training succeeded! +2023-04-14 05:17:43,566 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 05:18:54,270 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 2.912 mean squared error, 0.94 recall of 1.0, 0.3027375201288245 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.76 recall of 5.0, 0.40105540897097625 precision of 5.0, 340 perfect matches. +2023-04-14 05:18:54,397 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 2.912 mean squared error, 0.94 recall of 1.0, 0.3027375201288245 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.76 recall of 5.0, 0.40105540897097625 precision of 5.0, 340 perfect matches. +2023-04-14 05:18:54,398 __main__ DEBUG Running garbage collection... +2023-04-14 05:18:54,771 __main__ DEBUG Collected 82946 pieces of garbage! +2023-04-14 05:18:54,792 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-04-14 05:18:54,797 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-04-14 05:18:54,801 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-04-14 05:19:12,650 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:21:02,056 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:21:02,186 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 +2023-04-14 05:21:02,187 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-04-14 05:21:20,290 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:21:54,750 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:21:54,884 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 DEBUG Run #3 +2023-04-14 05:21:54,884 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-04-14 05:22:12,674 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:23:33,165 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:23:33,299 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 DEBUG Run #4 +2023-04-14 05:23:33,300 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-04-14 05:23:51,145 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:29:36,402 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Training succeeded! +2023-04-14 05:29:36,402 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 05:30:42,698 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.234 mean absolute error, 2.936 mean squared error, 0.825 recall of 1.0, 0.3579175704989154 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.885 recall of 5.0, 0.32838589981447125 precision of 5.0, 342 perfect matches. +2023-04-14 05:30:42,829 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.234 mean absolute error, 2.936 mean squared error, 0.825 recall of 1.0, 0.3579175704989154 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.885 recall of 5.0, 0.32838589981447125 precision of 5.0, 342 perfect matches. +2023-04-14 05:30:42,829 __main__ DEBUG Running garbage collection... +2023-04-14 05:30:43,156 __main__ DEBUG Collected 20272 pieces of garbage! +2023-04-14 05:30:43,161 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-04-14 05:30:43,161 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-04-14 05:30:43,161 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 05:31:00,984 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:32:56,493 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:32:56,701 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 +2023-04-14 05:32:56,701 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 05:33:14,587 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:33:49,685 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:33:49,953 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Run #3 +2023-04-14 05:33:49,953 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 05:34:07,901 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:35:23,629 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:35:23,778 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Run #4 +2023-04-14 05:35:23,778 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 05:35:41,994 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:36:50,388 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:36:50,595 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 DEBUG Run #5 +2023-04-14 05:36:50,595 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 05:37:08,524 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:42:46,919 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Training succeeded! +2023-04-14 05:42:46,934 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 05:43:58,719 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.14 mean absolute error, 2.56 mean squared error, 0.95 recall of 1.0, 0.3321678321678322 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.825 recall of 5.0, 0.3855140186915888 precision of 5.0, 355 perfect matches. +2023-04-14 05:43:59,171 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.14 mean absolute error, 2.56 mean squared error, 0.95 recall of 1.0, 0.3321678321678322 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.825 recall of 5.0, 0.3855140186915888 precision of 5.0, 355 perfect matches. +2023-04-14 05:43:59,172 __main__ DEBUG Running garbage collection... +2023-04-14 05:43:59,538 __main__ DEBUG Collected 33304 pieces of garbage! +2023-04-14 05:43:59,543 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-04-14 05:43:59,544 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-04-14 05:43:59,545 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 05:44:17,220 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:45:59,737 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:45:59,950 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 +2023-04-14 05:45:59,951 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 05:46:17,596 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:46:50,158 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:46:50,292 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 DEBUG Run #3 +2023-04-14 05:46:50,292 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-04-14 05:47:07,983 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:52:53,628 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Training succeeded! +2023-04-14 05:52:53,635 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 05:54:10,225 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.252 mean absolute error, 3.008 mean squared error, 0.8 recall of 1.0, 0.39119804400978 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.87 recall of 5.0, 0.29441624365482233 precision of 5.0, 334 perfect matches. +2023-04-14 05:54:10,551 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.252 mean absolute error, 3.008 mean squared error, 0.8 recall of 1.0, 0.39119804400978 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.87 recall of 5.0, 0.29441624365482233 precision of 5.0, 334 perfect matches. +2023-04-14 05:54:10,552 __main__ DEBUG Running garbage collection... +2023-04-14 05:54:14,999 __main__ DEBUG Collected 85504 pieces of garbage! +2023-04-14 05:54:15,022 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-04-14 05:54:15,029 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-04-14 05:54:15,034 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 05:54:32,483 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 05:56:10,997 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 05:56:11,132 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 +2023-04-14 05:56:11,132 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 05:56:28,864 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:02:32,505 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! +2023-04-14 06:02:32,505 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 06:03:41,718 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 2.912 mean squared error, 0.915 recall of 1.0, 0.32854578096947934 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.83 recall of 5.0, 0.3747178329571106 precision of 5.0, 349 perfect matches. +2023-04-14 06:03:41,951 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 2.912 mean squared error, 0.915 recall of 1.0, 0.32854578096947934 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.83 recall of 5.0, 0.3747178329571106 precision of 5.0, 349 perfect matches. +2023-04-14 06:03:41,951 __main__ DEBUG Running garbage collection... +2023-04-14 06:03:42,402 __main__ DEBUG Collected 85269 pieces of garbage! +2023-04-14 06:03:42,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-04-14 06:03:42,431 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-04-14 06:03:42,435 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... +2023-04-14 06:04:00,511 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:09:55,975 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-04-14 06:09:55,994 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 06:11:25,731 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.188 mean absolute error, 2.752 mean squared error, 0.84 recall of 1.0, 0.35 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.895 recall of 5.0, 0.34423076923076923 precision of 5.0, 347 perfect matches. +2023-04-14 06:11:26,003 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.188 mean absolute error, 2.752 mean squared error, 0.84 recall of 1.0, 0.35 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.895 recall of 5.0, 0.34423076923076923 precision of 5.0, 347 perfect matches. +2023-04-14 06:11:26,004 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer +2023-04-14 06:11:26,005 __main__ DEBUG Running garbage collection... +2023-04-14 06:11:27,284 __main__ DEBUG Collected 85753 pieces of garbage! +2023-04-14 06:11:27,310 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-04-14 06:11:27,315 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-04-14 06:11:27,321 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-04-14 06:11:50,957 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:17:30,496 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-04-14 06:17:30,496 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 06:18:40,181 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.825 mean absolute error, 1.443 mean squared error, 0.555 recall of 1.0, 0.5260663507109005 precision of 1.0, 0.345 recall of 2.0, 0.3988439306358382 precision of 2.0, 0.315 recall of 3.0, 0.3073170731707317 precision of 3.0, 0.31 recall of 4.0, 0.3263157894736842 precision of 4.0, 0.565 recall of 5.0, 0.5113122171945701 precision of 5.0, 418 perfect matches. +2023-04-14 06:18:40,315 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.825 mean absolute error, 1.443 mean squared error, 0.555 recall of 1.0, 0.5260663507109005 precision of 1.0, 0.345 recall of 2.0, 0.3988439306358382 precision of 2.0, 0.315 recall of 3.0, 0.3073170731707317 precision of 3.0, 0.31 recall of 4.0, 0.3263157894736842 precision of 4.0, 0.565 recall of 5.0, 0.5113122171945701 precision of 5.0, 418 perfect matches. +2023-04-14 06:18:40,316 __main__ DEBUG Running garbage collection... +2023-04-14 06:18:40,787 __main__ DEBUG Collected 87193 pieces of garbage! +2023-04-14 06:18:40,805 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-04-14 06:18:40,808 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-04-14 06:18:40,809 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-04-14 06:18:58,412 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:19:46,627 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:19:46,834 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 +2023-04-14 06:19:46,834 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-04-14 06:20:04,433 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:20:41,334 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:20:41,492 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.3 DEBUG Run #3 +2023-04-14 06:20:41,493 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-04-14 06:20:59,417 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:21:48,901 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:21:49,059 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 DEBUG Run #4 +2023-04-14 06:21:49,059 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-04-14 06:22:06,642 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:28:02,774 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Training succeeded! +2023-04-14 06:28:02,775 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 06:29:11,536 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.907 mean absolute error, 1.567 mean squared error, 0.345 recall of 1.0, 0.5267175572519084 precision of 1.0, 0.335 recall of 2.0, 0.3284313725490196 precision of 2.0, 0.195 recall of 3.0, 0.22941176470588234 precision of 3.0, 0.215 recall of 4.0, 0.22279792746113988 precision of 4.0, 0.675 recall of 5.0, 0.4470198675496689 precision of 5.0, 353 perfect matches. +2023-04-14 06:29:11,666 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.907 mean absolute error, 1.567 mean squared error, 0.345 recall of 1.0, 0.5267175572519084 precision of 1.0, 0.335 recall of 2.0, 0.3284313725490196 precision of 2.0, 0.195 recall of 3.0, 0.22941176470588234 precision of 3.0, 0.215 recall of 4.0, 0.22279792746113988 precision of 4.0, 0.675 recall of 5.0, 0.4470198675496689 precision of 5.0, 353 perfect matches. +2023-04-14 06:29:11,667 __main__ DEBUG Running garbage collection... +2023-04-14 06:29:12,174 __main__ DEBUG Collected 90089 pieces of garbage! +2023-04-14 06:29:12,194 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-04-14 06:29:12,197 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-04-14 06:29:12,198 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 06:29:29,623 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:30:05,562 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:30:05,703 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 +2023-04-14 06:30:05,703 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 06:30:23,120 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:31:39,938 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:31:40,073 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Run #3 +2023-04-14 06:31:40,073 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 06:31:57,555 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:33:42,338 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:33:42,478 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Run #4 +2023-04-14 06:33:42,479 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 06:34:00,265 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:34:30,472 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.4 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:34:30,614 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.5 DEBUG Run #5 +2023-04-14 06:34:30,614 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.5 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 06:34:48,476 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.5 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:35:49,348 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.5 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:35:49,492 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 DEBUG Run #6 +2023-04-14 06:35:49,492 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-04-14 06:36:06,881 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:42:02,171 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Training succeeded! +2023-04-14 06:42:02,171 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 06:43:12,916 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.883 mean absolute error, 1.585 mean squared error, 0.48 recall of 1.0, 0.5133689839572193 precision of 1.0, 0.36 recall of 2.0, 0.3037974683544304 precision of 2.0, 0.265 recall of 3.0, 0.2994350282485876 precision of 3.0, 0.24 recall of 4.0, 0.32 precision of 4.0, 0.585 recall of 5.0, 0.46987951807228917 precision of 5.0, 386 perfect matches. +2023-04-14 06:43:13,043 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.883 mean absolute error, 1.585 mean squared error, 0.48 recall of 1.0, 0.5133689839572193 precision of 1.0, 0.36 recall of 2.0, 0.3037974683544304 precision of 2.0, 0.265 recall of 3.0, 0.2994350282485876 precision of 3.0, 0.24 recall of 4.0, 0.32 precision of 4.0, 0.585 recall of 5.0, 0.46987951807228917 precision of 5.0, 386 perfect matches. +2023-04-14 06:43:13,044 __main__ DEBUG Running garbage collection... +2023-04-14 06:43:13,489 __main__ DEBUG Collected 34043 pieces of garbage! +2023-04-14 06:43:13,497 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-04-14 06:43:13,499 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-04-14 06:43:13,499 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-04-14 06:43:30,934 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:49:30,860 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-04-14 06:49:30,861 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 06:50:39,200 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.759 mean absolute error, 1.249 mean squared error, 0.535 recall of 1.0, 0.6114285714285714 precision of 1.0, 0.335 recall of 2.0, 0.40119760479041916 precision of 2.0, 0.455 recall of 3.0, 0.3192982456140351 precision of 3.0, 0.415 recall of 4.0, 0.3672566371681416 precision of 4.0, 0.44 recall of 5.0, 0.5986394557823129 precision of 5.0, 436 perfect matches. +2023-04-14 06:50:39,328 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.759 mean absolute error, 1.249 mean squared error, 0.535 recall of 1.0, 0.6114285714285714 precision of 1.0, 0.335 recall of 2.0, 0.40119760479041916 precision of 2.0, 0.455 recall of 3.0, 0.3192982456140351 precision of 3.0, 0.415 recall of 4.0, 0.3672566371681416 precision of 4.0, 0.44 recall of 5.0, 0.5986394557823129 precision of 5.0, 436 perfect matches. +2023-04-14 06:50:39,328 __main__ DEBUG Running garbage collection... +2023-04-14 06:50:39,838 __main__ DEBUG Collected 87193 pieces of garbage! +2023-04-14 06:50:39,856 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-04-14 06:50:39,859 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-04-14 06:50:39,860 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 06:50:57,320 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:52:15,989 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:52:16,123 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 +2023-04-14 06:52:16,124 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 06:52:33,737 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-04-14 06:53:46,252 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 ERROR Training failed, trying again with a different dataset... +2023-04-14 06:53:47,158 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Run #3 +2023-04-14 06:53:47,158 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-04-14 06:54:05,432 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training sentiment analyzer: tokenizer> +2023-04-14 07:00:08,974 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training succeeded! +2023-04-14 07:00:09,017 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 07:01:28,678 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.72 mean absolute error, 1.182 mean squared error, 0.47 recall of 1.0, 0.6308724832214765 precision of 1.0, 0.505 recall of 2.0, 0.3713235294117647 precision of 2.0, 0.365 recall of 3.0, 0.35609756097560974 precision of 3.0, 0.405 recall of 4.0, 0.43548387096774194 precision of 4.0, 0.58 recall of 5.0, 0.6170212765957447 precision of 5.0, 465 perfect matches. +2023-04-14 07:01:29,212 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.72 mean absolute error, 1.182 mean squared error, 0.47 recall of 1.0, 0.6308724832214765 precision of 1.0, 0.505 recall of 2.0, 0.3713235294117647 precision of 2.0, 0.365 recall of 3.0, 0.35609756097560974 precision of 3.0, 0.405 recall of 4.0, 0.43548387096774194 precision of 4.0, 0.58 recall of 5.0, 0.6170212765957447 precision of 5.0, 465 perfect matches. +2023-04-14 07:01:29,212 __main__ DEBUG Running garbage collection... +2023-04-14 07:01:32,557 __main__ DEBUG Collected 89097 pieces of garbage! +2023-04-14 07:01:32,564 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-04-14 07:01:32,566 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-04-14 07:01:32,568 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... +2023-04-14 07:01:50,460 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-04-14 07:08:07,392 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-04-14 07:08:07,418 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-04-14 07:09:21,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.806 mean absolute error, 1.408 mean squared error, 0.57 recall of 1.0, 0.5352112676056338 precision of 1.0, 0.4 recall of 2.0, 0.35398230088495575 precision of 2.0, 0.34 recall of 3.0, 0.3090909090909091 precision of 3.0, 0.265 recall of 4.0, 0.3680555555555556 precision of 4.0, 0.535 recall of 5.0, 0.5431472081218274 precision of 5.0, 422 perfect matches. +2023-04-14 07:09:22,182 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.806 mean absolute error, 1.408 mean squared error, 0.57 recall of 1.0, 0.5352112676056338 precision of 1.0, 0.4 recall of 2.0, 0.35398230088495575 precision of 2.0, 0.34 recall of 3.0, 0.3090909090909091 precision of 3.0, 0.265 recall of 4.0, 0.3680555555555556 precision of 4.0, 0.535 recall of 5.0, 0.5431472081218274 precision of 5.0, 422 perfect matches. diff --git a/data/logs/run-success2.tsv b/data/logs/run-success2.tsv new file mode 100644 index 0000000..32443b8 --- /dev/null +++ b/data/logs/run-success2.tsv @@ -0,0 +1,525 @@ +2023-05-08 04:23:54,262 __main__ INFO Started unimore-bda-6 in DEBUG mode! +2023-05-08 04:23:54,262 __main__ DEBUG Validating configuration... +2023-05-08 04:23:54,263 __main__ DEBUG Ensuring there are no leftover caches... +2023-05-08 04:23:54,288 __main__.sample_reviews_polar DEBUG Selected sample_func: sample_reviews_polar +2023-05-08 04:23:54,288 __main__.sample_reviews_polar.ThreeCheat DEBUG Selected SentimentAnalyzer: ThreeCheat +2023-05-08 04:23:54,289 __main__ DEBUG Running garbage collection... +2023-05-08 04:23:54,380 __main__ DEBUG Collected 10 pieces of garbage! +2023-05-08 04:23:54,381 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-08 04:23:54,381 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 DEBUG Run #1 +2023-05-08 04:23:54,381 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 DEBUG Instantiating ThreeCheat with PlainTokenizer... +2023-05-08 04:25:04,655 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:25:04,656 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-08 04:25:04,656 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:25:04,883 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:25:05,032 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:25:05,033 __main__ DEBUG Running garbage collection... +2023-05-08 04:25:05,131 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:25:05,132 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-08 04:25:05,132 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-08 04:25:05,132 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 DEBUG Instantiating ThreeCheat with LowercaseTokenizer... +2023-05-08 04:26:13,787 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:26:13,787 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-08 04:26:13,787 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:26:13,968 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:26:14,099 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:26:14,099 __main__ DEBUG Running garbage collection... +2023-05-08 04:26:14,188 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:26:14,188 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-08 04:26:14,188 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-08 04:26:14,188 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 DEBUG Instantiating ThreeCheat with NLTKWordTokenizer... +2023-05-08 04:27:23,968 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:27:23,968 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-08 04:27:23,968 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:27:24,167 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:27:24,301 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:27:24,302 __main__ DEBUG Running garbage collection... +2023-05-08 04:27:24,391 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:27:24,392 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-08 04:27:24,392 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 DEBUG Run #1 +2023-05-08 04:27:24,392 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 DEBUG Instantiating ThreeCheat with PottsTokenizer... +2023-05-08 04:28:33,262 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:28:33,263 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-08 04:28:33,263 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:28:33,455 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:28:33,587 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:28:33,587 __main__ DEBUG Running garbage collection... +2023-05-08 04:28:33,675 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:28:33,675 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-08 04:28:33,675 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-08 04:28:33,676 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Instantiating ThreeCheat with PottsTokenizerWithNegation... +2023-05-08 04:29:44,684 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:29:44,684 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-08 04:29:44,684 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:29:44,900 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:29:45,029 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:29:45,030 __main__ DEBUG Running garbage collection... +2023-05-08 04:29:45,123 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:29:45,123 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-08 04:29:45,123 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-08 04:29:45,124 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 DEBUG Instantiating ThreeCheat with HuggingBertTokenizer... +2023-05-08 04:30:52,115 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:30:52,115 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-08 04:30:52,115 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:30:52,292 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:30:52,420 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-08 04:30:52,421 __main__.sample_reviews_polar.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer +2023-05-08 04:30:52,421 __main__ DEBUG Running garbage collection... +2023-05-08 04:30:52,511 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:30:52,512 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-08 04:30:52,512 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-08 04:30:52,512 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... +2023-05-08 04:32:03,680 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:34:28,687 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-08 04:34:28,691 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:35:34,362 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.864 mean absolute error, 3.456 mean squared error, 0.694 recall of 1.0, 0.8463414634146341 precision of 1.0, 0.874 recall of 5.0, 0.7406779661016949 precision of 5.0, 784 perfect matches. +2023-05-08 04:35:34,488 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.864 mean absolute error, 3.456 mean squared error, 0.694 recall of 1.0, 0.8463414634146341 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.874 recall of 5.0, 0.7406779661016949 precision of 5.0, 784 perfect matches. +2023-05-08 04:35:34,489 __main__ DEBUG Running garbage collection... +2023-05-08 04:35:34,594 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:35:34,594 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-08 04:35:34,595 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-08 04:35:34,595 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... +2023-05-08 04:36:55,269 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:39:11,292 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-08 04:39:11,292 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:40:14,312 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.088 mean absolute error, 4.352 mean squared error, 0.614 recall of 1.0, 0.7953367875647669 precision of 1.0, 0.842 recall of 5.0, 0.6856677524429967 precision of 5.0, 728 perfect matches. +2023-05-08 04:40:14,580 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.088 mean absolute error, 4.352 mean squared error, 0.614 recall of 1.0, 0.7953367875647669 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.842 recall of 5.0, 0.6856677524429967 precision of 5.0, 728 perfect matches. +2023-05-08 04:40:14,581 __main__ DEBUG Running garbage collection... +2023-05-08 04:40:14,683 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:40:14,684 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-08 04:40:14,684 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-08 04:40:14,684 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... +2023-05-08 04:41:55,343 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:44:45,773 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-08 04:44:45,773 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:45:58,036 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.064 mean absolute error, 4.256 mean squared error, 0.624 recall of 1.0, 0.8 precision of 1.0, 0.844 recall of 5.0, 0.6918032786885245 precision of 5.0, 734 perfect matches. +2023-05-08 04:45:58,182 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.064 mean absolute error, 4.256 mean squared error, 0.624 recall of 1.0, 0.8 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.844 recall of 5.0, 0.6918032786885245 precision of 5.0, 734 perfect matches. +2023-05-08 04:45:58,183 __main__ DEBUG Running garbage collection... +2023-05-08 04:45:58,276 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:45:58,277 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-08 04:45:58,277 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-08 04:45:58,277 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... +2023-05-08 04:47:08,242 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:49:27,045 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-08 04:49:27,046 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:50:29,370 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.884 mean absolute error, 3.536 mean squared error, 0.69 recall of 1.0, 0.8394160583941606 precision of 1.0, 0.868 recall of 5.0, 0.7368421052631579 precision of 5.0, 779 perfect matches. +2023-05-08 04:50:29,496 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.884 mean absolute error, 3.536 mean squared error, 0.69 recall of 1.0, 0.8394160583941606 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.868 recall of 5.0, 0.7368421052631579 precision of 5.0, 779 perfect matches. +2023-05-08 04:50:29,497 __main__ DEBUG Running garbage collection... +2023-05-08 04:50:29,597 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:50:29,597 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-08 04:50:29,597 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-08 04:50:29,597 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-08 04:51:40,426 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:54:22,506 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-08 04:54:22,524 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 04:55:34,897 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.076 mean absolute error, 4.304 mean squared error, 0.598 recall of 1.0, 0.8147138964577657 precision of 1.0, 0.864 recall of 5.0, 0.6824644549763034 precision of 5.0, 731 perfect matches. +2023-05-08 04:55:35,024 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.076 mean absolute error, 4.304 mean squared error, 0.598 recall of 1.0, 0.8147138964577657 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.864 recall of 5.0, 0.6824644549763034 precision of 5.0, 731 perfect matches. +2023-05-08 04:55:35,025 __main__ DEBUG Running garbage collection... +2023-05-08 04:55:35,134 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 04:55:35,134 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-08 04:55:35,134 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-08 04:55:35,134 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... +2023-05-08 04:56:44,543 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 04:59:53,350 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-08 04:59:53,355 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 05:01:14,390 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.976 mean absolute error, 3.904 mean squared error, 0.662 recall of 1.0, 0.8152709359605911 precision of 1.0, 0.85 recall of 5.0, 0.7154882154882155 precision of 5.0, 756 perfect matches. +2023-05-08 05:01:14,516 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.976 mean absolute error, 3.904 mean squared error, 0.662 recall of 1.0, 0.8152709359605911 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.85 recall of 5.0, 0.7154882154882155 precision of 5.0, 756 perfect matches. +2023-05-08 05:01:14,516 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer +2023-05-08 05:01:14,517 __main__ DEBUG Running garbage collection... +2023-05-08 05:01:14,617 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 05:01:14,617 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-08 05:01:14,618 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-08 05:01:14,618 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-08 05:02:29,026 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 05:08:30,280 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-08 05:08:30,291 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 05:09:36,879 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.66 mean absolute error, 2.64 mean squared error, 0.818 recall of 1.0, 0.8467908902691511 precision of 1.0, 0.852 recall of 5.0, 0.8239845261121856 precision of 5.0, 835 perfect matches. +2023-05-08 05:09:37,030 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.66 mean absolute error, 2.64 mean squared error, 0.818 recall of 1.0, 0.8467908902691511 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.852 recall of 5.0, 0.8239845261121856 precision of 5.0, 835 perfect matches. +2023-05-08 05:09:37,030 __main__ DEBUG Running garbage collection... +2023-05-08 05:09:37,137 __main__ DEBUG Collected 16645 pieces of garbage! +2023-05-08 05:09:37,141 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-08 05:09:37,141 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-08 05:09:37,141 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-05-08 05:10:52,022 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 05:16:52,775 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-08 05:16:52,778 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 05:17:57,470 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.868 recall of 1.0, 0.875 precision of 1.0, 0.876 recall of 5.0, 0.8690476190476191 precision of 5.0, 872 perfect matches. +2023-05-08 05:17:57,826 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.868 recall of 1.0, 0.875 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.876 recall of 5.0, 0.8690476190476191 precision of 5.0, 872 perfect matches. +2023-05-08 05:17:57,827 __main__ DEBUG Running garbage collection... +2023-05-08 05:17:57,994 __main__ DEBUG Collected 53604 pieces of garbage! +2023-05-08 05:17:58,002 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-08 05:17:58,007 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-08 05:17:58,007 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-05-08 05:19:11,926 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 05:25:26,859 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-08 05:25:26,860 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 05:26:33,810 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.552 mean absolute error, 2.208 mean squared error, 0.864 recall of 1.0, 0.8605577689243028 precision of 1.0, 0.86 recall of 5.0, 0.8634538152610441 precision of 5.0, 862 perfect matches. +2023-05-08 05:26:33,939 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.552 mean absolute error, 2.208 mean squared error, 0.864 recall of 1.0, 0.8605577689243028 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.8634538152610441 precision of 5.0, 862 perfect matches. +2023-05-08 05:26:33,940 __main__ DEBUG Running garbage collection... +2023-05-08 05:26:34,099 __main__ DEBUG Collected 47800 pieces of garbage! +2023-05-08 05:26:34,113 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-08 05:26:34,116 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-08 05:26:34,117 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-05-08 05:27:41,090 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 05:28:28,707 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-08 05:28:28,837 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 +2023-05-08 05:28:28,837 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-05-08 05:29:35,277 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-08 05:35:48,049 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-08 05:35:48,049 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 05:36:53,031 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.536 mean absolute error, 2.144 mean squared error, 0.896 recall of 1.0, 0.8452830188679246 precision of 1.0, 0.836 recall of 5.0, 0.8893617021276595 precision of 5.0, 866 perfect matches. +2023-05-08 05:36:53,156 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.536 mean absolute error, 2.144 mean squared error, 0.896 recall of 1.0, 0.8452830188679246 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.836 recall of 5.0, 0.8893617021276595 precision of 5.0, 866 perfect matches. +2023-05-08 05:36:53,157 __main__ DEBUG Running garbage collection... +2023-05-08 05:36:53,341 __main__ DEBUG Collected 64471 pieces of garbage! +2023-05-08 05:36:53,359 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-08 05:36:53,364 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-08 05:36:53,367 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-08 05:38:02,478 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 05:43:55,485 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-08 05:43:55,485 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 05:45:00,933 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.93 recall of 1.0, 0.8532110091743119 precision of 1.0, 0.84 recall of 5.0, 0.9230769230769231 precision of 5.0, 885 perfect matches. +2023-05-08 05:45:01,093 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.93 recall of 1.0, 0.8532110091743119 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.84 recall of 5.0, 0.9230769230769231 precision of 5.0, 885 perfect matches. +2023-05-08 05:45:01,094 __main__ DEBUG Running garbage collection... +2023-05-08 05:45:01,253 __main__ DEBUG Collected 41289 pieces of garbage! +2023-05-08 05:45:01,263 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-08 05:45:01,266 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-08 05:45:01,267 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... +2023-05-08 05:46:09,330 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 05:52:00,364 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-08 05:52:00,364 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 05:53:05,830 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.504 mean absolute error, 2.016 mean squared error, 0.892 recall of 1.0, 0.861003861003861 precision of 1.0, 0.856 recall of 5.0, 0.8879668049792531 precision of 5.0, 874 perfect matches. +2023-05-08 05:53:05,953 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.504 mean absolute error, 2.016 mean squared error, 0.892 recall of 1.0, 0.861003861003861 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.856 recall of 5.0, 0.8879668049792531 precision of 5.0, 874 perfect matches. +2023-05-08 05:53:05,954 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer +2023-05-08 05:53:05,954 __main__ DEBUG Running garbage collection... +2023-05-08 05:53:06,126 __main__ DEBUG Collected 38369 pieces of garbage! +2023-05-08 05:53:06,134 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-08 05:53:06,135 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-08 05:53:06,135 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-05-08 05:54:14,119 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 05:54:33,790 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-08 05:54:33,920 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 +2023-05-08 05:54:33,920 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-05-08 05:55:41,501 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:01:24,114 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 INFO Training succeeded! +2023-05-08 06:01:24,114 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:02:28,791 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.54 mean absolute error, 2.16 mean squared error, 0.91 recall of 1.0, 0.8348623853211009 precision of 1.0, 0.82 recall of 5.0, 0.9010989010989011 precision of 5.0, 865 perfect matches. +2023-05-08 06:02:28,918 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.54 mean absolute error, 2.16 mean squared error, 0.91 recall of 1.0, 0.8348623853211009 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.82 recall of 5.0, 0.9010989010989011 precision of 5.0, 865 perfect matches. +2023-05-08 06:02:28,919 __main__ DEBUG Running garbage collection... +2023-05-08 06:02:29,125 __main__ DEBUG Collected 62312 pieces of garbage! +2023-05-08 06:02:29,141 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-08 06:02:29,147 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-08 06:02:29,150 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-05-08 06:03:35,550 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:09:36,303 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-08 06:09:36,325 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:10:41,166 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.5 mean absolute error, 2.0 mean squared error, 0.888 recall of 1.0, 0.8654970760233918 precision of 1.0, 0.862 recall of 5.0, 0.8850102669404517 precision of 5.0, 875 perfect matches. +2023-05-08 06:10:41,463 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.5 mean absolute error, 2.0 mean squared error, 0.888 recall of 1.0, 0.8654970760233918 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.862 recall of 5.0, 0.8850102669404517 precision of 5.0, 875 perfect matches. +2023-05-08 06:10:41,463 __main__ DEBUG Running garbage collection... +2023-05-08 06:10:41,638 __main__ DEBUG Collected 36931 pieces of garbage! +2023-05-08 06:10:41,649 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-08 06:10:41,651 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-08 06:10:41,651 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-05-08 06:11:54,499 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:18:16,274 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-08 06:18:16,289 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:19:23,560 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.524 mean absolute error, 2.096 mean squared error, 0.922 recall of 1.0, 0.833634719710669 precision of 1.0, 0.816 recall of 5.0, 0.912751677852349 precision of 5.0, 869 perfect matches. +2023-05-08 06:19:23,846 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.524 mean absolute error, 2.096 mean squared error, 0.922 recall of 1.0, 0.833634719710669 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.816 recall of 5.0, 0.912751677852349 precision of 5.0, 869 perfect matches. +2023-05-08 06:19:23,847 __main__ DEBUG Running garbage collection... +2023-05-08 06:19:24,044 __main__ DEBUG Collected 34748 pieces of garbage! +2023-05-08 06:19:24,054 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-08 06:19:24,055 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-08 06:19:24,056 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-05-08 06:20:34,231 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:22:40,728 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-08 06:22:40,862 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 +2023-05-08 06:22:40,862 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-05-08 06:23:47,409 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:29:58,970 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-08 06:29:58,971 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:31:04,040 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.862 recall of 1.0, 0.8707070707070707 precision of 1.0, 0.872 recall of 5.0, 0.8633663366336634 precision of 5.0, 867 perfect matches. +2023-05-08 06:31:04,166 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.862 recall of 1.0, 0.8707070707070707 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.872 recall of 5.0, 0.8633663366336634 precision of 5.0, 867 perfect matches. +2023-05-08 06:31:04,166 __main__ DEBUG Running garbage collection... +2023-05-08 06:31:04,394 __main__ DEBUG Collected 53578 pieces of garbage! +2023-05-08 06:31:04,410 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-08 06:31:04,414 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-08 06:31:04,414 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-08 06:32:11,689 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:38:46,938 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-08 06:38:46,939 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:39:52,676 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.52 mean absolute error, 2.08 mean squared error, 0.842 recall of 1.0, 0.8919491525423728 precision of 1.0, 0.898 recall of 5.0, 0.8503787878787878 precision of 5.0, 870 perfect matches. +2023-05-08 06:39:52,802 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.52 mean absolute error, 2.08 mean squared error, 0.842 recall of 1.0, 0.8919491525423728 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.898 recall of 5.0, 0.8503787878787878 precision of 5.0, 870 perfect matches. +2023-05-08 06:39:52,802 __main__ DEBUG Running garbage collection... +2023-05-08 06:39:53,016 __main__ DEBUG Collected 28249 pieces of garbage! +2023-05-08 06:39:53,020 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-08 06:39:53,021 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-08 06:39:53,021 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... +2023-05-08 06:40:58,643 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:47:32,701 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-08 06:47:32,717 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:48:40,112 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.456 mean absolute error, 1.824 mean squared error, 0.878 recall of 1.0, 0.8922764227642277 precision of 1.0, 0.894 recall of 5.0, 0.8799212598425197 precision of 5.0, 886 perfect matches. +2023-05-08 06:48:40,632 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.456 mean absolute error, 1.824 mean squared error, 0.878 recall of 1.0, 0.8922764227642277 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.894 recall of 5.0, 0.8799212598425197 precision of 5.0, 886 perfect matches. +2023-05-08 06:48:40,633 __main__.sample_reviews_varied DEBUG Selected sample_func: sample_reviews_varied +2023-05-08 06:48:40,633 __main__.sample_reviews_varied.ThreeCheat DEBUG Selected SentimentAnalyzer: ThreeCheat +2023-05-08 06:48:40,633 __main__ DEBUG Running garbage collection... +2023-05-08 06:48:40,831 __main__ DEBUG Collected 25349 pieces of garbage! +2023-05-08 06:48:40,835 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-08 06:48:40,836 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 DEBUG Run #1 +2023-05-08 06:48:40,836 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 DEBUG Instantiating ThreeCheat with PlainTokenizer... +2023-05-08 06:51:28,962 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:51:28,962 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-08 06:51:28,962 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:51:29,148 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 06:51:29,277 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 06:51:29,278 __main__ DEBUG Running garbage collection... +2023-05-08 06:51:29,452 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 06:51:29,453 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-08 06:51:29,453 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-08 06:51:29,453 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 DEBUG Instantiating ThreeCheat with LowercaseTokenizer... +2023-05-08 06:54:14,359 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:54:14,359 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-08 06:54:14,359 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:54:14,546 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 06:54:14,682 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 06:54:14,683 __main__ DEBUG Running garbage collection... +2023-05-08 06:54:14,854 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 06:54:14,855 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-08 06:54:14,855 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-08 06:54:14,855 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 DEBUG Instantiating ThreeCheat with NLTKWordTokenizer... +2023-05-08 06:57:04,762 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:57:04,762 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-08 06:57:04,762 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:57:04,974 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 06:57:05,108 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 06:57:05,108 __main__ DEBUG Running garbage collection... +2023-05-08 06:57:05,314 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 06:57:05,314 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-08 06:57:05,315 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 DEBUG Run #1 +2023-05-08 06:57:05,315 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 DEBUG Instantiating ThreeCheat with PottsTokenizer... +2023-05-08 06:59:57,541 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 06:59:57,541 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-08 06:59:57,541 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 06:59:57,747 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 06:59:57,878 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 06:59:57,878 __main__ DEBUG Running garbage collection... +2023-05-08 06:59:58,051 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 06:59:58,052 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-08 06:59:58,053 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-08 06:59:58,053 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Instantiating ThreeCheat with PottsTokenizerWithNegation... +2023-05-08 07:02:45,377 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 07:02:45,377 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-08 07:02:45,377 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 07:02:45,560 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 07:02:45,691 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 07:02:45,692 __main__ DEBUG Running garbage collection... +2023-05-08 07:02:45,864 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 07:02:45,865 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-08 07:02:45,865 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-08 07:02:45,866 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 DEBUG Instantiating ThreeCheat with HuggingBertTokenizer... +2023-05-08 07:05:31,644 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 07:05:31,644 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-08 07:05:31,644 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 07:05:31,852 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 07:05:31,992 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-08 07:05:31,993 __main__.sample_reviews_varied.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer +2023-05-08 07:05:31,993 __main__ DEBUG Running garbage collection... +2023-05-08 07:05:32,169 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 07:05:32,170 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-08 07:05:32,170 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-08 07:05:32,170 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... +2023-05-08 07:08:21,231 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 07:11:30,820 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-08 07:11:30,821 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 07:14:09,034 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.341 mean absolute error, 3.443 mean squared error, 0.345 recall of 1.0, 0.5227272727272727 precision of 1.0, 0.31 recall of 2.0, 0.32460732984293195 precision of 2.0, 0.185 recall of 3.0, 0.3557692307692308 precision of 3.0, 0.1 recall of 4.0, 0.3225806451612903 precision of 4.0, 0.7 recall of 5.0, 0.273972602739726 precision of 5.0, 328 perfect matches. +2023-05-08 07:14:09,162 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.341 mean absolute error, 3.443 mean squared error, 0.345 recall of 1.0, 0.5227272727272727 precision of 1.0, 0.31 recall of 2.0, 0.32460732984293195 precision of 2.0, 0.185 recall of 3.0, 0.3557692307692308 precision of 3.0, 0.1 recall of 4.0, 0.3225806451612903 precision of 4.0, 0.7 recall of 5.0, 0.273972602739726 precision of 5.0, 328 perfect matches. +2023-05-08 07:14:09,162 __main__ DEBUG Running garbage collection... +2023-05-08 07:14:09,366 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 07:14:09,367 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-08 07:14:09,367 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-08 07:14:09,367 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... +2023-05-08 07:17:00,709 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 07:19:56,507 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-08 07:19:56,614 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 07:22:24,654 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.221 mean absolute error, 2.967 mean squared error, 0.45 recall of 1.0, 0.5521472392638037 precision of 1.0, 0.21 recall of 2.0, 0.2876712328767123 precision of 2.0, 0.235 recall of 3.0, 0.36153846153846153 precision of 3.0, 0.135 recall of 4.0, 0.36 precision of 4.0, 0.72 recall of 5.0, 0.2962962962962963 precision of 5.0, 350 perfect matches. +2023-05-08 07:22:24,984 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.221 mean absolute error, 2.967 mean squared error, 0.45 recall of 1.0, 0.5521472392638037 precision of 1.0, 0.21 recall of 2.0, 0.2876712328767123 precision of 2.0, 0.235 recall of 3.0, 0.36153846153846153 precision of 3.0, 0.135 recall of 4.0, 0.36 precision of 4.0, 0.72 recall of 5.0, 0.2962962962962963 precision of 5.0, 350 perfect matches. +2023-05-08 07:22:24,985 __main__ DEBUG Running garbage collection... +2023-05-08 07:22:27,264 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 07:22:27,264 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-08 07:22:27,265 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-08 07:22:27,265 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... +2023-05-08 07:25:27,783 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 07:29:06,012 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-08 07:29:06,012 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 07:31:53,663 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.281 mean absolute error, 3.281 mean squared error, 0.365 recall of 1.0, 0.5069444444444444 precision of 1.0, 0.315 recall of 2.0, 0.38650306748466257 precision of 2.0, 0.215 recall of 3.0, 0.33076923076923076 precision of 3.0, 0.125 recall of 4.0, 0.32894736842105265 precision of 4.0, 0.715 recall of 5.0, 0.2936344969199179 precision of 5.0, 347 perfect matches. +2023-05-08 07:31:53,798 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.281 mean absolute error, 3.281 mean squared error, 0.365 recall of 1.0, 0.5069444444444444 precision of 1.0, 0.315 recall of 2.0, 0.38650306748466257 precision of 2.0, 0.215 recall of 3.0, 0.33076923076923076 precision of 3.0, 0.125 recall of 4.0, 0.32894736842105265 precision of 4.0, 0.715 recall of 5.0, 0.2936344969199179 precision of 5.0, 347 perfect matches. +2023-05-08 07:31:53,799 __main__ DEBUG Running garbage collection... +2023-05-08 07:31:53,994 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 07:31:53,994 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-08 07:31:53,994 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-08 07:31:53,994 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... +2023-05-08 07:34:43,429 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 07:37:43,383 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-08 07:37:43,384 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 07:40:07,837 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.244 mean absolute error, 3.022 mean squared error, 0.44 recall of 1.0, 0.5116279069767442 precision of 1.0, 0.255 recall of 2.0, 0.2463768115942029 precision of 2.0, 0.11 recall of 3.0, 0.24175824175824176 precision of 3.0, 0.14 recall of 4.0, 0.4745762711864407 precision of 4.0, 0.745 recall of 5.0, 0.31634819532908703 precision of 5.0, 338 perfect matches. +2023-05-08 07:40:07,966 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.244 mean absolute error, 3.022 mean squared error, 0.44 recall of 1.0, 0.5116279069767442 precision of 1.0, 0.255 recall of 2.0, 0.2463768115942029 precision of 2.0, 0.11 recall of 3.0, 0.24175824175824176 precision of 3.0, 0.14 recall of 4.0, 0.4745762711864407 precision of 4.0, 0.745 recall of 5.0, 0.31634819532908703 precision of 5.0, 338 perfect matches. +2023-05-08 07:40:07,967 __main__ DEBUG Running garbage collection... +2023-05-08 07:40:08,164 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 07:40:08,164 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-08 07:40:08,165 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-08 07:40:08,165 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-08 07:42:58,809 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 07:46:29,497 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-08 07:46:29,497 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 07:49:17,219 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.252 mean absolute error, 3.024 mean squared error, 0.38 recall of 1.0, 0.4 precision of 1.0, 0.255 recall of 2.0, 0.3493150684931507 precision of 2.0, 0.19 recall of 3.0, 0.2550335570469799 precision of 3.0, 0.085 recall of 4.0, 0.3148148148148148 precision of 4.0, 0.725 recall of 5.0, 0.31453362255965295 precision of 5.0, 327 perfect matches. +2023-05-08 07:49:17,343 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.252 mean absolute error, 3.024 mean squared error, 0.38 recall of 1.0, 0.4 precision of 1.0, 0.255 recall of 2.0, 0.3493150684931507 precision of 2.0, 0.19 recall of 3.0, 0.2550335570469799 precision of 3.0, 0.085 recall of 4.0, 0.3148148148148148 precision of 4.0, 0.725 recall of 5.0, 0.31453362255965295 precision of 5.0, 327 perfect matches. +2023-05-08 07:49:17,344 __main__ DEBUG Running garbage collection... +2023-05-08 07:49:17,545 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 07:49:17,545 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-08 07:49:17,545 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-08 07:49:17,545 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... +2023-05-08 07:52:13,697 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 07:56:21,760 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-08 07:56:21,760 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 07:59:30,673 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.37 mean absolute error, 3.612 mean squared error, 0.285 recall of 1.0, 0.5277777777777778 precision of 1.0, 0.275 recall of 2.0, 0.30726256983240224 precision of 2.0, 0.14 recall of 3.0, 0.4 precision of 3.0, 0.225 recall of 4.0, 0.41284403669724773 precision of 4.0, 0.695 recall of 5.0, 0.2602996254681648 precision of 5.0, 324 perfect matches. +2023-05-08 07:59:31,016 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.37 mean absolute error, 3.612 mean squared error, 0.285 recall of 1.0, 0.5277777777777778 precision of 1.0, 0.275 recall of 2.0, 0.30726256983240224 precision of 2.0, 0.14 recall of 3.0, 0.4 precision of 3.0, 0.225 recall of 4.0, 0.41284403669724773 precision of 4.0, 0.695 recall of 5.0, 0.2602996254681648 precision of 5.0, 324 perfect matches. +2023-05-08 07:59:31,017 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer +2023-05-08 07:59:31,017 __main__ DEBUG Running garbage collection... +2023-05-08 07:59:31,555 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-08 07:59:31,556 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-08 07:59:31,556 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-08 07:59:31,556 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-08 08:02:26,348 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 08:03:02,311 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-08 08:03:02,469 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 +2023-05-08 08:03:02,470 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-08 08:05:52,163 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-08 08:11:33,976 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training succeeded! +2023-05-08 08:11:33,976 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 08:12:45,719 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.294 mean absolute error, 3.176 mean squared error, 0.81 recall of 1.0, 0.34394904458598724 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.32514177693761814 precision of 5.0, 334 perfect matches. +2023-05-08 08:12:45,845 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.294 mean absolute error, 3.176 mean squared error, 0.81 recall of 1.0, 0.34394904458598724 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.32514177693761814 precision of 5.0, 334 perfect matches. +2023-05-08 08:12:45,846 __main__ DEBUG Running garbage collection... +2023-05-08 08:12:46,065 __main__ DEBUG Collected 18828 pieces of garbage! +2023-05-08 08:12:46,070 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-08 08:12:46,070 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-08 08:12:46,070 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-05-08 08:15:33,272 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 08:16:12,961 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-08 08:16:13,088 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 +2023-05-08 08:16:13,088 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-05-08 08:18:56,420 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-08 08:20:44,929 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-08 08:20:45,449 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 DEBUG Run #3 +2023-05-08 08:20:45,450 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-05-08 08:23:26,828 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-08 08:29:01,065 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 INFO Training succeeded! +2023-05-08 08:29:01,065 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 08:30:08,213 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.28 mean absolute error, 3.12 mean squared error, 0.84 recall of 1.0, 0.3421588594704684 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.815 recall of 5.0, 0.32023575638506874 precision of 5.0, 331 perfect matches. +2023-05-08 08:30:08,342 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.28 mean absolute error, 3.12 mean squared error, 0.84 recall of 1.0, 0.3421588594704684 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.815 recall of 5.0, 0.32023575638506874 precision of 5.0, 331 perfect matches. +2023-05-08 08:30:08,342 __main__ DEBUG Running garbage collection... +2023-05-08 08:30:08,593 __main__ DEBUG Collected 48511 pieces of garbage! +2023-05-08 08:30:08,607 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-08 08:30:08,610 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-08 08:30:08,612 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-05-08 08:32:59,626 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 08:38:42,487 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-08 08:38:42,487 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 08:39:50,478 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.208 mean absolute error, 2.832 mean squared error, 0.825 recall of 1.0, 0.3900709219858156 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.92 recall of 5.0, 0.3188908145580589 precision of 5.0, 349 perfect matches. +2023-05-08 08:39:50,680 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.208 mean absolute error, 2.832 mean squared error, 0.825 recall of 1.0, 0.3900709219858156 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.92 recall of 5.0, 0.3188908145580589 precision of 5.0, 349 perfect matches. +2023-05-08 08:39:50,680 __main__ DEBUG Running garbage collection... +2023-05-08 08:39:50,885 __main__ DEBUG Collected 5790 pieces of garbage! +2023-05-08 08:39:50,887 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-08 08:39:50,887 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-08 08:39:50,887 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-05-08 08:42:38,306 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 08:48:26,128 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-08 08:48:26,129 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 08:49:31,620 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 2.896 mean squared error, 0.9 recall of 1.0, 0.32786885245901637 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.78 recall of 5.0, 0.3458980044345898 precision of 5.0, 336 perfect matches. +2023-05-08 08:49:31,913 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 2.896 mean squared error, 0.9 recall of 1.0, 0.32786885245901637 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.78 recall of 5.0, 0.3458980044345898 precision of 5.0, 336 perfect matches. +2023-05-08 08:49:31,913 __main__ DEBUG Running garbage collection... +2023-05-08 08:49:32,241 __main__ DEBUG Collected 85763 pieces of garbage! +2023-05-08 08:49:32,250 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-08 08:49:32,257 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-08 08:49:32,261 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-08 08:52:32,731 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 08:58:22,412 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-08 08:58:22,424 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 08:59:32,565 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.172 mean absolute error, 2.688 mean squared error, 0.84 recall of 1.0, 0.37168141592920356 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.91 recall of 5.0, 0.33211678832116787 precision of 5.0, 350 perfect matches. +2023-05-08 08:59:32,737 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.172 mean absolute error, 2.688 mean squared error, 0.84 recall of 1.0, 0.37168141592920356 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.91 recall of 5.0, 0.33211678832116787 precision of 5.0, 350 perfect matches. +2023-05-08 08:59:32,737 __main__ DEBUG Running garbage collection... +2023-05-08 08:59:34,804 __main__ DEBUG Collected 85747 pieces of garbage! +2023-05-08 08:59:34,812 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-08 08:59:34,819 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-08 08:59:34,824 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... +2023-05-08 09:02:54,959 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 09:08:45,092 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-08 09:08:45,092 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 09:09:52,755 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.258 mean absolute error, 3.032 mean squared error, 0.875 recall of 1.0, 0.3141831238779174 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.81 recall of 5.0, 0.3656884875846501 precision of 5.0, 337 perfect matches. +2023-05-08 09:09:52,882 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.258 mean absolute error, 3.032 mean squared error, 0.875 recall of 1.0, 0.3141831238779174 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.81 recall of 5.0, 0.3656884875846501 precision of 5.0, 337 perfect matches. +2023-05-08 09:09:52,882 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer +2023-05-08 09:09:52,882 __main__ DEBUG Running garbage collection... +2023-05-08 09:09:53,244 __main__ DEBUG Collected 85741 pieces of garbage! +2023-05-08 09:09:53,252 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-08 09:09:53,258 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-08 09:09:53,263 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-05-08 09:12:44,184 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 09:18:45,371 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-08 09:18:45,379 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 09:19:53,641 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.887 mean absolute error, 1.583 mean squared error, 0.27 recall of 1.0, 0.5346534653465347 precision of 1.0, 0.455 recall of 2.0, 0.2808641975308642 precision of 2.0, 0.585 recall of 3.0, 0.3103448275862069 precision of 3.0, 0.165 recall of 4.0, 0.38823529411764707 precision of 4.0, 0.355 recall of 5.0, 0.6283185840707964 precision of 5.0, 366 perfect matches. +2023-05-08 09:19:54,023 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.887 mean absolute error, 1.583 mean squared error, 0.27 recall of 1.0, 0.5346534653465347 precision of 1.0, 0.455 recall of 2.0, 0.2808641975308642 precision of 2.0, 0.585 recall of 3.0, 0.3103448275862069 precision of 3.0, 0.165 recall of 4.0, 0.38823529411764707 precision of 4.0, 0.355 recall of 5.0, 0.6283185840707964 precision of 5.0, 366 perfect matches. +2023-05-08 09:19:54,024 __main__ DEBUG Running garbage collection... +2023-05-08 09:19:54,693 __main__ DEBUG Collected 87195 pieces of garbage! +2023-05-08 09:19:54,712 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-08 09:19:54,714 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-08 09:19:54,715 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-05-08 09:22:52,647 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 09:23:30,313 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-08 09:23:30,507 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 +2023-05-08 09:23:30,508 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-05-08 09:27:36,963 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-08 09:33:35,954 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-05-08 09:33:35,961 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 09:34:47,990 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.803 mean absolute error, 1.467 mean squared error, 0.48 recall of 1.0, 0.5517241379310345 precision of 1.0, 0.56 recall of 2.0, 0.37966101694915255 precision of 2.0, 0.275 recall of 3.0, 0.3741496598639456 precision of 3.0, 0.425 recall of 4.0, 0.34274193548387094 precision of 4.0, 0.405 recall of 5.0, 0.5955882352941176 precision of 5.0, 429 perfect matches. +2023-05-08 09:34:48,200 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.803 mean absolute error, 1.467 mean squared error, 0.48 recall of 1.0, 0.5517241379310345 precision of 1.0, 0.56 recall of 2.0, 0.37966101694915255 precision of 2.0, 0.275 recall of 3.0, 0.3741496598639456 precision of 3.0, 0.425 recall of 4.0, 0.34274193548387094 precision of 4.0, 0.405 recall of 5.0, 0.5955882352941176 precision of 5.0, 429 perfect matches. +2023-05-08 09:34:48,201 __main__ DEBUG Running garbage collection... +2023-05-08 09:34:48,460 __main__ DEBUG Collected 21722 pieces of garbage! +2023-05-08 09:34:48,464 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-08 09:34:48,465 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-08 09:34:48,465 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-05-08 09:37:43,553 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 09:43:52,626 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-08 09:43:52,660 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 09:45:02,535 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.813 mean absolute error, 1.373 mean squared error, 0.545 recall of 1.0, 0.5265700483091788 precision of 1.0, 0.3 recall of 2.0, 0.3821656050955414 precision of 2.0, 0.455 recall of 3.0, 0.3273381294964029 precision of 3.0, 0.32 recall of 4.0, 0.3333333333333333 precision of 4.0, 0.42 recall of 5.0, 0.5060240963855421 precision of 5.0, 408 perfect matches. +2023-05-08 09:45:02,815 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.813 mean absolute error, 1.373 mean squared error, 0.545 recall of 1.0, 0.5265700483091788 precision of 1.0, 0.3 recall of 2.0, 0.3821656050955414 precision of 2.0, 0.455 recall of 3.0, 0.3273381294964029 precision of 3.0, 0.32 recall of 4.0, 0.3333333333333333 precision of 4.0, 0.42 recall of 5.0, 0.5060240963855421 precision of 5.0, 408 perfect matches. +2023-05-08 09:45:02,815 __main__ DEBUG Running garbage collection... +2023-05-08 09:45:03,154 __main__ DEBUG Collected 87193 pieces of garbage! +2023-05-08 09:45:03,172 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-08 09:45:03,175 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-08 09:45:03,176 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-05-08 09:47:52,098 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 09:54:06,325 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-08 09:54:06,367 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 09:55:15,552 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.779 mean absolute error, 1.527 mean squared error, 0.485 recall of 1.0, 0.563953488372093 precision of 1.0, 0.445 recall of 2.0, 0.43842364532019706 precision of 2.0, 0.51 recall of 3.0, 0.379182156133829 precision of 3.0, 0.41 recall of 4.0, 0.4880952380952381 precision of 4.0, 0.53 recall of 5.0, 0.5638297872340425 precision of 5.0, 476 perfect matches. +2023-05-08 09:55:15,809 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.779 mean absolute error, 1.527 mean squared error, 0.485 recall of 1.0, 0.563953488372093 precision of 1.0, 0.445 recall of 2.0, 0.43842364532019706 precision of 2.0, 0.51 recall of 3.0, 0.379182156133829 precision of 3.0, 0.41 recall of 4.0, 0.4880952380952381 precision of 4.0, 0.53 recall of 5.0, 0.5638297872340425 precision of 5.0, 476 perfect matches. +2023-05-08 09:55:15,810 __main__ DEBUG Running garbage collection... +2023-05-08 09:55:16,193 __main__ DEBUG Collected 87179 pieces of garbage! +2023-05-08 09:55:16,211 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-08 09:55:16,215 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-08 09:55:16,216 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-08 09:58:25,111 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 10:00:21,074 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-05-08 10:00:21,453 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 +2023-05-08 10:00:21,453 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-08 10:03:50,047 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-05-08 10:09:51,315 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! +2023-05-08 10:09:51,315 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 10:11:03,766 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.831 mean absolute error, 1.417 mean squared error, 0.41 recall of 1.0, 0.6307692307692307 precision of 1.0, 0.34 recall of 2.0, 0.29310344827586204 precision of 2.0, 0.43 recall of 3.0, 0.3233082706766917 precision of 3.0, 0.355 recall of 4.0, 0.3271889400921659 precision of 4.0, 0.425 recall of 5.0, 0.5483870967741935 precision of 5.0, 392 perfect matches. +2023-05-08 10:11:03,895 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.831 mean absolute error, 1.417 mean squared error, 0.41 recall of 1.0, 0.6307692307692307 precision of 1.0, 0.34 recall of 2.0, 0.29310344827586204 precision of 2.0, 0.43 recall of 3.0, 0.3233082706766917 precision of 3.0, 0.355 recall of 4.0, 0.3271889400921659 precision of 4.0, 0.425 recall of 5.0, 0.5483870967741935 precision of 5.0, 392 perfect matches. +2023-05-08 10:11:03,896 __main__ DEBUG Running garbage collection... +2023-05-08 10:11:04,168 __main__ DEBUG Collected 13027 pieces of garbage! +2023-05-08 10:11:04,172 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-08 10:11:04,172 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-08 10:11:04,172 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... +2023-05-08 10:13:51,532 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-08 10:19:41,412 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-08 10:19:41,413 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-08 10:20:50,241 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.872 mean absolute error, 1.63 mean squared error, 0.545 recall of 1.0, 0.461864406779661 precision of 1.0, 0.275 recall of 2.0, 0.3055555555555556 precision of 2.0, 0.26 recall of 3.0, 0.2826086956521739 precision of 3.0, 0.45 recall of 4.0, 0.36 precision of 4.0, 0.465 recall of 5.0, 0.62 precision of 5.0, 399 perfect matches. +2023-05-08 10:20:50,775 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.872 mean absolute error, 1.63 mean squared error, 0.545 recall of 1.0, 0.461864406779661 precision of 1.0, 0.275 recall of 2.0, 0.3055555555555556 precision of 2.0, 0.26 recall of 3.0, 0.2826086956521739 precision of 3.0, 0.45 recall of 4.0, 0.36 precision of 4.0, 0.465 recall of 5.0, 0.62 precision of 5.0, 399 perfect matches. diff --git a/data/logs/run-success3.tsv b/data/logs/run-success3.tsv new file mode 100644 index 0000000..ce96417 --- /dev/null +++ b/data/logs/run-success3.tsv @@ -0,0 +1,549 @@ +2023-05-09 05:23:10,479 __main__ INFO Started unimore-bda-6 in DEBUG mode! +2023-05-09 05:23:10,479 __main__ DEBUG Validating configuration... +2023-05-09 05:23:10,481 __main__ DEBUG Ensuring there are no leftover caches... +2023-05-09 05:23:10,505 __main__.sample_reviews_polar DEBUG Selected sample_func: sample_reviews_polar +2023-05-09 05:23:10,505 __main__.sample_reviews_polar.ThreeCheat DEBUG Selected SentimentAnalyzer: ThreeCheat +2023-05-09 05:23:10,506 __main__ DEBUG Running garbage collection... +2023-05-09 05:23:10,607 __main__ DEBUG Collected 19 pieces of garbage! +2023-05-09 05:23:10,608 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-09 05:23:10,608 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 DEBUG Run #1 +2023-05-09 05:23:10,608 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 DEBUG Instantiating ThreeCheat with PlainTokenizer... +2023-05-09 05:24:27,907 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:24:27,907 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-09 05:24:27,907 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:24:28,145 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:24:28,287 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:24:28,288 __main__ DEBUG Running garbage collection... +2023-05-09 05:24:28,378 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:24:28,378 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-09 05:24:28,378 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-09 05:24:28,378 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 DEBUG Instantiating ThreeCheat with LowercaseTokenizer... +2023-05-09 05:25:40,832 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:25:40,832 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-09 05:25:40,833 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:25:41,029 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:25:41,177 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:25:41,178 __main__ DEBUG Running garbage collection... +2023-05-09 05:25:41,266 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:25:41,266 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-09 05:25:41,266 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-09 05:25:41,266 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 DEBUG Instantiating ThreeCheat with NLTKWordTokenizer... +2023-05-09 05:26:52,688 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:26:52,688 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-09 05:26:52,689 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:26:52,900 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:26:53,029 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:26:53,029 __main__ DEBUG Running garbage collection... +2023-05-09 05:26:53,116 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:26:53,117 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-09 05:26:53,117 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 DEBUG Run #1 +2023-05-09 05:26:53,117 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 DEBUG Instantiating ThreeCheat with PottsTokenizer... +2023-05-09 05:28:04,548 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:28:04,548 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-09 05:28:04,549 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:28:04,743 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:28:04,875 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:28:04,876 __main__ DEBUG Running garbage collection... +2023-05-09 05:28:04,964 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:28:04,964 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-09 05:28:04,964 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-09 05:28:04,964 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Instantiating ThreeCheat with PottsTokenizerWithNegation... +2023-05-09 05:29:13,309 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:29:13,309 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-09 05:29:13,310 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:29:13,507 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:29:13,658 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:29:13,659 __main__ DEBUG Running garbage collection... +2023-05-09 05:29:13,750 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:29:13,750 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-09 05:29:13,750 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-09 05:29:13,750 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 DEBUG Instantiating ThreeCheat with HuggingBertTokenizer... +2023-05-09 05:30:20,904 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:30:20,904 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-09 05:30:20,905 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:30:21,095 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:30:21,233 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-09 05:30:21,233 __main__.sample_reviews_polar.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer +2023-05-09 05:30:21,234 __main__ DEBUG Running garbage collection... +2023-05-09 05:30:21,325 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:30:21,326 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-09 05:30:21,326 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-09 05:30:21,326 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... +2023-05-09 05:31:30,893 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:33:50,078 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-09 05:33:50,078 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:34:56,163 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.108 mean absolute error, 4.432 mean squared error, 0.622 recall of 1.0, 0.7794486215538847 precision of 1.0, 0.824 recall of 5.0, 0.6855241264559068 precision of 5.0, 723 perfect matches. +2023-05-09 05:34:56,426 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.108 mean absolute error, 4.432 mean squared error, 0.622 recall of 1.0, 0.7794486215538847 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.824 recall of 5.0, 0.6855241264559068 precision of 5.0, 723 perfect matches. +2023-05-09 05:34:56,427 __main__ DEBUG Running garbage collection... +2023-05-09 05:34:56,546 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:34:56,547 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-09 05:34:56,547 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-09 05:34:56,547 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... +2023-05-09 05:36:04,859 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:38:17,222 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-09 05:38:17,223 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:39:20,559 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.928 mean absolute error, 3.712 mean squared error, 0.67 recall of 1.0, 0.8333333333333334 precision of 1.0, 0.866 recall of 5.0, 0.7240802675585284 precision of 5.0, 768 perfect matches. +2023-05-09 05:39:20,712 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.928 mean absolute error, 3.712 mean squared error, 0.67 recall of 1.0, 0.8333333333333334 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.866 recall of 5.0, 0.7240802675585284 precision of 5.0, 768 perfect matches. +2023-05-09 05:39:20,712 __main__ DEBUG Running garbage collection... +2023-05-09 05:39:20,811 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:39:20,812 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-09 05:39:20,812 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-09 05:39:20,812 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... +2023-05-09 05:40:35,014 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:43:39,342 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-09 05:43:39,342 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:44:54,911 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.032 mean absolute error, 4.128 mean squared error, 0.636 recall of 1.0, 0.8071065989847716 precision of 1.0, 0.848 recall of 5.0, 0.6996699669966997 precision of 5.0, 742 perfect matches. +2023-05-09 05:44:55,149 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.032 mean absolute error, 4.128 mean squared error, 0.636 recall of 1.0, 0.8071065989847716 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.848 recall of 5.0, 0.6996699669966997 precision of 5.0, 742 perfect matches. +2023-05-09 05:44:55,150 __main__ DEBUG Running garbage collection... +2023-05-09 05:44:55,248 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:44:55,248 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-09 05:44:55,249 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-09 05:44:55,249 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... +2023-05-09 05:46:07,367 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:48:23,922 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-09 05:48:23,951 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:49:25,731 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.004 mean absolute error, 4.016 mean squared error, 0.654 recall of 1.0, 0.8074074074074075 precision of 1.0, 0.844 recall of 5.0, 0.7092436974789916 precision of 5.0, 749 perfect matches. +2023-05-09 05:49:26,193 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.004 mean absolute error, 4.016 mean squared error, 0.654 recall of 1.0, 0.8074074074074075 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.844 recall of 5.0, 0.7092436974789916 precision of 5.0, 749 perfect matches. +2023-05-09 05:49:26,194 __main__ DEBUG Running garbage collection... +2023-05-09 05:49:26,290 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:49:26,291 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-09 05:49:26,291 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-09 05:49:26,291 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 05:50:41,860 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:53:36,023 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-09 05:53:36,023 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 05:54:52,105 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.128 mean absolute error, 4.512 mean squared error, 0.59 recall of 1.0, 0.793010752688172 precision of 1.0, 0.846 recall of 5.0, 0.6735668789808917 precision of 5.0, 718 perfect matches. +2023-05-09 05:54:52,772 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.128 mean absolute error, 4.512 mean squared error, 0.59 recall of 1.0, 0.793010752688172 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.846 recall of 5.0, 0.6735668789808917 precision of 5.0, 718 perfect matches. +2023-05-09 05:54:52,773 __main__ DEBUG Running garbage collection... +2023-05-09 05:54:52,871 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 05:54:52,872 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-09 05:54:52,872 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-09 05:54:52,872 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... +2023-05-09 05:56:32,519 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 05:59:51,873 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-09 05:59:51,874 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 06:01:16,768 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 4.896 mean squared error, 0.554 recall of 1.0, 0.7694444444444445 precision of 1.0, 0.834 recall of 5.0, 0.6515625 precision of 5.0, 694 perfect matches. +2023-05-09 06:01:16,926 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 4.896 mean squared error, 0.554 recall of 1.0, 0.7694444444444445 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.834 recall of 5.0, 0.6515625 precision of 5.0, 694 perfect matches. +2023-05-09 06:01:16,926 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer +2023-05-09 06:01:16,927 __main__ DEBUG Running garbage collection... +2023-05-09 06:01:17,046 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 06:01:17,046 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-09 06:01:17,047 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-09 06:01:17,047 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-09 06:02:34,491 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:04:32,576 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 06:04:33,318 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 +2023-05-09 06:04:33,318 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-09 06:05:51,081 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:06:34,775 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-09 06:06:35,321 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Run #3 +2023-05-09 06:06:35,321 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-09 06:07:55,286 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:14:39,979 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training succeeded! +2023-05-09 06:14:40,002 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 06:15:50,611 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.89 recall of 1.0, 0.859073359073359 precision of 1.0, 0.854 recall of 5.0, 0.8858921161825726 precision of 5.0, 872 perfect matches. +2023-05-09 06:15:51,013 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.89 recall of 1.0, 0.859073359073359 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.854 recall of 5.0, 0.8858921161825726 precision of 5.0, 872 perfect matches. +2023-05-09 06:15:51,014 __main__ DEBUG Running garbage collection... +2023-05-09 06:15:51,163 __main__ DEBUG Collected 47085 pieces of garbage! +2023-05-09 06:15:51,175 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-09 06:15:51,176 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-09 06:15:51,177 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-05-09 06:17:09,650 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:24:21,933 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-09 06:24:21,962 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 06:25:30,721 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.898 recall of 1.0, 0.8821218074656189 precision of 1.0, 0.88 recall of 5.0, 0.8961303462321792 precision of 5.0, 889 perfect matches. +2023-05-09 06:25:31,300 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.898 recall of 1.0, 0.8821218074656189 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.88 recall of 5.0, 0.8961303462321792 precision of 5.0, 889 perfect matches. +2023-05-09 06:25:31,301 __main__ DEBUG Running garbage collection... +2023-05-09 06:25:31,457 __main__ DEBUG Collected 46358 pieces of garbage! +2023-05-09 06:25:31,470 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-09 06:25:31,475 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-09 06:25:31,476 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-05-09 06:26:47,300 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:33:56,798 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-09 06:33:56,834 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 06:35:07,707 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.536 mean absolute error, 2.144 mean squared error, 0.944 recall of 1.0, 0.8166089965397924 precision of 1.0, 0.788 recall of 5.0, 0.933649289099526 precision of 5.0, 866 perfect matches. +2023-05-09 06:35:08,066 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.536 mean absolute error, 2.144 mean squared error, 0.944 recall of 1.0, 0.8166089965397924 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.788 recall of 5.0, 0.933649289099526 precision of 5.0, 866 perfect matches. +2023-05-09 06:35:08,066 __main__ DEBUG Running garbage collection... +2023-05-09 06:35:08,225 __main__ DEBUG Collected 44183 pieces of garbage! +2023-05-09 06:35:08,238 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-09 06:35:08,243 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-09 06:35:08,243 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-05-09 06:36:25,951 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:42:55,523 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-09 06:42:55,539 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 06:44:04,905 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.468 mean absolute error, 1.872 mean squared error, 0.942 recall of 1.0, 0.8425760286225402 precision of 1.0, 0.824 recall of 5.0, 0.9342403628117913 precision of 5.0, 883 perfect matches. +2023-05-09 06:44:05,412 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.468 mean absolute error, 1.872 mean squared error, 0.942 recall of 1.0, 0.8425760286225402 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.824 recall of 5.0, 0.9342403628117913 precision of 5.0, 883 perfect matches. +2023-05-09 06:44:05,413 __main__ DEBUG Running garbage collection... +2023-05-09 06:44:05,586 __main__ DEBUG Collected 42002 pieces of garbage! +2023-05-09 06:44:05,591 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-09 06:44:05,593 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-09 06:44:05,594 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 06:45:25,931 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:46:04,740 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 06:46:04,982 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 +2023-05-09 06:46:04,982 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 06:47:22,959 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:48:34,068 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 ERROR Training failed, trying again with a different dataset... +2023-05-09 06:48:34,437 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Run #3 +2023-05-09 06:48:34,437 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 06:49:51,948 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training sentiment analyzer: tokenizer> +2023-05-09 06:55:52,382 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training succeeded! +2023-05-09 06:55:52,408 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 06:57:06,513 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.448 mean absolute error, 1.792 mean squared error, 0.91 recall of 1.0, 0.8716475095785441 precision of 1.0, 0.866 recall of 5.0, 0.9058577405857741 precision of 5.0, 888 perfect matches. +2023-05-09 06:57:06,856 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.448 mean absolute error, 1.792 mean squared error, 0.91 recall of 1.0, 0.8716475095785441 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.866 recall of 5.0, 0.9058577405857741 precision of 5.0, 888 perfect matches. +2023-05-09 06:57:06,857 __main__ DEBUG Running garbage collection... +2023-05-09 06:57:07,008 __main__ DEBUG Collected 5792 pieces of garbage! +2023-05-09 06:57:07,010 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-09 06:57:07,010 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-09 06:57:07,011 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... +2023-05-09 06:58:34,466 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 07:04:33,082 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-09 07:04:33,091 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 07:05:43,028 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.852 recall of 1.0, 0.8875 precision of 1.0, 0.892 recall of 5.0, 0.8576923076923076 precision of 5.0, 872 perfect matches. +2023-05-09 07:05:43,377 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.852 recall of 1.0, 0.8875 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.892 recall of 5.0, 0.8576923076923076 precision of 5.0, 872 perfect matches. +2023-05-09 07:05:43,377 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer +2023-05-09 07:05:43,378 __main__ DEBUG Running garbage collection... +2023-05-09 07:05:43,558 __main__ DEBUG Collected 33314 pieces of garbage! +2023-05-09 07:05:43,564 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-09 07:05:43,565 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-09 07:05:43,566 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-05-09 07:07:00,569 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 07:13:17,955 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-09 07:13:17,981 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 07:14:27,458 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.504 mean absolute error, 2.016 mean squared error, 0.874 recall of 1.0, 0.874 precision of 1.0, 0.874 recall of 5.0, 0.874 precision of 5.0, 874 perfect matches. +2023-05-09 07:14:27,930 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.504 mean absolute error, 2.016 mean squared error, 0.874 recall of 1.0, 0.874 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.874 recall of 5.0, 0.874 precision of 5.0, 874 perfect matches. +2023-05-09 07:14:27,931 __main__ DEBUG Running garbage collection... +2023-05-09 07:14:28,117 __main__ DEBUG Collected 34039 pieces of garbage! +2023-05-09 07:14:28,129 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-09 07:14:28,131 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-09 07:14:28,131 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-05-09 07:15:45,785 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 07:16:00,914 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 07:16:01,101 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 +2023-05-09 07:16:01,101 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-05-09 07:17:19,284 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 07:23:16,121 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-05-09 07:23:16,159 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 07:24:25,715 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.894 recall of 1.0, 0.8662790697674418 precision of 1.0, 0.862 recall of 5.0, 0.890495867768595 precision of 5.0, 878 perfect matches. +2023-05-09 07:24:26,053 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.894 recall of 1.0, 0.8662790697674418 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.862 recall of 5.0, 0.890495867768595 precision of 5.0, 878 perfect matches. +2023-05-09 07:24:26,053 __main__ DEBUG Running garbage collection... +2023-05-09 07:24:26,273 __main__ DEBUG Collected 51429 pieces of garbage! +2023-05-09 07:24:26,287 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-09 07:24:26,291 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-09 07:24:26,292 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-05-09 07:25:47,348 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 07:32:07,563 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-09 07:32:07,564 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 07:33:18,119 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.564 mean absolute error, 2.256 mean squared error, 0.844 recall of 1.0, 0.8701030927835052 precision of 1.0, 0.874 recall of 5.0, 0.8485436893203884 precision of 5.0, 859 perfect matches. +2023-05-09 07:33:18,611 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.564 mean absolute error, 2.256 mean squared error, 0.844 recall of 1.0, 0.8701030927835052 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.874 recall of 5.0, 0.8485436893203884 precision of 5.0, 859 perfect matches. +2023-05-09 07:33:18,611 __main__ DEBUG Running garbage collection... +2023-05-09 07:33:18,802 __main__ DEBUG Collected 29691 pieces of garbage! +2023-05-09 07:33:18,805 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-09 07:33:18,807 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-09 07:33:18,807 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-05-09 07:34:34,054 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 07:40:55,750 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-09 07:40:55,777 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 07:42:07,019 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.432 mean absolute error, 1.728 mean squared error, 0.924 recall of 1.0, 0.868421052631579 precision of 1.0, 0.86 recall of 5.0, 0.9188034188034188 precision of 5.0, 892 perfect matches. +2023-05-09 07:42:07,563 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.432 mean absolute error, 1.728 mean squared error, 0.924 recall of 1.0, 0.868421052631579 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.9188034188034188 precision of 5.0, 892 perfect matches. +2023-05-09 07:42:07,563 __main__ DEBUG Running garbage collection... +2023-05-09 07:42:07,757 __main__ DEBUG Collected 26805 pieces of garbage! +2023-05-09 07:42:07,766 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-09 07:42:07,767 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-09 07:42:07,767 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 07:43:58,532 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 07:50:08,508 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-09 07:50:08,543 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 07:51:18,903 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.862 recall of 1.0, 0.8941908713692946 precision of 1.0, 0.898 recall of 5.0, 0.8667953667953668 precision of 5.0, 880 perfect matches. +2023-05-09 07:51:19,340 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.862 recall of 1.0, 0.8941908713692946 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.898 recall of 5.0, 0.8667953667953668 precision of 5.0, 880 perfect matches. +2023-05-09 07:51:19,341 __main__ DEBUG Running garbage collection... +2023-05-09 07:51:19,540 __main__ DEBUG Collected 24622 pieces of garbage! +2023-05-09 07:51:19,544 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-09 07:51:19,544 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-09 07:51:19,544 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... +2023-05-09 07:52:35,419 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 07:58:56,842 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-09 07:58:56,877 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:00:07,076 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.908 recall of 1.0, 0.8566037735849057 precision of 1.0, 0.848 recall of 5.0, 0.902127659574468 precision of 5.0, 878 perfect matches. +2023-05-09 08:00:07,459 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.908 recall of 1.0, 0.8566037735849057 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.848 recall of 5.0, 0.902127659574468 precision of 5.0, 878 perfect matches. +2023-05-09 08:00:07,460 __main__.sample_reviews_varied DEBUG Selected sample_func: sample_reviews_varied +2023-05-09 08:00:07,461 __main__.sample_reviews_varied.ThreeCheat DEBUG Selected SentimentAnalyzer: ThreeCheat +2023-05-09 08:00:07,461 __main__ DEBUG Running garbage collection... +2023-05-09 08:00:07,669 __main__ DEBUG Collected 22445 pieces of garbage! +2023-05-09 08:00:07,672 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-09 08:00:07,673 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 DEBUG Run #1 +2023-05-09 08:00:07,673 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 DEBUG Instantiating ThreeCheat with PlainTokenizer... +2023-05-09 08:03:03,476 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:03:03,476 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-09 08:03:03,477 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:03:03,663 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:03:03,813 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:03:03,813 __main__ DEBUG Running garbage collection... +2023-05-09 08:03:04,003 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:03:04,004 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-09 08:03:04,004 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-09 08:03:04,004 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 DEBUG Instantiating ThreeCheat with LowercaseTokenizer... +2023-05-09 08:05:57,016 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:05:57,016 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-09 08:05:57,016 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:05:57,207 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:05:57,353 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:05:57,354 __main__ DEBUG Running garbage collection... +2023-05-09 08:05:57,538 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:05:57,538 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-09 08:05:57,538 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-09 08:05:57,538 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 DEBUG Instantiating ThreeCheat with NLTKWordTokenizer... +2023-05-09 08:08:49,781 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:08:49,782 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-09 08:08:49,782 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:08:49,985 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:08:50,133 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:08:50,133 __main__ DEBUG Running garbage collection... +2023-05-09 08:08:50,320 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:08:50,321 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-09 08:08:50,321 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 DEBUG Run #1 +2023-05-09 08:08:50,321 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 DEBUG Instantiating ThreeCheat with PottsTokenizer... +2023-05-09 08:11:45,418 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:11:45,418 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-09 08:11:45,418 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:11:45,616 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:11:45,756 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:11:45,757 __main__ DEBUG Running garbage collection... +2023-05-09 08:11:45,944 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:11:45,944 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-09 08:11:45,944 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-09 08:11:45,944 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Instantiating ThreeCheat with PottsTokenizerWithNegation... +2023-05-09 08:14:40,650 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:14:40,650 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-09 08:14:40,651 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:14:40,853 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:14:40,999 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:14:40,999 __main__ DEBUG Running garbage collection... +2023-05-09 08:14:41,180 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:14:41,181 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-09 08:14:41,181 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-09 08:14:41,182 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 DEBUG Instantiating ThreeCheat with HuggingBertTokenizer... +2023-05-09 08:18:26,378 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:18:26,396 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-09 08:18:26,396 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:18:26,582 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:18:26,754 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-09 08:18:26,755 __main__.sample_reviews_varied.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer +2023-05-09 08:18:26,755 __main__ DEBUG Running garbage collection... +2023-05-09 08:18:26,940 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:18:26,940 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-09 08:18:26,940 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-09 08:18:26,941 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... +2023-05-09 08:22:46,955 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:25:57,693 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-09 08:25:57,693 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:28:40,246 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.301 mean absolute error, 3.171 mean squared error, 0.36 recall of 1.0, 0.496551724137931 precision of 1.0, 0.31 recall of 2.0, 0.2616033755274262 precision of 2.0, 0.075 recall of 3.0, 0.19480519480519481 precision of 3.0, 0.095 recall of 4.0, 0.3064516129032258 precision of 4.0, 0.7 recall of 5.0, 0.29227557411273486 precision of 5.0, 308 perfect matches. +2023-05-09 08:28:40,683 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.301 mean absolute error, 3.171 mean squared error, 0.36 recall of 1.0, 0.496551724137931 precision of 1.0, 0.31 recall of 2.0, 0.2616033755274262 precision of 2.0, 0.075 recall of 3.0, 0.19480519480519481 precision of 3.0, 0.095 recall of 4.0, 0.3064516129032258 precision of 4.0, 0.7 recall of 5.0, 0.29227557411273486 precision of 5.0, 308 perfect matches. +2023-05-09 08:28:40,684 __main__ DEBUG Running garbage collection... +2023-05-09 08:28:40,892 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:28:40,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-09 08:28:40,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-09 08:28:40,893 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... +2023-05-09 08:31:44,828 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:34:36,824 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-09 08:34:36,824 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:37:07,157 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.285 mean absolute error, 3.297 mean squared error, 0.385 recall of 1.0, 0.4666666666666667 precision of 1.0, 0.285 recall of 2.0, 0.2835820895522388 precision of 2.0, 0.18 recall of 3.0, 0.3564356435643564 precision of 3.0, 0.19 recall of 4.0, 0.5135135135135135 precision of 4.0, 0.72 recall of 5.0, 0.3137254901960784 precision of 5.0, 352 perfect matches. +2023-05-09 08:37:07,339 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.285 mean absolute error, 3.297 mean squared error, 0.385 recall of 1.0, 0.4666666666666667 precision of 1.0, 0.285 recall of 2.0, 0.2835820895522388 precision of 2.0, 0.18 recall of 3.0, 0.3564356435643564 precision of 3.0, 0.19 recall of 4.0, 0.5135135135135135 precision of 4.0, 0.72 recall of 5.0, 0.3137254901960784 precision of 5.0, 352 perfect matches. +2023-05-09 08:37:07,339 __main__ DEBUG Running garbage collection... +2023-05-09 08:37:07,596 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:37:07,597 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-09 08:37:07,597 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-09 08:37:07,597 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... +2023-05-09 08:40:06,874 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:43:39,911 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-09 08:43:39,911 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:46:29,247 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.242 mean absolute error, 3.052 mean squared error, 0.405 recall of 1.0, 0.4308510638297872 precision of 1.0, 0.225 recall of 2.0, 0.2631578947368421 precision of 2.0, 0.175 recall of 3.0, 0.35714285714285715 precision of 3.0, 0.11 recall of 4.0, 0.36065573770491804 precision of 4.0, 0.76 recall of 5.0, 0.3153526970954357 precision of 5.0, 335 perfect matches. +2023-05-09 08:46:29,377 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.242 mean absolute error, 3.052 mean squared error, 0.405 recall of 1.0, 0.4308510638297872 precision of 1.0, 0.225 recall of 2.0, 0.2631578947368421 precision of 2.0, 0.175 recall of 3.0, 0.35714285714285715 precision of 3.0, 0.11 recall of 4.0, 0.36065573770491804 precision of 4.0, 0.76 recall of 5.0, 0.3153526970954357 precision of 5.0, 335 perfect matches. +2023-05-09 08:46:29,377 __main__ DEBUG Running garbage collection... +2023-05-09 08:46:29,583 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:46:29,583 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-09 08:46:29,583 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-09 08:46:29,584 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... +2023-05-09 08:49:24,027 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 08:52:17,921 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-09 08:52:17,922 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 08:54:40,904 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 3.024 mean squared error, 0.445 recall of 1.0, 0.4734042553191489 precision of 1.0, 0.155 recall of 2.0, 0.31 precision of 2.0, 0.3 recall of 3.0, 0.2803738317757009 precision of 3.0, 0.075 recall of 4.0, 0.3125 precision of 4.0, 0.665 recall of 5.0, 0.29555555555555557 precision of 5.0, 328 perfect matches. +2023-05-09 08:54:41,058 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 3.024 mean squared error, 0.445 recall of 1.0, 0.4734042553191489 precision of 1.0, 0.155 recall of 2.0, 0.31 precision of 2.0, 0.3 recall of 3.0, 0.2803738317757009 precision of 3.0, 0.075 recall of 4.0, 0.3125 precision of 4.0, 0.665 recall of 5.0, 0.29555555555555557 precision of 5.0, 328 perfect matches. +2023-05-09 08:54:41,059 __main__ DEBUG Running garbage collection... +2023-05-09 08:54:41,281 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 08:54:41,282 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-09 08:54:41,282 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-09 08:54:41,282 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 08:57:38,658 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 09:01:15,148 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-09 09:01:15,165 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 09:04:10,565 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.345 mean absolute error, 3.415 mean squared error, 0.35 recall of 1.0, 0.4268292682926829 precision of 1.0, 0.205 recall of 2.0, 0.23699421965317918 precision of 2.0, 0.14 recall of 3.0, 0.3010752688172043 precision of 3.0, 0.11 recall of 4.0, 0.3548387096774194 precision of 4.0, 0.77 recall of 5.0, 0.3031496062992126 precision of 5.0, 315 perfect matches. +2023-05-09 09:04:10,850 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.345 mean absolute error, 3.415 mean squared error, 0.35 recall of 1.0, 0.4268292682926829 precision of 1.0, 0.205 recall of 2.0, 0.23699421965317918 precision of 2.0, 0.14 recall of 3.0, 0.3010752688172043 precision of 3.0, 0.11 recall of 4.0, 0.3548387096774194 precision of 4.0, 0.77 recall of 5.0, 0.3031496062992126 precision of 5.0, 315 perfect matches. +2023-05-09 09:04:10,851 __main__ DEBUG Running garbage collection... +2023-05-09 09:04:11,061 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 09:04:11,061 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-09 09:04:11,061 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-09 09:04:11,061 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... +2023-05-09 09:07:08,716 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 09:11:17,098 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-09 09:11:17,099 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 09:14:31,177 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.263 mean absolute error, 3.127 mean squared error, 0.36 recall of 1.0, 0.4675324675324675 precision of 1.0, 0.24 recall of 2.0, 0.35555555555555557 precision of 2.0, 0.2 recall of 3.0, 0.26143790849673204 precision of 3.0, 0.1 recall of 4.0, 0.3125 precision of 4.0, 0.77 recall of 5.0, 0.3117408906882591 precision of 5.0, 334 perfect matches. +2023-05-09 09:14:31,338 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.263 mean absolute error, 3.127 mean squared error, 0.36 recall of 1.0, 0.4675324675324675 precision of 1.0, 0.24 recall of 2.0, 0.35555555555555557 precision of 2.0, 0.2 recall of 3.0, 0.26143790849673204 precision of 3.0, 0.1 recall of 4.0, 0.3125 precision of 4.0, 0.77 recall of 5.0, 0.3117408906882591 precision of 5.0, 334 perfect matches. +2023-05-09 09:14:31,338 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer +2023-05-09 09:14:31,339 __main__ DEBUG Running garbage collection... +2023-05-09 09:14:31,554 __main__ DEBUG Collected 0 pieces of garbage! +2023-05-09 09:14:31,554 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-09 09:14:31,554 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-09 09:14:31,554 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-09 09:17:30,540 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 09:18:40,721 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 09:18:40,908 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 +2023-05-09 09:18:40,908 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-09 09:21:40,669 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 09:22:07,772 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-09 09:22:07,920 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Run #3 +2023-05-09 09:22:07,920 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... +2023-05-09 09:24:56,782 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-09 09:31:31,796 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training succeeded! +2023-05-09 09:31:31,824 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 09:32:47,881 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.282 mean absolute error, 3.128 mean squared error, 0.925 recall of 1.0, 0.3140916808149406 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.74 recall of 5.0, 0.36009732360097324 precision of 5.0, 333 perfect matches. +2023-05-09 09:32:48,206 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.282 mean absolute error, 3.128 mean squared error, 0.925 recall of 1.0, 0.3140916808149406 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.74 recall of 5.0, 0.36009732360097324 precision of 5.0, 333 perfect matches. +2023-05-09 09:32:48,207 __main__ DEBUG Running garbage collection... +2023-05-09 09:32:48,436 __main__ DEBUG Collected 31129 pieces of garbage! +2023-05-09 09:32:48,449 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-09 09:32:48,451 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-09 09:32:48,451 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... +2023-05-09 09:36:07,346 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 09:42:26,127 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-09 09:42:26,154 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 09:43:41,102 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.242 mean absolute error, 2.968 mean squared error, 0.87 recall of 1.0, 0.3246268656716418 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.805 recall of 5.0, 0.34698275862068967 precision of 5.0, 335 perfect matches. +2023-05-09 09:43:41,775 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.242 mean absolute error, 2.968 mean squared error, 0.87 recall of 1.0, 0.3246268656716418 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.805 recall of 5.0, 0.34698275862068967 precision of 5.0, 335 perfect matches. +2023-05-09 09:43:41,776 __main__ DEBUG Running garbage collection... +2023-05-09 09:43:41,988 __main__ DEBUG Collected 5802 pieces of garbage! +2023-05-09 09:43:41,990 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-09 09:43:41,990 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-09 09:43:41,990 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-05-09 09:46:39,859 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 09:48:45,696 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 09:48:46,213 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 +2023-05-09 09:48:46,213 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-05-09 09:51:39,487 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 09:52:54,457 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-09 09:52:55,527 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Run #3 +2023-05-09 09:52:55,528 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... +2023-05-09 09:55:58,843 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-09 10:02:28,560 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training succeeded! +2023-05-09 10:02:28,581 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 10:03:52,406 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.198 mean absolute error, 2.792 mean squared error, 0.84 recall of 1.0, 0.3605150214592275 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.895 recall of 5.0, 0.3352059925093633 precision of 5.0, 347 perfect matches. +2023-05-09 10:03:52,817 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.198 mean absolute error, 2.792 mean squared error, 0.84 recall of 1.0, 0.3605150214592275 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.895 recall of 5.0, 0.3352059925093633 precision of 5.0, 347 perfect matches. +2023-05-09 10:03:52,817 __main__ DEBUG Running garbage collection... +2023-05-09 10:03:53,070 __main__ DEBUG Collected 40546 pieces of garbage! +2023-05-09 10:03:53,082 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-09 10:03:53,083 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-09 10:03:53,084 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-05-09 10:07:26,539 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 10:09:20,147 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 10:09:21,785 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 +2023-05-09 10:09:21,786 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... +2023-05-09 10:13:13,168 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 10:19:23,799 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-09 10:19:23,800 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 10:20:39,244 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 2.896 mean squared error, 0.8 recall of 1.0, 0.3686635944700461 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.91 recall of 5.0, 0.3215547703180212 precision of 5.0, 342 perfect matches. +2023-05-09 10:20:39,562 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 2.896 mean squared error, 0.8 recall of 1.0, 0.3686635944700461 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.91 recall of 5.0, 0.3215547703180212 precision of 5.0, 342 perfect matches. +2023-05-09 10:20:39,563 __main__ DEBUG Running garbage collection... +2023-05-09 10:20:39,804 __main__ DEBUG Collected 23174 pieces of garbage! +2023-05-09 10:20:39,812 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-09 10:20:39,812 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-09 10:20:39,812 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 10:23:31,580 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 10:29:43,475 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-09 10:29:43,476 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 10:30:51,406 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.202 mean absolute error, 2.808 mean squared error, 0.925 recall of 1.0, 0.29983792544570503 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.785 recall of 5.0, 0.40992167101827676 precision of 5.0, 342 perfect matches. +2023-05-09 10:30:51,539 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.202 mean absolute error, 2.808 mean squared error, 0.925 recall of 1.0, 0.29983792544570503 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.785 recall of 5.0, 0.40992167101827676 precision of 5.0, 342 perfect matches. +2023-05-09 10:30:51,539 __main__ DEBUG Running garbage collection... +2023-05-09 10:30:51,871 __main__ DEBUG Collected 85765 pieces of garbage! +2023-05-09 10:30:51,894 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-09 10:30:51,899 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-09 10:30:51,902 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... +2023-05-09 10:33:38,228 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 10:39:53,425 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-09 10:39:53,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 10:41:01,628 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.186 mean absolute error, 2.744 mean squared error, 0.865 recall of 1.0, 0.36041666666666666 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.9 recall of 5.0, 0.34615384615384615 precision of 5.0, 353 perfect matches. +2023-05-09 10:41:01,765 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.186 mean absolute error, 2.744 mean squared error, 0.865 recall of 1.0, 0.36041666666666666 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.9 recall of 5.0, 0.34615384615384615 precision of 5.0, 353 perfect matches. +2023-05-09 10:41:01,766 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer +2023-05-09 10:41:01,766 __main__ DEBUG Running garbage collection... +2023-05-09 10:41:02,097 __main__ DEBUG Collected 85743 pieces of garbage! +2023-05-09 10:41:02,120 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer +2023-05-09 10:41:02,126 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 +2023-05-09 10:41:02,131 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... +2023-05-09 10:43:48,227 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 10:50:25,072 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-09 10:50:25,073 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 10:51:32,722 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.864 mean absolute error, 1.446 mean squared error, 0.49 recall of 1.0, 0.5798816568047337 precision of 1.0, 0.395 recall of 2.0, 0.30859375 precision of 2.0, 0.225 recall of 3.0, 0.22277227722772278 precision of 3.0, 0.405 recall of 4.0, 0.32661290322580644 precision of 4.0, 0.35 recall of 5.0, 0.56 precision of 5.0, 373 perfect matches. +2023-05-09 10:51:32,846 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.864 mean absolute error, 1.446 mean squared error, 0.49 recall of 1.0, 0.5798816568047337 precision of 1.0, 0.395 recall of 2.0, 0.30859375 precision of 2.0, 0.225 recall of 3.0, 0.22277227722772278 precision of 3.0, 0.405 recall of 4.0, 0.32661290322580644 precision of 4.0, 0.35 recall of 5.0, 0.56 precision of 5.0, 373 perfect matches. +2023-05-09 10:51:32,847 __main__ DEBUG Running garbage collection... +2023-05-09 10:51:33,183 __main__ DEBUG Collected 87209 pieces of garbage! +2023-05-09 10:51:33,200 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer +2023-05-09 10:51:33,205 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 +2023-05-09 10:51:33,206 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-05-09 10:54:21,941 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 10:54:39,553 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 10:54:39,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 +2023-05-09 10:54:39,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... +2023-05-09 10:57:25,389 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 11:04:00,421 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-05-09 11:04:00,421 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 11:05:08,302 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.856 mean absolute error, 1.754 mean squared error, 0.63 recall of 1.0, 0.5185185185185185 precision of 1.0, 0.25 recall of 2.0, 0.44642857142857145 precision of 2.0, 0.42 recall of 3.0, 0.38009049773755654 precision of 3.0, 0.38 recall of 4.0, 0.3486238532110092 precision of 4.0, 0.545 recall of 5.0, 0.529126213592233 precision of 5.0, 445 perfect matches. +2023-05-09 11:05:08,423 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.856 mean absolute error, 1.754 mean squared error, 0.63 recall of 1.0, 0.5185185185185185 precision of 1.0, 0.25 recall of 2.0, 0.44642857142857145 precision of 2.0, 0.42 recall of 3.0, 0.38009049773755654 precision of 3.0, 0.38 recall of 4.0, 0.3486238532110092 precision of 4.0, 0.545 recall of 5.0, 0.529126213592233 precision of 5.0, 445 perfect matches. +2023-05-09 11:05:08,424 __main__ DEBUG Running garbage collection... +2023-05-09 11:05:08,683 __main__ DEBUG Collected 10851 pieces of garbage! +2023-05-09 11:05:08,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer +2023-05-09 11:05:08,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 +2023-05-09 11:05:08,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... +2023-05-09 11:07:59,265 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 11:14:33,575 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-09 11:14:33,576 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 11:15:43,028 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.779 mean absolute error, 1.257 mean squared error, 0.43 recall of 1.0, 0.688 precision of 1.0, 0.18 recall of 2.0, 0.3076923076923077 precision of 2.0, 0.505 recall of 3.0, 0.2961876832844575 precision of 3.0, 0.465 recall of 4.0, 0.3576923076923077 precision of 4.0, 0.51 recall of 5.0, 0.6496815286624203 precision of 5.0, 418 perfect matches. +2023-05-09 11:15:43,154 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.779 mean absolute error, 1.257 mean squared error, 0.43 recall of 1.0, 0.688 precision of 1.0, 0.18 recall of 2.0, 0.3076923076923077 precision of 2.0, 0.505 recall of 3.0, 0.2961876832844575 precision of 3.0, 0.465 recall of 4.0, 0.3576923076923077 precision of 4.0, 0.51 recall of 5.0, 0.6496815286624203 precision of 5.0, 418 perfect matches. +2023-05-09 11:15:43,154 __main__ DEBUG Running garbage collection... +2023-05-09 11:15:43,502 __main__ DEBUG Collected 87215 pieces of garbage! +2023-05-09 11:15:43,521 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer +2023-05-09 11:15:43,524 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 +2023-05-09 11:15:43,524 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-05-09 11:18:32,841 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 11:20:35,375 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 11:20:35,508 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 +2023-05-09 11:20:35,508 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-05-09 11:23:48,209 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 11:24:54,284 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-09 11:24:54,412 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 DEBUG Run #3 +2023-05-09 11:24:54,413 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... +2023-05-09 11:27:43,056 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-09 11:33:55,614 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Training succeeded! +2023-05-09 11:33:55,615 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 11:35:03,758 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.805 mean absolute error, 1.473 mean squared error, 0.535 recall of 1.0, 0.5846994535519126 precision of 1.0, 0.455 recall of 2.0, 0.4008810572687225 precision of 2.0, 0.42 recall of 3.0, 0.3514644351464435 precision of 3.0, 0.365 recall of 4.0, 0.3476190476190476 precision of 4.0, 0.44 recall of 5.0, 0.624113475177305 precision of 5.0, 443 perfect matches. +2023-05-09 11:35:03,885 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.805 mean absolute error, 1.473 mean squared error, 0.535 recall of 1.0, 0.5846994535519126 precision of 1.0, 0.455 recall of 2.0, 0.4008810572687225 precision of 2.0, 0.42 recall of 3.0, 0.3514644351464435 precision of 3.0, 0.365 recall of 4.0, 0.3476190476190476 precision of 4.0, 0.44 recall of 5.0, 0.624113475177305 precision of 5.0, 443 perfect matches. +2023-05-09 11:35:03,886 __main__ DEBUG Running garbage collection... +2023-05-09 11:35:04,190 __main__ DEBUG Collected 28962 pieces of garbage! +2023-05-09 11:35:04,201 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation +2023-05-09 11:35:04,201 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 +2023-05-09 11:35:04,202 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 11:37:50,279 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 11:39:06,137 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-05-09 11:39:06,291 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 +2023-05-09 11:39:06,291 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... +2023-05-09 11:42:32,775 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-05-09 11:49:09,170 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! +2023-05-09 11:49:09,173 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 11:50:18,948 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.901 mean absolute error, 1.833 mean squared error, 0.435 recall of 1.0, 0.46774193548387094 precision of 1.0, 0.28 recall of 2.0, 0.3660130718954248 precision of 2.0, 0.355 recall of 3.0, 0.3776595744680851 precision of 3.0, 0.415 recall of 4.0, 0.33739837398373984 precision of 4.0, 0.58 recall of 5.0, 0.5110132158590308 precision of 5.0, 413 perfect matches. +2023-05-09 11:50:19,347 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.901 mean absolute error, 1.833 mean squared error, 0.435 recall of 1.0, 0.46774193548387094 precision of 1.0, 0.28 recall of 2.0, 0.3660130718954248 precision of 2.0, 0.355 recall of 3.0, 0.3776595744680851 precision of 3.0, 0.415 recall of 4.0, 0.33739837398373984 precision of 4.0, 0.58 recall of 5.0, 0.5110132158590308 precision of 5.0, 413 perfect matches. +2023-05-09 11:50:19,347 __main__ DEBUG Running garbage collection... +2023-05-09 11:50:21,295 __main__ DEBUG Collected 88141 pieces of garbage! +2023-05-09 11:50:21,314 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer +2023-05-09 11:50:21,317 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 +2023-05-09 11:50:21,317 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... +2023-05-09 11:53:15,418 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-09 11:59:36,817 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-09 11:59:36,817 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-09 12:00:44,982 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.817 mean absolute error, 1.453 mean squared error, 0.535 recall of 1.0, 0.5376884422110553 precision of 1.0, 0.34 recall of 2.0, 0.3333333333333333 precision of 2.0, 0.4 recall of 3.0, 0.32786885245901637 precision of 3.0, 0.31 recall of 4.0, 0.389937106918239 precision of 4.0, 0.54 recall of 5.0, 0.5567010309278351 precision of 5.0, 425 perfect matches. +2023-05-09 12:00:45,106 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.817 mean absolute error, 1.453 mean squared error, 0.535 recall of 1.0, 0.5376884422110553 precision of 1.0, 0.34 recall of 2.0, 0.3333333333333333 precision of 2.0, 0.4 recall of 3.0, 0.32786885245901637 precision of 3.0, 0.31 recall of 4.0, 0.389937106918239 precision of 4.0, 0.54 recall of 5.0, 0.5567010309278351 precision of 5.0, 425 perfect matches. diff --git a/data/logs/run-success4.tsv b/data/logs/run-success4.tsv new file mode 100644 index 0000000..69aeed7 --- /dev/null +++ b/data/logs/run-success4.tsv @@ -0,0 +1,309 @@ +2023-05-10 02:43:35,852 __main__ INFO Started unimore-bda-6 in PRODUCTION mode! +2023-05-10 02:44:58,691 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 02:44:58,692 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-10 02:44:58,692 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 02:44:58,756 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:44:58,887 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 02:44:58,887 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:46:09,238 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 02:46:09,238 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-10 02:46:09,238 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 02:46:09,301 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:46:09,429 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 02:46:09,429 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:47:14,564 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 02:47:14,564 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-10 02:47:14,564 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 02:47:14,629 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:47:14,759 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 02:47:14,760 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:48:22,805 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 02:48:22,806 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-10 02:48:22,806 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 02:48:22,872 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:48:23,016 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 02:48:23,016 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:49:31,383 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 02:49:31,383 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-10 02:49:31,383 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 02:49:31,445 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:49:31,574 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-10 02:49:31,574 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:50:40,086 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 02:50:40,086 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-10 02:50:40,087 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 02:50:40,150 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:50:40,277 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 02:50:40,277 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-10 02:51:48,760 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 02:54:07,227 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-10 02:54:07,227 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 02:55:08,694 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.932 mean absolute error, 3.728 mean squared error, 0.676 recall of 1.0, 0.8264058679706602 precision of 1.0, 0.858 recall of 5.0, 0.7258883248730964 precision of 5.0, 767 perfect matches. +2023-05-10 02:55:08,845 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 02:55:08,846 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.932 mean absolute error, 3.728 mean squared error, 0.676 recall of 1.0, 0.8264058679706602 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.858 recall of 5.0, 0.7258883248730964 precision of 5.0, 767 perfect matches. +2023-05-10 02:56:17,610 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 02:58:39,299 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-10 02:58:39,299 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 02:59:40,009 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.06 mean absolute error, 4.24 mean squared error, 0.61 recall of 1.0, 0.8133333333333334 precision of 1.0, 0.86 recall of 5.0, 0.688 precision of 5.0, 735 perfect matches. +2023-05-10 02:59:40,137 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 02:59:40,137 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.06 mean absolute error, 4.24 mean squared error, 0.61 recall of 1.0, 0.8133333333333334 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.688 precision of 5.0, 735 perfect matches. +2023-05-10 03:00:46,448 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:03:42,339 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-10 03:03:42,339 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 03:04:52,676 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.108 mean absolute error, 4.432 mean squared error, 0.608 recall of 1.0, 0.7896103896103897 precision of 1.0, 0.838 recall of 5.0, 0.6813008130081301 precision of 5.0, 723 perfect matches. +2023-05-10 03:04:52,801 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 03:04:52,801 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.108 mean absolute error, 4.432 mean squared error, 0.608 recall of 1.0, 0.7896103896103897 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.838 recall of 5.0, 0.6813008130081301 precision of 5.0, 723 perfect matches. +2023-05-10 03:05:58,634 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:08:13,605 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-10 03:08:13,605 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 03:09:11,730 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.076 mean absolute error, 4.304 mean squared error, 0.62 recall of 1.0, 0.7969151670951157 precision of 1.0, 0.842 recall of 5.0, 0.6890343698854338 precision of 5.0, 731 perfect matches. +2023-05-10 03:09:11,866 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 03:09:11,867 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.076 mean absolute error, 4.304 mean squared error, 0.62 recall of 1.0, 0.7969151670951157 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.842 recall of 5.0, 0.6890343698854338 precision of 5.0, 731 perfect matches. +2023-05-10 03:10:22,481 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:13:07,679 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-10 03:13:07,680 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 03:14:19,041 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.196 mean absolute error, 4.784 mean squared error, 0.582 recall of 1.0, 0.7637795275590551 precision of 1.0, 0.82 recall of 5.0, 0.6623586429725363 precision of 5.0, 701 perfect matches. +2023-05-10 03:14:19,229 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-10 03:14:19,230 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.196 mean absolute error, 4.784 mean squared error, 0.582 recall of 1.0, 0.7637795275590551 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.82 recall of 5.0, 0.6623586429725363 precision of 5.0, 701 perfect matches. +2023-05-10 03:15:46,197 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:18:56,976 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-10 03:18:56,977 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 03:20:17,188 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.056 mean absolute error, 4.224 mean squared error, 0.598 recall of 1.0, 0.8259668508287292 precision of 1.0, 0.874 recall of 5.0, 0.6849529780564263 precision of 5.0, 736 perfect matches. +2023-05-10 03:20:17,319 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 03:20:17,319 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.056 mean absolute error, 4.224 mean squared error, 0.598 recall of 1.0, 0.8259668508287292 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.874 recall of 5.0, 0.6849529780564263 precision of 5.0, 736 perfect matches. +2023-05-10 03:21:25,068 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:22:31,887 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-10 03:23:40,059 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:29:02,549 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training succeeded! +2023-05-10 03:29:02,549 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 03:30:09,274 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.568 mean absolute error, 2.272 mean squared error, 0.87 recall of 1.0, 0.849609375 precision of 1.0, 0.846 recall of 5.0, 0.8668032786885246 precision of 5.0, 858 perfect matches. +2023-05-10 03:30:09,403 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 03:30:09,403 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.568 mean absolute error, 2.272 mean squared error, 0.87 recall of 1.0, 0.849609375 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.846 recall of 5.0, 0.8668032786885246 precision of 5.0, 858 perfect matches. +2023-05-10 03:31:19,299 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:36:52,094 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-10 03:36:52,095 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 03:37:57,538 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.844 recall of 1.0, 0.9055793991416309 precision of 1.0, 0.912 recall of 5.0, 0.8539325842696629 precision of 5.0, 878 perfect matches. +2023-05-10 03:37:57,664 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 03:37:57,664 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.844 recall of 1.0, 0.9055793991416309 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.912 recall of 5.0, 0.8539325842696629 precision of 5.0, 878 perfect matches. +2023-05-10 03:39:05,712 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:45:01,541 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-10 03:45:01,542 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 03:46:09,282 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.872 recall of 1.0, 0.8952772073921971 precision of 1.0, 0.898 recall of 5.0, 0.8752436647173489 precision of 5.0, 885 perfect matches. +2023-05-10 03:46:09,528 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 03:46:09,529 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.872 recall of 1.0, 0.8952772073921971 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.898 recall of 5.0, 0.8752436647173489 precision of 5.0, 885 perfect matches. +2023-05-10 03:47:19,709 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:48:34,195 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-10 03:49:49,069 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-10 03:55:26,273 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-10 03:55:26,283 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 03:56:32,420 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.496 mean absolute error, 1.984 mean squared error, 0.858 recall of 1.0, 0.8900414937759336 precision of 1.0, 0.894 recall of 5.0, 0.862934362934363 precision of 5.0, 876 perfect matches. +2023-05-10 03:56:32,652 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 03:56:32,653 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.496 mean absolute error, 1.984 mean squared error, 0.858 recall of 1.0, 0.8900414937759336 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.894 recall of 5.0, 0.862934362934363 precision of 5.0, 876 perfect matches. +2023-05-10 03:57:44,651 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 04:03:25,274 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-10 04:03:25,274 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 04:04:31,838 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.856 recall of 1.0, 0.8842975206611571 precision of 1.0, 0.888 recall of 5.0, 0.8604651162790697 precision of 5.0, 872 perfect matches. +2023-05-10 04:04:32,023 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-10 04:04:32,024 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.856 recall of 1.0, 0.8842975206611571 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.888 recall of 5.0, 0.8604651162790697 precision of 5.0, 872 perfect matches. +2023-05-10 04:05:39,080 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 04:11:19,086 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-10 04:11:19,086 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 04:12:25,320 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.9 recall of 1.0, 0.8620689655172413 precision of 1.0, 0.856 recall of 5.0, 0.895397489539749 precision of 5.0, 878 perfect matches. +2023-05-10 04:12:25,446 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 04:12:25,446 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.9 recall of 1.0, 0.8620689655172413 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.856 recall of 5.0, 0.895397489539749 precision of 5.0, 878 perfect matches. +2023-05-10 04:13:33,200 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 04:19:15,778 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-10 04:19:15,778 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 04:20:21,539 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.492 mean absolute error, 1.968 mean squared error, 0.89 recall of 1.0, 0.8674463937621832 precision of 1.0, 0.864 recall of 5.0, 0.8870636550308009 precision of 5.0, 877 perfect matches. +2023-05-10 04:20:21,676 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 04:20:21,677 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.492 mean absolute error, 1.968 mean squared error, 0.89 recall of 1.0, 0.8674463937621832 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.864 recall of 5.0, 0.8870636550308009 precision of 5.0, 877 perfect matches. +2023-05-10 04:21:26,908 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 04:27:14,282 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-10 04:27:14,283 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 04:28:20,645 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.544 mean absolute error, 2.176 mean squared error, 0.892 recall of 1.0, 0.8446969696969697 precision of 1.0, 0.836 recall of 5.0, 0.885593220338983 precision of 5.0, 864 perfect matches. +2023-05-10 04:28:21,047 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 04:28:21,047 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.544 mean absolute error, 2.176 mean squared error, 0.892 recall of 1.0, 0.8446969696969697 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.836 recall of 5.0, 0.885593220338983 precision of 5.0, 864 perfect matches. +2023-05-10 04:29:40,053 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 04:31:20,580 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-10 04:32:24,903 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-10 04:38:31,942 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training succeeded! +2023-05-10 04:38:31,943 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 04:39:39,172 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.496 mean absolute error, 1.984 mean squared error, 0.866 recall of 1.0, 0.8836734693877552 precision of 1.0, 0.886 recall of 5.0, 0.8686274509803922 precision of 5.0, 876 perfect matches. +2023-05-10 04:39:39,311 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 04:39:39,312 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.496 mean absolute error, 1.984 mean squared error, 0.866 recall of 1.0, 0.8836734693877552 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.886 recall of 5.0, 0.8686274509803922 precision of 5.0, 876 perfect matches. +2023-05-10 04:40:48,231 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 04:46:58,176 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-10 04:46:58,176 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 04:48:03,765 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.872 recall of 1.0, 0.8879837067209776 precision of 1.0, 0.89 recall of 5.0, 0.8742632612966601 precision of 5.0, 881 perfect matches. +2023-05-10 04:48:03,893 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 04:48:03,893 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.872 recall of 1.0, 0.8879837067209776 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.89 recall of 5.0, 0.8742632612966601 precision of 5.0, 881 perfect matches. +2023-05-10 04:49:11,878 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 04:55:31,159 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-10 04:55:31,159 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 04:56:36,492 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.882 recall of 1.0, 0.8945233265720081 precision of 1.0, 0.896 recall of 5.0, 0.883629191321499 precision of 5.0, 889 perfect matches. +2023-05-10 04:56:36,615 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-10 04:56:36,615 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.882 recall of 1.0, 0.8945233265720081 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.896 recall of 5.0, 0.883629191321499 precision of 5.0, 889 perfect matches. +2023-05-10 04:57:44,990 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:04:10,315 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-10 05:04:10,315 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:05:15,975 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.56 mean absolute error, 2.24 mean squared error, 0.854 recall of 1.0, 0.8643724696356275 precision of 1.0, 0.866 recall of 5.0, 0.8557312252964426 precision of 5.0, 860 perfect matches. +2023-05-10 05:05:16,189 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:05:16,190 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.56 mean absolute error, 2.24 mean squared error, 0.854 recall of 1.0, 0.8643724696356275 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.866 recall of 5.0, 0.8557312252964426 precision of 5.0, 860 perfect matches. +2023-05-10 05:08:02,528 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:08:02,529 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-10 05:08:02,529 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:08:02,594 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:08:02,742 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:08:02,742 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:10:46,903 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:10:46,903 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-10 05:10:46,903 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:10:46,972 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:10:47,103 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:10:47,103 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:13:28,479 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:13:28,479 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-10 05:13:28,479 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:13:28,542 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:13:28,669 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:13:28,669 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:16:18,137 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:16:18,138 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-10 05:16:18,138 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:16:18,223 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:16:18,353 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:16:18,353 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:19:07,108 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:19:07,108 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-10 05:19:07,109 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:19:07,173 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:19:07,317 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-10 05:19:07,317 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:21:47,202 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:21:47,203 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-10 05:21:47,203 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:21:47,265 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:21:47,393 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:21:47,393 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-10 05:24:33,310 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:27:32,731 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-10 05:27:32,731 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:30:02,836 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 3.07 mean squared error, 0.385 recall of 1.0, 0.5620437956204379 precision of 1.0, 0.27 recall of 2.0, 0.4186046511627907 precision of 2.0, 0.25 recall of 3.0, 0.3067484662576687 precision of 3.0, 0.155 recall of 4.0, 0.4025974025974026 precision of 4.0, 0.76 recall of 5.0, 0.3076923076923077 precision of 5.0, 364 perfect matches. +2023-05-10 05:30:02,961 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:30:02,962 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 3.07 mean squared error, 0.385 recall of 1.0, 0.5620437956204379 precision of 1.0, 0.27 recall of 2.0, 0.4186046511627907 precision of 2.0, 0.25 recall of 3.0, 0.3067484662576687 precision of 3.0, 0.155 recall of 4.0, 0.4025974025974026 precision of 4.0, 0.76 recall of 5.0, 0.3076923076923077 precision of 5.0, 364 perfect matches. +2023-05-10 05:32:46,093 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:35:49,963 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-10 05:35:49,963 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:38:20,816 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.322 mean absolute error, 3.384 mean squared error, 0.3 recall of 1.0, 0.46875 precision of 1.0, 0.205 recall of 2.0, 0.31297709923664124 precision of 2.0, 0.245 recall of 3.0, 0.3475177304964539 precision of 3.0, 0.1 recall of 4.0, 0.2898550724637681 precision of 4.0, 0.76 recall of 5.0, 0.2862523540489642 precision of 5.0, 322 perfect matches. +2023-05-10 05:38:20,941 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:38:20,941 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.322 mean absolute error, 3.384 mean squared error, 0.3 recall of 1.0, 0.46875 precision of 1.0, 0.205 recall of 2.0, 0.31297709923664124 precision of 2.0, 0.245 recall of 3.0, 0.3475177304964539 precision of 3.0, 0.1 recall of 4.0, 0.2898550724637681 precision of 4.0, 0.76 recall of 5.0, 0.2862523540489642 precision of 5.0, 322 perfect matches. +2023-05-10 05:41:28,214 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:45:18,280 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-10 05:45:18,280 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:48:07,889 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.223 mean absolute error, 2.863 mean squared error, 0.485 recall of 1.0, 0.4041666666666667 precision of 1.0, 0.185 recall of 2.0, 0.29838709677419356 precision of 2.0, 0.15 recall of 3.0, 0.21428571428571427 precision of 3.0, 0.14 recall of 4.0, 0.345679012345679 precision of 4.0, 0.685 recall of 5.0, 0.3301204819277108 precision of 5.0, 329 perfect matches. +2023-05-10 05:48:08,021 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:48:08,021 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.223 mean absolute error, 2.863 mean squared error, 0.485 recall of 1.0, 0.4041666666666667 precision of 1.0, 0.185 recall of 2.0, 0.29838709677419356 precision of 2.0, 0.15 recall of 3.0, 0.21428571428571427 precision of 3.0, 0.14 recall of 4.0, 0.345679012345679 precision of 4.0, 0.685 recall of 5.0, 0.3301204819277108 precision of 5.0, 329 perfect matches. +2023-05-10 05:50:57,649 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 05:53:55,869 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-10 05:53:55,869 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 05:56:18,730 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.3 mean absolute error, 3.272 mean squared error, 0.39 recall of 1.0, 0.46987951807228917 precision of 1.0, 0.25 recall of 2.0, 0.31446540880503143 precision of 2.0, 0.22 recall of 3.0, 0.3333333333333333 precision of 3.0, 0.065 recall of 4.0, 0.2653061224489796 precision of 4.0, 0.715 recall of 5.0, 0.2894736842105263 precision of 5.0, 328 perfect matches. +2023-05-10 05:56:18,859 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 05:56:18,859 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.3 mean absolute error, 3.272 mean squared error, 0.39 recall of 1.0, 0.46987951807228917 precision of 1.0, 0.25 recall of 2.0, 0.31446540880503143 precision of 2.0, 0.22 recall of 3.0, 0.3333333333333333 precision of 3.0, 0.065 recall of 4.0, 0.2653061224489796 precision of 4.0, 0.715 recall of 5.0, 0.2894736842105263 precision of 5.0, 328 perfect matches. +2023-05-10 05:59:09,123 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 06:02:46,351 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-10 06:02:46,351 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 06:05:35,637 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.262 mean absolute error, 3.148 mean squared error, 0.35 recall of 1.0, 0.48951048951048953 precision of 1.0, 0.28 recall of 2.0, 0.3076923076923077 precision of 2.0, 0.12 recall of 3.0, 0.34782608695652173 precision of 3.0, 0.14 recall of 4.0, 0.3181818181818182 precision of 4.0, 0.8 recall of 5.0, 0.3088803088803089 precision of 5.0, 338 perfect matches. +2023-05-10 06:05:35,890 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-10 06:05:35,890 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.262 mean absolute error, 3.148 mean squared error, 0.35 recall of 1.0, 0.48951048951048953 precision of 1.0, 0.28 recall of 2.0, 0.3076923076923077 precision of 2.0, 0.12 recall of 3.0, 0.34782608695652173 precision of 3.0, 0.14 recall of 4.0, 0.3181818181818182 precision of 4.0, 0.8 recall of 5.0, 0.3088803088803089 precision of 5.0, 338 perfect matches. +2023-05-10 06:08:27,660 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 06:12:37,328 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-10 06:12:37,328 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 06:15:45,376 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.37 mean absolute error, 3.576 mean squared error, 0.265 recall of 1.0, 0.4774774774774775 precision of 1.0, 0.305 recall of 2.0, 0.291866028708134 precision of 2.0, 0.185 recall of 3.0, 0.3394495412844037 precision of 3.0, 0.105 recall of 4.0, 0.38181818181818183 precision of 4.0, 0.725 recall of 5.0, 0.2810077519379845 precision of 5.0, 317 perfect matches. +2023-05-10 06:15:45,507 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 06:15:45,507 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.37 mean absolute error, 3.576 mean squared error, 0.265 recall of 1.0, 0.4774774774774775 precision of 1.0, 0.305 recall of 2.0, 0.291866028708134 precision of 2.0, 0.185 recall of 3.0, 0.3394495412844037 precision of 3.0, 0.105 recall of 4.0, 0.38181818181818183 precision of 4.0, 0.725 recall of 5.0, 0.2810077519379845 precision of 5.0, 317 perfect matches. +2023-05-10 06:18:38,050 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 06:24:28,753 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-10 06:24:28,754 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 06:25:37,417 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.268 mean absolute error, 3.072 mean squared error, 0.835 recall of 1.0, 0.3280943025540275 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.81 recall of 5.0, 0.329938900203666 precision of 5.0, 329 perfect matches. +2023-05-10 06:25:37,551 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 06:25:37,551 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.268 mean absolute error, 3.072 mean squared error, 0.835 recall of 1.0, 0.3280943025540275 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.81 recall of 5.0, 0.329938900203666 precision of 5.0, 329 perfect matches. +2023-05-10 06:28:21,653 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 06:29:46,700 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-10 06:32:38,509 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-10 06:38:30,106 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-05-10 06:38:30,106 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 06:39:35,821 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.268 mean absolute error, 3.072 mean squared error, 0.95 recall of 1.0, 0.2954898911353033 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.73 recall of 5.0, 0.40896358543417366 precision of 5.0, 336 perfect matches. +2023-05-10 06:39:36,499 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 06:39:36,500 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.268 mean absolute error, 3.072 mean squared error, 0.95 recall of 1.0, 0.2954898911353033 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.73 recall of 5.0, 0.40896358543417366 precision of 5.0, 336 perfect matches. +2023-05-10 06:42:29,066 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 06:44:07,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-10 06:46:52,248 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-10 06:49:06,453 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-10 06:51:46,951 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-10 06:57:59,348 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training succeeded! +2023-05-10 06:57:59,349 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 06:59:06,402 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.262 mean absolute error, 3.048 mean squared error, 0.835 recall of 1.0, 0.35084033613445376 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.835 recall of 5.0, 0.3187022900763359 precision of 5.0, 334 perfect matches. +2023-05-10 06:59:06,643 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 06:59:06,643 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.262 mean absolute error, 3.048 mean squared error, 0.835 recall of 1.0, 0.35084033613445376 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.835 recall of 5.0, 0.3187022900763359 precision of 5.0, 334 perfect matches. +2023-05-10 07:01:52,956 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 07:03:13,863 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-10 07:06:04,939 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-10 07:12:15,494 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-10 07:12:15,494 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 07:13:21,378 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.198 mean absolute error, 2.792 mean squared error, 0.875 recall of 1.0, 0.32710280373831774 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.36989247311827955 precision of 5.0, 347 perfect matches. +2023-05-10 07:13:21,534 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 07:13:21,534 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.198 mean absolute error, 2.792 mean squared error, 0.875 recall of 1.0, 0.32710280373831774 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.36989247311827955 precision of 5.0, 347 perfect matches. +2023-05-10 07:16:12,097 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 07:22:13,792 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-10 07:22:13,824 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 07:23:21,430 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.26 mean absolute error, 3.04 mean squared error, 0.78 recall of 1.0, 0.37681159420289856 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.905 recall of 5.0, 0.30887372013651876 precision of 5.0, 337 perfect matches. +2023-05-10 07:23:22,038 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-10 07:23:22,039 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.26 mean absolute error, 3.04 mean squared error, 0.78 recall of 1.0, 0.37681159420289856 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.905 recall of 5.0, 0.30887372013651876 precision of 5.0, 337 perfect matches. +2023-05-10 07:26:44,423 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 07:33:19,940 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-10 07:33:19,940 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 07:34:25,839 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.166 mean absolute error, 2.664 mean squared error, 0.885 recall of 1.0, 0.33270676691729323 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.88 recall of 5.0, 0.37606837606837606 precision of 5.0, 353 perfect matches. +2023-05-10 07:34:26,008 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 07:34:26,008 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.166 mean absolute error, 2.664 mean squared error, 0.885 recall of 1.0, 0.33270676691729323 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.88 recall of 5.0, 0.37606837606837606 precision of 5.0, 353 perfect matches. +2023-05-10 07:37:14,490 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 07:43:43,502 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-10 07:43:43,514 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 07:44:50,262 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.898 mean absolute error, 1.814 mean squared error, 0.465 recall of 1.0, 0.5470588235294118 precision of 1.0, 0.285 recall of 2.0, 0.3275862068965517 precision of 2.0, 0.4 recall of 3.0, 0.33755274261603374 precision of 3.0, 0.46 recall of 4.0, 0.36507936507936506 precision of 4.0, 0.45 recall of 5.0, 0.5389221556886228 precision of 5.0, 412 perfect matches. +2023-05-10 07:44:50,825 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 07:44:50,825 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.898 mean absolute error, 1.814 mean squared error, 0.465 recall of 1.0, 0.5470588235294118 precision of 1.0, 0.285 recall of 2.0, 0.3275862068965517 precision of 2.0, 0.4 recall of 3.0, 0.33755274261603374 precision of 3.0, 0.46 recall of 4.0, 0.36507936507936506 precision of 4.0, 0.45 recall of 5.0, 0.5389221556886228 precision of 5.0, 412 perfect matches. +2023-05-10 07:47:44,517 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 07:54:02,202 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-10 07:54:02,202 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 07:55:08,378 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.802 mean absolute error, 1.4 mean squared error, 0.49 recall of 1.0, 0.5632183908045977 precision of 1.0, 0.4 recall of 2.0, 0.40404040404040403 precision of 2.0, 0.385 recall of 3.0, 0.3181818181818182 precision of 3.0, 0.425 recall of 4.0, 0.34274193548387094 precision of 4.0, 0.435 recall of 5.0, 0.6304347826086957 precision of 5.0, 427 perfect matches. +2023-05-10 07:55:08,555 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 07:55:08,555 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.802 mean absolute error, 1.4 mean squared error, 0.49 recall of 1.0, 0.5632183908045977 precision of 1.0, 0.4 recall of 2.0, 0.40404040404040403 precision of 2.0, 0.385 recall of 3.0, 0.3181818181818182 precision of 3.0, 0.425 recall of 4.0, 0.34274193548387094 precision of 4.0, 0.435 recall of 5.0, 0.6304347826086957 precision of 5.0, 427 perfect matches. +2023-05-10 08:00:05,468 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 08:06:41,780 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-10 08:06:41,802 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 08:07:52,749 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.818 mean absolute error, 1.5 mean squared error, 0.64 recall of 1.0, 0.5161290322580645 precision of 1.0, 0.335 recall of 2.0, 0.335 precision of 2.0, 0.305 recall of 3.0, 0.3674698795180723 precision of 3.0, 0.35 recall of 4.0, 0.3645833333333333 precision of 4.0, 0.54 recall of 5.0, 0.5567010309278351 precision of 5.0, 434 perfect matches. +2023-05-10 08:07:53,300 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 08:07:53,300 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.818 mean absolute error, 1.5 mean squared error, 0.64 recall of 1.0, 0.5161290322580645 precision of 1.0, 0.335 recall of 2.0, 0.335 precision of 2.0, 0.305 recall of 3.0, 0.3674698795180723 precision of 3.0, 0.35 recall of 4.0, 0.3645833333333333 precision of 4.0, 0.54 recall of 5.0, 0.5567010309278351 precision of 5.0, 434 perfect matches. +2023-05-10 08:10:37,480 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 08:12:17,017 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-10 08:14:55,878 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-10 08:21:08,091 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-10 08:21:08,119 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 08:22:16,428 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.818 mean absolute error, 1.508 mean squared error, 0.535 recall of 1.0, 0.5944444444444444 precision of 1.0, 0.265 recall of 2.0, 0.38405797101449274 precision of 2.0, 0.315 recall of 3.0, 0.3058252427184466 precision of 3.0, 0.375 recall of 4.0, 0.33783783783783783 precision of 4.0, 0.665 recall of 5.0, 0.5236220472440944 precision of 5.0, 431 perfect matches. +2023-05-10 08:22:16,691 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 08:22:16,691 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.818 mean absolute error, 1.508 mean squared error, 0.535 recall of 1.0, 0.5944444444444444 precision of 1.0, 0.265 recall of 2.0, 0.38405797101449274 precision of 2.0, 0.315 recall of 3.0, 0.3058252427184466 precision of 3.0, 0.375 recall of 4.0, 0.33783783783783783 precision of 4.0, 0.665 recall of 5.0, 0.5236220472440944 precision of 5.0, 431 perfect matches. +2023-05-10 08:26:02,329 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 08:28:06,424 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-05-10 08:32:22,638 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-05-10 08:33:54,843 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 ERROR Training failed, trying again with a different dataset... +2023-05-10 08:37:32,588 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training sentiment analyzer: tokenizer> +2023-05-10 08:43:37,800 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training succeeded! +2023-05-10 08:43:37,800 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 08:44:51,705 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.811 mean absolute error, 1.505 mean squared error, 0.565 recall of 1.0, 0.5330188679245284 precision of 1.0, 0.43 recall of 2.0, 0.4321608040201005 precision of 2.0, 0.38 recall of 3.0, 0.3958333333333333 precision of 3.0, 0.31 recall of 4.0, 0.3229166666666667 precision of 4.0, 0.55 recall of 5.0, 0.5365853658536586 precision of 5.0, 447 perfect matches. +2023-05-10 08:44:51,876 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-10 08:44:51,876 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.811 mean absolute error, 1.505 mean squared error, 0.565 recall of 1.0, 0.5330188679245284 precision of 1.0, 0.43 recall of 2.0, 0.4321608040201005 precision of 2.0, 0.38 recall of 3.0, 0.3958333333333333 precision of 3.0, 0.31 recall of 4.0, 0.3229166666666667 precision of 4.0, 0.55 recall of 5.0, 0.5365853658536586 precision of 5.0, 447 perfect matches. +2023-05-10 08:47:42,022 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-10 08:53:33,282 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-10 08:53:33,282 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-10 08:54:41,498 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.782 mean absolute error, 1.446 mean squared error, 0.495 recall of 1.0, 0.5210526315789473 precision of 1.0, 0.295 recall of 2.0, 0.38562091503267976 precision of 2.0, 0.46 recall of 3.0, 0.3484848484848485 precision of 3.0, 0.475 recall of 4.0, 0.4148471615720524 precision of 4.0, 0.52 recall of 5.0, 0.6341463414634146 precision of 5.0, 449 perfect matches. +2023-05-10 08:54:41,783 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-10 08:54:41,783 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.782 mean absolute error, 1.446 mean squared error, 0.495 recall of 1.0, 0.5210526315789473 precision of 1.0, 0.295 recall of 2.0, 0.38562091503267976 precision of 2.0, 0.46 recall of 3.0, 0.3484848484848485 precision of 3.0, 0.475 recall of 4.0, 0.4148471615720524 precision of 4.0, 0.52 recall of 5.0, 0.6341463414634146 precision of 5.0, 449 perfect matches. diff --git a/data/logs/run-success5.tsv b/data/logs/run-success5.tsv new file mode 100644 index 0000000..4911504 --- /dev/null +++ b/data/logs/run-success5.tsv @@ -0,0 +1,313 @@ +2023-05-11 02:48:14,590 __main__ INFO Started unimore-bda-6 in PRODUCTION mode! +2023-05-11 02:49:48,525 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 02:49:48,526 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-11 02:49:48,526 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 02:49:48,592 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:49:48,734 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 02:49:48,735 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:50:55,949 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 02:50:55,949 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-11 02:50:55,950 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 02:50:56,012 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:50:56,145 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 02:50:56,146 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:52:02,513 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 02:52:02,513 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-11 02:52:02,513 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 02:52:02,585 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:52:02,719 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 02:52:02,720 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:53:07,430 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 02:53:07,430 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-11 02:53:07,430 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 02:53:07,493 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:53:07,625 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 02:53:07,625 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:54:10,919 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 02:54:10,919 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-11 02:54:10,920 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 02:54:10,981 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:54:11,118 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-11 02:54:11,118 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:55:20,447 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 02:55:20,447 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-11 02:55:20,447 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 02:55:20,511 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:55:20,642 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 02:55:20,642 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-11 02:56:25,464 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 02:58:39,936 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-11 02:58:39,936 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 02:59:42,928 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.112 mean absolute error, 4.448 mean squared error, 0.6 recall of 1.0, 0.7936507936507936 precision of 1.0, 0.844 recall of 5.0, 0.6784565916398714 precision of 5.0, 722 perfect matches. +2023-05-11 02:59:43,056 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 02:59:43,056 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.112 mean absolute error, 4.448 mean squared error, 0.6 recall of 1.0, 0.7936507936507936 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.844 recall of 5.0, 0.6784565916398714 precision of 5.0, 722 perfect matches. +2023-05-11 03:00:49,870 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:02:52,781 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-11 03:02:52,782 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 03:03:51,289 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.844 mean absolute error, 3.376 mean squared error, 0.732 recall of 1.0, 0.8261851015801355 precision of 1.0, 0.846 recall of 5.0, 0.7594254937163375 precision of 5.0, 789 perfect matches. +2023-05-11 03:03:51,434 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 03:03:51,434 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.844 mean absolute error, 3.376 mean squared error, 0.732 recall of 1.0, 0.8261851015801355 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.846 recall of 5.0, 0.7594254937163375 precision of 5.0, 789 perfect matches. +2023-05-11 03:04:58,344 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:07:37,201 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-11 03:07:37,201 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 03:08:44,021 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.016 mean absolute error, 4.064 mean squared error, 0.636 recall of 1.0, 0.8153846153846154 precision of 1.0, 0.856 recall of 5.0, 0.7016393442622951 precision of 5.0, 746 perfect matches. +2023-05-11 03:08:44,148 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 03:08:44,148 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.016 mean absolute error, 4.064 mean squared error, 0.636 recall of 1.0, 0.8153846153846154 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.856 recall of 5.0, 0.7016393442622951 precision of 5.0, 746 perfect matches. +2023-05-11 03:09:48,163 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:11:49,951 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-11 03:11:49,951 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 03:12:44,566 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.876 mean absolute error, 3.504 mean squared error, 0.676 recall of 1.0, 0.8556962025316456 precision of 1.0, 0.886 recall of 5.0, 0.7322314049586777 precision of 5.0, 781 perfect matches. +2023-05-11 03:12:44,692 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 03:12:44,693 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.876 mean absolute error, 3.504 mean squared error, 0.676 recall of 1.0, 0.8556962025316456 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.886 recall of 5.0, 0.7322314049586777 precision of 5.0, 781 perfect matches. +2023-05-11 03:13:49,881 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:16:25,770 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-11 03:16:25,770 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 03:17:35,774 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.14 mean absolute error, 4.56 mean squared error, 0.588 recall of 1.0, 0.7882037533512064 precision of 1.0, 0.842 recall of 5.0, 0.671451355661882 precision of 5.0, 715 perfect matches. +2023-05-11 03:17:35,900 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-11 03:17:35,901 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.14 mean absolute error, 4.56 mean squared error, 0.588 recall of 1.0, 0.7882037533512064 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.842 recall of 5.0, 0.671451355661882 precision of 5.0, 715 perfect matches. +2023-05-11 03:18:42,935 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:21:38,474 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-11 03:21:38,474 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 03:22:56,163 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 5.024 mean squared error, 0.566 recall of 1.0, 0.7447368421052631 precision of 1.0, 0.806 recall of 5.0, 0.65 precision of 5.0, 686 perfect matches. +2023-05-11 03:22:56,290 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 03:22:56,290 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 5.024 mean squared error, 0.566 recall of 1.0, 0.7447368421052631 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.806 recall of 5.0, 0.65 precision of 5.0, 686 perfect matches. +2023-05-11 03:24:02,140 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:29:36,914 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-11 03:29:36,914 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 03:30:44,840 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.592 mean absolute error, 2.368 mean squared error, 0.882 recall of 1.0, 0.8320754716981132 precision of 1.0, 0.822 recall of 5.0, 0.874468085106383 precision of 5.0, 852 perfect matches. +2023-05-11 03:30:44,974 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 03:30:44,975 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.592 mean absolute error, 2.368 mean squared error, 0.882 recall of 1.0, 0.8320754716981132 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.822 recall of 5.0, 0.874468085106383 precision of 5.0, 852 perfect matches. +2023-05-11 03:31:49,377 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:32:16,324 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-11 03:33:20,469 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:38:59,808 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-05-11 03:38:59,808 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 03:40:06,999 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.54 mean absolute error, 2.16 mean squared error, 0.892 recall of 1.0, 0.8462998102466793 precision of 1.0, 0.838 recall of 5.0, 0.8858350951374208 precision of 5.0, 865 perfect matches. +2023-05-11 03:40:07,158 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 03:40:07,159 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.54 mean absolute error, 2.16 mean squared error, 0.892 recall of 1.0, 0.8462998102466793 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.838 recall of 5.0, 0.8858350951374208 precision of 5.0, 865 perfect matches. +2023-05-11 03:41:10,657 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:43:06,232 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-11 03:44:05,808 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:45:57,648 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-11 03:47:02,141 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:48:52,237 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-05-11 03:49:53,364 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:50:31,650 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 ERROR Training failed, trying again with a different dataset... +2023-05-11 03:51:37,108 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Training sentiment analyzer: tokenizer> +2023-05-11 03:57:18,501 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Training succeeded! +2023-05-11 03:57:18,501 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 03:58:26,860 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.832 recall of 1.0, 0.8946236559139785 precision of 1.0, 0.902 recall of 5.0, 0.8429906542056075 precision of 5.0, 867 perfect matches. +2023-05-11 03:58:26,989 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 03:58:26,989 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.832 recall of 1.0, 0.8946236559139785 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.902 recall of 5.0, 0.8429906542056075 precision of 5.0, 867 perfect matches. +2023-05-11 03:59:31,548 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 04:05:13,976 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-11 04:05:13,976 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 04:06:21,379 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.882 recall of 1.0, 0.8563106796116505 precision of 1.0, 0.852 recall of 5.0, 0.8783505154639175 precision of 5.0, 867 perfect matches. +2023-05-11 04:06:21,519 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 04:06:21,520 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.882 recall of 1.0, 0.8563106796116505 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.852 recall of 5.0, 0.8783505154639175 precision of 5.0, 867 perfect matches. +2023-05-11 04:07:28,406 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 04:13:09,604 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-11 04:13:09,605 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 04:14:16,831 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.456 mean absolute error, 1.824 mean squared error, 0.878 recall of 1.0, 0.8922764227642277 precision of 1.0, 0.894 recall of 5.0, 0.8799212598425197 precision of 5.0, 886 perfect matches. +2023-05-11 04:14:16,980 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-11 04:14:16,980 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.456 mean absolute error, 1.824 mean squared error, 0.878 recall of 1.0, 0.8922764227642277 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.894 recall of 5.0, 0.8799212598425197 precision of 5.0, 886 perfect matches. +2023-05-11 04:15:23,775 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 04:21:02,974 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-11 04:21:02,975 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 04:22:10,742 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.632 mean absolute error, 2.528 mean squared error, 0.894 recall of 1.0, 0.8097826086956522 precision of 1.0, 0.79 recall of 5.0, 0.8816964285714286 precision of 5.0, 842 perfect matches. +2023-05-11 04:22:10,870 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 04:22:10,870 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.632 mean absolute error, 2.528 mean squared error, 0.894 recall of 1.0, 0.8097826086956522 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.79 recall of 5.0, 0.8816964285714286 precision of 5.0, 842 perfect matches. +2023-05-11 04:23:16,722 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 04:28:49,797 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-11 04:28:49,798 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 04:29:56,264 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.508 mean absolute error, 2.032 mean squared error, 0.896 recall of 1.0, 0.8565965583173997 precision of 1.0, 0.85 recall of 5.0, 0.8909853249475891 precision of 5.0, 873 perfect matches. +2023-05-11 04:29:56,391 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 04:29:56,392 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.508 mean absolute error, 2.032 mean squared error, 0.896 recall of 1.0, 0.8565965583173997 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.85 recall of 5.0, 0.8909853249475891 precision of 5.0, 873 perfect matches. +2023-05-11 04:31:01,629 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 04:36:38,357 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-11 04:36:38,358 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 04:37:45,390 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.552 mean absolute error, 2.208 mean squared error, 0.838 recall of 1.0, 0.8802521008403361 precision of 1.0, 0.886 recall of 5.0, 0.8454198473282443 precision of 5.0, 862 perfect matches. +2023-05-11 04:37:45,519 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 04:37:45,519 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.552 mean absolute error, 2.208 mean squared error, 0.838 recall of 1.0, 0.8802521008403361 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.886 recall of 5.0, 0.8454198473282443 precision of 5.0, 862 perfect matches. +2023-05-11 04:38:49,338 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 04:44:27,594 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-11 04:44:27,595 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 04:45:35,966 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.52 mean absolute error, 2.08 mean squared error, 0.87 recall of 1.0, 0.87 precision of 1.0, 0.87 recall of 5.0, 0.87 precision of 5.0, 870 perfect matches. +2023-05-11 04:45:36,333 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 04:45:36,333 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.52 mean absolute error, 2.08 mean squared error, 0.87 recall of 1.0, 0.87 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.87 recall of 5.0, 0.87 precision of 5.0, 870 perfect matches. +2023-05-11 04:46:42,506 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 04:48:23,021 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-11 04:49:26,469 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-11 04:55:07,754 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-11 04:55:07,770 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 04:56:14,805 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.468 mean absolute error, 1.872 mean squared error, 0.908 recall of 1.0, 0.8647619047619047 precision of 1.0, 0.858 recall of 5.0, 0.9031578947368422 precision of 5.0, 883 perfect matches. +2023-05-11 04:56:14,983 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 04:56:14,983 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.468 mean absolute error, 1.872 mean squared error, 0.908 recall of 1.0, 0.8647619047619047 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.858 recall of 5.0, 0.9031578947368422 precision of 5.0, 883 perfect matches. +2023-05-11 04:57:21,995 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:03:07,053 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-11 05:03:07,064 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:04:13,641 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.576 mean absolute error, 2.304 mean squared error, 0.814 recall of 1.0, 0.888646288209607 precision of 1.0, 0.898 recall of 5.0, 0.8284132841328413 precision of 5.0, 856 perfect matches. +2023-05-11 05:04:13,776 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-11 05:04:13,776 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.576 mean absolute error, 2.304 mean squared error, 0.814 recall of 1.0, 0.888646288209607 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.898 recall of 5.0, 0.8284132841328413 precision of 5.0, 856 perfect matches. +2023-05-11 05:05:23,420 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:11:11,965 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-11 05:11:11,974 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:12:19,280 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.58 mean absolute error, 2.32 mean squared error, 0.864 recall of 1.0, 0.8487229862475442 precision of 1.0, 0.846 recall of 5.0, 0.8615071283095723 precision of 5.0, 855 perfect matches. +2023-05-11 05:12:19,427 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:12:19,427 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.58 mean absolute error, 2.32 mean squared error, 0.864 recall of 1.0, 0.8487229862475442 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.846 recall of 5.0, 0.8615071283095723 precision of 5.0, 855 perfect matches. +2023-05-11 05:15:05,229 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:15:05,230 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-11 05:15:05,230 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:15:05,293 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:15:05,424 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:15:05,424 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:17:48,478 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:17:48,478 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-11 05:17:48,478 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:17:48,542 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:17:48,676 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:17:48,676 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:20:27,731 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:20:27,731 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-11 05:20:27,731 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:20:27,793 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:20:27,927 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:20:27,927 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:23:06,291 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:23:06,291 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-11 05:23:06,291 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:23:06,353 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:23:06,485 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:23:06,485 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:25:50,794 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:25:50,795 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-11 05:25:50,795 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:25:50,861 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:25:51,000 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-11 05:25:51,000 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:28:23,292 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:28:23,293 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-11 05:28:23,293 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:28:23,356 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:28:23,492 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:28:23,492 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-11 05:30:59,419 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:33:45,267 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-11 05:33:45,267 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:36:08,901 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.294 mean absolute error, 3.25 mean squared error, 0.295 recall of 1.0, 0.3959731543624161 precision of 1.0, 0.25 recall of 2.0, 0.33557046979865773 precision of 2.0, 0.215 recall of 3.0, 0.30935251798561153 precision of 3.0, 0.145 recall of 4.0, 0.3670886075949367 precision of 4.0, 0.715 recall of 5.0, 0.29545454545454547 precision of 5.0, 324 perfect matches. +2023-05-11 05:36:09,028 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:36:09,028 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.294 mean absolute error, 3.25 mean squared error, 0.295 recall of 1.0, 0.3959731543624161 precision of 1.0, 0.25 recall of 2.0, 0.33557046979865773 precision of 2.0, 0.215 recall of 3.0, 0.30935251798561153 precision of 3.0, 0.145 recall of 4.0, 0.3670886075949367 precision of 4.0, 0.715 recall of 5.0, 0.29545454545454547 precision of 5.0, 324 perfect matches. +2023-05-11 05:38:51,579 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:41:34,342 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-11 05:41:34,343 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:43:55,712 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.168 mean absolute error, 2.712 mean squared error, 0.45 recall of 1.0, 0.40358744394618834 precision of 1.0, 0.22 recall of 2.0, 0.3333333333333333 precision of 2.0, 0.205 recall of 3.0, 0.27702702702702703 precision of 3.0, 0.165 recall of 4.0, 0.35106382978723405 precision of 4.0, 0.66 recall of 5.0, 0.32754342431761785 precision of 5.0, 340 perfect matches. +2023-05-11 05:43:55,846 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:43:55,846 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.168 mean absolute error, 2.712 mean squared error, 0.45 recall of 1.0, 0.40358744394618834 precision of 1.0, 0.22 recall of 2.0, 0.3333333333333333 precision of 2.0, 0.205 recall of 3.0, 0.27702702702702703 precision of 3.0, 0.165 recall of 4.0, 0.35106382978723405 precision of 4.0, 0.66 recall of 5.0, 0.32754342431761785 precision of 5.0, 340 perfect matches. +2023-05-11 05:46:36,773 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:49:59,188 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-11 05:49:59,188 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 05:52:40,968 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.285 mean absolute error, 3.131 mean squared error, 0.395 recall of 1.0, 0.45664739884393063 precision of 1.0, 0.22 recall of 2.0, 0.2732919254658385 precision of 2.0, 0.15 recall of 3.0, 0.28846153846153844 precision of 3.0, 0.14 recall of 4.0, 0.34146341463414637 precision of 4.0, 0.69 recall of 5.0, 0.2875 precision of 5.0, 319 perfect matches. +2023-05-11 05:52:41,107 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 05:52:41,107 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.285 mean absolute error, 3.131 mean squared error, 0.395 recall of 1.0, 0.45664739884393063 precision of 1.0, 0.22 recall of 2.0, 0.2732919254658385 precision of 2.0, 0.15 recall of 3.0, 0.28846153846153844 precision of 3.0, 0.14 recall of 4.0, 0.34146341463414637 precision of 4.0, 0.69 recall of 5.0, 0.2875 precision of 5.0, 319 perfect matches. +2023-05-11 05:55:20,971 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 05:58:17,583 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-11 05:58:17,596 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 06:00:39,479 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.225 mean absolute error, 3.039 mean squared error, 0.395 recall of 1.0, 0.5096774193548387 precision of 1.0, 0.3 recall of 2.0, 0.35294117647058826 precision of 2.0, 0.195 recall of 3.0, 0.35454545454545455 precision of 3.0, 0.18 recall of 4.0, 0.43373493975903615 precision of 4.0, 0.73 recall of 5.0, 0.3029045643153527 precision of 5.0, 360 perfect matches. +2023-05-11 06:00:39,626 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 06:00:39,626 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.225 mean absolute error, 3.039 mean squared error, 0.395 recall of 1.0, 0.5096774193548387 precision of 1.0, 0.3 recall of 2.0, 0.35294117647058826 precision of 2.0, 0.195 recall of 3.0, 0.35454545454545455 precision of 3.0, 0.18 recall of 4.0, 0.43373493975903615 precision of 4.0, 0.73 recall of 5.0, 0.3029045643153527 precision of 5.0, 360 perfect matches. +2023-05-11 06:03:25,843 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 06:06:52,942 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-11 06:06:52,952 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 06:09:38,098 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.317 mean absolute error, 3.321 mean squared error, 0.36 recall of 1.0, 0.4864864864864865 precision of 1.0, 0.1 recall of 2.0, 0.2564102564102564 precision of 2.0, 0.275 recall of 3.0, 0.3005464480874317 precision of 3.0, 0.11 recall of 4.0, 0.2857142857142857 precision of 4.0, 0.745 recall of 5.0, 0.2898832684824903 precision of 5.0, 318 perfect matches. +2023-05-11 06:09:38,271 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-11 06:09:38,271 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.317 mean absolute error, 3.321 mean squared error, 0.36 recall of 1.0, 0.4864864864864865 precision of 1.0, 0.1 recall of 2.0, 0.2564102564102564 precision of 2.0, 0.275 recall of 3.0, 0.3005464480874317 precision of 3.0, 0.11 recall of 4.0, 0.2857142857142857 precision of 4.0, 0.745 recall of 5.0, 0.2898832684824903 precision of 5.0, 318 perfect matches. +2023-05-11 06:12:25,893 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 06:16:09,381 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-11 06:16:09,398 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 06:19:06,604 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.389 mean absolute error, 3.683 mean squared error, 0.24 recall of 1.0, 0.45714285714285713 precision of 1.0, 0.3 recall of 2.0, 0.3488372093023256 precision of 2.0, 0.185 recall of 3.0, 0.3557692307692308 precision of 3.0, 0.12 recall of 4.0, 0.3582089552238806 precision of 4.0, 0.765 recall of 5.0, 0.27717391304347827 precision of 5.0, 322 perfect matches. +2023-05-11 06:19:06,790 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 06:19:06,791 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.389 mean absolute error, 3.683 mean squared error, 0.24 recall of 1.0, 0.45714285714285713 precision of 1.0, 0.3 recall of 2.0, 0.3488372093023256 precision of 2.0, 0.185 recall of 3.0, 0.3557692307692308 precision of 3.0, 0.12 recall of 4.0, 0.3582089552238806 precision of 4.0, 0.765 recall of 5.0, 0.27717391304347827 precision of 5.0, 322 perfect matches. +2023-05-11 06:21:46,236 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 06:23:41,778 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-11 06:26:16,216 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-11 06:31:53,135 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training succeeded! +2023-05-11 06:31:53,135 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 06:32:58,331 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.296 mean absolute error, 3.184 mean squared error, 0.755 recall of 1.0, 0.3813131313131313 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.905 recall of 5.0, 0.2996688741721854 precision of 5.0, 332 perfect matches. +2023-05-11 06:32:58,581 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 06:32:58,581 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.296 mean absolute error, 3.184 mean squared error, 0.755 recall of 1.0, 0.3813131313131313 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.905 recall of 5.0, 0.2996688741721854 precision of 5.0, 332 perfect matches. +2023-05-11 06:35:39,785 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 06:41:18,873 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-11 06:41:18,896 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 06:42:25,156 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.26 mean absolute error, 3.04 mean squared error, 0.835 recall of 1.0, 0.3599137931034483 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.865 recall of 5.0, 0.32276119402985076 precision of 5.0, 340 perfect matches. +2023-05-11 06:42:25,409 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 06:42:25,410 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.26 mean absolute error, 3.04 mean squared error, 0.835 recall of 1.0, 0.3599137931034483 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.865 recall of 5.0, 0.32276119402985076 precision of 5.0, 340 perfect matches. +2023-05-11 06:45:10,671 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 06:46:43,952 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-11 06:49:25,586 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-11 06:55:07,069 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training succeeded! +2023-05-11 06:55:07,069 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 06:56:15,006 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.314 mean absolute error, 3.256 mean squared error, 0.805 recall of 1.0, 0.3425531914893617 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.85 recall of 5.0, 0.32075471698113206 precision of 5.0, 331 perfect matches. +2023-05-11 06:56:15,140 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 06:56:15,140 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.314 mean absolute error, 3.256 mean squared error, 0.805 recall of 1.0, 0.3425531914893617 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.85 recall of 5.0, 0.32075471698113206 precision of 5.0, 331 perfect matches. +2023-05-11 06:58:58,711 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:04:38,625 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-11 07:04:38,625 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 07:05:44,313 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.222 mean absolute error, 2.888 mean squared error, 0.89 recall of 1.0, 0.3531746031746032 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.83 recall of 5.0, 0.3346774193548387 precision of 5.0, 344 perfect matches. +2023-05-11 07:05:44,444 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 07:05:44,445 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.222 mean absolute error, 2.888 mean squared error, 0.89 recall of 1.0, 0.3531746031746032 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.83 recall of 5.0, 0.3346774193548387 precision of 5.0, 344 perfect matches. +2023-05-11 07:08:21,790 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:08:53,099 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-05-11 07:11:31,829 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:17:13,843 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! +2023-05-11 07:17:13,844 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 07:18:20,057 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 2.896 mean squared error, 0.84 recall of 1.0, 0.33399602385685884 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.855 recall of 5.0, 0.3440643863179074 precision of 5.0, 339 perfect matches. +2023-05-11 07:18:20,188 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-11 07:18:20,188 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 2.896 mean squared error, 0.84 recall of 1.0, 0.33399602385685884 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.855 recall of 5.0, 0.3440643863179074 precision of 5.0, 339 perfect matches. +2023-05-11 07:21:03,959 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:26:32,065 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-11 07:26:32,080 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 07:27:38,139 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.198 mean absolute error, 2.792 mean squared error, 0.845 recall of 1.0, 0.3373253493013972 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.87 recall of 5.0, 0.3486973947895792 precision of 5.0, 343 perfect matches. +2023-05-11 07:27:38,367 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 07:27:38,367 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.198 mean absolute error, 2.792 mean squared error, 0.845 recall of 1.0, 0.3373253493013972 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.87 recall of 5.0, 0.3486973947895792 precision of 5.0, 343 perfect matches. +2023-05-11 07:30:20,832 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:35:46,481 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-11 07:35:46,482 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 07:36:52,441 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.875 mean absolute error, 1.557 mean squared error, 0.44 recall of 1.0, 0.5432098765432098 precision of 1.0, 0.335 recall of 2.0, 0.3544973544973545 precision of 2.0, 0.32 recall of 3.0, 0.2570281124497992 precision of 3.0, 0.31 recall of 4.0, 0.3229166666666667 precision of 4.0, 0.575 recall of 5.0, 0.5528846153846154 precision of 5.0, 396 perfect matches. +2023-05-11 07:36:52,597 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 07:36:52,597 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.875 mean absolute error, 1.557 mean squared error, 0.44 recall of 1.0, 0.5432098765432098 precision of 1.0, 0.335 recall of 2.0, 0.3544973544973545 precision of 2.0, 0.32 recall of 3.0, 0.2570281124497992 precision of 3.0, 0.31 recall of 4.0, 0.3229166666666667 precision of 4.0, 0.575 recall of 5.0, 0.5528846153846154 precision of 5.0, 396 perfect matches. +2023-05-11 07:39:34,080 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:40:04,969 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-11 07:42:47,689 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:48:13,621 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-05-11 07:48:13,622 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 07:49:19,291 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.831 mean absolute error, 1.577 mean squared error, 0.455 recall of 1.0, 0.5833333333333334 precision of 1.0, 0.32 recall of 2.0, 0.40764331210191085 precision of 2.0, 0.44 recall of 3.0, 0.3548387096774194 precision of 3.0, 0.44 recall of 4.0, 0.34108527131782945 precision of 4.0, 0.45 recall of 5.0, 0.4972375690607735 precision of 5.0, 421 perfect matches. +2023-05-11 07:49:19,421 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 07:49:19,421 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.831 mean absolute error, 1.577 mean squared error, 0.455 recall of 1.0, 0.5833333333333334 precision of 1.0, 0.32 recall of 2.0, 0.40764331210191085 precision of 2.0, 0.44 recall of 3.0, 0.3548387096774194 precision of 3.0, 0.44 recall of 4.0, 0.34108527131782945 precision of 4.0, 0.45 recall of 5.0, 0.4972375690607735 precision of 5.0, 421 perfect matches. +2023-05-11 07:51:55,999 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:53:15,870 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-11 07:55:56,708 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-11 07:57:52,331 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-11 08:00:34,487 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-11 08:06:17,823 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Training succeeded! +2023-05-11 08:06:17,823 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 08:07:26,415 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.845 mean absolute error, 1.547 mean squared error, 0.58 recall of 1.0, 0.4773662551440329 precision of 1.0, 0.26 recall of 2.0, 0.42276422764227645 precision of 2.0, 0.395 recall of 3.0, 0.3278008298755187 precision of 3.0, 0.43 recall of 4.0, 0.36134453781512604 precision of 4.0, 0.445 recall of 5.0, 0.5741935483870968 precision of 5.0, 422 perfect matches. +2023-05-11 08:07:26,550 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 08:07:26,550 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.845 mean absolute error, 1.547 mean squared error, 0.58 recall of 1.0, 0.4773662551440329 precision of 1.0, 0.26 recall of 2.0, 0.42276422764227645 precision of 2.0, 0.395 recall of 3.0, 0.3278008298755187 precision of 3.0, 0.43 recall of 4.0, 0.36134453781512604 precision of 4.0, 0.445 recall of 5.0, 0.5741935483870968 precision of 5.0, 422 perfect matches. +2023-05-11 08:10:07,075 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 08:15:43,714 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-11 08:15:43,714 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 08:16:49,888 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.817 mean absolute error, 1.385 mean squared error, 0.48 recall of 1.0, 0.5303867403314917 precision of 1.0, 0.46 recall of 2.0, 0.33454545454545453 precision of 2.0, 0.29 recall of 3.0, 0.30851063829787234 precision of 3.0, 0.34 recall of 4.0, 0.35051546391752575 precision of 4.0, 0.46 recall of 5.0, 0.5679012345679012 precision of 5.0, 406 perfect matches. +2023-05-11 08:16:50,041 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 08:16:50,041 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.817 mean absolute error, 1.385 mean squared error, 0.48 recall of 1.0, 0.5303867403314917 precision of 1.0, 0.46 recall of 2.0, 0.33454545454545453 precision of 2.0, 0.29 recall of 3.0, 0.30851063829787234 precision of 3.0, 0.34 recall of 4.0, 0.35051546391752575 precision of 4.0, 0.46 recall of 5.0, 0.5679012345679012 precision of 5.0, 406 perfect matches. +2023-05-11 08:19:29,735 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 08:25:13,174 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-11 08:25:13,202 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 08:26:19,536 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.822 mean absolute error, 1.42 mean squared error, 0.62 recall of 1.0, 0.5511111111111111 precision of 1.0, 0.37 recall of 2.0, 0.296 precision of 2.0, 0.24 recall of 3.0, 0.4067796610169492 precision of 3.0, 0.305 recall of 4.0, 0.28773584905660377 precision of 4.0, 0.525 recall of 5.0, 0.5384615384615384 precision of 5.0, 412 perfect matches. +2023-05-11 08:26:19,814 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-11 08:26:19,814 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.822 mean absolute error, 1.42 mean squared error, 0.62 recall of 1.0, 0.5511111111111111 precision of 1.0, 0.37 recall of 2.0, 0.296 precision of 2.0, 0.24 recall of 3.0, 0.4067796610169492 precision of 3.0, 0.305 recall of 4.0, 0.28773584905660377 precision of 4.0, 0.525 recall of 5.0, 0.5384615384615384 precision of 5.0, 412 perfect matches. +2023-05-11 08:29:01,606 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-11 08:34:54,291 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-11 08:34:54,292 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-11 08:36:00,670 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.835 mean absolute error, 1.581 mean squared error, 0.49 recall of 1.0, 0.593939393939394 precision of 1.0, 0.315 recall of 2.0, 0.375 precision of 2.0, 0.31 recall of 3.0, 0.34831460674157305 precision of 3.0, 0.435 recall of 4.0, 0.3283018867924528 precision of 4.0, 0.62 recall of 5.0, 0.5535714285714286 precision of 5.0, 434 perfect matches. +2023-05-11 08:36:00,947 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-11 08:36:00,947 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.835 mean absolute error, 1.581 mean squared error, 0.49 recall of 1.0, 0.593939393939394 precision of 1.0, 0.315 recall of 2.0, 0.375 precision of 2.0, 0.31 recall of 3.0, 0.34831460674157305 precision of 3.0, 0.435 recall of 4.0, 0.3283018867924528 precision of 4.0, 0.62 recall of 5.0, 0.5535714285714286 precision of 5.0, 434 perfect matches. diff --git a/data/logs/run-success6.tsv b/data/logs/run-success6.tsv new file mode 100644 index 0000000..067383a --- /dev/null +++ b/data/logs/run-success6.tsv @@ -0,0 +1,319 @@ +2023-05-14 18:28:53,382 __main__ INFO Started unimore-bda-6 in PRODUCTION mode! +2023-05-14 18:30:19,991 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:30:20,087 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-14 18:30:20,088 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:30:20,170 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:30:20,336 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:30:20,337 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:31:43,419 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:31:43,419 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-14 18:31:43,419 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:31:43,485 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:31:43,632 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:31:43,633 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:33:06,134 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:33:06,135 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-14 18:33:06,135 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:33:06,202 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:33:06,364 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:33:06,365 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:34:32,003 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:34:32,021 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-14 18:34:32,021 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:34:32,088 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:34:32,248 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:34:32,249 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:36:21,016 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:36:21,017 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-14 18:36:21,017 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:36:21,084 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:36:21,238 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-14 18:36:21,239 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:38:11,493 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:38:11,493 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-14 18:38:11,494 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:38:11,561 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:38:11,728 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:38:11,728 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. +2023-05-14 18:39:33,280 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:41:57,026 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-14 18:41:57,039 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:43:07,168 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.06 mean absolute error, 4.24 mean squared error, 0.636 recall of 1.0, 0.7930174563591023 precision of 1.0, 0.834 recall of 5.0, 0.6961602671118531 precision of 5.0, 735 perfect matches. +2023-05-14 18:43:07,758 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:43:07,758 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.06 mean absolute error, 4.24 mean squared error, 0.636 recall of 1.0, 0.7930174563591023 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.834 recall of 5.0, 0.6961602671118531 precision of 5.0, 735 perfect matches. +2023-05-14 18:44:31,061 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:46:48,646 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-14 18:46:48,670 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:47:53,603 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.984 mean absolute error, 3.936 mean squared error, 0.676 recall of 1.0, 0.8009478672985783 precision of 1.0, 0.832 recall of 5.0, 0.7197231833910035 precision of 5.0, 754 perfect matches. +2023-05-14 18:47:54,612 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:47:54,613 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.984 mean absolute error, 3.936 mean squared error, 0.676 recall of 1.0, 0.8009478672985783 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.832 recall of 5.0, 0.7197231833910035 precision of 5.0, 754 perfect matches. +2023-05-14 18:49:28,434 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:52:31,950 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-14 18:52:31,971 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:53:50,016 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.212 mean absolute error, 4.848 mean squared error, 0.57 recall of 1.0, 0.7640750670241286 precision of 1.0, 0.824 recall of 5.0, 0.6570972886762361 precision of 5.0, 697 perfect matches. +2023-05-14 18:53:50,208 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:53:50,209 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.212 mean absolute error, 4.848 mean squared error, 0.57 recall of 1.0, 0.7640750670241286 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.824 recall of 5.0, 0.6570972886762361 precision of 5.0, 697 perfect matches. +2023-05-14 18:55:14,633 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 18:57:29,055 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-14 18:57:29,071 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 18:58:31,040 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.084 mean absolute error, 4.336 mean squared error, 0.598 recall of 1.0, 0.8102981029810298 precision of 1.0, 0.86 recall of 5.0, 0.6814580031695721 precision of 5.0, 729 perfect matches. +2023-05-14 18:58:31,276 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 18:58:31,276 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.084 mean absolute error, 4.336 mean squared error, 0.598 recall of 1.0, 0.8102981029810298 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.6814580031695721 precision of 5.0, 729 perfect matches. +2023-05-14 18:59:55,772 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:02:48,694 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-14 19:02:48,695 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 19:04:08,500 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.996 mean absolute error, 3.984 mean squared error, 0.644 recall of 1.0, 0.8193384223918575 precision of 1.0, 0.858 recall of 5.0, 0.7067545304777595 precision of 5.0, 751 perfect matches. +2023-05-14 19:04:09,319 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-14 19:04:09,320 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.996 mean absolute error, 3.984 mean squared error, 0.644 recall of 1.0, 0.8193384223918575 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.858 recall of 5.0, 0.7067545304777595 precision of 5.0, 751 perfect matches. +2023-05-14 19:05:46,832 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:08:55,430 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-14 19:08:55,430 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 19:10:20,916 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.08 mean absolute error, 4.32 mean squared error, 0.626 recall of 1.0, 0.7904040404040404 precision of 1.0, 0.834 recall of 5.0, 0.6903973509933775 precision of 5.0, 730 perfect matches. +2023-05-14 19:10:21,510 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 19:10:21,511 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.08 mean absolute error, 4.32 mean squared error, 0.626 recall of 1.0, 0.7904040404040404 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.834 recall of 5.0, 0.6903973509933775 precision of 5.0, 730 perfect matches. +2023-05-14 19:11:48,800 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:12:27,758 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-14 19:13:55,396 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:14:33,383 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-14 19:15:58,180 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:16:33,561 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-05-14 19:18:01,239 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:24:27,166 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Training succeeded! +2023-05-14 19:24:27,201 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 19:25:45,123 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.908 recall of 1.0, 0.8391866913123844 precision of 1.0, 0.826 recall of 5.0, 0.8997821350762527 precision of 5.0, 867 perfect matches. +2023-05-14 19:25:45,413 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 19:25:45,414 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.908 recall of 1.0, 0.8391866913123844 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.826 recall of 5.0, 0.8997821350762527 precision of 5.0, 867 perfect matches. +2023-05-14 19:27:12,009 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:27:48,254 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-14 19:29:18,455 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:35:45,213 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-05-14 19:35:45,254 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 19:37:03,922 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.624 mean absolute error, 2.496 mean squared error, 0.894 recall of 1.0, 0.8127272727272727 precision of 1.0, 0.794 recall of 5.0, 0.8822222222222222 precision of 5.0, 844 perfect matches. +2023-05-14 19:37:04,560 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 19:37:04,561 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.624 mean absolute error, 2.496 mean squared error, 0.894 recall of 1.0, 0.8127272727272727 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.794 recall of 5.0, 0.8822222222222222 precision of 5.0, 844 perfect matches. +2023-05-14 19:38:33,403 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:40:48,106 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-14 19:42:50,532 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:49:34,232 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training succeeded! +2023-05-14 19:49:34,273 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 19:50:54,338 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.588 mean absolute error, 2.352 mean squared error, 0.842 recall of 1.0, 0.8609406952965235 precision of 1.0, 0.864 recall of 5.0, 0.8454011741682974 precision of 5.0, 853 perfect matches. +2023-05-14 19:50:54,842 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 19:50:54,843 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.588 mean absolute error, 2.352 mean squared error, 0.842 recall of 1.0, 0.8609406952965235 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.864 recall of 5.0, 0.8454011741682974 precision of 5.0, 853 perfect matches. +2023-05-14 19:53:22,417 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 19:54:00,872 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-14 19:55:31,493 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-14 20:01:59,394 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-14 20:01:59,428 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 20:03:19,661 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.84 recall of 1.0, 0.9130434782608695 precision of 1.0, 0.92 recall of 5.0, 0.8518518518518519 precision of 5.0, 880 perfect matches. +2023-05-14 20:03:19,973 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 20:03:19,973 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.84 recall of 1.0, 0.9130434782608695 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.92 recall of 5.0, 0.8518518518518519 precision of 5.0, 880 perfect matches. +2023-05-14 20:04:45,745 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 20:05:00,440 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-05-14 20:06:28,188 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-05-14 20:12:39,786 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! +2023-05-14 20:12:39,809 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 20:13:58,686 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.448 mean absolute error, 1.792 mean squared error, 0.914 recall of 1.0, 0.8688212927756654 precision of 1.0, 0.862 recall of 5.0, 0.9092827004219409 precision of 5.0, 888 perfect matches. +2023-05-14 20:14:01,170 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-14 20:14:01,170 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.448 mean absolute error, 1.792 mean squared error, 0.914 recall of 1.0, 0.8688212927756654 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.862 recall of 5.0, 0.9092827004219409 precision of 5.0, 888 perfect matches. +2023-05-14 20:16:39,400 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 20:23:10,924 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-14 20:23:10,957 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 20:24:41,737 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.496 mean absolute error, 1.984 mean squared error, 0.874 recall of 1.0, 0.8775100401606426 precision of 1.0, 0.878 recall of 5.0, 0.8745019920318725 precision of 5.0, 876 perfect matches. +2023-05-14 20:24:42,480 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 20:24:42,481 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.496 mean absolute error, 1.984 mean squared error, 0.874 recall of 1.0, 0.8775100401606426 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.878 recall of 5.0, 0.8745019920318725 precision of 5.0, 876 perfect matches. +2023-05-14 20:26:55,379 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 20:33:27,773 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-14 20:33:27,795 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 20:34:53,013 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.472 mean absolute error, 1.888 mean squared error, 0.886 recall of 1.0, 0.878968253968254 precision of 1.0, 0.878 recall of 5.0, 0.8850806451612904 precision of 5.0, 882 perfect matches. +2023-05-14 20:34:53,503 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 20:34:53,504 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.472 mean absolute error, 1.888 mean squared error, 0.886 recall of 1.0, 0.878968253968254 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.878 recall of 5.0, 0.8850806451612904 precision of 5.0, 882 perfect matches. +2023-05-14 20:37:15,186 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 20:43:14,232 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-14 20:43:14,258 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 20:44:38,415 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.882 recall of 1.0, 0.875 precision of 1.0, 0.874 recall of 5.0, 0.8810483870967742 precision of 5.0, 878 perfect matches. +2023-05-14 20:44:39,987 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 20:44:39,988 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.882 recall of 1.0, 0.875 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.874 recall of 5.0, 0.8810483870967742 precision of 5.0, 878 perfect matches. +2023-05-14 20:47:01,036 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 20:53:19,134 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-14 20:53:19,167 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 20:54:46,893 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.428 mean absolute error, 1.712 mean squared error, 0.896 recall of 1.0, 0.8906560636182903 precision of 1.0, 0.89 recall of 5.0, 0.8953722334004024 precision of 5.0, 893 perfect matches. +2023-05-14 20:54:48,060 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 20:54:48,061 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.428 mean absolute error, 1.712 mean squared error, 0.896 recall of 1.0, 0.8906560636182903 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.89 recall of 5.0, 0.8953722334004024 precision of 5.0, 893 perfect matches. +2023-05-14 20:57:59,733 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 20:59:54,134 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-14 21:01:51,327 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:02:10,879 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-14 21:03:59,530 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:05:39,711 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 ERROR Training failed, trying again with a different dataset... +2023-05-14 21:07:22,871 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:13:19,605 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Training succeeded! +2023-05-14 21:13:19,630 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:14:45,317 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.54 mean absolute error, 2.16 mean squared error, 0.886 recall of 1.0, 0.8502879078694817 precision of 1.0, 0.844 recall of 5.0, 0.8810020876826722 precision of 5.0, 865 perfect matches. +2023-05-14 21:14:45,701 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 21:14:45,702 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.54 mean absolute error, 2.16 mean squared error, 0.886 recall of 1.0, 0.8502879078694817 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.844 recall of 5.0, 0.8810020876826722 precision of 5.0, 865 perfect matches. +2023-05-14 21:16:36,796 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:22:47,855 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-14 21:22:47,882 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:24:25,687 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.544 mean absolute error, 2.176 mean squared error, 0.89 recall of 1.0, 0.8460076045627376 precision of 1.0, 0.838 recall of 5.0, 0.8839662447257384 precision of 5.0, 864 perfect matches. +2023-05-14 21:24:26,362 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-14 21:24:26,363 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.544 mean absolute error, 2.176 mean squared error, 0.89 recall of 1.0, 0.8460076045627376 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.838 recall of 5.0, 0.8839662447257384 precision of 5.0, 864 perfect matches. +2023-05-14 21:26:46,173 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:32:38,591 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-14 21:32:38,627 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:34:03,747 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.564 mean absolute error, 2.256 mean squared error, 0.858 recall of 1.0, 0.8597194388777555 precision of 1.0, 0.86 recall of 5.0, 0.8582834331337326 precision of 5.0, 859 perfect matches. +2023-05-14 21:34:04,168 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 21:34:04,168 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.564 mean absolute error, 2.256 mean squared error, 0.858 recall of 1.0, 0.8597194388777555 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.8582834331337326 precision of 5.0, 859 perfect matches. +2023-05-14 21:37:26,122 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:37:26,149 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! +2023-05-14 21:37:26,150 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:37:26,217 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:37:26,418 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 21:37:26,419 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:40:24,519 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:40:24,519 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-14 21:40:24,520 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:40:24,590 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:40:24,761 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 21:40:24,761 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:43:30,577 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:43:30,577 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-14 21:43:30,577 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:43:30,642 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:43:30,783 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 21:43:30,783 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:46:39,423 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:46:39,453 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! +2023-05-14 21:46:39,454 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:46:39,519 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:46:39,682 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 21:46:39,682 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:49:57,959 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:49:57,986 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-14 21:49:57,986 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:49:58,052 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:49:58,215 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-14 21:49:58,216 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:53:16,148 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:53:16,161 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-14 21:53:16,162 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 21:53:16,226 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:53:16,368 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 21:53:16,368 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. +2023-05-14 21:56:40,377 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 21:59:51,287 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-14 21:59:51,305 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 22:02:42,216 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.107 mean absolute error, 2.545 mean squared error, 0.535 recall of 1.0, 0.4592274678111588 precision of 1.0, 0.37 recall of 2.0, 0.3627450980392157 precision of 2.0, 0.185 recall of 3.0, 0.30327868852459017 precision of 3.0, 0.11 recall of 4.0, 0.36065573770491804 precision of 4.0, 0.675 recall of 5.0, 0.35526315789473684 precision of 5.0, 375 perfect matches. +2023-05-14 22:02:42,985 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 22:02:42,986 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.107 mean absolute error, 2.545 mean squared error, 0.535 recall of 1.0, 0.4592274678111588 precision of 1.0, 0.37 recall of 2.0, 0.3627450980392157 precision of 2.0, 0.185 recall of 3.0, 0.30327868852459017 precision of 3.0, 0.11 recall of 4.0, 0.36065573770491804 precision of 4.0, 0.675 recall of 5.0, 0.35526315789473684 precision of 5.0, 375 perfect matches. +2023-05-14 22:09:24,327 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 22:12:45,028 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-14 22:12:45,065 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 22:15:40,317 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.376 mean absolute error, 3.58 mean squared error, 0.295 recall of 1.0, 0.4338235294117647 precision of 1.0, 0.275 recall of 2.0, 0.3125 precision of 2.0, 0.135 recall of 3.0, 0.28421052631578947 precision of 3.0, 0.14 recall of 4.0, 0.45161290322580644 precision of 4.0, 0.705 recall of 5.0, 0.2655367231638418 precision of 5.0, 310 perfect matches. +2023-05-14 22:15:41,229 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 22:15:41,229 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.376 mean absolute error, 3.58 mean squared error, 0.295 recall of 1.0, 0.4338235294117647 precision of 1.0, 0.275 recall of 2.0, 0.3125 precision of 2.0, 0.135 recall of 3.0, 0.28421052631578947 precision of 3.0, 0.14 recall of 4.0, 0.45161290322580644 precision of 4.0, 0.705 recall of 5.0, 0.2655367231638418 precision of 5.0, 310 perfect matches. +2023-05-14 22:20:59,783 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 22:24:54,706 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-14 22:24:54,726 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 22:28:15,815 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.305 mean absolute error, 3.255 mean squared error, 0.28 recall of 1.0, 0.35 precision of 1.0, 0.28 recall of 2.0, 0.3027027027027027 precision of 2.0, 0.16 recall of 3.0, 0.3368421052631579 precision of 3.0, 0.14 recall of 4.0, 0.358974358974359 precision of 4.0, 0.715 recall of 5.0, 0.2966804979253112 precision of 5.0, 315 perfect matches. +2023-05-14 22:28:16,905 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 22:28:16,906 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.305 mean absolute error, 3.255 mean squared error, 0.28 recall of 1.0, 0.35 precision of 1.0, 0.28 recall of 2.0, 0.3027027027027027 precision of 2.0, 0.16 recall of 3.0, 0.3368421052631579 precision of 3.0, 0.14 recall of 4.0, 0.358974358974359 precision of 4.0, 0.715 recall of 5.0, 0.2966804979253112 precision of 5.0, 315 perfect matches. +2023-05-14 22:39:31,882 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 22:44:30,634 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-14 22:44:30,870 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 22:48:16,755 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.289 mean absolute error, 3.285 mean squared error, 0.36 recall of 1.0, 0.5714285714285714 precision of 1.0, 0.295 recall of 2.0, 0.34104046242774566 precision of 2.0, 0.155 recall of 3.0, 0.2980769230769231 precision of 3.0, 0.175 recall of 4.0, 0.35714285714285715 precision of 4.0, 0.715 recall of 5.0, 0.2865731462925852 precision of 5.0, 340 perfect matches. +2023-05-14 22:48:17,763 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 22:48:17,764 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.289 mean absolute error, 3.285 mean squared error, 0.36 recall of 1.0, 0.5714285714285714 precision of 1.0, 0.295 recall of 2.0, 0.34104046242774566 precision of 2.0, 0.155 recall of 3.0, 0.2980769230769231 precision of 3.0, 0.175 recall of 4.0, 0.35714285714285715 precision of 4.0, 0.715 recall of 5.0, 0.2865731462925852 precision of 5.0, 340 perfect matches. +2023-05-14 22:56:21,561 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 23:01:38,492 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-14 23:01:38,549 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 23:06:02,516 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.222 mean absolute error, 2.91 mean squared error, 0.365 recall of 1.0, 0.5140845070422535 precision of 1.0, 0.175 recall of 2.0, 0.3181818181818182 precision of 2.0, 0.31 recall of 3.0, 0.2627118644067797 precision of 3.0, 0.11 recall of 4.0, 0.39285714285714285 precision of 4.0, 0.705 recall of 5.0, 0.3092105263157895 precision of 5.0, 333 perfect matches. +2023-05-14 23:06:03,465 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-14 23:06:03,467 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.222 mean absolute error, 2.91 mean squared error, 0.365 recall of 1.0, 0.5140845070422535 precision of 1.0, 0.175 recall of 2.0, 0.3181818181818182 precision of 2.0, 0.31 recall of 3.0, 0.2627118644067797 precision of 3.0, 0.11 recall of 4.0, 0.39285714285714285 precision of 4.0, 0.705 recall of 5.0, 0.3092105263157895 precision of 5.0, 333 perfect matches. +2023-05-14 23:12:58,957 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 23:19:23,103 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-14 23:19:23,167 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 23:24:50,517 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.309 mean absolute error, 3.207 mean squared error, 0.37 recall of 1.0, 0.5211267605633803 precision of 1.0, 0.235 recall of 2.0, 0.2883435582822086 precision of 2.0, 0.17 recall of 3.0, 0.2809917355371901 precision of 3.0, 0.105 recall of 4.0, 0.3181818181818182 precision of 4.0, 0.67 recall of 5.0, 0.2637795275590551 precision of 5.0, 310 perfect matches. +2023-05-14 23:24:51,584 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 23:24:51,586 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.309 mean absolute error, 3.207 mean squared error, 0.37 recall of 1.0, 0.5211267605633803 precision of 1.0, 0.235 recall of 2.0, 0.2883435582822086 precision of 2.0, 0.17 recall of 3.0, 0.2809917355371901 precision of 3.0, 0.105 recall of 4.0, 0.3181818181818182 precision of 4.0, 0.67 recall of 5.0, 0.2637795275590551 precision of 5.0, 310 perfect matches. +2023-05-14 23:31:49,461 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 23:39:22,155 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-14 23:39:22,200 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 23:40:51,722 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.296 mean absolute error, 3.184 mean squared error, 0.875 recall of 1.0, 0.30973451327433627 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.785 recall of 5.0, 0.36091954022988504 precision of 5.0, 332 perfect matches. +2023-05-14 23:40:52,282 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 23:40:52,282 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.296 mean absolute error, 3.184 mean squared error, 0.875 recall of 1.0, 0.30973451327433627 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.785 recall of 5.0, 0.36091954022988504 precision of 5.0, 332 perfect matches. +2023-05-14 23:46:39,191 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-14 23:47:21,707 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-14 23:51:12,369 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-14 23:58:06,790 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! +2023-05-14 23:58:06,820 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-14 23:59:40,130 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 3.024 mean squared error, 0.795 recall of 1.0, 0.3975 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.925 recall of 5.0, 0.30833333333333335 precision of 5.0, 344 perfect matches. +2023-05-14 23:59:40,683 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-14 23:59:40,684 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 3.024 mean squared error, 0.795 recall of 1.0, 0.3975 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.925 recall of 5.0, 0.30833333333333335 precision of 5.0, 344 perfect matches. +2023-05-15 00:04:46,382 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 00:12:09,322 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! +2023-05-15 00:12:09,353 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 00:14:16,034 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.276 mean absolute error, 3.104 mean squared error, 0.775 recall of 1.0, 0.3530751708428246 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.905 recall of 5.0, 0.3226381461675579 precision of 5.0, 336 perfect matches. +2023-05-15 00:14:16,490 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-15 00:14:16,492 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.276 mean absolute error, 3.104 mean squared error, 0.775 recall of 1.0, 0.3530751708428246 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.905 recall of 5.0, 0.3226381461675579 precision of 5.0, 336 perfect matches. +2023-05-15 00:21:45,707 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 00:29:20,272 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! +2023-05-15 00:29:20,300 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 00:30:45,596 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.22 mean absolute error, 2.88 mean squared error, 0.885 recall of 1.0, 0.31494661921708184 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.845 recall of 5.0, 0.3858447488584475 precision of 5.0, 346 perfect matches. +2023-05-15 00:30:46,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-15 00:30:46,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.22 mean absolute error, 2.88 mean squared error, 0.885 recall of 1.0, 0.31494661921708184 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.845 recall of 5.0, 0.3858447488584475 precision of 5.0, 346 perfect matches. +2023-05-15 00:34:48,935 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 00:35:53,229 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... +2023-05-15 00:39:20,582 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> +2023-05-15 00:47:00,981 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! +2023-05-15 00:47:01,009 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 00:48:57,797 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.286 mean absolute error, 3.144 mean squared error, 0.81 recall of 1.0, 0.3432203389830508 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.835 recall of 5.0, 0.3162878787878788 precision of 5.0, 329 perfect matches. +2023-05-15 00:48:58,391 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-15 00:48:58,392 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.286 mean absolute error, 3.144 mean squared error, 0.81 recall of 1.0, 0.3432203389830508 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.835 recall of 5.0, 0.3162878787878788 precision of 5.0, 329 perfect matches. +2023-05-15 00:53:25,382 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 01:00:55,015 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-15 01:00:55,051 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 01:02:20,316 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.234 mean absolute error, 2.936 mean squared error, 0.82 recall of 1.0, 0.3234714003944773 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.89 recall of 5.0, 0.36105476673427994 precision of 5.0, 342 perfect matches. +2023-05-15 01:02:21,308 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-15 01:02:21,309 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.234 mean absolute error, 2.936 mean squared error, 0.82 recall of 1.0, 0.3234714003944773 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.89 recall of 5.0, 0.36105476673427994 precision of 5.0, 342 perfect matches. +2023-05-15 01:06:35,280 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 01:13:40,555 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! +2023-05-15 01:13:40,593 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 01:15:20,173 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.806 mean absolute error, 1.516 mean squared error, 0.49 recall of 1.0, 0.5414364640883977 precision of 1.0, 0.36 recall of 2.0, 0.36 precision of 2.0, 0.48 recall of 3.0, 0.375 precision of 3.0, 0.395 recall of 4.0, 0.398989898989899 precision of 4.0, 0.485 recall of 5.0, 0.5878787878787879 precision of 5.0, 442 perfect matches. +2023-05-15 01:15:21,654 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... +2023-05-15 01:15:21,654 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.806 mean absolute error, 1.516 mean squared error, 0.49 recall of 1.0, 0.5414364640883977 precision of 1.0, 0.36 recall of 2.0, 0.36 precision of 2.0, 0.48 recall of 3.0, 0.375 precision of 3.0, 0.395 recall of 4.0, 0.398989898989899 precision of 4.0, 0.485 recall of 5.0, 0.5878787878787879 precision of 5.0, 442 perfect matches. +2023-05-15 01:20:14,632 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 01:29:31,573 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! +2023-05-15 01:29:31,607 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 01:31:06,260 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.812 mean absolute error, 1.418 mean squared error, 0.555 recall of 1.0, 0.5577889447236181 precision of 1.0, 0.13 recall of 2.0, 0.33766233766233766 precision of 2.0, 0.405 recall of 3.0, 0.3103448275862069 precision of 3.0, 0.565 recall of 4.0, 0.3610223642172524 precision of 4.0, 0.445 recall of 5.0, 0.5933333333333334 precision of 5.0, 420 perfect matches. +2023-05-15 01:31:07,176 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... +2023-05-15 01:31:07,177 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.812 mean absolute error, 1.418 mean squared error, 0.555 recall of 1.0, 0.5577889447236181 precision of 1.0, 0.13 recall of 2.0, 0.33766233766233766 precision of 2.0, 0.405 recall of 3.0, 0.3103448275862069 precision of 3.0, 0.565 recall of 4.0, 0.3610223642172524 precision of 4.0, 0.445 recall of 5.0, 0.5933333333333334 precision of 5.0, 420 perfect matches. +2023-05-15 01:35:58,251 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 01:36:45,058 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-15 01:42:02,441 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-15 01:43:23,181 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... +2023-05-15 01:48:12,079 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> +2023-05-15 01:54:41,539 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Training succeeded! +2023-05-15 01:54:41,540 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 01:56:09,826 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.812 mean absolute error, 1.554 mean squared error, 0.46 recall of 1.0, 0.6216216216216216 precision of 1.0, 0.46 recall of 2.0, 0.3898305084745763 precision of 2.0, 0.355 recall of 3.0, 0.3879781420765027 precision of 3.0, 0.435 recall of 4.0, 0.3717948717948718 precision of 4.0, 0.55 recall of 5.0, 0.5527638190954773 precision of 5.0, 452 perfect matches. +2023-05-15 01:56:10,118 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... +2023-05-15 01:56:10,119 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.812 mean absolute error, 1.554 mean squared error, 0.46 recall of 1.0, 0.6216216216216216 precision of 1.0, 0.46 recall of 2.0, 0.3898305084745763 precision of 2.0, 0.355 recall of 3.0, 0.3879781420765027 precision of 3.0, 0.435 recall of 4.0, 0.3717948717948718 precision of 4.0, 0.55 recall of 5.0, 0.5527638190954773 precision of 5.0, 452 perfect matches. +2023-05-15 02:02:21,211 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 02:04:02,334 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... +2023-05-15 02:09:46,207 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> +2023-05-15 02:17:23,596 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! +2023-05-15 02:17:23,620 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 02:18:51,696 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.741 mean absolute error, 1.313 mean squared error, 0.535 recall of 1.0, 0.5631578947368421 precision of 1.0, 0.4 recall of 2.0, 0.40816326530612246 precision of 2.0, 0.505 recall of 3.0, 0.404 precision of 3.0, 0.43 recall of 4.0, 0.3926940639269406 precision of 4.0, 0.46 recall of 5.0, 0.6344827586206897 precision of 5.0, 466 perfect matches. +2023-05-15 02:18:52,304 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... +2023-05-15 02:18:52,304 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.741 mean absolute error, 1.313 mean squared error, 0.535 recall of 1.0, 0.5631578947368421 precision of 1.0, 0.4 recall of 2.0, 0.40816326530612246 precision of 2.0, 0.505 recall of 3.0, 0.404 precision of 3.0, 0.43 recall of 4.0, 0.3926940639269406 precision of 4.0, 0.46 recall of 5.0, 0.6344827586206897 precision of 5.0, 466 perfect matches. +2023-05-15 02:24:58,127 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 02:32:16,812 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! +2023-05-15 02:32:16,851 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 02:33:46,544 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.828 mean absolute error, 1.406 mean squared error, 0.57 recall of 1.0, 0.504424778761062 precision of 1.0, 0.21 recall of 2.0, 0.3925233644859813 precision of 2.0, 0.5 recall of 3.0, 0.3067484662576687 precision of 3.0, 0.335 recall of 4.0, 0.3401015228426396 precision of 4.0, 0.405 recall of 5.0, 0.5625 precision of 5.0, 404 perfect matches. +2023-05-15 02:33:47,137 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... +2023-05-15 02:33:47,138 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.828 mean absolute error, 1.406 mean squared error, 0.57 recall of 1.0, 0.504424778761062 precision of 1.0, 0.21 recall of 2.0, 0.3925233644859813 precision of 2.0, 0.5 recall of 3.0, 0.3067484662576687 precision of 3.0, 0.335 recall of 4.0, 0.3401015228426396 precision of 4.0, 0.405 recall of 5.0, 0.5625 precision of 5.0, 404 perfect matches. +2023-05-15 02:38:40,649 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> +2023-05-15 02:45:25,977 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! +2023-05-15 02:45:25,997 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> +2023-05-15 02:46:51,057 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.801 mean absolute error, 1.453 mean squared error, 0.375 recall of 1.0, 0.6302521008403361 precision of 1.0, 0.33 recall of 2.0, 0.35294117647058826 precision of 2.0, 0.465 recall of 3.0, 0.34572490706319703 precision of 3.0, 0.4 recall of 4.0, 0.37735849056603776 precision of 4.0, 0.57 recall of 5.0, 0.5352112676056338 precision of 5.0, 428 perfect matches. +2023-05-15 02:46:51,701 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... +2023-05-15 02:46:51,702 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.801 mean absolute error, 1.453 mean squared error, 0.375 recall of 1.0, 0.6302521008403361 precision of 1.0, 0.33 recall of 2.0, 0.35294117647058826 precision of 2.0, 0.465 recall of 3.0, 0.34572490706319703 precision of 3.0, 0.4 recall of 4.0, 0.37735849056603776 precision of 4.0, 0.57 recall of 5.0, 0.5352112676056338 precision of 5.0, 428 perfect matches.