2023-05-14 18:28:53,382 __main__ INFO Started unimore-bda-6 in PRODUCTION mode! 2023-05-14 18:30:19,991 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:30:20,087 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! 2023-05-14 18:30:20,088 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:30:20,170 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:30:20,336 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:30:20,337 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:31:43,419 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:31:43,419 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-14 18:31:43,419 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:31:43,485 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:31:43,632 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:31:43,633 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:33:06,134 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:33:06,135 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-14 18:33:06,135 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:33:06,202 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:33:06,364 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:33:06,365 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:34:32,003 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:34:32,021 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! 2023-05-14 18:34:32,021 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:34:32,088 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:34:32,248 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:34:32,249 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:36:21,016 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:36:21,017 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-14 18:36:21,017 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:36:21,084 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:36:21,238 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... 2023-05-14 18:36:21,239 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:38:11,493 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:38:11,493 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-14 18:38:11,494 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:38:11,561 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:38:11,728 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:38:11,728 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-14 18:39:33,280 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:41:57,026 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-14 18:41:57,039 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:43:07,168 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.06 mean absolute error, 4.24 mean squared error, 0.636 recall of 1.0, 0.7930174563591023 precision of 1.0, 0.834 recall of 5.0, 0.6961602671118531 precision of 5.0, 735 perfect matches. 2023-05-14 18:43:07,758 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:43:07,758 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.06 mean absolute error, 4.24 mean squared error, 0.636 recall of 1.0, 0.7930174563591023 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.834 recall of 5.0, 0.6961602671118531 precision of 5.0, 735 perfect matches. 2023-05-14 18:44:31,061 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:46:48,646 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-14 18:46:48,670 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:47:53,603 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.984 mean absolute error, 3.936 mean squared error, 0.676 recall of 1.0, 0.8009478672985783 precision of 1.0, 0.832 recall of 5.0, 0.7197231833910035 precision of 5.0, 754 perfect matches. 2023-05-14 18:47:54,612 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:47:54,613 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.984 mean absolute error, 3.936 mean squared error, 0.676 recall of 1.0, 0.8009478672985783 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.832 recall of 5.0, 0.7197231833910035 precision of 5.0, 754 perfect matches. 2023-05-14 18:49:28,434 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:52:31,950 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-14 18:52:31,971 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:53:50,016 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.212 mean absolute error, 4.848 mean squared error, 0.57 recall of 1.0, 0.7640750670241286 precision of 1.0, 0.824 recall of 5.0, 0.6570972886762361 precision of 5.0, 697 perfect matches. 2023-05-14 18:53:50,208 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:53:50,209 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.212 mean absolute error, 4.848 mean squared error, 0.57 recall of 1.0, 0.7640750670241286 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.824 recall of 5.0, 0.6570972886762361 precision of 5.0, 697 perfect matches. 2023-05-14 18:55:14,633 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 18:57:29,055 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-05-14 18:57:29,071 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 18:58:31,040 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.084 mean absolute error, 4.336 mean squared error, 0.598 recall of 1.0, 0.8102981029810298 precision of 1.0, 0.86 recall of 5.0, 0.6814580031695721 precision of 5.0, 729 perfect matches. 2023-05-14 18:58:31,276 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 18:58:31,276 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.084 mean absolute error, 4.336 mean squared error, 0.598 recall of 1.0, 0.8102981029810298 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.6814580031695721 precision of 5.0, 729 perfect matches. 2023-05-14 18:59:55,772 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:02:48,694 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-14 19:02:48,695 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 19:04:08,500 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.996 mean absolute error, 3.984 mean squared error, 0.644 recall of 1.0, 0.8193384223918575 precision of 1.0, 0.858 recall of 5.0, 0.7067545304777595 precision of 5.0, 751 perfect matches. 2023-05-14 19:04:09,319 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... 2023-05-14 19:04:09,320 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.996 mean absolute error, 3.984 mean squared error, 0.644 recall of 1.0, 0.8193384223918575 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.858 recall of 5.0, 0.7067545304777595 precision of 5.0, 751 perfect matches. 2023-05-14 19:05:46,832 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:08:55,430 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-14 19:08:55,430 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 19:10:20,916 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.08 mean absolute error, 4.32 mean squared error, 0.626 recall of 1.0, 0.7904040404040404 precision of 1.0, 0.834 recall of 5.0, 0.6903973509933775 precision of 5.0, 730 perfect matches. 2023-05-14 19:10:21,510 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 19:10:21,511 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.08 mean absolute error, 4.32 mean squared error, 0.626 recall of 1.0, 0.7904040404040404 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.834 recall of 5.0, 0.6903973509933775 precision of 5.0, 730 perfect matches. 2023-05-14 19:11:48,800 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:12:27,758 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-14 19:13:55,396 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:14:33,383 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-05-14 19:15:58,180 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:16:33,561 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-05-14 19:18:01,239 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:24:27,166 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Training succeeded! 2023-05-14 19:24:27,201 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 19:25:45,123 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.908 recall of 1.0, 0.8391866913123844 precision of 1.0, 0.826 recall of 5.0, 0.8997821350762527 precision of 5.0, 867 perfect matches. 2023-05-14 19:25:45,413 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 19:25:45,414 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.532 mean absolute error, 2.128 mean squared error, 0.908 recall of 1.0, 0.8391866913123844 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.826 recall of 5.0, 0.8997821350762527 precision of 5.0, 867 perfect matches. 2023-05-14 19:27:12,009 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:27:48,254 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-14 19:29:18,455 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:35:45,213 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! 2023-05-14 19:35:45,254 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 19:37:03,922 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.624 mean absolute error, 2.496 mean squared error, 0.894 recall of 1.0, 0.8127272727272727 precision of 1.0, 0.794 recall of 5.0, 0.8822222222222222 precision of 5.0, 844 perfect matches. 2023-05-14 19:37:04,560 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 19:37:04,561 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.624 mean absolute error, 2.496 mean squared error, 0.894 recall of 1.0, 0.8127272727272727 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.794 recall of 5.0, 0.8822222222222222 precision of 5.0, 844 perfect matches. 2023-05-14 19:38:33,403 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:40:48,106 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-14 19:42:50,532 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:49:34,232 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training succeeded! 2023-05-14 19:49:34,273 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 19:50:54,338 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.588 mean absolute error, 2.352 mean squared error, 0.842 recall of 1.0, 0.8609406952965235 precision of 1.0, 0.864 recall of 5.0, 0.8454011741682974 precision of 5.0, 853 perfect matches. 2023-05-14 19:50:54,842 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 19:50:54,843 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.588 mean absolute error, 2.352 mean squared error, 0.842 recall of 1.0, 0.8609406952965235 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.864 recall of 5.0, 0.8454011741682974 precision of 5.0, 853 perfect matches. 2023-05-14 19:53:22,417 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 19:54:00,872 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-14 19:55:31,493 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-14 20:01:59,394 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! 2023-05-14 20:01:59,428 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 20:03:19,661 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.84 recall of 1.0, 0.9130434782608695 precision of 1.0, 0.92 recall of 5.0, 0.8518518518518519 precision of 5.0, 880 perfect matches. 2023-05-14 20:03:19,973 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 20:03:19,973 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.84 recall of 1.0, 0.9130434782608695 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.92 recall of 5.0, 0.8518518518518519 precision of 5.0, 880 perfect matches. 2023-05-14 20:04:45,745 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 20:05:00,440 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... 2023-05-14 20:06:28,188 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> 2023-05-14 20:12:39,786 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! 2023-05-14 20:12:39,809 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 20:13:58,686 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.448 mean absolute error, 1.792 mean squared error, 0.914 recall of 1.0, 0.8688212927756654 precision of 1.0, 0.862 recall of 5.0, 0.9092827004219409 precision of 5.0, 888 perfect matches. 2023-05-14 20:14:01,170 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... 2023-05-14 20:14:01,170 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.448 mean absolute error, 1.792 mean squared error, 0.914 recall of 1.0, 0.8688212927756654 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.862 recall of 5.0, 0.9092827004219409 precision of 5.0, 888 perfect matches. 2023-05-14 20:16:39,400 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 20:23:10,924 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-14 20:23:10,957 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 20:24:41,737 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.496 mean absolute error, 1.984 mean squared error, 0.874 recall of 1.0, 0.8775100401606426 precision of 1.0, 0.878 recall of 5.0, 0.8745019920318725 precision of 5.0, 876 perfect matches. 2023-05-14 20:24:42,480 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 20:24:42,481 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.496 mean absolute error, 1.984 mean squared error, 0.874 recall of 1.0, 0.8775100401606426 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.878 recall of 5.0, 0.8745019920318725 precision of 5.0, 876 perfect matches. 2023-05-14 20:26:55,379 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 20:33:27,773 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-14 20:33:27,795 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 20:34:53,013 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.472 mean absolute error, 1.888 mean squared error, 0.886 recall of 1.0, 0.878968253968254 precision of 1.0, 0.878 recall of 5.0, 0.8850806451612904 precision of 5.0, 882 perfect matches. 2023-05-14 20:34:53,503 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 20:34:53,504 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.472 mean absolute error, 1.888 mean squared error, 0.886 recall of 1.0, 0.878968253968254 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.878 recall of 5.0, 0.8850806451612904 precision of 5.0, 882 perfect matches. 2023-05-14 20:37:15,186 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 20:43:14,232 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-14 20:43:14,258 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 20:44:38,415 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.882 recall of 1.0, 0.875 precision of 1.0, 0.874 recall of 5.0, 0.8810483870967742 precision of 5.0, 878 perfect matches. 2023-05-14 20:44:39,987 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 20:44:39,988 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.882 recall of 1.0, 0.875 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.874 recall of 5.0, 0.8810483870967742 precision of 5.0, 878 perfect matches. 2023-05-14 20:47:01,036 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 20:53:19,134 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-14 20:53:19,167 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 20:54:46,893 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.428 mean absolute error, 1.712 mean squared error, 0.896 recall of 1.0, 0.8906560636182903 precision of 1.0, 0.89 recall of 5.0, 0.8953722334004024 precision of 5.0, 893 perfect matches. 2023-05-14 20:54:48,060 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 20:54:48,061 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.428 mean absolute error, 1.712 mean squared error, 0.896 recall of 1.0, 0.8906560636182903 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.89 recall of 5.0, 0.8953722334004024 precision of 5.0, 893 perfect matches. 2023-05-14 20:57:59,733 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 20:59:54,134 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-14 21:01:51,327 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:02:10,879 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-05-14 21:03:59,530 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:05:39,711 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-05-14 21:07:22,871 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:13:19,605 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Training succeeded! 2023-05-14 21:13:19,630 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:14:45,317 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.54 mean absolute error, 2.16 mean squared error, 0.886 recall of 1.0, 0.8502879078694817 precision of 1.0, 0.844 recall of 5.0, 0.8810020876826722 precision of 5.0, 865 perfect matches. 2023-05-14 21:14:45,701 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 21:14:45,702 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.54 mean absolute error, 2.16 mean squared error, 0.886 recall of 1.0, 0.8502879078694817 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.844 recall of 5.0, 0.8810020876826722 precision of 5.0, 865 perfect matches. 2023-05-14 21:16:36,796 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:22:47,855 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-14 21:22:47,882 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:24:25,687 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.544 mean absolute error, 2.176 mean squared error, 0.89 recall of 1.0, 0.8460076045627376 precision of 1.0, 0.838 recall of 5.0, 0.8839662447257384 precision of 5.0, 864 perfect matches. 2023-05-14 21:24:26,362 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... 2023-05-14 21:24:26,363 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.544 mean absolute error, 2.176 mean squared error, 0.89 recall of 1.0, 0.8460076045627376 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.838 recall of 5.0, 0.8839662447257384 precision of 5.0, 864 perfect matches. 2023-05-14 21:26:46,173 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:32:38,591 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-14 21:32:38,627 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:34:03,747 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.564 mean absolute error, 2.256 mean squared error, 0.858 recall of 1.0, 0.8597194388777555 precision of 1.0, 0.86 recall of 5.0, 0.8582834331337326 precision of 5.0, 859 perfect matches. 2023-05-14 21:34:04,168 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 21:34:04,168 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.564 mean absolute error, 2.256 mean squared error, 0.858 recall of 1.0, 0.8597194388777555 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.8582834331337326 precision of 5.0, 859 perfect matches. 2023-05-14 21:37:26,122 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:37:26,149 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! 2023-05-14 21:37:26,150 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:37:26,217 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:37:26,418 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 21:37:26,419 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:40:24,519 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:40:24,519 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-14 21:40:24,520 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:40:24,590 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:40:24,761 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 21:40:24,761 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:43:30,577 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:43:30,577 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-14 21:43:30,577 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:43:30,642 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:43:30,783 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 21:43:30,783 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:46:39,423 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:46:39,453 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! 2023-05-14 21:46:39,454 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:46:39,519 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:46:39,682 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 21:46:39,682 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:49:57,959 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:49:57,986 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-14 21:49:57,986 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:49:58,052 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:49:58,215 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... 2023-05-14 21:49:58,216 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:53:16,148 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:53:16,161 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-14 21:53:16,162 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 21:53:16,226 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:53:16,368 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 21:53:16,368 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-14 21:56:40,377 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 21:59:51,287 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-14 21:59:51,305 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 22:02:42,216 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.107 mean absolute error, 2.545 mean squared error, 0.535 recall of 1.0, 0.4592274678111588 precision of 1.0, 0.37 recall of 2.0, 0.3627450980392157 precision of 2.0, 0.185 recall of 3.0, 0.30327868852459017 precision of 3.0, 0.11 recall of 4.0, 0.36065573770491804 precision of 4.0, 0.675 recall of 5.0, 0.35526315789473684 precision of 5.0, 375 perfect matches. 2023-05-14 22:02:42,985 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 22:02:42,986 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.107 mean absolute error, 2.545 mean squared error, 0.535 recall of 1.0, 0.4592274678111588 precision of 1.0, 0.37 recall of 2.0, 0.3627450980392157 precision of 2.0, 0.185 recall of 3.0, 0.30327868852459017 precision of 3.0, 0.11 recall of 4.0, 0.36065573770491804 precision of 4.0, 0.675 recall of 5.0, 0.35526315789473684 precision of 5.0, 375 perfect matches. 2023-05-14 22:09:24,327 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 22:12:45,028 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-14 22:12:45,065 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 22:15:40,317 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.376 mean absolute error, 3.58 mean squared error, 0.295 recall of 1.0, 0.4338235294117647 precision of 1.0, 0.275 recall of 2.0, 0.3125 precision of 2.0, 0.135 recall of 3.0, 0.28421052631578947 precision of 3.0, 0.14 recall of 4.0, 0.45161290322580644 precision of 4.0, 0.705 recall of 5.0, 0.2655367231638418 precision of 5.0, 310 perfect matches. 2023-05-14 22:15:41,229 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 22:15:41,229 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.376 mean absolute error, 3.58 mean squared error, 0.295 recall of 1.0, 0.4338235294117647 precision of 1.0, 0.275 recall of 2.0, 0.3125 precision of 2.0, 0.135 recall of 3.0, 0.28421052631578947 precision of 3.0, 0.14 recall of 4.0, 0.45161290322580644 precision of 4.0, 0.705 recall of 5.0, 0.2655367231638418 precision of 5.0, 310 perfect matches. 2023-05-14 22:20:59,783 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 22:24:54,706 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-14 22:24:54,726 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 22:28:15,815 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.305 mean absolute error, 3.255 mean squared error, 0.28 recall of 1.0, 0.35 precision of 1.0, 0.28 recall of 2.0, 0.3027027027027027 precision of 2.0, 0.16 recall of 3.0, 0.3368421052631579 precision of 3.0, 0.14 recall of 4.0, 0.358974358974359 precision of 4.0, 0.715 recall of 5.0, 0.2966804979253112 precision of 5.0, 315 perfect matches. 2023-05-14 22:28:16,905 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 22:28:16,906 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.305 mean absolute error, 3.255 mean squared error, 0.28 recall of 1.0, 0.35 precision of 1.0, 0.28 recall of 2.0, 0.3027027027027027 precision of 2.0, 0.16 recall of 3.0, 0.3368421052631579 precision of 3.0, 0.14 recall of 4.0, 0.358974358974359 precision of 4.0, 0.715 recall of 5.0, 0.2966804979253112 precision of 5.0, 315 perfect matches. 2023-05-14 22:39:31,882 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 22:44:30,634 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-05-14 22:44:30,870 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 22:48:16,755 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.289 mean absolute error, 3.285 mean squared error, 0.36 recall of 1.0, 0.5714285714285714 precision of 1.0, 0.295 recall of 2.0, 0.34104046242774566 precision of 2.0, 0.155 recall of 3.0, 0.2980769230769231 precision of 3.0, 0.175 recall of 4.0, 0.35714285714285715 precision of 4.0, 0.715 recall of 5.0, 0.2865731462925852 precision of 5.0, 340 perfect matches. 2023-05-14 22:48:17,763 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 22:48:17,764 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.289 mean absolute error, 3.285 mean squared error, 0.36 recall of 1.0, 0.5714285714285714 precision of 1.0, 0.295 recall of 2.0, 0.34104046242774566 precision of 2.0, 0.155 recall of 3.0, 0.2980769230769231 precision of 3.0, 0.175 recall of 4.0, 0.35714285714285715 precision of 4.0, 0.715 recall of 5.0, 0.2865731462925852 precision of 5.0, 340 perfect matches. 2023-05-14 22:56:21,561 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 23:01:38,492 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-14 23:01:38,549 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 23:06:02,516 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.222 mean absolute error, 2.91 mean squared error, 0.365 recall of 1.0, 0.5140845070422535 precision of 1.0, 0.175 recall of 2.0, 0.3181818181818182 precision of 2.0, 0.31 recall of 3.0, 0.2627118644067797 precision of 3.0, 0.11 recall of 4.0, 0.39285714285714285 precision of 4.0, 0.705 recall of 5.0, 0.3092105263157895 precision of 5.0, 333 perfect matches. 2023-05-14 23:06:03,465 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... 2023-05-14 23:06:03,467 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.222 mean absolute error, 2.91 mean squared error, 0.365 recall of 1.0, 0.5140845070422535 precision of 1.0, 0.175 recall of 2.0, 0.3181818181818182 precision of 2.0, 0.31 recall of 3.0, 0.2627118644067797 precision of 3.0, 0.11 recall of 4.0, 0.39285714285714285 precision of 4.0, 0.705 recall of 5.0, 0.3092105263157895 precision of 5.0, 333 perfect matches. 2023-05-14 23:12:58,957 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 23:19:23,103 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-14 23:19:23,167 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 23:24:50,517 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.309 mean absolute error, 3.207 mean squared error, 0.37 recall of 1.0, 0.5211267605633803 precision of 1.0, 0.235 recall of 2.0, 0.2883435582822086 precision of 2.0, 0.17 recall of 3.0, 0.2809917355371901 precision of 3.0, 0.105 recall of 4.0, 0.3181818181818182 precision of 4.0, 0.67 recall of 5.0, 0.2637795275590551 precision of 5.0, 310 perfect matches. 2023-05-14 23:24:51,584 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 23:24:51,586 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.309 mean absolute error, 3.207 mean squared error, 0.37 recall of 1.0, 0.5211267605633803 precision of 1.0, 0.235 recall of 2.0, 0.2883435582822086 precision of 2.0, 0.17 recall of 3.0, 0.2809917355371901 precision of 3.0, 0.105 recall of 4.0, 0.3181818181818182 precision of 4.0, 0.67 recall of 5.0, 0.2637795275590551 precision of 5.0, 310 perfect matches. 2023-05-14 23:31:49,461 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 23:39:22,155 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-14 23:39:22,200 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 23:40:51,722 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.296 mean absolute error, 3.184 mean squared error, 0.875 recall of 1.0, 0.30973451327433627 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.785 recall of 5.0, 0.36091954022988504 precision of 5.0, 332 perfect matches. 2023-05-14 23:40:52,282 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 23:40:52,282 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.296 mean absolute error, 3.184 mean squared error, 0.875 recall of 1.0, 0.30973451327433627 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.785 recall of 5.0, 0.36091954022988504 precision of 5.0, 332 perfect matches. 2023-05-14 23:46:39,191 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-14 23:47:21,707 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-14 23:51:12,369 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-14 23:58:06,790 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! 2023-05-14 23:58:06,820 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-14 23:59:40,130 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 3.024 mean squared error, 0.795 recall of 1.0, 0.3975 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.925 recall of 5.0, 0.30833333333333335 precision of 5.0, 344 perfect matches. 2023-05-14 23:59:40,683 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... 2023-05-14 23:59:40,684 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 3.024 mean squared error, 0.795 recall of 1.0, 0.3975 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.925 recall of 5.0, 0.30833333333333335 precision of 5.0, 344 perfect matches. 2023-05-15 00:04:46,382 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 00:12:09,322 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-15 00:12:09,353 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 00:14:16,034 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.276 mean absolute error, 3.104 mean squared error, 0.775 recall of 1.0, 0.3530751708428246 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.905 recall of 5.0, 0.3226381461675579 precision of 5.0, 336 perfect matches. 2023-05-15 00:14:16,490 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... 2023-05-15 00:14:16,492 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.276 mean absolute error, 3.104 mean squared error, 0.775 recall of 1.0, 0.3530751708428246 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.905 recall of 5.0, 0.3226381461675579 precision of 5.0, 336 perfect matches. 2023-05-15 00:21:45,707 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 00:29:20,272 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-05-15 00:29:20,300 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 00:30:45,596 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.22 mean absolute error, 2.88 mean squared error, 0.885 recall of 1.0, 0.31494661921708184 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.845 recall of 5.0, 0.3858447488584475 precision of 5.0, 346 perfect matches. 2023-05-15 00:30:46,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... 2023-05-15 00:30:46,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.22 mean absolute error, 2.88 mean squared error, 0.885 recall of 1.0, 0.31494661921708184 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.845 recall of 5.0, 0.3858447488584475 precision of 5.0, 346 perfect matches. 2023-05-15 00:34:48,935 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 00:35:53,229 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... 2023-05-15 00:39:20,582 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> 2023-05-15 00:47:00,981 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! 2023-05-15 00:47:01,009 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 00:48:57,797 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.286 mean absolute error, 3.144 mean squared error, 0.81 recall of 1.0, 0.3432203389830508 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.835 recall of 5.0, 0.3162878787878788 precision of 5.0, 329 perfect matches. 2023-05-15 00:48:58,391 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... 2023-05-15 00:48:58,392 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.286 mean absolute error, 3.144 mean squared error, 0.81 recall of 1.0, 0.3432203389830508 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.835 recall of 5.0, 0.3162878787878788 precision of 5.0, 329 perfect matches. 2023-05-15 00:53:25,382 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 01:00:55,015 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-15 01:00:55,051 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 01:02:20,316 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.234 mean absolute error, 2.936 mean squared error, 0.82 recall of 1.0, 0.3234714003944773 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.89 recall of 5.0, 0.36105476673427994 precision of 5.0, 342 perfect matches. 2023-05-15 01:02:21,308 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... 2023-05-15 01:02:21,309 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.234 mean absolute error, 2.936 mean squared error, 0.82 recall of 1.0, 0.3234714003944773 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.89 recall of 5.0, 0.36105476673427994 precision of 5.0, 342 perfect matches. 2023-05-15 01:06:35,280 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 01:13:40,555 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-15 01:13:40,593 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 01:15:20,173 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.806 mean absolute error, 1.516 mean squared error, 0.49 recall of 1.0, 0.5414364640883977 precision of 1.0, 0.36 recall of 2.0, 0.36 precision of 2.0, 0.48 recall of 3.0, 0.375 precision of 3.0, 0.395 recall of 4.0, 0.398989898989899 precision of 4.0, 0.485 recall of 5.0, 0.5878787878787879 precision of 5.0, 442 perfect matches. 2023-05-15 01:15:21,654 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Reached target of 1 runs, moving on... 2023-05-15 01:15:21,654 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.806 mean absolute error, 1.516 mean squared error, 0.49 recall of 1.0, 0.5414364640883977 precision of 1.0, 0.36 recall of 2.0, 0.36 precision of 2.0, 0.48 recall of 3.0, 0.375 precision of 3.0, 0.395 recall of 4.0, 0.398989898989899 precision of 4.0, 0.485 recall of 5.0, 0.5878787878787879 precision of 5.0, 442 perfect matches. 2023-05-15 01:20:14,632 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 01:29:31,573 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-15 01:29:31,607 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 01:31:06,260 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.812 mean absolute error, 1.418 mean squared error, 0.555 recall of 1.0, 0.5577889447236181 precision of 1.0, 0.13 recall of 2.0, 0.33766233766233766 precision of 2.0, 0.405 recall of 3.0, 0.3103448275862069 precision of 3.0, 0.565 recall of 4.0, 0.3610223642172524 precision of 4.0, 0.445 recall of 5.0, 0.5933333333333334 precision of 5.0, 420 perfect matches. 2023-05-15 01:31:07,176 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Reached target of 1 runs, moving on... 2023-05-15 01:31:07,177 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.812 mean absolute error, 1.418 mean squared error, 0.555 recall of 1.0, 0.5577889447236181 precision of 1.0, 0.13 recall of 2.0, 0.33766233766233766 precision of 2.0, 0.405 recall of 3.0, 0.3103448275862069 precision of 3.0, 0.565 recall of 4.0, 0.3610223642172524 precision of 4.0, 0.445 recall of 5.0, 0.5933333333333334 precision of 5.0, 420 perfect matches. 2023-05-15 01:35:58,251 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 01:36:45,058 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-15 01:42:02,441 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-15 01:43:23,181 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-05-15 01:48:12,079 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-05-15 01:54:41,539 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Training succeeded! 2023-05-15 01:54:41,540 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 01:56:09,826 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.812 mean absolute error, 1.554 mean squared error, 0.46 recall of 1.0, 0.6216216216216216 precision of 1.0, 0.46 recall of 2.0, 0.3898305084745763 precision of 2.0, 0.355 recall of 3.0, 0.3879781420765027 precision of 3.0, 0.435 recall of 4.0, 0.3717948717948718 precision of 4.0, 0.55 recall of 5.0, 0.5527638190954773 precision of 5.0, 452 perfect matches. 2023-05-15 01:56:10,118 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Reached target of 1 runs, moving on... 2023-05-15 01:56:10,119 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.812 mean absolute error, 1.554 mean squared error, 0.46 recall of 1.0, 0.6216216216216216 precision of 1.0, 0.46 recall of 2.0, 0.3898305084745763 precision of 2.0, 0.355 recall of 3.0, 0.3879781420765027 precision of 3.0, 0.435 recall of 4.0, 0.3717948717948718 precision of 4.0, 0.55 recall of 5.0, 0.5527638190954773 precision of 5.0, 452 perfect matches. 2023-05-15 02:02:21,211 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 02:04:02,334 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-15 02:09:46,207 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-15 02:17:23,596 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! 2023-05-15 02:17:23,620 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 02:18:51,696 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.741 mean absolute error, 1.313 mean squared error, 0.535 recall of 1.0, 0.5631578947368421 precision of 1.0, 0.4 recall of 2.0, 0.40816326530612246 precision of 2.0, 0.505 recall of 3.0, 0.404 precision of 3.0, 0.43 recall of 4.0, 0.3926940639269406 precision of 4.0, 0.46 recall of 5.0, 0.6344827586206897 precision of 5.0, 466 perfect matches. 2023-05-15 02:18:52,304 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Reached target of 1 runs, moving on... 2023-05-15 02:18:52,304 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.741 mean absolute error, 1.313 mean squared error, 0.535 recall of 1.0, 0.5631578947368421 precision of 1.0, 0.4 recall of 2.0, 0.40816326530612246 precision of 2.0, 0.505 recall of 3.0, 0.404 precision of 3.0, 0.43 recall of 4.0, 0.3926940639269406 precision of 4.0, 0.46 recall of 5.0, 0.6344827586206897 precision of 5.0, 466 perfect matches. 2023-05-15 02:24:58,127 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 02:32:16,812 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-15 02:32:16,851 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 02:33:46,544 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.828 mean absolute error, 1.406 mean squared error, 0.57 recall of 1.0, 0.504424778761062 precision of 1.0, 0.21 recall of 2.0, 0.3925233644859813 precision of 2.0, 0.5 recall of 3.0, 0.3067484662576687 precision of 3.0, 0.335 recall of 4.0, 0.3401015228426396 precision of 4.0, 0.405 recall of 5.0, 0.5625 precision of 5.0, 404 perfect matches. 2023-05-15 02:33:47,137 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Reached target of 1 runs, moving on... 2023-05-15 02:33:47,138 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.828 mean absolute error, 1.406 mean squared error, 0.57 recall of 1.0, 0.504424778761062 precision of 1.0, 0.21 recall of 2.0, 0.3925233644859813 precision of 2.0, 0.5 recall of 3.0, 0.3067484662576687 precision of 3.0, 0.335 recall of 4.0, 0.3401015228426396 precision of 4.0, 0.405 recall of 5.0, 0.5625 precision of 5.0, 404 perfect matches. 2023-05-15 02:38:40,649 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-15 02:45:25,977 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-15 02:45:25,997 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-15 02:46:51,057 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.801 mean absolute error, 1.453 mean squared error, 0.375 recall of 1.0, 0.6302521008403361 precision of 1.0, 0.33 recall of 2.0, 0.35294117647058826 precision of 2.0, 0.465 recall of 3.0, 0.34572490706319703 precision of 3.0, 0.4 recall of 4.0, 0.37735849056603776 precision of 4.0, 0.57 recall of 5.0, 0.5352112676056338 precision of 5.0, 428 perfect matches. 2023-05-15 02:46:51,701 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Reached target of 1 runs, moving on... 2023-05-15 02:46:51,702 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.801 mean absolute error, 1.453 mean squared error, 0.375 recall of 1.0, 0.6302521008403361 precision of 1.0, 0.33 recall of 2.0, 0.35294117647058826 precision of 2.0, 0.465 recall of 3.0, 0.34572490706319703 precision of 3.0, 0.4 recall of 4.0, 0.37735849056603776 precision of 4.0, 0.57 recall of 5.0, 0.5352112676056338 precision of 5.0, 428 perfect matches.