2023-04-14 02:07:26,695 __main__ INFO Started unimore-bda-6 in DEBUG mode! 2023-04-14 02:07:26,696 __main__ DEBUG Validating configuration... 2023-04-14 02:07:26,698 __main__ DEBUG Ensuring there are no leftover caches... 2023-04-14 02:07:26,720 __main__.sample_reviews_polar DEBUG Selected sample_func: sample_reviews_polar 2023-04-14 02:07:26,720 __main__.sample_reviews_polar.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer 2023-04-14 02:07:26,720 __main__ DEBUG Running garbage collection... 2023-04-14 02:07:26,867 __main__ DEBUG Collected 19 pieces of garbage! 2023-04-14 02:07:26,867 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-04-14 02:07:26,868 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-04-14 02:07:26,868 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... 2023-04-14 02:07:41,386 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:10:19,246 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-04-14 02:10:19,246 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:11:26,941 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.848 mean absolute error, 3.392 mean squared error, 0.692 recall of 1.0, 0.8564356435643564 precision of 1.0, 0.884 recall of 5.0, 0.7416107382550335 precision of 5.0, 788 perfect matches. 2023-04-14 02:11:27,571 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.848 mean absolute error, 3.392 mean squared error, 0.692 recall of 1.0, 0.8564356435643564 precision of 1.0, 0.884 recall of 5.0, 0.7416107382550335 precision of 5.0, 788 perfect matches. 2023-04-14 02:11:27,572 __main__ DEBUG Running garbage collection... 2023-04-14 02:11:27,670 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 02:11:27,670 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-04-14 02:11:27,671 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-04-14 02:11:27,671 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... 2023-04-14 02:11:36,419 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:13:36,021 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-04-14 02:13:36,021 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:14:30,293 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.88 mean absolute error, 3.52 mean squared error, 0.682 recall of 1.0, 0.8482587064676617 precision of 1.0, 0.878 recall of 5.0, 0.7341137123745819 precision of 5.0, 780 perfect matches. 2023-04-14 02:14:30,425 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.88 mean absolute error, 3.52 mean squared error, 0.682 recall of 1.0, 0.8482587064676617 precision of 1.0, 0.878 recall of 5.0, 0.7341137123745819 precision of 5.0, 780 perfect matches. 2023-04-14 02:14:30,426 __main__ DEBUG Running garbage collection... 2023-04-14 02:14:30,528 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 02:14:30,529 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-04-14 02:14:30,529 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-04-14 02:14:30,529 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 02:14:39,156 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:17:18,585 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-04-14 02:17:18,585 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:18:28,715 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.748 mean absolute error, 2.992 mean squared error, 0.776 recall of 1.0, 0.838012958963283 precision of 1.0, 0.85 recall of 5.0, 0.7914338919925512 precision of 5.0, 813 perfect matches. 2023-04-14 02:18:28,861 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.748 mean absolute error, 2.992 mean squared error, 0.776 recall of 1.0, 0.838012958963283 precision of 1.0, 0.85 recall of 5.0, 0.7914338919925512 precision of 5.0, 813 perfect matches. 2023-04-14 02:18:28,862 __main__ DEBUG Running garbage collection... 2023-04-14 02:18:28,969 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 02:18:28,969 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-04-14 02:18:28,970 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-04-14 02:18:28,970 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... 2023-04-14 02:18:38,174 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:20:49,210 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-04-14 02:20:49,210 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:21:47,287 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.636 mean absolute error, 2.544 mean squared error, 0.778 recall of 1.0, 0.8901601830663616 precision of 1.0, 0.904 recall of 5.0, 0.8028419182948491 precision of 5.0, 841 perfect matches. 2023-04-14 02:21:47,424 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.636 mean absolute error, 2.544 mean squared error, 0.778 recall of 1.0, 0.8901601830663616 precision of 1.0, 0.904 recall of 5.0, 0.8028419182948491 precision of 5.0, 841 perfect matches. 2023-04-14 02:21:47,425 __main__ DEBUG Running garbage collection... 2023-04-14 02:21:47,540 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 02:21:47,541 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-04-14 02:21:47,541 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-04-14 02:21:47,541 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 02:21:55,677 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:24:21,987 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-04-14 02:24:21,988 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:25:25,939 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.868 mean absolute error, 3.472 mean squared error, 0.684 recall of 1.0, 0.8528678304239401 precision of 1.0, 0.882 recall of 5.0, 0.7362270450751253 precision of 5.0, 783 perfect matches. 2023-04-14 02:25:26,088 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.868 mean absolute error, 3.472 mean squared error, 0.684 recall of 1.0, 0.8528678304239401 precision of 1.0, 0.882 recall of 5.0, 0.7362270450751253 precision of 5.0, 783 perfect matches. 2023-04-14 02:25:26,089 __main__ DEBUG Running garbage collection... 2023-04-14 02:25:26,229 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 02:25:26,230 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-04-14 02:25:26,230 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-04-14 02:25:26,230 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... 2023-04-14 02:25:35,178 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:28:05,080 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-04-14 02:28:05,080 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:29:09,808 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.932 mean absolute error, 3.728 mean squared error, 0.642 recall of 1.0, 0.856 precision of 1.0, 0.892 recall of 5.0, 0.7136 precision of 5.0, 767 perfect matches. 2023-04-14 02:29:09,937 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.932 mean absolute error, 3.728 mean squared error, 0.642 recall of 1.0, 0.856 precision of 1.0, 0.892 recall of 5.0, 0.7136 precision of 5.0, 767 perfect matches. 2023-04-14 02:29:09,938 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer 2023-04-14 02:29:09,938 __main__ DEBUG Running garbage collection... 2023-04-14 02:29:10,036 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 02:29:10,037 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-04-14 02:29:10,037 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-04-14 02:29:10,037 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 02:29:19,203 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:35:29,078 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-04-14 02:35:29,079 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:36:40,858 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.896 recall of 1.0, 0.8699029126213592 precision of 1.0, 0.866 recall of 5.0, 0.8927835051546392 precision of 5.0, 881 perfect matches. 2023-04-14 02:36:41,005 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.896 recall of 1.0, 0.8699029126213592 precision of 1.0, 0.866 recall of 5.0, 0.8927835051546392 precision of 5.0, 881 perfect matches. 2023-04-14 02:36:41,006 __main__ DEBUG Running garbage collection... 2023-04-14 02:36:41,115 __main__ DEBUG Collected 14481 pieces of garbage! 2023-04-14 02:36:41,120 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-04-14 02:36:41,120 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-04-14 02:36:41,120 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... 2023-04-14 02:36:49,377 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:37:29,450 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 02:37:29,603 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 2023-04-14 02:37:29,603 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... 2023-04-14 02:37:37,599 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:43:50,896 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! 2023-04-14 02:43:50,917 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:45:02,727 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.916 recall of 1.0, 0.8544776119402985 precision of 1.0, 0.844 recall of 5.0, 0.9094827586206896 precision of 5.0, 880 perfect matches. 2023-04-14 02:45:03,221 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.916 recall of 1.0, 0.8544776119402985 precision of 1.0, 0.844 recall of 5.0, 0.9094827586206896 precision of 5.0, 880 perfect matches. 2023-04-14 02:45:03,222 __main__ DEBUG Running garbage collection... 2023-04-14 02:45:03,354 __main__ DEBUG Collected 17374 pieces of garbage! 2023-04-14 02:45:03,361 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-04-14 02:45:03,361 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-04-14 02:45:03,361 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 02:45:12,281 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:46:13,004 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 02:46:13,319 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 2023-04-14 02:46:13,320 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 02:46:21,650 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:48:01,137 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 02:48:01,400 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Run #3 2023-04-14 02:48:01,401 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 02:48:10,130 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:49:33,320 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 02:49:33,512 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Run #4 2023-04-14 02:49:33,513 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 02:49:41,342 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:55:48,568 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Training succeeded! 2023-04-14 02:55:48,568 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 02:56:59,685 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.492 mean absolute error, 1.968 mean squared error, 0.908 recall of 1.0, 0.8549905838041432 precision of 1.0, 0.846 recall of 5.0, 0.9019189765458422 precision of 5.0, 877 perfect matches. 2023-04-14 02:56:59,830 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.492 mean absolute error, 1.968 mean squared error, 0.908 recall of 1.0, 0.8549905838041432 precision of 1.0, 0.846 recall of 5.0, 0.9019189765458422 precision of 5.0, 877 perfect matches. 2023-04-14 02:56:59,830 __main__ DEBUG Running garbage collection... 2023-04-14 02:57:00,002 __main__ DEBUG Collected 39114 pieces of garbage! 2023-04-14 02:57:00,006 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-04-14 02:57:00,007 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-04-14 02:57:00,007 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 02:57:08,032 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:58:22,273 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 02:58:22,405 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 2023-04-14 02:58:22,406 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 02:58:30,418 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:59:21,741 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 02:59:21,871 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 DEBUG Run #3 2023-04-14 02:59:21,872 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 02:59:30,063 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 02:59:59,644 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 02:59:59,795 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.4 DEBUG Run #4 2023-04-14 02:59:59,795 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 03:00:08,298 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:01:06,431 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.4 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:01:06,590 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.5 DEBUG Run #5 2023-04-14 03:01:06,591 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.5 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 03:01:14,562 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.5 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:02:11,267 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.5 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:02:11,405 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.6 DEBUG Run #6 2023-04-14 03:02:11,405 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.6 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 03:02:19,868 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.6 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:04:03,096 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.6 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:04:03,229 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 DEBUG Run #7 2023-04-14 03:04:03,230 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 03:04:12,163 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:10:18,531 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Training succeeded! 2023-04-14 03:10:18,531 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 03:11:30,141 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.946 recall of 1.0, 0.8431372549019608 precision of 1.0, 0.824 recall of 5.0, 0.9384965831435079 precision of 5.0, 885 perfect matches. 2023-04-14 03:11:30,268 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.7 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.946 recall of 1.0, 0.8431372549019608 precision of 1.0, 0.824 recall of 5.0, 0.9384965831435079 precision of 5.0, 885 perfect matches. 2023-04-14 03:11:30,268 __main__ DEBUG Running garbage collection... 2023-04-14 03:11:30,514 __main__ DEBUG Collected 80413 pieces of garbage! 2023-04-14 03:11:30,536 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-04-14 03:11:30,543 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-04-14 03:11:30,547 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 03:11:38,102 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:11:50,429 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:11:50,565 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 2023-04-14 03:11:50,565 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 03:11:58,297 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:14:05,622 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:14:05,821 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Run #3 2023-04-14 03:14:05,821 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 03:14:38,382 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:21:02,076 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training succeeded! 2023-04-14 03:21:02,079 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 03:22:56,464 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.352 mean absolute error, 1.408 mean squared error, 0.914 recall of 1.0, 0.9103585657370518 precision of 1.0, 0.91 recall of 5.0, 0.9136546184738956 precision of 5.0, 912 perfect matches. 2023-04-14 03:22:56,761 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.352 mean absolute error, 1.408 mean squared error, 0.914 recall of 1.0, 0.9103585657370518 precision of 1.0, 0.91 recall of 5.0, 0.9136546184738956 precision of 5.0, 912 perfect matches. 2023-04-14 03:22:56,761 __main__ DEBUG Running garbage collection... 2023-04-14 03:22:57,030 __main__ DEBUG Collected 60127 pieces of garbage! 2023-04-14 03:22:57,051 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-04-14 03:22:57,056 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-04-14 03:22:57,059 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... 2023-04-14 03:23:10,637 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:29:33,070 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-04-14 03:29:33,070 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 03:30:43,505 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.852 recall of 1.0, 0.9122055674518201 precision of 1.0, 0.918 recall of 5.0, 0.8611632270168855 precision of 5.0, 885 perfect matches. 2023-04-14 03:30:43,637 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.852 recall of 1.0, 0.9122055674518201 precision of 1.0, 0.918 recall of 5.0, 0.8611632270168855 precision of 5.0, 885 perfect matches. 2023-04-14 03:30:43,637 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer 2023-04-14 03:30:43,637 __main__ DEBUG Running garbage collection... 2023-04-14 03:30:43,824 __main__ DEBUG Collected 18820 pieces of garbage! 2023-04-14 03:30:43,831 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-04-14 03:30:43,831 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-04-14 03:30:43,831 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-04-14 03:30:52,433 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:31:20,342 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:31:20,473 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 2023-04-14 03:31:20,473 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-04-14 03:31:28,781 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:32:11,843 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:32:11,976 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.3 DEBUG Run #3 2023-04-14 03:32:11,977 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-04-14 03:32:19,909 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:33:33,315 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:33:33,453 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.4 DEBUG Run #4 2023-04-14 03:33:33,453 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.4 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-04-14 03:33:41,627 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:34:05,939 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.4 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:34:06,079 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.5 DEBUG Run #5 2023-04-14 03:34:06,080 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.5 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-04-14 03:34:14,346 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.5 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:35:38,755 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.5 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:35:38,918 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.6 DEBUG Run #6 2023-04-14 03:35:38,919 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.6 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-04-14 03:35:46,938 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.6 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:36:39,339 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.6 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:36:39,477 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 DEBUG Run #7 2023-04-14 03:36:39,477 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-04-14 03:36:47,466 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:43:26,463 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Training succeeded! 2023-04-14 03:43:26,464 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 03:44:39,601 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.924 recall of 1.0, 0.850828729281768 precision of 1.0, 0.838 recall of 5.0, 0.9168490153172867 precision of 5.0, 881 perfect matches. 2023-04-14 03:44:39,737 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.7 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.476 mean absolute error, 1.904 mean squared error, 0.924 recall of 1.0, 0.850828729281768 precision of 1.0, 0.838 recall of 5.0, 0.9168490153172867 precision of 5.0, 881 perfect matches. 2023-04-14 03:44:39,737 __main__ DEBUG Running garbage collection... 2023-04-14 03:44:40,038 __main__ DEBUG Collected 52887 pieces of garbage! 2023-04-14 03:44:40,050 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-04-14 03:44:40,051 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-04-14 03:44:40,052 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-04-14 03:44:48,729 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:51:06,107 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-04-14 03:51:06,107 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 03:52:14,645 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.898 recall of 1.0, 0.8752436647173489 precision of 1.0, 0.872 recall of 5.0, 0.8952772073921971 precision of 5.0, 885 perfect matches. 2023-04-14 03:52:14,773 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.46 mean absolute error, 1.84 mean squared error, 0.898 recall of 1.0, 0.8752436647173489 precision of 1.0, 0.872 recall of 5.0, 0.8952772073921971 precision of 5.0, 885 perfect matches. 2023-04-14 03:52:14,774 __main__ DEBUG Running garbage collection... 2023-04-14 03:52:14,990 __main__ DEBUG Collected 8694 pieces of garbage! 2023-04-14 03:52:14,992 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-04-14 03:52:14,993 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-04-14 03:52:14,993 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 03:52:22,820 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 03:53:34,894 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 03:53:35,087 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 2023-04-14 03:53:35,088 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 03:53:43,136 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:00:25,276 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training succeeded! 2023-04-14 04:00:25,277 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:01:34,638 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.898 recall of 1.0, 0.8821218074656189 precision of 1.0, 0.88 recall of 5.0, 0.8961303462321792 precision of 5.0, 889 perfect matches. 2023-04-14 04:01:34,773 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.898 recall of 1.0, 0.8821218074656189 precision of 1.0, 0.88 recall of 5.0, 0.8961303462321792 precision of 5.0, 889 perfect matches. 2023-04-14 04:01:34,773 __main__ DEBUG Running garbage collection... 2023-04-14 04:01:35,019 __main__ DEBUG Collected 28229 pieces of garbage! 2023-04-14 04:01:35,024 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-04-14 04:01:35,025 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-04-14 04:01:35,025 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-04-14 04:01:42,831 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:03:12,088 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 04:03:12,222 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 2023-04-14 04:03:12,222 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-04-14 04:03:20,096 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:03:38,086 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 04:03:38,263 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 DEBUG Run #3 2023-04-14 04:03:38,264 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-04-14 04:03:46,055 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:04:11,099 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 04:04:11,530 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 DEBUG Run #4 2023-04-14 04:04:11,531 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-04-14 04:04:19,473 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:04:46,680 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.4 ERROR Training failed, trying again with a different dataset... 2023-04-14 04:04:47,232 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 DEBUG Run #5 2023-04-14 04:04:47,232 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-04-14 04:04:54,934 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:11:15,368 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Training succeeded! 2023-04-14 04:11:15,382 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:12:23,245 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.452 mean absolute error, 1.808 mean squared error, 0.874 recall of 1.0, 0.8973305954825462 precision of 1.0, 0.9 recall of 5.0, 0.8771929824561403 precision of 5.0, 887 perfect matches. 2023-04-14 04:12:23,746 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.5 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.452 mean absolute error, 1.808 mean squared error, 0.874 recall of 1.0, 0.8973305954825462 precision of 1.0, 0.9 recall of 5.0, 0.8771929824561403 precision of 5.0, 887 perfect matches. 2023-04-14 04:12:23,747 __main__ DEBUG Running garbage collection... 2023-04-14 04:12:24,081 __main__ DEBUG Collected 86213 pieces of garbage! 2023-04-14 04:12:24,104 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-04-14 04:12:24,110 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-04-14 04:12:24,116 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 04:12:31,693 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:18:38,833 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-04-14 04:18:38,857 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:19:46,151 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.42 mean absolute error, 1.68 mean squared error, 0.868 recall of 1.0, 0.9175475687103594 precision of 1.0, 0.922 recall of 5.0, 0.8747628083491461 precision of 5.0, 895 perfect matches. 2023-04-14 04:19:46,513 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.42 mean absolute error, 1.68 mean squared error, 0.868 recall of 1.0, 0.9175475687103594 precision of 1.0, 0.922 recall of 5.0, 0.8747628083491461 precision of 5.0, 895 perfect matches. 2023-04-14 04:19:46,513 __main__ DEBUG Running garbage collection... 2023-04-14 04:19:46,848 __main__ DEBUG Collected 87213 pieces of garbage! 2023-04-14 04:19:46,866 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-04-14 04:19:46,869 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-04-14 04:19:46,871 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... 2023-04-14 04:19:54,868 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:26:18,101 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-04-14 04:26:18,124 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:27:25,055 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.91 recall of 1.0, 0.8733205374280231 precision of 1.0, 0.868 recall of 5.0, 0.906054279749478 precision of 5.0, 889 perfect matches. 2023-04-14 04:27:25,605 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.91 recall of 1.0, 0.8733205374280231 precision of 1.0, 0.868 recall of 5.0, 0.906054279749478 precision of 5.0, 889 perfect matches. 2023-04-14 04:27:25,606 __main__.sample_reviews_varied DEBUG Selected sample_func: sample_reviews_varied 2023-04-14 04:27:25,606 __main__.sample_reviews_varied.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer 2023-04-14 04:27:25,606 __main__ DEBUG Running garbage collection... 2023-04-14 04:27:26,012 __main__ DEBUG Collected 87197 pieces of garbage! 2023-04-14 04:27:26,019 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-04-14 04:27:26,021 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-04-14 04:27:26,022 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... 2023-04-14 04:27:43,719 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:30:37,000 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-04-14 04:30:37,000 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:33:04,724 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.065 mean absolute error, 2.343 mean squared error, 0.68 recall of 1.0, 0.43037974683544306 precision of 1.0, 0.235 recall of 2.0, 0.34057971014492755 precision of 2.0, 0.2 recall of 3.0, 0.32786885245901637 precision of 3.0, 0.165 recall of 4.0, 0.3707865168539326 precision of 4.0, 0.61 recall of 5.0, 0.3641791044776119 precision of 5.0, 378 perfect matches. 2023-04-14 04:33:04,999 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.065 mean absolute error, 2.343 mean squared error, 0.68 recall of 1.0, 0.43037974683544306 precision of 1.0, 0.235 recall of 2.0, 0.34057971014492755 precision of 2.0, 0.2 recall of 3.0, 0.32786885245901637 precision of 3.0, 0.165 recall of 4.0, 0.3707865168539326 precision of 4.0, 0.61 recall of 5.0, 0.3641791044776119 precision of 5.0, 378 perfect matches. 2023-04-14 04:33:05,000 __main__ DEBUG Running garbage collection... 2023-04-14 04:33:05,275 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 04:33:05,276 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-04-14 04:33:05,276 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-04-14 04:33:05,276 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... 2023-04-14 04:33:23,054 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:36:09,314 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-04-14 04:36:09,315 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:38:31,038 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.146 mean absolute error, 2.712 mean squared error, 0.52 recall of 1.0, 0.4642857142857143 precision of 1.0, 0.33 recall of 2.0, 0.3815028901734104 precision of 2.0, 0.22 recall of 3.0, 0.33587786259541985 precision of 3.0, 0.1 recall of 4.0, 0.3389830508474576 precision of 4.0, 0.655 recall of 5.0, 0.3171912832929782 precision of 5.0, 365 perfect matches. 2023-04-14 04:38:31,166 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.146 mean absolute error, 2.712 mean squared error, 0.52 recall of 1.0, 0.4642857142857143 precision of 1.0, 0.33 recall of 2.0, 0.3815028901734104 precision of 2.0, 0.22 recall of 3.0, 0.33587786259541985 precision of 3.0, 0.1 recall of 4.0, 0.3389830508474576 precision of 4.0, 0.655 recall of 5.0, 0.3171912832929782 precision of 5.0, 365 perfect matches. 2023-04-14 04:38:31,167 __main__ DEBUG Running garbage collection... 2023-04-14 04:38:31,443 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 04:38:31,443 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-04-14 04:38:31,444 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-04-14 04:38:31,444 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 04:38:49,170 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:42:07,945 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-04-14 04:42:07,945 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:44:49,844 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.213 mean absolute error, 2.921 mean squared error, 0.5 recall of 1.0, 0.45662100456621 precision of 1.0, 0.235 recall of 2.0, 0.34558823529411764 precision of 2.0, 0.175 recall of 3.0, 0.25 precision of 3.0, 0.145 recall of 4.0, 0.42028985507246375 precision of 4.0, 0.69 recall of 5.0, 0.3165137614678899 precision of 5.0, 349 perfect matches. 2023-04-14 04:44:50,310 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.213 mean absolute error, 2.921 mean squared error, 0.5 recall of 1.0, 0.45662100456621 precision of 1.0, 0.235 recall of 2.0, 0.34558823529411764 precision of 2.0, 0.175 recall of 3.0, 0.25 precision of 3.0, 0.145 recall of 4.0, 0.42028985507246375 precision of 4.0, 0.69 recall of 5.0, 0.3165137614678899 precision of 5.0, 349 perfect matches. 2023-04-14 04:44:50,311 __main__ DEBUG Running garbage collection... 2023-04-14 04:44:52,556 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 04:44:52,556 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-04-14 04:44:52,557 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-04-14 04:44:52,557 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... 2023-04-14 04:45:16,474 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:47:56,326 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-04-14 04:47:56,326 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:50:02,739 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.019 mean absolute error, 2.195 mean squared error, 0.695 recall of 1.0, 0.4633333333333333 precision of 1.0, 0.125 recall of 2.0, 0.2840909090909091 precision of 2.0, 0.29 recall of 3.0, 0.31521739130434784 precision of 3.0, 0.15 recall of 4.0, 0.4918032786885246 precision of 4.0, 0.69 recall of 5.0, 0.3760217983651226 precision of 5.0, 390 perfect matches. 2023-04-14 04:50:02,868 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.019 mean absolute error, 2.195 mean squared error, 0.695 recall of 1.0, 0.4633333333333333 precision of 1.0, 0.125 recall of 2.0, 0.2840909090909091 precision of 2.0, 0.29 recall of 3.0, 0.31521739130434784 precision of 3.0, 0.15 recall of 4.0, 0.4918032786885246 precision of 4.0, 0.69 recall of 5.0, 0.3760217983651226 precision of 5.0, 390 perfect matches. 2023-04-14 04:50:02,868 __main__ DEBUG Running garbage collection... 2023-04-14 04:50:03,147 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 04:50:03,147 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-04-14 04:50:03,147 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-04-14 04:50:03,147 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 04:50:20,955 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:53:26,986 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-04-14 04:53:26,987 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 04:55:58,484 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.104 mean absolute error, 2.508 mean squared error, 0.61 recall of 1.0, 0.44525547445255476 precision of 1.0, 0.235 recall of 2.0, 0.29012345679012347 precision of 2.0, 0.21 recall of 3.0, 0.33070866141732286 precision of 3.0, 0.125 recall of 4.0, 0.43103448275862066 precision of 4.0, 0.68 recall of 5.0, 0.35883905013192613 precision of 5.0, 372 perfect matches. 2023-04-14 04:55:58,610 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.104 mean absolute error, 2.508 mean squared error, 0.61 recall of 1.0, 0.44525547445255476 precision of 1.0, 0.235 recall of 2.0, 0.29012345679012347 precision of 2.0, 0.21 recall of 3.0, 0.33070866141732286 precision of 3.0, 0.125 recall of 4.0, 0.43103448275862066 precision of 4.0, 0.68 recall of 5.0, 0.35883905013192613 precision of 5.0, 372 perfect matches. 2023-04-14 04:55:58,611 __main__ DEBUG Running garbage collection... 2023-04-14 04:55:58,891 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 04:55:58,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-04-14 04:55:58,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-04-14 04:55:58,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... 2023-04-14 04:56:17,158 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 04:59:43,480 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-04-14 04:59:43,480 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 05:02:19,881 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.086 mean absolute error, 2.492 mean squared error, 0.645 recall of 1.0, 0.48134328358208955 precision of 1.0, 0.31 recall of 2.0, 0.4305555555555556 precision of 2.0, 0.165 recall of 3.0, 0.28695652173913044 precision of 3.0, 0.13 recall of 4.0, 0.35135135135135137 precision of 4.0, 0.675 recall of 5.0, 0.3383458646616541 precision of 5.0, 385 perfect matches. 2023-04-14 05:02:20,029 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.086 mean absolute error, 2.492 mean squared error, 0.645 recall of 1.0, 0.48134328358208955 precision of 1.0, 0.31 recall of 2.0, 0.4305555555555556 precision of 2.0, 0.165 recall of 3.0, 0.28695652173913044 precision of 3.0, 0.13 recall of 4.0, 0.35135135135135137 precision of 4.0, 0.675 recall of 5.0, 0.3383458646616541 precision of 5.0, 385 perfect matches. 2023-04-14 05:02:20,029 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer 2023-04-14 05:02:20,029 __main__ DEBUG Running garbage collection... 2023-04-14 05:02:20,310 __main__ DEBUG Collected 0 pieces of garbage! 2023-04-14 05:02:20,311 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-04-14 05:02:20,311 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-04-14 05:02:20,311 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 05:02:38,449 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:04:30,196 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:04:30,499 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 2023-04-14 05:04:30,499 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 05:04:48,396 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:06:47,932 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:06:48,068 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Run #3 2023-04-14 05:06:48,069 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 05:07:06,116 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:07:40,525 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:07:40,658 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 DEBUG Run #4 2023-04-14 05:07:40,658 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 05:07:58,697 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:09:04,576 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.4 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:09:04,720 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.5 DEBUG Run #5 2023-04-14 05:09:04,721 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.5 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 05:09:22,459 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.5 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:09:51,742 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.5 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:09:51,872 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.6 DEBUG Run #6 2023-04-14 05:09:51,872 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.6 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 05:10:09,649 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.6 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:10:28,862 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.6 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:10:28,991 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.7 DEBUG Run #7 2023-04-14 05:10:28,992 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.7 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 05:10:46,596 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.7 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:11:45,240 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.7 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:11:45,375 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 DEBUG Run #8 2023-04-14 05:11:45,375 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-04-14 05:12:03,548 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:17:43,566 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Training succeeded! 2023-04-14 05:17:43,566 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 05:18:54,270 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 2.912 mean squared error, 0.94 recall of 1.0, 0.3027375201288245 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.76 recall of 5.0, 0.40105540897097625 precision of 5.0, 340 perfect matches. 2023-04-14 05:18:54,397 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.8 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 2.912 mean squared error, 0.94 recall of 1.0, 0.3027375201288245 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.76 recall of 5.0, 0.40105540897097625 precision of 5.0, 340 perfect matches. 2023-04-14 05:18:54,398 __main__ DEBUG Running garbage collection... 2023-04-14 05:18:54,771 __main__ DEBUG Collected 82946 pieces of garbage! 2023-04-14 05:18:54,792 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-04-14 05:18:54,797 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-04-14 05:18:54,801 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... 2023-04-14 05:19:12,650 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:21:02,056 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:21:02,186 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 2023-04-14 05:21:02,187 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... 2023-04-14 05:21:20,290 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:21:54,750 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:21:54,884 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 DEBUG Run #3 2023-04-14 05:21:54,884 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... 2023-04-14 05:22:12,674 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:23:33,165 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:23:33,299 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 DEBUG Run #4 2023-04-14 05:23:33,300 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... 2023-04-14 05:23:51,145 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:29:36,402 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Training succeeded! 2023-04-14 05:29:36,402 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 05:30:42,698 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.234 mean absolute error, 2.936 mean squared error, 0.825 recall of 1.0, 0.3579175704989154 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.885 recall of 5.0, 0.32838589981447125 precision of 5.0, 342 perfect matches. 2023-04-14 05:30:42,829 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.4 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.234 mean absolute error, 2.936 mean squared error, 0.825 recall of 1.0, 0.3579175704989154 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.885 recall of 5.0, 0.32838589981447125 precision of 5.0, 342 perfect matches. 2023-04-14 05:30:42,829 __main__ DEBUG Running garbage collection... 2023-04-14 05:30:43,156 __main__ DEBUG Collected 20272 pieces of garbage! 2023-04-14 05:30:43,161 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-04-14 05:30:43,161 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-04-14 05:30:43,161 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 05:31:00,984 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:32:56,493 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:32:56,701 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 2023-04-14 05:32:56,701 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 05:33:14,587 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:33:49,685 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:33:49,953 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Run #3 2023-04-14 05:33:49,953 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 05:34:07,901 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:35:23,629 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:35:23,778 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Run #4 2023-04-14 05:35:23,778 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 05:35:41,994 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:36:50,388 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.4 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:36:50,595 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 DEBUG Run #5 2023-04-14 05:36:50,595 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 05:37:08,524 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:42:46,919 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Training succeeded! 2023-04-14 05:42:46,934 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 05:43:58,719 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.14 mean absolute error, 2.56 mean squared error, 0.95 recall of 1.0, 0.3321678321678322 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.825 recall of 5.0, 0.3855140186915888 precision of 5.0, 355 perfect matches. 2023-04-14 05:43:59,171 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.5 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.14 mean absolute error, 2.56 mean squared error, 0.95 recall of 1.0, 0.3321678321678322 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.825 recall of 5.0, 0.3855140186915888 precision of 5.0, 355 perfect matches. 2023-04-14 05:43:59,172 __main__ DEBUG Running garbage collection... 2023-04-14 05:43:59,538 __main__ DEBUG Collected 33304 pieces of garbage! 2023-04-14 05:43:59,543 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-04-14 05:43:59,544 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-04-14 05:43:59,545 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 05:44:17,220 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:45:59,737 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:45:59,950 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 2023-04-14 05:45:59,951 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 05:46:17,596 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:46:50,158 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:46:50,292 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 DEBUG Run #3 2023-04-14 05:46:50,292 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-04-14 05:47:07,983 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:52:53,628 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Training succeeded! 2023-04-14 05:52:53,635 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 05:54:10,225 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.252 mean absolute error, 3.008 mean squared error, 0.8 recall of 1.0, 0.39119804400978 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.87 recall of 5.0, 0.29441624365482233 precision of 5.0, 334 perfect matches. 2023-04-14 05:54:10,551 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.252 mean absolute error, 3.008 mean squared error, 0.8 recall of 1.0, 0.39119804400978 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.87 recall of 5.0, 0.29441624365482233 precision of 5.0, 334 perfect matches. 2023-04-14 05:54:10,552 __main__ DEBUG Running garbage collection... 2023-04-14 05:54:14,999 __main__ DEBUG Collected 85504 pieces of garbage! 2023-04-14 05:54:15,022 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-04-14 05:54:15,029 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-04-14 05:54:15,034 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 05:54:32,483 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 05:56:10,997 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 05:56:11,132 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 2023-04-14 05:56:11,132 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 05:56:28,864 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:02:32,505 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! 2023-04-14 06:02:32,505 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 06:03:41,718 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 2.912 mean squared error, 0.915 recall of 1.0, 0.32854578096947934 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.83 recall of 5.0, 0.3747178329571106 precision of 5.0, 349 perfect matches. 2023-04-14 06:03:41,951 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.228 mean absolute error, 2.912 mean squared error, 0.915 recall of 1.0, 0.32854578096947934 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.83 recall of 5.0, 0.3747178329571106 precision of 5.0, 349 perfect matches. 2023-04-14 06:03:41,951 __main__ DEBUG Running garbage collection... 2023-04-14 06:03:42,402 __main__ DEBUG Collected 85269 pieces of garbage! 2023-04-14 06:03:42,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-04-14 06:03:42,431 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-04-14 06:03:42,435 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... 2023-04-14 06:04:00,511 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:09:55,975 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-04-14 06:09:55,994 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 06:11:25,731 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.188 mean absolute error, 2.752 mean squared error, 0.84 recall of 1.0, 0.35 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.895 recall of 5.0, 0.34423076923076923 precision of 5.0, 347 perfect matches. 2023-04-14 06:11:26,003 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.188 mean absolute error, 2.752 mean squared error, 0.84 recall of 1.0, 0.35 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.895 recall of 5.0, 0.34423076923076923 precision of 5.0, 347 perfect matches. 2023-04-14 06:11:26,004 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer 2023-04-14 06:11:26,005 __main__ DEBUG Running garbage collection... 2023-04-14 06:11:27,284 __main__ DEBUG Collected 85753 pieces of garbage! 2023-04-14 06:11:27,310 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-04-14 06:11:27,315 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-04-14 06:11:27,321 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-04-14 06:11:50,957 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:17:30,496 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-04-14 06:17:30,496 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 06:18:40,181 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.825 mean absolute error, 1.443 mean squared error, 0.555 recall of 1.0, 0.5260663507109005 precision of 1.0, 0.345 recall of 2.0, 0.3988439306358382 precision of 2.0, 0.315 recall of 3.0, 0.3073170731707317 precision of 3.0, 0.31 recall of 4.0, 0.3263157894736842 precision of 4.0, 0.565 recall of 5.0, 0.5113122171945701 precision of 5.0, 418 perfect matches. 2023-04-14 06:18:40,315 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.825 mean absolute error, 1.443 mean squared error, 0.555 recall of 1.0, 0.5260663507109005 precision of 1.0, 0.345 recall of 2.0, 0.3988439306358382 precision of 2.0, 0.315 recall of 3.0, 0.3073170731707317 precision of 3.0, 0.31 recall of 4.0, 0.3263157894736842 precision of 4.0, 0.565 recall of 5.0, 0.5113122171945701 precision of 5.0, 418 perfect matches. 2023-04-14 06:18:40,316 __main__ DEBUG Running garbage collection... 2023-04-14 06:18:40,787 __main__ DEBUG Collected 87193 pieces of garbage! 2023-04-14 06:18:40,805 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-04-14 06:18:40,808 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-04-14 06:18:40,809 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-04-14 06:18:58,412 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:19:46,627 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:19:46,834 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 2023-04-14 06:19:46,834 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-04-14 06:20:04,433 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:20:41,334 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:20:41,492 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.3 DEBUG Run #3 2023-04-14 06:20:41,493 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-04-14 06:20:59,417 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:21:48,901 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:21:49,059 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 DEBUG Run #4 2023-04-14 06:21:49,059 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-04-14 06:22:06,642 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:28:02,774 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Training succeeded! 2023-04-14 06:28:02,775 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 06:29:11,536 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.907 mean absolute error, 1.567 mean squared error, 0.345 recall of 1.0, 0.5267175572519084 precision of 1.0, 0.335 recall of 2.0, 0.3284313725490196 precision of 2.0, 0.195 recall of 3.0, 0.22941176470588234 precision of 3.0, 0.215 recall of 4.0, 0.22279792746113988 precision of 4.0, 0.675 recall of 5.0, 0.4470198675496689 precision of 5.0, 353 perfect matches. 2023-04-14 06:29:11,666 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.4 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.907 mean absolute error, 1.567 mean squared error, 0.345 recall of 1.0, 0.5267175572519084 precision of 1.0, 0.335 recall of 2.0, 0.3284313725490196 precision of 2.0, 0.195 recall of 3.0, 0.22941176470588234 precision of 3.0, 0.215 recall of 4.0, 0.22279792746113988 precision of 4.0, 0.675 recall of 5.0, 0.4470198675496689 precision of 5.0, 353 perfect matches. 2023-04-14 06:29:11,667 __main__ DEBUG Running garbage collection... 2023-04-14 06:29:12,174 __main__ DEBUG Collected 90089 pieces of garbage! 2023-04-14 06:29:12,194 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-04-14 06:29:12,197 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-04-14 06:29:12,198 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 06:29:29,623 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:30:05,562 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:30:05,703 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 2023-04-14 06:30:05,703 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 06:30:23,120 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:31:39,938 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:31:40,073 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Run #3 2023-04-14 06:31:40,073 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 06:31:57,555 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:33:42,338 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.3 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:33:42,478 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Run #4 2023-04-14 06:33:42,479 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.4 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 06:34:00,265 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.4 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:34:30,472 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.4 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:34:30,614 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.5 DEBUG Run #5 2023-04-14 06:34:30,614 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.5 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 06:34:48,476 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.5 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:35:49,348 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.5 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:35:49,492 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 DEBUG Run #6 2023-04-14 06:35:49,492 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-04-14 06:36:06,881 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:42:02,171 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Training succeeded! 2023-04-14 06:42:02,171 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 06:43:12,916 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.883 mean absolute error, 1.585 mean squared error, 0.48 recall of 1.0, 0.5133689839572193 precision of 1.0, 0.36 recall of 2.0, 0.3037974683544304 precision of 2.0, 0.265 recall of 3.0, 0.2994350282485876 precision of 3.0, 0.24 recall of 4.0, 0.32 precision of 4.0, 0.585 recall of 5.0, 0.46987951807228917 precision of 5.0, 386 perfect matches. 2023-04-14 06:43:13,043 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.6 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.883 mean absolute error, 1.585 mean squared error, 0.48 recall of 1.0, 0.5133689839572193 precision of 1.0, 0.36 recall of 2.0, 0.3037974683544304 precision of 2.0, 0.265 recall of 3.0, 0.2994350282485876 precision of 3.0, 0.24 recall of 4.0, 0.32 precision of 4.0, 0.585 recall of 5.0, 0.46987951807228917 precision of 5.0, 386 perfect matches. 2023-04-14 06:43:13,044 __main__ DEBUG Running garbage collection... 2023-04-14 06:43:13,489 __main__ DEBUG Collected 34043 pieces of garbage! 2023-04-14 06:43:13,497 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-04-14 06:43:13,499 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-04-14 06:43:13,499 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-04-14 06:43:30,934 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:49:30,860 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-04-14 06:49:30,861 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 06:50:39,200 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.759 mean absolute error, 1.249 mean squared error, 0.535 recall of 1.0, 0.6114285714285714 precision of 1.0, 0.335 recall of 2.0, 0.40119760479041916 precision of 2.0, 0.455 recall of 3.0, 0.3192982456140351 precision of 3.0, 0.415 recall of 4.0, 0.3672566371681416 precision of 4.0, 0.44 recall of 5.0, 0.5986394557823129 precision of 5.0, 436 perfect matches. 2023-04-14 06:50:39,328 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.759 mean absolute error, 1.249 mean squared error, 0.535 recall of 1.0, 0.6114285714285714 precision of 1.0, 0.335 recall of 2.0, 0.40119760479041916 precision of 2.0, 0.455 recall of 3.0, 0.3192982456140351 precision of 3.0, 0.415 recall of 4.0, 0.3672566371681416 precision of 4.0, 0.44 recall of 5.0, 0.5986394557823129 precision of 5.0, 436 perfect matches. 2023-04-14 06:50:39,328 __main__ DEBUG Running garbage collection... 2023-04-14 06:50:39,838 __main__ DEBUG Collected 87193 pieces of garbage! 2023-04-14 06:50:39,856 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-04-14 06:50:39,859 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-04-14 06:50:39,860 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 06:50:57,320 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:52:15,989 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:52:16,123 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 2023-04-14 06:52:16,124 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 06:52:33,737 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> 2023-04-14 06:53:46,252 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 ERROR Training failed, trying again with a different dataset... 2023-04-14 06:53:47,158 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Run #3 2023-04-14 06:53:47,158 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... 2023-04-14 06:54:05,432 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training sentiment analyzer: tokenizer> 2023-04-14 07:00:08,974 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training succeeded! 2023-04-14 07:00:09,017 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 07:01:28,678 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.72 mean absolute error, 1.182 mean squared error, 0.47 recall of 1.0, 0.6308724832214765 precision of 1.0, 0.505 recall of 2.0, 0.3713235294117647 precision of 2.0, 0.365 recall of 3.0, 0.35609756097560974 precision of 3.0, 0.405 recall of 4.0, 0.43548387096774194 precision of 4.0, 0.58 recall of 5.0, 0.6170212765957447 precision of 5.0, 465 perfect matches. 2023-04-14 07:01:29,212 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.72 mean absolute error, 1.182 mean squared error, 0.47 recall of 1.0, 0.6308724832214765 precision of 1.0, 0.505 recall of 2.0, 0.3713235294117647 precision of 2.0, 0.365 recall of 3.0, 0.35609756097560974 precision of 3.0, 0.405 recall of 4.0, 0.43548387096774194 precision of 4.0, 0.58 recall of 5.0, 0.6170212765957447 precision of 5.0, 465 perfect matches. 2023-04-14 07:01:29,212 __main__ DEBUG Running garbage collection... 2023-04-14 07:01:32,557 __main__ DEBUG Collected 89097 pieces of garbage! 2023-04-14 07:01:32,564 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-04-14 07:01:32,566 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-04-14 07:01:32,568 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... 2023-04-14 07:01:50,460 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-04-14 07:08:07,392 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-04-14 07:08:07,418 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-04-14 07:09:21,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.806 mean absolute error, 1.408 mean squared error, 0.57 recall of 1.0, 0.5352112676056338 precision of 1.0, 0.4 recall of 2.0, 0.35398230088495575 precision of 2.0, 0.34 recall of 3.0, 0.3090909090909091 precision of 3.0, 0.265 recall of 4.0, 0.3680555555555556 precision of 4.0, 0.535 recall of 5.0, 0.5431472081218274 precision of 5.0, 422 perfect matches. 2023-04-14 07:09:22,182 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.806 mean absolute error, 1.408 mean squared error, 0.57 recall of 1.0, 0.5352112676056338 precision of 1.0, 0.4 recall of 2.0, 0.35398230088495575 precision of 2.0, 0.34 recall of 3.0, 0.3090909090909091 precision of 3.0, 0.265 recall of 4.0, 0.3680555555555556 precision of 4.0, 0.535 recall of 5.0, 0.5431472081218274 precision of 5.0, 422 perfect matches.