2023-05-09 05:23:10,479 __main__ INFO Started unimore-bda-6 in DEBUG mode! 2023-05-09 05:23:10,479 __main__ DEBUG Validating configuration... 2023-05-09 05:23:10,481 __main__ DEBUG Ensuring there are no leftover caches... 2023-05-09 05:23:10,505 __main__.sample_reviews_polar DEBUG Selected sample_func: sample_reviews_polar 2023-05-09 05:23:10,505 __main__.sample_reviews_polar.ThreeCheat DEBUG Selected SentimentAnalyzer: ThreeCheat 2023-05-09 05:23:10,506 __main__ DEBUG Running garbage collection... 2023-05-09 05:23:10,607 __main__ DEBUG Collected 19 pieces of garbage! 2023-05-09 05:23:10,608 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-05-09 05:23:10,608 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 DEBUG Run #1 2023-05-09 05:23:10,608 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 DEBUG Instantiating ThreeCheat with PlainTokenizer... 2023-05-09 05:24:27,907 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:24:27,907 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! 2023-05-09 05:24:27,907 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:24:28,145 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:24:28,287 __main__.sample_reviews_polar.ThreeCheat.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:24:28,288 __main__ DEBUG Running garbage collection... 2023-05-09 05:24:28,378 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:24:28,378 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-05-09 05:24:28,378 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 DEBUG Run #1 2023-05-09 05:24:28,378 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 DEBUG Instantiating ThreeCheat with LowercaseTokenizer... 2023-05-09 05:25:40,832 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:25:40,832 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-09 05:25:40,833 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:25:41,029 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:25:41,177 __main__.sample_reviews_polar.ThreeCheat.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:25:41,178 __main__ DEBUG Running garbage collection... 2023-05-09 05:25:41,266 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:25:41,266 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-05-09 05:25:41,266 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 DEBUG Run #1 2023-05-09 05:25:41,266 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 DEBUG Instantiating ThreeCheat with NLTKWordTokenizer... 2023-05-09 05:26:52,688 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:26:52,688 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-09 05:26:52,689 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:26:52,900 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:26:53,029 __main__.sample_reviews_polar.ThreeCheat.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:26:53,029 __main__ DEBUG Running garbage collection... 2023-05-09 05:26:53,116 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:26:53,117 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-05-09 05:26:53,117 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 DEBUG Run #1 2023-05-09 05:26:53,117 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 DEBUG Instantiating ThreeCheat with PottsTokenizer... 2023-05-09 05:28:04,548 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:28:04,548 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! 2023-05-09 05:28:04,549 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:28:04,743 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:28:04,875 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:28:04,876 __main__ DEBUG Running garbage collection... 2023-05-09 05:28:04,964 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:28:04,964 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-05-09 05:28:04,964 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-05-09 05:28:04,964 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Instantiating ThreeCheat with PottsTokenizerWithNegation... 2023-05-09 05:29:13,309 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:29:13,309 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-09 05:29:13,310 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:29:13,507 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:29:13,658 __main__.sample_reviews_polar.ThreeCheat.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:29:13,659 __main__ DEBUG Running garbage collection... 2023-05-09 05:29:13,750 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:29:13,750 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-05-09 05:29:13,750 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 DEBUG Run #1 2023-05-09 05:29:13,750 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 DEBUG Instantiating ThreeCheat with HuggingBertTokenizer... 2023-05-09 05:30:20,904 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:30:20,904 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-09 05:30:20,905 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:30:21,095 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 3.0, 0.0 precision of 3.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:30:21,233 __main__.sample_reviews_polar.ThreeCheat.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 2.0 mean absolute error, 4.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, 0.0 precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 0 perfect matches. 2023-05-09 05:30:21,233 __main__.sample_reviews_polar.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer 2023-05-09 05:30:21,234 __main__ DEBUG Running garbage collection... 2023-05-09 05:30:21,325 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:30:21,326 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-05-09 05:30:21,326 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-05-09 05:30:21,326 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... 2023-05-09 05:31:30,893 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:33:50,078 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-09 05:33:50,078 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:34:56,163 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.108 mean absolute error, 4.432 mean squared error, 0.622 recall of 1.0, 0.7794486215538847 precision of 1.0, 0.824 recall of 5.0, 0.6855241264559068 precision of 5.0, 723 perfect matches. 2023-05-09 05:34:56,426 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.108 mean absolute error, 4.432 mean squared error, 0.622 recall of 1.0, 0.7794486215538847 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.824 recall of 5.0, 0.6855241264559068 precision of 5.0, 723 perfect matches. 2023-05-09 05:34:56,427 __main__ DEBUG Running garbage collection... 2023-05-09 05:34:56,546 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:34:56,547 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-05-09 05:34:56,547 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-05-09 05:34:56,547 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... 2023-05-09 05:36:04,859 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:38:17,222 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-09 05:38:17,223 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:39:20,559 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.928 mean absolute error, 3.712 mean squared error, 0.67 recall of 1.0, 0.8333333333333334 precision of 1.0, 0.866 recall of 5.0, 0.7240802675585284 precision of 5.0, 768 perfect matches. 2023-05-09 05:39:20,712 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.928 mean absolute error, 3.712 mean squared error, 0.67 recall of 1.0, 0.8333333333333334 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.866 recall of 5.0, 0.7240802675585284 precision of 5.0, 768 perfect matches. 2023-05-09 05:39:20,712 __main__ DEBUG Running garbage collection... 2023-05-09 05:39:20,811 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:39:20,812 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-05-09 05:39:20,812 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-05-09 05:39:20,812 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... 2023-05-09 05:40:35,014 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:43:39,342 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-09 05:43:39,342 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:44:54,911 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.032 mean absolute error, 4.128 mean squared error, 0.636 recall of 1.0, 0.8071065989847716 precision of 1.0, 0.848 recall of 5.0, 0.6996699669966997 precision of 5.0, 742 perfect matches. 2023-05-09 05:44:55,149 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.032 mean absolute error, 4.128 mean squared error, 0.636 recall of 1.0, 0.8071065989847716 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.848 recall of 5.0, 0.6996699669966997 precision of 5.0, 742 perfect matches. 2023-05-09 05:44:55,150 __main__ DEBUG Running garbage collection... 2023-05-09 05:44:55,248 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:44:55,248 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-05-09 05:44:55,249 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-05-09 05:44:55,249 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... 2023-05-09 05:46:07,367 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:48:23,922 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-05-09 05:48:23,951 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:49:25,731 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.004 mean absolute error, 4.016 mean squared error, 0.654 recall of 1.0, 0.8074074074074075 precision of 1.0, 0.844 recall of 5.0, 0.7092436974789916 precision of 5.0, 749 perfect matches. 2023-05-09 05:49:26,193 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.004 mean absolute error, 4.016 mean squared error, 0.654 recall of 1.0, 0.8074074074074075 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.844 recall of 5.0, 0.7092436974789916 precision of 5.0, 749 perfect matches. 2023-05-09 05:49:26,194 __main__ DEBUG Running garbage collection... 2023-05-09 05:49:26,290 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:49:26,291 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-05-09 05:49:26,291 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-05-09 05:49:26,291 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 05:50:41,860 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:53:36,023 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-09 05:53:36,023 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 05:54:52,105 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.128 mean absolute error, 4.512 mean squared error, 0.59 recall of 1.0, 0.793010752688172 precision of 1.0, 0.846 recall of 5.0, 0.6735668789808917 precision of 5.0, 718 perfect matches. 2023-05-09 05:54:52,772 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.128 mean absolute error, 4.512 mean squared error, 0.59 recall of 1.0, 0.793010752688172 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.846 recall of 5.0, 0.6735668789808917 precision of 5.0, 718 perfect matches. 2023-05-09 05:54:52,773 __main__ DEBUG Running garbage collection... 2023-05-09 05:54:52,871 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 05:54:52,872 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-05-09 05:54:52,872 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-05-09 05:54:52,872 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... 2023-05-09 05:56:32,519 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 05:59:51,873 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-09 05:59:51,874 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 06:01:16,768 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 4.896 mean squared error, 0.554 recall of 1.0, 0.7694444444444445 precision of 1.0, 0.834 recall of 5.0, 0.6515625 precision of 5.0, 694 perfect matches. 2023-05-09 06:01:16,926 __main__.sample_reviews_polar.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 4.896 mean squared error, 0.554 recall of 1.0, 0.7694444444444445 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.834 recall of 5.0, 0.6515625 precision of 5.0, 694 perfect matches. 2023-05-09 06:01:16,926 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer 2023-05-09 06:01:16,927 __main__ DEBUG Running garbage collection... 2023-05-09 06:01:17,046 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 06:01:17,046 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-05-09 06:01:17,047 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-05-09 06:01:17,047 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-05-09 06:02:34,491 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:04:32,576 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 06:04:33,318 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 2023-05-09 06:04:33,318 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-05-09 06:05:51,081 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:06:34,775 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-05-09 06:06:35,321 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Run #3 2023-05-09 06:06:35,321 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-05-09 06:07:55,286 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:14:39,979 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training succeeded! 2023-05-09 06:14:40,002 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 06:15:50,611 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.89 recall of 1.0, 0.859073359073359 precision of 1.0, 0.854 recall of 5.0, 0.8858921161825726 precision of 5.0, 872 perfect matches. 2023-05-09 06:15:51,013 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.89 recall of 1.0, 0.859073359073359 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.854 recall of 5.0, 0.8858921161825726 precision of 5.0, 872 perfect matches. 2023-05-09 06:15:51,014 __main__ DEBUG Running garbage collection... 2023-05-09 06:15:51,163 __main__ DEBUG Collected 47085 pieces of garbage! 2023-05-09 06:15:51,175 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-05-09 06:15:51,176 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-05-09 06:15:51,177 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... 2023-05-09 06:17:09,650 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:24:21,933 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-09 06:24:21,962 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 06:25:30,721 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.898 recall of 1.0, 0.8821218074656189 precision of 1.0, 0.88 recall of 5.0, 0.8961303462321792 precision of 5.0, 889 perfect matches. 2023-05-09 06:25:31,300 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.444 mean absolute error, 1.776 mean squared error, 0.898 recall of 1.0, 0.8821218074656189 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.88 recall of 5.0, 0.8961303462321792 precision of 5.0, 889 perfect matches. 2023-05-09 06:25:31,301 __main__ DEBUG Running garbage collection... 2023-05-09 06:25:31,457 __main__ DEBUG Collected 46358 pieces of garbage! 2023-05-09 06:25:31,470 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-05-09 06:25:31,475 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-05-09 06:25:31,476 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-05-09 06:26:47,300 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:33:56,798 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-09 06:33:56,834 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 06:35:07,707 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.536 mean absolute error, 2.144 mean squared error, 0.944 recall of 1.0, 0.8166089965397924 precision of 1.0, 0.788 recall of 5.0, 0.933649289099526 precision of 5.0, 866 perfect matches. 2023-05-09 06:35:08,066 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.536 mean absolute error, 2.144 mean squared error, 0.944 recall of 1.0, 0.8166089965397924 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.788 recall of 5.0, 0.933649289099526 precision of 5.0, 866 perfect matches. 2023-05-09 06:35:08,066 __main__ DEBUG Running garbage collection... 2023-05-09 06:35:08,225 __main__ DEBUG Collected 44183 pieces of garbage! 2023-05-09 06:35:08,238 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-05-09 06:35:08,243 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-05-09 06:35:08,243 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-05-09 06:36:25,951 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:42:55,523 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-05-09 06:42:55,539 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 06:44:04,905 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.468 mean absolute error, 1.872 mean squared error, 0.942 recall of 1.0, 0.8425760286225402 precision of 1.0, 0.824 recall of 5.0, 0.9342403628117913 precision of 5.0, 883 perfect matches. 2023-05-09 06:44:05,412 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.468 mean absolute error, 1.872 mean squared error, 0.942 recall of 1.0, 0.8425760286225402 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.824 recall of 5.0, 0.9342403628117913 precision of 5.0, 883 perfect matches. 2023-05-09 06:44:05,413 __main__ DEBUG Running garbage collection... 2023-05-09 06:44:05,586 __main__ DEBUG Collected 42002 pieces of garbage! 2023-05-09 06:44:05,591 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-05-09 06:44:05,593 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-05-09 06:44:05,594 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 06:45:25,931 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:46:04,740 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 06:46:04,982 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 2023-05-09 06:46:04,982 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 06:47:22,959 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:48:34,068 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.2 ERROR Training failed, trying again with a different dataset... 2023-05-09 06:48:34,437 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Run #3 2023-05-09 06:48:34,437 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 06:49:51,948 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training sentiment analyzer: tokenizer> 2023-05-09 06:55:52,382 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Training succeeded! 2023-05-09 06:55:52,408 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 06:57:06,513 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.448 mean absolute error, 1.792 mean squared error, 0.91 recall of 1.0, 0.8716475095785441 precision of 1.0, 0.866 recall of 5.0, 0.9058577405857741 precision of 5.0, 888 perfect matches. 2023-05-09 06:57:06,856 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.448 mean absolute error, 1.792 mean squared error, 0.91 recall of 1.0, 0.8716475095785441 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.866 recall of 5.0, 0.9058577405857741 precision of 5.0, 888 perfect matches. 2023-05-09 06:57:06,857 __main__ DEBUG Running garbage collection... 2023-05-09 06:57:07,008 __main__ DEBUG Collected 5792 pieces of garbage! 2023-05-09 06:57:07,010 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-05-09 06:57:07,010 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-05-09 06:57:07,011 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... 2023-05-09 06:58:34,466 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 07:04:33,082 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-09 07:04:33,091 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 07:05:43,028 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.852 recall of 1.0, 0.8875 precision of 1.0, 0.892 recall of 5.0, 0.8576923076923076 precision of 5.0, 872 perfect matches. 2023-05-09 07:05:43,377 __main__.sample_reviews_polar.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.512 mean absolute error, 2.048 mean squared error, 0.852 recall of 1.0, 0.8875 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.892 recall of 5.0, 0.8576923076923076 precision of 5.0, 872 perfect matches. 2023-05-09 07:05:43,377 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer 2023-05-09 07:05:43,378 __main__ DEBUG Running garbage collection... 2023-05-09 07:05:43,558 __main__ DEBUG Collected 33314 pieces of garbage! 2023-05-09 07:05:43,564 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-05-09 07:05:43,565 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-05-09 07:05:43,566 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-05-09 07:07:00,569 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 07:13:17,955 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-09 07:13:17,981 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 07:14:27,458 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.504 mean absolute error, 2.016 mean squared error, 0.874 recall of 1.0, 0.874 precision of 1.0, 0.874 recall of 5.0, 0.874 precision of 5.0, 874 perfect matches. 2023-05-09 07:14:27,930 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.504 mean absolute error, 2.016 mean squared error, 0.874 recall of 1.0, 0.874 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.874 recall of 5.0, 0.874 precision of 5.0, 874 perfect matches. 2023-05-09 07:14:27,931 __main__ DEBUG Running garbage collection... 2023-05-09 07:14:28,117 __main__ DEBUG Collected 34039 pieces of garbage! 2023-05-09 07:14:28,129 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-05-09 07:14:28,131 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-05-09 07:14:28,131 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-05-09 07:15:45,785 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 07:16:00,914 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 07:16:01,101 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 2023-05-09 07:16:01,101 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-05-09 07:17:19,284 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 07:23:16,121 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! 2023-05-09 07:23:16,159 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 07:24:25,715 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.894 recall of 1.0, 0.8662790697674418 precision of 1.0, 0.862 recall of 5.0, 0.890495867768595 precision of 5.0, 878 perfect matches. 2023-05-09 07:24:26,053 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.894 recall of 1.0, 0.8662790697674418 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.862 recall of 5.0, 0.890495867768595 precision of 5.0, 878 perfect matches. 2023-05-09 07:24:26,053 __main__ DEBUG Running garbage collection... 2023-05-09 07:24:26,273 __main__ DEBUG Collected 51429 pieces of garbage! 2023-05-09 07:24:26,287 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-05-09 07:24:26,291 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-05-09 07:24:26,292 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-05-09 07:25:47,348 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 07:32:07,563 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-09 07:32:07,564 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 07:33:18,119 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.564 mean absolute error, 2.256 mean squared error, 0.844 recall of 1.0, 0.8701030927835052 precision of 1.0, 0.874 recall of 5.0, 0.8485436893203884 precision of 5.0, 859 perfect matches. 2023-05-09 07:33:18,611 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.564 mean absolute error, 2.256 mean squared error, 0.844 recall of 1.0, 0.8701030927835052 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.874 recall of 5.0, 0.8485436893203884 precision of 5.0, 859 perfect matches. 2023-05-09 07:33:18,611 __main__ DEBUG Running garbage collection... 2023-05-09 07:33:18,802 __main__ DEBUG Collected 29691 pieces of garbage! 2023-05-09 07:33:18,805 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-05-09 07:33:18,807 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-05-09 07:33:18,807 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-05-09 07:34:34,054 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 07:40:55,750 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-05-09 07:40:55,777 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 07:42:07,019 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.432 mean absolute error, 1.728 mean squared error, 0.924 recall of 1.0, 0.868421052631579 precision of 1.0, 0.86 recall of 5.0, 0.9188034188034188 precision of 5.0, 892 perfect matches. 2023-05-09 07:42:07,563 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.432 mean absolute error, 1.728 mean squared error, 0.924 recall of 1.0, 0.868421052631579 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.86 recall of 5.0, 0.9188034188034188 precision of 5.0, 892 perfect matches. 2023-05-09 07:42:07,563 __main__ DEBUG Running garbage collection... 2023-05-09 07:42:07,757 __main__ DEBUG Collected 26805 pieces of garbage! 2023-05-09 07:42:07,766 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-05-09 07:42:07,767 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-05-09 07:42:07,767 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 07:43:58,532 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 07:50:08,508 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-09 07:50:08,543 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 07:51:18,903 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.862 recall of 1.0, 0.8941908713692946 precision of 1.0, 0.898 recall of 5.0, 0.8667953667953668 precision of 5.0, 880 perfect matches. 2023-05-09 07:51:19,340 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.48 mean absolute error, 1.92 mean squared error, 0.862 recall of 1.0, 0.8941908713692946 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.898 recall of 5.0, 0.8667953667953668 precision of 5.0, 880 perfect matches. 2023-05-09 07:51:19,341 __main__ DEBUG Running garbage collection... 2023-05-09 07:51:19,540 __main__ DEBUG Collected 24622 pieces of garbage! 2023-05-09 07:51:19,544 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-05-09 07:51:19,544 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-05-09 07:51:19,544 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... 2023-05-09 07:52:35,419 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 07:58:56,842 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-09 07:58:56,877 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:00:07,076 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.908 recall of 1.0, 0.8566037735849057 precision of 1.0, 0.848 recall of 5.0, 0.902127659574468 precision of 5.0, 878 perfect matches. 2023-05-09 08:00:07,459 __main__.sample_reviews_polar.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.488 mean absolute error, 1.952 mean squared error, 0.908 recall of 1.0, 0.8566037735849057 precision of 1.0, inf recall of 2.0, inf precision of 2.0, inf recall of 3.0, inf precision of 3.0, inf recall of 4.0, inf precision of 4.0, 0.848 recall of 5.0, 0.902127659574468 precision of 5.0, 878 perfect matches. 2023-05-09 08:00:07,460 __main__.sample_reviews_varied DEBUG Selected sample_func: sample_reviews_varied 2023-05-09 08:00:07,461 __main__.sample_reviews_varied.ThreeCheat DEBUG Selected SentimentAnalyzer: ThreeCheat 2023-05-09 08:00:07,461 __main__ DEBUG Running garbage collection... 2023-05-09 08:00:07,669 __main__ DEBUG Collected 22445 pieces of garbage! 2023-05-09 08:00:07,672 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-05-09 08:00:07,673 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 DEBUG Run #1 2023-05-09 08:00:07,673 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 DEBUG Instantiating ThreeCheat with PlainTokenizer... 2023-05-09 08:03:03,476 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:03:03,476 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Training succeeded! 2023-05-09 08:03:03,477 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:03:03,663 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:03:03,813 __main__.sample_reviews_varied.ThreeCheat.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:03:03,813 __main__ DEBUG Running garbage collection... 2023-05-09 08:03:04,003 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:03:04,004 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-05-09 08:03:04,004 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 DEBUG Run #1 2023-05-09 08:03:04,004 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 DEBUG Instantiating ThreeCheat with LowercaseTokenizer... 2023-05-09 08:05:57,016 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:05:57,016 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-09 08:05:57,016 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:05:57,207 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:05:57,353 __main__.sample_reviews_varied.ThreeCheat.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:05:57,354 __main__ DEBUG Running garbage collection... 2023-05-09 08:05:57,538 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:05:57,538 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-05-09 08:05:57,538 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 DEBUG Run #1 2023-05-09 08:05:57,538 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 DEBUG Instantiating ThreeCheat with NLTKWordTokenizer... 2023-05-09 08:08:49,781 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:08:49,782 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-09 08:08:49,782 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:08:49,985 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:08:50,133 __main__.sample_reviews_varied.ThreeCheat.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:08:50,133 __main__ DEBUG Running garbage collection... 2023-05-09 08:08:50,320 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:08:50,321 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-05-09 08:08:50,321 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 DEBUG Run #1 2023-05-09 08:08:50,321 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 DEBUG Instantiating ThreeCheat with PottsTokenizer... 2023-05-09 08:11:45,418 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:11:45,418 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Training succeeded! 2023-05-09 08:11:45,418 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:11:45,616 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:11:45,756 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:11:45,757 __main__ DEBUG Running garbage collection... 2023-05-09 08:11:45,944 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:11:45,944 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-05-09 08:11:45,944 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-05-09 08:11:45,944 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 DEBUG Instantiating ThreeCheat with PottsTokenizerWithNegation... 2023-05-09 08:14:40,650 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:14:40,650 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-09 08:14:40,651 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:14:40,853 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:14:40,999 __main__.sample_reviews_varied.ThreeCheat.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:14:40,999 __main__ DEBUG Running garbage collection... 2023-05-09 08:14:41,180 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:14:41,181 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-05-09 08:14:41,181 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 DEBUG Run #1 2023-05-09 08:14:41,182 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 DEBUG Instantiating ThreeCheat with HuggingBertTokenizer... 2023-05-09 08:18:26,378 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:18:26,396 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-09 08:18:26,396 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:18:26,582 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:18:26,754 __main__.sample_reviews_varied.ThreeCheat.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.2 mean absolute error, 2.0 mean squared error, 0.0 recall of 1.0, inf precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 1.0 recall of 3.0, 0.2 precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.0 recall of 5.0, inf precision of 5.0, 200 perfect matches. 2023-05-09 08:18:26,755 __main__.sample_reviews_varied.NLTKSentimentAnalyzer DEBUG Selected SentimentAnalyzer: NLTKSentimentAnalyzer 2023-05-09 08:18:26,755 __main__ DEBUG Running garbage collection... 2023-05-09 08:18:26,940 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:18:26,940 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-05-09 08:18:26,940 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-05-09 08:18:26,941 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PlainTokenizer... 2023-05-09 08:22:46,955 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:25:57,693 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-09 08:25:57,693 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:28:40,246 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.301 mean absolute error, 3.171 mean squared error, 0.36 recall of 1.0, 0.496551724137931 precision of 1.0, 0.31 recall of 2.0, 0.2616033755274262 precision of 2.0, 0.075 recall of 3.0, 0.19480519480519481 precision of 3.0, 0.095 recall of 4.0, 0.3064516129032258 precision of 4.0, 0.7 recall of 5.0, 0.29227557411273486 precision of 5.0, 308 perfect matches. 2023-05-09 08:28:40,683 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.301 mean absolute error, 3.171 mean squared error, 0.36 recall of 1.0, 0.496551724137931 precision of 1.0, 0.31 recall of 2.0, 0.2616033755274262 precision of 2.0, 0.075 recall of 3.0, 0.19480519480519481 precision of 3.0, 0.095 recall of 4.0, 0.3064516129032258 precision of 4.0, 0.7 recall of 5.0, 0.29227557411273486 precision of 5.0, 308 perfect matches. 2023-05-09 08:28:40,684 __main__ DEBUG Running garbage collection... 2023-05-09 08:28:40,892 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:28:40,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-05-09 08:28:40,892 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-05-09 08:28:40,893 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with LowercaseTokenizer... 2023-05-09 08:31:44,828 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:34:36,824 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-09 08:34:36,824 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:37:07,157 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.285 mean absolute error, 3.297 mean squared error, 0.385 recall of 1.0, 0.4666666666666667 precision of 1.0, 0.285 recall of 2.0, 0.2835820895522388 precision of 2.0, 0.18 recall of 3.0, 0.3564356435643564 precision of 3.0, 0.19 recall of 4.0, 0.5135135135135135 precision of 4.0, 0.72 recall of 5.0, 0.3137254901960784 precision of 5.0, 352 perfect matches. 2023-05-09 08:37:07,339 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.285 mean absolute error, 3.297 mean squared error, 0.385 recall of 1.0, 0.4666666666666667 precision of 1.0, 0.285 recall of 2.0, 0.2835820895522388 precision of 2.0, 0.18 recall of 3.0, 0.3564356435643564 precision of 3.0, 0.19 recall of 4.0, 0.5135135135135135 precision of 4.0, 0.72 recall of 5.0, 0.3137254901960784 precision of 5.0, 352 perfect matches. 2023-05-09 08:37:07,339 __main__ DEBUG Running garbage collection... 2023-05-09 08:37:07,596 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:37:07,597 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-05-09 08:37:07,597 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-05-09 08:37:07,597 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with NLTKWordTokenizer... 2023-05-09 08:40:06,874 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:43:39,911 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-09 08:43:39,911 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:46:29,247 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.242 mean absolute error, 3.052 mean squared error, 0.405 recall of 1.0, 0.4308510638297872 precision of 1.0, 0.225 recall of 2.0, 0.2631578947368421 precision of 2.0, 0.175 recall of 3.0, 0.35714285714285715 precision of 3.0, 0.11 recall of 4.0, 0.36065573770491804 precision of 4.0, 0.76 recall of 5.0, 0.3153526970954357 precision of 5.0, 335 perfect matches. 2023-05-09 08:46:29,377 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.242 mean absolute error, 3.052 mean squared error, 0.405 recall of 1.0, 0.4308510638297872 precision of 1.0, 0.225 recall of 2.0, 0.2631578947368421 precision of 2.0, 0.175 recall of 3.0, 0.35714285714285715 precision of 3.0, 0.11 recall of 4.0, 0.36065573770491804 precision of 4.0, 0.76 recall of 5.0, 0.3153526970954357 precision of 5.0, 335 perfect matches. 2023-05-09 08:46:29,377 __main__ DEBUG Running garbage collection... 2023-05-09 08:46:29,583 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:46:29,583 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-05-09 08:46:29,583 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-05-09 08:46:29,584 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizer... 2023-05-09 08:49:24,027 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 08:52:17,921 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Training succeeded! 2023-05-09 08:52:17,922 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 08:54:40,904 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 3.024 mean squared error, 0.445 recall of 1.0, 0.4734042553191489 precision of 1.0, 0.155 recall of 2.0, 0.31 precision of 2.0, 0.3 recall of 3.0, 0.2803738317757009 precision of 3.0, 0.075 recall of 4.0, 0.3125 precision of 4.0, 0.665 recall of 5.0, 0.29555555555555557 precision of 5.0, 328 perfect matches. 2023-05-09 08:54:41,058 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.256 mean absolute error, 3.024 mean squared error, 0.445 recall of 1.0, 0.4734042553191489 precision of 1.0, 0.155 recall of 2.0, 0.31 precision of 2.0, 0.3 recall of 3.0, 0.2803738317757009 precision of 3.0, 0.075 recall of 4.0, 0.3125 precision of 4.0, 0.665 recall of 5.0, 0.29555555555555557 precision of 5.0, 328 perfect matches. 2023-05-09 08:54:41,059 __main__ DEBUG Running garbage collection... 2023-05-09 08:54:41,281 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 08:54:41,282 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-05-09 08:54:41,282 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-05-09 08:54:41,282 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating NLTKSentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 08:57:38,658 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 09:01:15,148 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-09 09:01:15,165 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 09:04:10,565 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.345 mean absolute error, 3.415 mean squared error, 0.35 recall of 1.0, 0.4268292682926829 precision of 1.0, 0.205 recall of 2.0, 0.23699421965317918 precision of 2.0, 0.14 recall of 3.0, 0.3010752688172043 precision of 3.0, 0.11 recall of 4.0, 0.3548387096774194 precision of 4.0, 0.77 recall of 5.0, 0.3031496062992126 precision of 5.0, 315 perfect matches. 2023-05-09 09:04:10,850 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.345 mean absolute error, 3.415 mean squared error, 0.35 recall of 1.0, 0.4268292682926829 precision of 1.0, 0.205 recall of 2.0, 0.23699421965317918 precision of 2.0, 0.14 recall of 3.0, 0.3010752688172043 precision of 3.0, 0.11 recall of 4.0, 0.3548387096774194 precision of 4.0, 0.77 recall of 5.0, 0.3031496062992126 precision of 5.0, 315 perfect matches. 2023-05-09 09:04:10,851 __main__ DEBUG Running garbage collection... 2023-05-09 09:04:11,061 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 09:04:11,061 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-05-09 09:04:11,061 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-05-09 09:04:11,061 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating NLTKSentimentAnalyzer with HuggingBertTokenizer... 2023-05-09 09:07:08,716 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 09:11:17,098 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-09 09:11:17,099 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 09:14:31,177 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.263 mean absolute error, 3.127 mean squared error, 0.36 recall of 1.0, 0.4675324675324675 precision of 1.0, 0.24 recall of 2.0, 0.35555555555555557 precision of 2.0, 0.2 recall of 3.0, 0.26143790849673204 precision of 3.0, 0.1 recall of 4.0, 0.3125 precision of 4.0, 0.77 recall of 5.0, 0.3117408906882591 precision of 5.0, 334 perfect matches. 2023-05-09 09:14:31,338 __main__.sample_reviews_varied.NLTKSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.263 mean absolute error, 3.127 mean squared error, 0.36 recall of 1.0, 0.4675324675324675 precision of 1.0, 0.24 recall of 2.0, 0.35555555555555557 precision of 2.0, 0.2 recall of 3.0, 0.26143790849673204 precision of 3.0, 0.1 recall of 4.0, 0.3125 precision of 4.0, 0.77 recall of 5.0, 0.3117408906882591 precision of 5.0, 334 perfect matches. 2023-05-09 09:14:31,338 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowPolarSentimentAnalyzer 2023-05-09 09:14:31,339 __main__ DEBUG Running garbage collection... 2023-05-09 09:14:31,554 __main__ DEBUG Collected 0 pieces of garbage! 2023-05-09 09:14:31,554 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-05-09 09:14:31,554 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-05-09 09:14:31,554 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-05-09 09:17:30,540 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 09:18:40,721 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 09:18:40,908 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Run #2 2023-05-09 09:18:40,908 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-05-09 09:21:40,669 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 09:22:07,772 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-05-09 09:22:07,920 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Run #3 2023-05-09 09:22:07,920 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PlainTokenizer... 2023-05-09 09:24:56,782 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-05-09 09:31:31,796 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Training succeeded! 2023-05-09 09:31:31,824 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 09:32:47,881 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.282 mean absolute error, 3.128 mean squared error, 0.925 recall of 1.0, 0.3140916808149406 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.74 recall of 5.0, 0.36009732360097324 precision of 5.0, 333 perfect matches. 2023-05-09 09:32:48,206 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PlainTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.282 mean absolute error, 3.128 mean squared error, 0.925 recall of 1.0, 0.3140916808149406 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.74 recall of 5.0, 0.36009732360097324 precision of 5.0, 333 perfect matches. 2023-05-09 09:32:48,207 __main__ DEBUG Running garbage collection... 2023-05-09 09:32:48,436 __main__ DEBUG Collected 31129 pieces of garbage! 2023-05-09 09:32:48,449 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-05-09 09:32:48,451 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-05-09 09:32:48,451 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with LowercaseTokenizer... 2023-05-09 09:36:07,346 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 09:42:26,127 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Training succeeded! 2023-05-09 09:42:26,154 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 09:43:41,102 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.242 mean absolute error, 2.968 mean squared error, 0.87 recall of 1.0, 0.3246268656716418 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.805 recall of 5.0, 0.34698275862068967 precision of 5.0, 335 perfect matches. 2023-05-09 09:43:41,775 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.LowercaseTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.242 mean absolute error, 2.968 mean squared error, 0.87 recall of 1.0, 0.3246268656716418 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.805 recall of 5.0, 0.34698275862068967 precision of 5.0, 335 perfect matches. 2023-05-09 09:43:41,776 __main__ DEBUG Running garbage collection... 2023-05-09 09:43:41,988 __main__ DEBUG Collected 5802 pieces of garbage! 2023-05-09 09:43:41,990 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-05-09 09:43:41,990 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-05-09 09:43:41,990 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-05-09 09:46:39,859 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 09:48:45,696 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 09:48:46,213 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Run #2 2023-05-09 09:48:46,213 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-05-09 09:51:39,487 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 09:52:54,457 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-05-09 09:52:55,527 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Run #3 2023-05-09 09:52:55,528 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with NLTKWordTokenizer... 2023-05-09 09:55:58,843 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-05-09 10:02:28,560 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Training succeeded! 2023-05-09 10:02:28,581 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 10:03:52,406 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.198 mean absolute error, 2.792 mean squared error, 0.84 recall of 1.0, 0.3605150214592275 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.895 recall of 5.0, 0.3352059925093633 precision of 5.0, 347 perfect matches. 2023-05-09 10:03:52,817 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.NLTKWordTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.198 mean absolute error, 2.792 mean squared error, 0.84 recall of 1.0, 0.3605150214592275 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.895 recall of 5.0, 0.3352059925093633 precision of 5.0, 347 perfect matches. 2023-05-09 10:03:52,817 __main__ DEBUG Running garbage collection... 2023-05-09 10:03:53,070 __main__ DEBUG Collected 40546 pieces of garbage! 2023-05-09 10:03:53,082 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-05-09 10:03:53,083 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-05-09 10:03:53,084 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-05-09 10:07:26,539 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 10:09:20,147 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 10:09:21,785 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 2023-05-09 10:09:21,786 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizer... 2023-05-09 10:13:13,168 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 10:19:23,799 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Training succeeded! 2023-05-09 10:19:23,800 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 10:20:39,244 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 2.896 mean squared error, 0.8 recall of 1.0, 0.3686635944700461 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.91 recall of 5.0, 0.3215547703180212 precision of 5.0, 342 perfect matches. 2023-05-09 10:20:39,562 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.224 mean absolute error, 2.896 mean squared error, 0.8 recall of 1.0, 0.3686635944700461 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.91 recall of 5.0, 0.3215547703180212 precision of 5.0, 342 perfect matches. 2023-05-09 10:20:39,563 __main__ DEBUG Running garbage collection... 2023-05-09 10:20:39,804 __main__ DEBUG Collected 23174 pieces of garbage! 2023-05-09 10:20:39,812 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-05-09 10:20:39,812 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-05-09 10:20:39,812 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 10:23:31,580 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 10:29:43,475 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training succeeded! 2023-05-09 10:29:43,476 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 10:30:51,406 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.202 mean absolute error, 2.808 mean squared error, 0.925 recall of 1.0, 0.29983792544570503 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.785 recall of 5.0, 0.40992167101827676 precision of 5.0, 342 perfect matches. 2023-05-09 10:30:51,539 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.202 mean absolute error, 2.808 mean squared error, 0.925 recall of 1.0, 0.29983792544570503 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.785 recall of 5.0, 0.40992167101827676 precision of 5.0, 342 perfect matches. 2023-05-09 10:30:51,539 __main__ DEBUG Running garbage collection... 2023-05-09 10:30:51,871 __main__ DEBUG Collected 85765 pieces of garbage! 2023-05-09 10:30:51,894 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-05-09 10:30:51,899 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-05-09 10:30:51,902 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowPolarSentimentAnalyzer with HuggingBertTokenizer... 2023-05-09 10:33:38,228 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 10:39:53,425 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-09 10:39:53,426 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 10:41:01,628 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 1.186 mean absolute error, 2.744 mean squared error, 0.865 recall of 1.0, 0.36041666666666666 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.9 recall of 5.0, 0.34615384615384615 precision of 5.0, 353 perfect matches. 2023-05-09 10:41:01,765 __main__.sample_reviews_varied.TensorflowPolarSentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 1.186 mean absolute error, 2.744 mean squared error, 0.865 recall of 1.0, 0.36041666666666666 precision of 1.0, 0.0 recall of 2.0, inf precision of 2.0, 0.0 recall of 3.0, inf precision of 3.0, 0.0 recall of 4.0, inf precision of 4.0, 0.9 recall of 5.0, 0.34615384615384615 precision of 5.0, 353 perfect matches. 2023-05-09 10:41:01,766 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer DEBUG Selected SentimentAnalyzer: TensorflowCategorySentimentAnalyzer 2023-05-09 10:41:01,766 __main__ DEBUG Running garbage collection... 2023-05-09 10:41:02,097 __main__ DEBUG Collected 85743 pieces of garbage! 2023-05-09 10:41:02,120 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer DEBUG Selected Tokenizer: PlainTokenizer 2023-05-09 10:41:02,126 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Run #1 2023-05-09 10:41:02,131 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PlainTokenizer... 2023-05-09 10:43:48,227 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 10:50:25,072 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Training succeeded! 2023-05-09 10:50:25,073 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 10:51:32,722 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.864 mean absolute error, 1.446 mean squared error, 0.49 recall of 1.0, 0.5798816568047337 precision of 1.0, 0.395 recall of 2.0, 0.30859375 precision of 2.0, 0.225 recall of 3.0, 0.22277227722772278 precision of 3.0, 0.405 recall of 4.0, 0.32661290322580644 precision of 4.0, 0.35 recall of 5.0, 0.56 precision of 5.0, 373 perfect matches. 2023-05-09 10:51:32,846 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PlainTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.864 mean absolute error, 1.446 mean squared error, 0.49 recall of 1.0, 0.5798816568047337 precision of 1.0, 0.395 recall of 2.0, 0.30859375 precision of 2.0, 0.225 recall of 3.0, 0.22277227722772278 precision of 3.0, 0.405 recall of 4.0, 0.32661290322580644 precision of 4.0, 0.35 recall of 5.0, 0.56 precision of 5.0, 373 perfect matches. 2023-05-09 10:51:32,847 __main__ DEBUG Running garbage collection... 2023-05-09 10:51:33,183 __main__ DEBUG Collected 87209 pieces of garbage! 2023-05-09 10:51:33,200 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer DEBUG Selected Tokenizer: LowercaseTokenizer 2023-05-09 10:51:33,205 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Run #1 2023-05-09 10:51:33,206 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-05-09 10:54:21,941 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 10:54:39,553 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 10:54:39,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Run #2 2023-05-09 10:54:39,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with LowercaseTokenizer... 2023-05-09 10:57:25,389 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 11:04:00,421 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Training succeeded! 2023-05-09 11:04:00,421 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 11:05:08,302 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.856 mean absolute error, 1.754 mean squared error, 0.63 recall of 1.0, 0.5185185185185185 precision of 1.0, 0.25 recall of 2.0, 0.44642857142857145 precision of 2.0, 0.42 recall of 3.0, 0.38009049773755654 precision of 3.0, 0.38 recall of 4.0, 0.3486238532110092 precision of 4.0, 0.545 recall of 5.0, 0.529126213592233 precision of 5.0, 445 perfect matches. 2023-05-09 11:05:08,423 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.LowercaseTokenizer.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.856 mean absolute error, 1.754 mean squared error, 0.63 recall of 1.0, 0.5185185185185185 precision of 1.0, 0.25 recall of 2.0, 0.44642857142857145 precision of 2.0, 0.42 recall of 3.0, 0.38009049773755654 precision of 3.0, 0.38 recall of 4.0, 0.3486238532110092 precision of 4.0, 0.545 recall of 5.0, 0.529126213592233 precision of 5.0, 445 perfect matches. 2023-05-09 11:05:08,424 __main__ DEBUG Running garbage collection... 2023-05-09 11:05:08,683 __main__ DEBUG Collected 10851 pieces of garbage! 2023-05-09 11:05:08,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer DEBUG Selected Tokenizer: NLTKWordTokenizer 2023-05-09 11:05:08,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Run #1 2023-05-09 11:05:08,686 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with NLTKWordTokenizer... 2023-05-09 11:07:59,265 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 11:14:33,575 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Training succeeded! 2023-05-09 11:14:33,576 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 11:15:43,028 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.779 mean absolute error, 1.257 mean squared error, 0.43 recall of 1.0, 0.688 precision of 1.0, 0.18 recall of 2.0, 0.3076923076923077 precision of 2.0, 0.505 recall of 3.0, 0.2961876832844575 precision of 3.0, 0.465 recall of 4.0, 0.3576923076923077 precision of 4.0, 0.51 recall of 5.0, 0.6496815286624203 precision of 5.0, 418 perfect matches. 2023-05-09 11:15:43,154 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.NLTKWordTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.779 mean absolute error, 1.257 mean squared error, 0.43 recall of 1.0, 0.688 precision of 1.0, 0.18 recall of 2.0, 0.3076923076923077 precision of 2.0, 0.505 recall of 3.0, 0.2961876832844575 precision of 3.0, 0.465 recall of 4.0, 0.3576923076923077 precision of 4.0, 0.51 recall of 5.0, 0.6496815286624203 precision of 5.0, 418 perfect matches. 2023-05-09 11:15:43,154 __main__ DEBUG Running garbage collection... 2023-05-09 11:15:43,502 __main__ DEBUG Collected 87215 pieces of garbage! 2023-05-09 11:15:43,521 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer DEBUG Selected Tokenizer: PottsTokenizer 2023-05-09 11:15:43,524 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Run #1 2023-05-09 11:15:43,524 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-05-09 11:18:32,841 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 11:20:35,375 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 11:20:35,508 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Run #2 2023-05-09 11:20:35,508 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-05-09 11:23:48,209 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 11:24:54,284 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.2 ERROR Training failed, trying again with a different dataset... 2023-05-09 11:24:54,412 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 DEBUG Run #3 2023-05-09 11:24:54,413 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizer... 2023-05-09 11:27:43,056 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Training sentiment analyzer: tokenizer> 2023-05-09 11:33:55,614 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Training succeeded! 2023-05-09 11:33:55,615 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 11:35:03,758 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.805 mean absolute error, 1.473 mean squared error, 0.535 recall of 1.0, 0.5846994535519126 precision of 1.0, 0.455 recall of 2.0, 0.4008810572687225 precision of 2.0, 0.42 recall of 3.0, 0.3514644351464435 precision of 3.0, 0.365 recall of 4.0, 0.3476190476190476 precision of 4.0, 0.44 recall of 5.0, 0.624113475177305 precision of 5.0, 443 perfect matches. 2023-05-09 11:35:03,885 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizer.3 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.805 mean absolute error, 1.473 mean squared error, 0.535 recall of 1.0, 0.5846994535519126 precision of 1.0, 0.455 recall of 2.0, 0.4008810572687225 precision of 2.0, 0.42 recall of 3.0, 0.3514644351464435 precision of 3.0, 0.365 recall of 4.0, 0.3476190476190476 precision of 4.0, 0.44 recall of 5.0, 0.624113475177305 precision of 5.0, 443 perfect matches. 2023-05-09 11:35:03,886 __main__ DEBUG Running garbage collection... 2023-05-09 11:35:04,190 __main__ DEBUG Collected 28962 pieces of garbage! 2023-05-09 11:35:04,201 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation DEBUG Selected Tokenizer: PottsTokenizerWithNegation 2023-05-09 11:35:04,201 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Run #1 2023-05-09 11:35:04,202 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 11:37:50,279 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 11:39:06,137 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.1 ERROR Training failed, trying again with a different dataset... 2023-05-09 11:39:06,291 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Run #2 2023-05-09 11:39:06,291 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with PottsTokenizerWithNegation... 2023-05-09 11:42:32,775 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training sentiment analyzer: tokenizer> 2023-05-09 11:49:09,170 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Training succeeded! 2023-05-09 11:49:09,173 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 11:50:18,948 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.901 mean absolute error, 1.833 mean squared error, 0.435 recall of 1.0, 0.46774193548387094 precision of 1.0, 0.28 recall of 2.0, 0.3660130718954248 precision of 2.0, 0.355 recall of 3.0, 0.3776595744680851 precision of 3.0, 0.415 recall of 4.0, 0.33739837398373984 precision of 4.0, 0.58 recall of 5.0, 0.5110132158590308 precision of 5.0, 413 perfect matches. 2023-05-09 11:50:19,347 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.PottsTokenizerWithNegation.2 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.901 mean absolute error, 1.833 mean squared error, 0.435 recall of 1.0, 0.46774193548387094 precision of 1.0, 0.28 recall of 2.0, 0.3660130718954248 precision of 2.0, 0.355 recall of 3.0, 0.3776595744680851 precision of 3.0, 0.415 recall of 4.0, 0.33739837398373984 precision of 4.0, 0.58 recall of 5.0, 0.5110132158590308 precision of 5.0, 413 perfect matches. 2023-05-09 11:50:19,347 __main__ DEBUG Running garbage collection... 2023-05-09 11:50:21,295 __main__ DEBUG Collected 88141 pieces of garbage! 2023-05-09 11:50:21,314 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer DEBUG Selected Tokenizer: HuggingBertTokenizer 2023-05-09 11:50:21,317 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Run #1 2023-05-09 11:50:21,317 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 DEBUG Instantiating TensorflowCategorySentimentAnalyzer with HuggingBertTokenizer... 2023-05-09 11:53:15,418 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training sentiment analyzer: tokenizer> 2023-05-09 11:59:36,817 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Training succeeded! 2023-05-09 11:59:36,817 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluating sentiment analyzer: tokenizer> 2023-05-09 12:00:44,982 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Evaluation results: Evaluation results: 1000 evaluated, 0.817 mean absolute error, 1.453 mean squared error, 0.535 recall of 1.0, 0.5376884422110553 precision of 1.0, 0.34 recall of 2.0, 0.3333333333333333 precision of 2.0, 0.4 recall of 3.0, 0.32786885245901637 precision of 3.0, 0.31 recall of 4.0, 0.389937106918239 precision of 4.0, 0.54 recall of 5.0, 0.5567010309278351 precision of 5.0, 425 perfect matches. 2023-05-09 12:00:45,106 __main__.sample_reviews_varied.TensorflowCategorySentimentAnalyzer.HuggingBertTokenizer.1 INFO Cumulative evaluation results: Evaluation results: 1000 evaluated, 0.817 mean absolute error, 1.453 mean squared error, 0.535 recall of 1.0, 0.5376884422110553 precision of 1.0, 0.34 recall of 2.0, 0.3333333333333333 precision of 2.0, 0.4 recall of 3.0, 0.32786885245901637 precision of 3.0, 0.31 recall of 4.0, 0.389937106918239 precision of 4.0, 0.54 recall of 5.0, 0.5567010309278351 precision of 5.0, 425 perfect matches.