11 commits

Author	SHA1	Message	Date
Stefano Pigozzi	58554c84e0	Do not stringify processed tokens	2023-02-14 17:51:24 +01:00
Stefano Pigozzi	c82352c7dc	Fix PottsTokenizer failing to train NLTK model	2023-02-13 17:45:28 +01:00
Stefano Pigozzi	e93a8ddaf7	Fix type annotation of PottsTokenizerWithNegation	2023-02-13 15:55:45 +01:00
Stefano Pigozzi	4e8aa68db3	CODE IS DONE	2023-02-12 05:11:58 +01:00
Stefano Pigozzi	7778c648c1	fix and patch things	2023-02-11 04:32:17 +01:00
Stefano Pigozzi	3d9eeecb2a	Improve the tokenizer situation	2023-02-10 05:12:07 +01:00
Stefano Pigozzi	48ac00b548	Document and fix imports in .tokenizer	2023-02-10 03:19:17 +01:00
Stefano Pigozzi	e3005ab8b0	enough	2023-02-08 19:46:05 +01:00
Stefano Pigozzi	3abba24ca2	Made good progress ... How does text vectorization in tensorflow work?	2023-02-05 17:40:22 +01:00
Stefano Pigozzi	e6dcf6e423	stop here for now	2023-02-04 01:36:42 +01:00
Stefano Pigozzi	6ef81c1c19	New version working nicely	2023-02-03 23:27:44 +01:00