Laura Gorrieri
May 20, 2021

--

Hello Scott,

yes you are exactly right! It would have been a better tokenization, I didn't notice it. It looks like the tokenizer preferred to give priority to "break in" in the meaning of forcefully entering a place, even if it is a mistake.

Thanks for your feedback.

Have a nice one,

Laura

--

--

Laura Gorrieri
Laura Gorrieri

Written by Laura Gorrieri

Academic background in NLP and in Philosophy, nowadays PhD researcher in Ethics and AI, I’m a curious person and a humanist at heart.

No responses yet