Sekirov Dictionary
/
Practise
My words
Apps
Sign in
tokenizer
noun
1
•
A
system
that
parses
an
input
stream
into
its
component
tokens.
forms
tokenizers
This dictionary works without the internet:
on your phone
·
in Chrome
