why a word even not exist in spacy should have vector? #12536
Answered
by
adrianeboyd
Oscarjia
asked this question in
Help: Other Questions
-
How to reproduce the behaviouri want to use word's vector to check if word is existed, but i found even not existed word in spacy model will have vector.
the word Your Environment
|
Beta Was this translation helpful? Give feedback.
Answered by
adrianeboyd
Apr 17, 2023
Replies: 1 comment
-
The words with vectors are words above a certain frequency in a corpus of primarily webcrawl data, so if a misspelling or typo is frequent enough, it may have a vector. The list of words with vectors is large and noisy and probably isn't the right kind of word list to use for this task. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
svlandeg
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The words with vectors are words above a certain frequency in a corpus of primarily webcrawl data, so if a misspelling or typo is frequent enough, it may have a vector.
The list of words with vectors is large and noisy and probably isn't the right kind of word list to use for this task.