![]() Both words co-occur with their shared property water frequently, and both co-occur with the unrelated word fashion infrequently. Here are some actual probabilities from a 6 billion word corpus:Īs one might expect, ice co-occurs more frequently with solid than it does with gas, whereas steam co-occurs more frequently with gas than it does with solid. ![]() For example, consider the co-occurrence probabilities for target words ice and steam with various probe words from the vocabulary. The main intuition underlying the model is the simple observation that ratios of word-word co-occurrence probabilities have the potential for encoding some form of meaning. GloVe is essentially a log-bilinear model with a weighted least-squares objective. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |