{"title":"word2vec (CBOW)","provider_name":"Hatena Blog","width":"100%","provider_url":"https://hatena.blog","author_url":"https://blog.hatena.ne.jp/derwind/","author_name":"derwind","url":"https://randommemory.hatenablog.com/entry/2020/01/26/173300","published":"2020-01-26 17:33:00","type":"rich","description":"\u8a73\u8aacword2vec\u307f\u305f\u3044\u306a\u4f55\u3068\u3082\u8a00\u3048\u306a\u3044\u69cb\u9020\u3002 \u30b3\u30fc\u30d1\u30b9\u306e\u5358\u8a9e\u6570\u306e\u9577\u3055($L$)\u306e\u6570\u30d9\u30af\u30c8\u30eb\u3092\u30b3\u30f3\u30c6\u30ad\u30b9\u30c8\u306e\u30a6\u30a3\u30f3\u30c9\u30a6\u30b5\u30a4\u30ba\u306e2\u500d\u5206($N$)\u3060\u3051\u5165\u529b\u3057\u3066\u30b3\u30fc\u30d1\u30b9\u306e\u500b\u6570\u306b\u7b49\u3057\u3044\u51fa\u529b\u3092\u51fa\u3057\u3001softmax\u3067\u78ba\u7387\u306b\u5909\u63db\u3059\u308b\u3002MINIST\u306e\u6642\u3092\u601d\u3044\u51fa\u3059\u3068\u3001\u5165\u529b\u5c64\u306f784\u6b21\u5143\u306e\u6570\u30d9\u30af\u30c8\u30eb\u3060\u3063\u305f\u3002\u4eca\u56de\u306f $N$ \u6b21\u5143\u306e\u30d9\u30af\u30c8\u30eb\u306e\u30d9\u30af\u30c8\u30eb\u3067\u3042\u308b\u3002\u3053\u3053\u3067\u8a18\u53f7\u3068\u3057\u3066 $\\mathcal{V} = \\R^L$ \u3092\u8a2d\u5b9a\u3059\u308b\u3002\u3059\u308b\u3068\u3001MNIST\u306e\u6642\u306e\u5165\u529b\u306f $\\R^{784}$ \u3067\u3042\u3063\u305f\u306e\u306b\u5bfe\u3057\u3066 word2vec (CBOW) \u3067\u306f $\\mathcal{V}^N$ \u3067\u3042\u308b\u3002\u898b\u305f\u76ee\u304c\u5c11\u3057\u8fd1\u304f\u306a\u3063\u3066\u304d\u305f\u3002MNIST\u2026","image_url":null,"blog_title":"\u3089\u3093\u3060\u3080\u306a\u8a18\u61b6","height":"190","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Frandommemory.hatenablog.com%2Fentry%2F2020%2F01%2F26%2F173300\" title=\"word2vec (CBOW) - \u3089\u3093\u3060\u3080\u306a\u8a18\u61b6\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","categories":["machine_learning"],"blog_url":"https://randommemory.hatenablog.com/","version":"1.0"}