{"version":"1.0","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fstmind.hatenablog.com%2Fentry%2F2024%2F08%2F15%2F175141\" title=\"BLIP-2\u306e\u8ad6\u6587\u30e1\u30e2\u3068\u30bc\u30ed\u30b7\u30e7\u30c3\u30c8\u306eimage-to-text\u751f\u6210\u306e\u304a\u8a66\u3057 - stMind\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","published":"2024-08-15 17:51:41","provider_name":"Hatena Blog","author_url":"https://blog.hatena.ne.jp/satojkovic/","categories":[],"url":"https://stmind.hatenablog.com/entry/2024/08/15/175141","width":"100%","provider_url":"https://hatena.blog","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/s/satojkovic/20240804/20240804150514.png","title":"BLIP-2\u306e\u8ad6\u6587\u30e1\u30e2\u3068\u30bc\u30ed\u30b7\u30e7\u30c3\u30c8\u306eimage-to-text\u751f\u6210\u306e\u304a\u8a66\u3057","height":"190","type":"rich","blog_url":"https://stmind.hatenablog.com/","blog_title":"stMind","author_name":"satojkovic","description":"\u3053\u306e\u8ad6\u6587\u3067\u306f\u3001\u4e8b\u524d\u5b66\u7fd2\u6e08\u307f\u306e\u753b\u50cf\u30a8\u30f3\u30b3\u30fc\u30c0\u30fc\u3068\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\u3092\u5229\u7528\u3057\u3001\u8efd\u91cf\u306aQuerying Transformer\uff08Q-former\uff09\u3067\u8996\u899a\u3068\u8a00\u8a9e\u306e\u30e2\u30c0\u30ea\u30c6\u30a3\u30ae\u30e3\u30c3\u30d7\u3092\u57cb\u3081\u308b\u3001 \u6c4e\u7528\u7684\u3067\u52b9\u7387\u7684\u306a\u65b0\u3057\u3044\u4e8b\u524d\u5b66\u7fd2\u6226\u7565\u3067\u3042\u308bBLIP-2\u3092\u63d0\u6848\u3057\u3066\u3044\u307e\u3059\u3002 BLIP-2\u306f\u3001\u65e2\u5b58\u624b\u6cd5\u3088\u308a\u5c11\u306a\u3044\u30d1\u30e9\u30e1\u30fc\u30bf\u3067\u69d8\u3005\u306aVision Language\u30bf\u30b9\u30af\u3067State-of-the-art\u306a\u6027\u80fd\u3092\u9054\u6210\u3057\u3066\u3044\u3066\u3001\u4f8b\u3048\u3070\u30bc\u30ed\u30b7\u30e7\u30c3\u30c8VQAv2\u3067\u306fFlamingo80B\u3088\u308a\u308254\u500d\u5c11\u306a\u3044\u30d1\u30e9\u30e1\u30fc\u30bf\u30678.7%\u306e\u6027\u80fd\u6539\u5584\u3092\u793a\u3057\u307e\u3057\u305f\u3002\u307e\u305f\u3001\u81ea\u7136\u8a00\u8a9e\u306e\u6307\u793a\u306b\u5f93\u3063\u305f\u30bc\u30ed\u30b7\u30e7\u30c3\u30c8\u306eimage-to-text \u751f\u6210\u3068\u3044\u3046\u3001\u3053\u306e\u2026"}