{"provider_name":"Hatena Blog","published":"2024-03-06 23:55:11","title":"The Era of 1-bit LLMs by Microsoft \u307e\u3068\u3081","provider_url":"https://hatena.blog","categories":["LLM"],"height":"190","author_url":"https://blog.hatena.ne.jp/kaeken/","blog_title":"kaeken(\u5609\u6c38\u5cf6\u5065\u53f8)\u30d6\u30ed\u30b0","url":"https://kaeken.hatenablog.com/entry/2024/03/06/235511","author_name":"kaeken","type":"rich","html":"<iframe src=\"https://hatenablog-parts.com/embed?url=https%3A%2F%2Fkaeken.hatenablog.com%2Fentry%2F2024%2F03%2F06%2F235511\" title=\"The Era of 1-bit LLMs by Microsoft \u307e\u3068\u3081 - kaeken(\u5609\u6c38\u5cf6\u5065\u53f8)\u30d6\u30ed\u30b0\" class=\"embed-card embed-blogcard\" scrolling=\"no\" frameborder=\"0\" style=\"display: block; width: 100%; height: 190px; max-width: 500px; margin: 10px 0px;\"></iframe>","blog_url":"https://kaeken.hatenablog.com/","description":"overview Title: The Impact of 1-Bit LLM: A 8.9-Fold Speed Increase with BitNet 1.58Bits Significant Advancement in LLMs: Introduction of a 1-bit LLM, \"BitNet 1.58Bits,\" by Microsoft's China team. Leap in Efficiency and Performance: Transition from 8-bit or 4-bit to 1-bit quantization. Remarkable Spe\u2026","width":"100%","version":"1.0","image_url":"https://cdn-ak.f.st-hatena.com/images/fotolife/k/kaeken/20240306/20240306231736.png"}