{"id":1416,"date":"2023-10-19T22:55:53","date_gmt":"2023-10-19T21:55:53","guid":{"rendered":"https:\/\/blog.thomarite.uk\/?p=1416"},"modified":"2023-10-19T22:55:53","modified_gmt":"2023-10-19T21:55:53","slug":"ring-memory","status":"publish","type":"post","link":"https:\/\/blog.thomarite.uk\/index.php\/2023\/10\/19\/ring-memory\/","title":{"rendered":"Ring Memory"},"content":{"rendered":"\n<p>Reading this <a href=\"https:\/\/www.businessinsider.com\/google-researcher-ai-models-analyze-millions-of-words-at-once-2023-10\">news<\/a> I was surprised by the mentioned <a href=\"https:\/\/arxiv.org\/pdf\/2112.05682.pdf\">paper<\/a> where LLM can take up to millions of tokens. My knowledge of LLM infrastucture is very little (and the paper is a bit beyond me&#8230;) but I thought the implementation of this models followed kind of &#8220;chain\/waterfall&#8221; where the output of some GPUs fed other GPUs.<\/p>\n\n\n\n<p> <\/p>\n","protected":false},"excerpt":{"rendered":"<p>Reading this news I was surprised by the mentioned paper where LLM can take up to millions of tokens. My knowledge of LLM infrastucture is very little (and the paper is a bit beyond me&#8230;) but I thought the implementation of this models followed kind of &#8220;chain\/waterfall&#8221; where the output of some GPUs fed other &hellip; <a href=\"https:\/\/blog.thomarite.uk\/index.php\/2023\/10\/19\/ring-memory\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Ring Memory&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"class_list":["post-1416","post","type-post","status-publish","format-standard","hentry","category-networks"],"_links":{"self":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1416","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/comments?post=1416"}],"version-history":[{"count":1,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1416\/revisions"}],"predecessor-version":[{"id":1417,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/posts\/1416\/revisions\/1417"}],"wp:attachment":[{"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/media?parent=1416"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/categories?post=1416"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.thomarite.uk\/index.php\/wp-json\/wp\/v2\/tags?post=1416"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}