August 2024

What are Tokens & Context-Length in Large Language Models (LLMs)?

With the fast advancement of artificial intelligence (AI), Large Language Models (LLMs) have become increasingly sophisticated. As new models are released, two key concepts consistently emerge in discussions: context-length and tokens. Tokens Let’s consider the latest open-source LLM model by Meta AI, Llama 3.1 405B, having 128K tokens as the context-length. We will talk about

What are Tokens & Context-Length in Large Language Models (LLMs)? Read More »