Extending Context Window of Large Language Models via Positional Interpolation Explained
Paper found here: https://arxiv.org/abs/2306.15595
Looks like there was a discussion about this topic here if interested: https://github.com/ggerganov/llama.cp...