I’m downloading the full weights currently. Will give it a try on my Framework Desktop when I can. I expect that I will need a newer version of llama.cpp given the new architecture – there are already pull requests pending though… (e.g. https://github.com/ggml-org/llama.cpp/pull/27742)