The config file seems to be mismatch ed with the model loaded from the checkpoint. can you provide right config file of the model in the checkpoint?
Compiler: cc (Ubuntu 11.4.0-1ubuntu1~22.04.2) 11.4.0 I previously was able to run llama-server with the model gemma-3-12b-it-qat-q4_0.gguf successfully, but now the ...
Resolve multiple Windows PC issues and speed up your PC effortlessly with specialized software. For fixing DLL errors, we recommend HelpSoft PC Cleaner. The tool will ...