📍 What Is It?

runtimeLLMSettings.ini is a text file that lets you customise how INDIVIDUAL local language modes behave in CakeMix. You can tweak everything from creativity and repetition to sampling methods and token limits — all before starting a chat.

🔎 Where to Find It

You can locate the file by going to Advanced Settings in CakeMix and clicking the "Open Folder" button in 'Local CakeMix Data'. Inside the folder that opens, look for a folder called "llm" and inside that folder you'll see folders named after the LLMs you've downloaded. Inside each of those is a file called runtimeLLMSettings.ini which is made for that specific LLM.

🛠️ How to Edit

Open the file in any plain-text editor, such as Notepad or Notepad++. Make your changes and save before launching a chat session (the Start button on the Scenarios page). The settings will then apply automatically.

🧠 Key Settings

• temperature — Lower = more predictable, higher = more creative
• topK & topP — Control diversity of outputs
• repeatPenalty, presencePenalty, frequencyPenalty — Help reduce repetition
• grammar, grammarJSON — Advanced: define structured output rules
• mirostat — Dynamic entropy tuning (0 = off, 1 = Mirostat v1, 2 = Mirostat v2)
• seed — Set this for reproducible outputs

📄 Sample File

[LLMCharacter]

; If deleted, this file will be created with default values.

numPredict = 1024
slot = 0
grammar = 
grammarJSON = 
seed = -1
temperature = 0.8
topK = 40
topP = 0.95
minP = 0.05
repeatPenalty = 1.1
presencePenalty = 0.7
frequencyPenalty = 0.5
typicalP = 1
repeatLastN = 64
penalizeNl = True
penaltyPrompt = 
mirostat = 0
mirostatTau = 5
mirostatEta = 0.1
nProbs = 0
ignoreEos = False

📍 What is this?

cakemix.ini is a text file that lets you customise how ALL local language models behave in CakeMix.

🔎 Where to Find It

You can locate the file by going to Advanced Settings in CakeMix and clicking the "Open Folder" button in 'Local CakeMix Data'. Inside the folder that opens, look for a file called cakemix.ini.

🛠️ How and what to Edit

Open the file in any plain-text editor, such as Notepad or Notepad++. The main thing to look at is num_GPU_Layers. This should already be set for your particular system specs but you can change it. It controls how much of your GPU is used for AI chat, and can have a huge impact. The default is 20 but you can go all the way up to 999. Try out various options within the range of 20-45 and see how it helps/hinders. Make your changes and save before launching a CakeMix session . The settings will then apply automatically.

🍰 Get CakeMix

If you have no idea what this is, find out here!