Hyperparameter

this model has four hyperparameters

The exact interpretation of these hyperparameters becomes clearer once you have seen their role in the posterior and, hence, we defer a deeper discussion of prior elicitation until the next section.

The ideal learning algorithm just takes a dataset and outputs a function, without requiring hand tuning of hyperparameters.

“Model behaviour is not determined by architecture, hyperparameters, or optimizer choices,” he said, referring to the technical difficulties of training a language model. “It’s determined by your dataset, nothing else. […]”