neural networks

2. (... window)The span of text or data that a model considers when making predictions or generating output.
6. A technique for selecting a subset of data points from a larger dataset, often used in text generation.
8. The basic units of a neural network that process and transmit information.
10. A learning algorithm that adjusts weights in a neural network by minimizing the error, using gradients from the output back to the input.
11. Parameters that determine the strength of connections between neurons in a neural network.

1. A type of neural network where connections between nodes do not form cycles, passing information in one direction.
3. The process of teaching a neural network to perform tasks by adjusting its parameters using data.
4. An additional parameter in a neuron that shifts the activation function, helping the model fit the data better.
5. A level of computation in a neural network where inputs are processed and transformed into outputs.
7. Input text given to models like GPT to generate a response or complete a task.
9. One complete cycle through the entire training dataset during the model’s learning process.