Activation Function

A mathematical function applied to the output of a neural network node that introduces non-linearity, allowing the network to learn complex patterns. Common examples include ReLU, Sigmoid, and Tanh.