Weight Initialization

Process of setting initial values for the weights in a neural network before starting training. Proper weight initialization can improve model convergence and prevent issues like getting stuck in local minima. Common weight initialization techniques include random initialization, initialization with specific distributions such as normal or uniform, and initialization using methods like Xavier initialization or He initialization.