A sufficient condition for convergence of Gauss-Seidel (and Jacobi) is that the matrix is strictly diagonally dominant: \(|a_{ii}|>\sum_{j\neq i}|a_{ij}|\) for each row \(i\). Diagonal dominance ensures the iteration converges from any starting point.