A correlation matrix is a table that displays correlation coefficients between pairs of variables within a dataset. These coefficients, ranging from -1 to 1, measure the strength and direction of linear relationships between variables. It helps identify multicollinearity, dependencies, and potential features for modeling, facilitating insights into data structure and informing feature selection in machine learning projects.