A histogram is a graphical representation used in AI infrastructure to visualize the distribution of numerical data. It displays data frequencies by dividing the range into intervals, or bins, and using rectangular bars where the height indicates the number of data points within each bin. Histograms help identify data patterns, variability, and skewness crucial for data analysis and preprocessing.