A perceptron is a fundamental unit in machine learning that models a simplified neural network for binary classification tasks. It processes input features through weighted connections, sums them, and applies an activation function (typically a step function) to determine the output as one of two classes. It's foundational for understanding neural networks and forms the basis for more complex models.