Baym's definition of a self-consistent approximation is rephrased in a more diagrammatic way and compared with formulations of the exact many-body problem of Balian, Bloch, and DeDominicis. It is shown that many of the results of these authors are valid for any self-consistent approximation as defined by Baym.