I predict you'll find this logistic regression example with R to be helpful for gleaning useful information from common binary classification problems.

Regression can be used on categorical responses to estimate probabilities and to classify.

David Muchlinski, David Siroky, Jingrui He, Matthew Kocher, Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data, Political Analysis, Vol. 24, No. 1 ...

The paper discusses some diagnostic tools for binary logistic regression which use smoothing techniques. Smoothed binary data are employed to devise a battery of diagnostic plots, from simple ...