I predict you'll find this logistic regression example with R to be helpful for gleaning useful information from common binary classification problems.

David Muchlinski, David Siroky, Jingrui He, Matthew Kocher, Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data, Political Analysis, Vol. 24, No. 1 ...

Peter Bühlmann, Bin Yu, Boosting with the L₂ Loss: Regression and Classification, Journal of the American Statistical Association, Vol. 98, No. 462 (Jun., 2003 ...