I predict you'll find this logistic regression example with R to be helpful for gleaning useful information from common binary classification problems.

David Muchlinski, David Siroky, Jingrui He, Matthew Kocher, Comparing Random Forest with Logistic Regression for Predicting Class-Imbalanced Civil War Onset Data, Political Analysis, Vol. 24, No. 1 ...

The regression diagnostics introduced by Pregibon for the dichotomous logistic model are extended to multiple groups viewed as a multivariate generalized linear model. We develop diagnostics which ...