To test the use of well-studied and widely used classification methods alongside newly developed data filtering techniques specifically designed for imbalanced-data classification in order to demonstrate proof of principle for an automated radiation therapy (RT) quality assurance process on prostate cancer treatment.