Subject Area:
Text Mining

Description:
This is the dataset used for the SIAM 2007 Text Mining competition. This competition focused on developing text mining algorithms for document classification. The documents in question were aviation safety reports that documented one or more problems that occurred during certain flights. The goal was to label the documents with respect to the types of problems that were described. This is a subset of the Aviation Safety Reporting System (ASRS) dataset, which is publicly available.

How Data Was Acquired:
The data for this competition came from human generated reports on incidents that occurred during a flight.

Sample Rates, Parameter Description, and Format:
There is one document per incident. The datasets are in raw text format. All documents for each set will be contained in a single file. Each row in this file corresponds to a single document. The first characters on each line of the file are the document number and a tilde separats the document number from the text itself.

Anomalies/Faults:
This is a document category classification problem.