Limits...
Discerning tumor status from unstructured MRI reports--completeness of information in existing reports and utility of automated natural language processing.

Cheng LT, Zheng J, Savova GK, Erickson BJ - J Digit Imaging (2009)

Bottom Line: Natural language processing (NLP) is an emerging technique for rapid and efficient clinical data retrieval.The NLP tool utilized a support vector machines model with statistical and rule-based outcomes.In conclusion, most reports contained sufficient information for tumor status determination, though variable features were used to describe status.

View Article: PubMed Central - PubMed

Affiliation: Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA.

ABSTRACT
Information in electronic medical records is often in an unstructured free-text format. This format presents challenges for expedient data retrieval and may fail to convey important findings. Natural language processing (NLP) is an emerging technique for rapid and efficient clinical data retrieval. While proven in disease detection, the utility of NLP in discerning disease progression from free-text reports is untested. We aimed to (1) assess whether unstructured radiology reports contained sufficient information for tumor status classification; (2) develop an NLP-based data extraction tool to determine tumor status from unstructured reports; and (3) compare NLP and human tumor status classification outcomes. Consecutive follow-up brain tumor magnetic resonance imaging reports (2000--2007) from a tertiary center were manually annotated using consensus guidelines on tumor status. Reports were randomized to NLP training (70%) or testing (30%) groups. The NLP tool utilized a support vector machines model with statistical and rule-based outcomes. Most reports had sufficient information for tumor status classification, although 0.8% did not describe status despite reference to prior examinations. Tumor size was unreported in 68.7% of documents, while 50.3% lacked data on change magnitude when there was detectable progression or regression. Using retrospective human classification as the gold standard, NLP achieved 80.6% sensitivity and 91.6% specificity for tumor status determination (mean positive predictive value, 82.4%; negative predictive value, 92.0%). In conclusion, most reports contained sufficient information for tumor status determination, though variable features were used to describe status. NLP demonstrated good accuracy for tumor status classification and may have novel application for automated disease status classification from electronic databases.

Show MeSH

Related in: MedlinePlus

Development of NLP-based data extraction tool.
© Copyright Policy
Related In: Results  -  Collection


getmorefigures.php?uid=PMC2837158&req=5

Fig2: Development of NLP-based data extraction tool.

Mentions: The NLP-based data extraction tool built for the task of discovering tumor status, magnitude of change, and significance of change combined statistical and rule-based methods (Fig. 2). The discovery of tumor status was cast as a classification task extending the support vector machines (SVMs) method,17 while that for magnitude and significance was approached as a pattern-matching task. A simplified illustration of how an example report would be processed and analyzed by the NLP-based data extraction tool is given in Figure 3.Fig 2


Discerning tumor status from unstructured MRI reports--completeness of information in existing reports and utility of automated natural language processing.

Cheng LT, Zheng J, Savova GK, Erickson BJ - J Digit Imaging (2009)

Development of NLP-based data extraction tool.
© Copyright Policy
Related In: Results  -  Collection

Show All Figures
getmorefigures.php?uid=PMC2837158&req=5

Fig2: Development of NLP-based data extraction tool.
Mentions: The NLP-based data extraction tool built for the task of discovering tumor status, magnitude of change, and significance of change combined statistical and rule-based methods (Fig. 2). The discovery of tumor status was cast as a classification task extending the support vector machines (SVMs) method,17 while that for magnitude and significance was approached as a pattern-matching task. A simplified illustration of how an example report would be processed and analyzed by the NLP-based data extraction tool is given in Figure 3.Fig 2

Bottom Line: Natural language processing (NLP) is an emerging technique for rapid and efficient clinical data retrieval.The NLP tool utilized a support vector machines model with statistical and rule-based outcomes.In conclusion, most reports contained sufficient information for tumor status determination, though variable features were used to describe status.

View Article: PubMed Central - PubMed

Affiliation: Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA.

ABSTRACT
Information in electronic medical records is often in an unstructured free-text format. This format presents challenges for expedient data retrieval and may fail to convey important findings. Natural language processing (NLP) is an emerging technique for rapid and efficient clinical data retrieval. While proven in disease detection, the utility of NLP in discerning disease progression from free-text reports is untested. We aimed to (1) assess whether unstructured radiology reports contained sufficient information for tumor status classification; (2) develop an NLP-based data extraction tool to determine tumor status from unstructured reports; and (3) compare NLP and human tumor status classification outcomes. Consecutive follow-up brain tumor magnetic resonance imaging reports (2000--2007) from a tertiary center were manually annotated using consensus guidelines on tumor status. Reports were randomized to NLP training (70%) or testing (30%) groups. The NLP tool utilized a support vector machines model with statistical and rule-based outcomes. Most reports had sufficient information for tumor status classification, although 0.8% did not describe status despite reference to prior examinations. Tumor size was unreported in 68.7% of documents, while 50.3% lacked data on change magnitude when there was detectable progression or regression. Using retrospective human classification as the gold standard, NLP achieved 80.6% sensitivity and 91.6% specificity for tumor status determination (mean positive predictive value, 82.4%; negative predictive value, 92.0%). In conclusion, most reports contained sufficient information for tumor status determination, though variable features were used to describe status. NLP demonstrated good accuracy for tumor status classification and may have novel application for automated disease status classification from electronic databases.

Show MeSH
Related in: MedlinePlus