Rare disease diagnosis: A review of web search, social media and large-scale data-mining approaches

Research output: Contribution to journalJournal article – Annual report year: 2015Researchpeer-review

Documents

DOI

View graph of relations

Physicians and the general public are increasingly using web-based tools to find answers to medical questions. The field of rare diseases is especially challenging and important as shown by the long delay and many mistakes associated with diagnoses. In this paper we review recent initiatives on the use of web search, social media and data mining in data repositories for medical diagnosis. We compare the retrieval accuracy on 56 rare disease cases with known diagnosis for the web search tools google.com, pubmed.gov, omim.org and our own search tool findzebra.com. We give a detailed description of IBM's Watson system and make a rough comparison between findzebra.com and Watson on subsets of the Doctor's dilemma dataset. The recall@10 and recall@20 (fraction of cases where the correct result appears in top 10 and top 20) for the 56 cases are found to be be 29%, 16%, 27% and 59% and 32%, 18%, 34% and 64%, respectively. Thus, FindZebra has a significantly (p <0.01) higher recall than the other 3 search engines. When tested under the same conditions, Watson and FindZebra showed similar recall@10 accuracy. However, the tests were performed on different subsets of Doctors dilemma questions. Advances in technology and access to high quality data have opened new possibilities for aiding the diagnostic process. Specialized search engines, data mining tools and social media are some of the areas that hold promise.
Original languageEnglish
Article numbere1083145
JournalRare Diseases (Online)
Volume3
Issue number1
Number of pages7
ISSN2167-5511
DOIs
Publication statusPublished - 2015
CitationsWeb of Science® Times Cited: No match on DOI

    Research areas

  • clinical diagnosis decision support systems, data mining, information retrieval, machine learning, rare diseases, search engines

Download statistics

No data available

ID: 117326034