healthy4u: IBM Watson

Once Again, on IBM Watson, Cybernetic Miracles and Reductionist Views of Medicine

The cybernetic miracle shamans are at it again: <blockquote><a href="http://www.engadget.com/2011/09/12/ibms-watson-set-to-tackle-health-insurance-takes-diagnosis-fo/">IBM's Watson set to tackle health insurance, takes 'Diagnosis for $1,000'</a> via Engadget by Billy Steele on 9/12/11 After tackling your tech support woes, the famed Watson is moving on to mop up the health insurance industry. That's right, the IBM showstopper we all know and love for trouncing trivia kings on Jeopardy has been hired by one of the largest health insurance company's in the US. WellPoint Inc. [yes - <a href="http://hcrenewal.blogspot.com/search/label/WellPoint">this</a> WellPoint, a company that HC Renewal has referenced not just a few times - ed.] will make use of the system's breakneck speed and healthcare database alongside patient records -- allowing the supercomputer to guide treatment options and prescribe medicines. [Med Mal plaintiff's attorneys: take note - ed.] Once implemented, data will be combined from three sources in a matter of seconds: a patient's chart / records from a doctor, the insurance company's patient history and the medical knowledge that Watson already possesses. A pilot program will roll out next year to a number of cancer facilities, academic medical centers and oncology practices. No word yet on when The Watson School of Medicine will start accepting applications.</blockquote> I wrote on these issues quite seriously back in January 2011 at this post: "<a href="http://hcrenewal.blogspot.com/2011/01/ibms-watson-jeopardy-and-revolutioning.html" style="font-weight: bold;">IBM's Watson, Jeopardy, and Revolutionizing Medicine</a>." I wrote on a somewhat sarcastic note at this March 2011 post: "<a href="http://hcrenewal.blogspot.com/2011/03/quick-thought-on-cybernetic-medicine.html" style="font-weight: bold;">Here Comes the Judge! A Quick Thought on Cybernetic Medicine: Why Can't Computers Also Do Law?</a>" My views are unchanged since then. Roy Poses adds a good point: <ul><li>Where are the clinical trials? There is nothing here about actually doing clinical trials to test if Watson is accurate enough to do more good than harm before rolling this out. [As Scot has said a zillion times] This is an experimental technology akin to a new medical device that should be tested as rigorously as any new device or drug should be tested before it is used on patients. </li></ul>To which I further add: <ul><li>Where is the patient informed consent? </li></ul>-- SS Addendum: Perhaps Watson should better replace our "they're all the best and brightest" hospital CEO's and managers.

Once Again, on IBM Watson, Cybernetic Miracles and Reductionist Views of Medicine

The cybernetic miracle shamans are at it again: IBM's Watson set to tackle health insurance, takes 'Diagnosis for $1,000' via En...

Đọc thêm »

Here Comes the Judge! A Quick Thought on Cybernetic Medicine: Why Can't Computers Also Do Law?

At my Jan. 2011 post "<a href="http://hcrenewal.blogspot.com/2011/01/ibms-watson-jeopardy-and-revolutioning.html">IBM's Watson, Jeopardy, and Revolutionizing Medicine</a>" I lamented that with every new computer advance since the 1950's, soon to follow was a prediction of cybernetic advancements in medicine, such as this: <blockquote>... A Watson-like system can take that information and co-relate it against all the medical journals and relevant information, and say, "Here's what I think and why," while showing its evidence for how it came up with the conclusion, according to Frase [vice president of industry solutions and emerging business at IBM Research].</blockquote> The following recently occurred to me in the early morning hours as I watched the sun rise: I wonder why there are no suggestions of replacing lawyers with computers. After all, a Watson-like system can take lawsuit information and co-relate it against all the legal journals and relevant information, and say, "Here's what I think and why," while showing its evidence for how it came up with the conclusion. No need for lawyers and their cognitive processes and judgment! Right? The judge could be replaced by a cyber-judge. <a href="http://www.judgealex.com/">Judge Alex</a> and <a href="http://www.judgejudy.com/">Judge Judy</a>, you've met your match. Here comes the cybernetic judge... <div style="text-align: center;"><a href="http://www.youtube.com/watch?v=3hIcKkKID8k"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5580606684680627346" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhfUsQtELFbFI5kw9SqfSKmNrJBUR0u1MGAWPvsOZ2Vn5hWX1mVOhAd-itrZltd3LuFv9rlFV_Kv6Qp9M594b4dpzKt9_amMGKdU9nRBpA5w7CL5_P3_pgRQl3DRGWRxgE45dgQ3SSqyZzG/s320/here_come_the_judge.jpg" style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 254px; height: 122px;" /></a>Order in the Court, Cause Here Comes the Judge! Click to play video. </div> A set of Watson-like systems could even serve as a jury, being capable, as we know, of flawless human judgment. ... The jury findings, your honor Judge Watson are: <blockquote>Bob Watson: defendant is guilty by algorithm. Mary Watson: defendant is guilty by algorithm. Judy Watson : defendant is guilty by algorithm. Frank Watson: defendant is guilty by algorithm. Tom Watson: defendant is ... xoxooxo1011001%$&#@# </blockquote> (Oops, sorry, your cybernetic Honor, Tom's primary CPU crashed.) Think of the possibilities... Perhaps Watson could even be programmed to, say, determine if a proposed law is constitutional or not? No more Supreme Court! Like medicine, cybernetic practice of law should be <a href="http://www.thefreedictionary.com/reductio+ad+absurdum">child's play</a>, no? -- SS

Here Comes the Judge! A Quick Thought on Cybernetic Medicine: Why Can't Computers Also Do Law?

At my Jan. 2011 post " IBM's Watson, Jeopardy, and Revolutionizing Medicine " I lamented that with every new computer advance ...

Đọc thêm »

MedInformaticsMD in WSJ again: No Patient Will Ever Say, 'Quick, Watson, the Needle!'

Following along the lines of my Jan. 2011 post <a href="http://hcrenewal.blogspot.com/2011/01/ibms-watson-jeopardy-and-revolutioning.html">IBM's Watson, Jeopardy, and "Revolutionizing Medicine</a>" , the Wall Street Journal published this Letter to the Editor by me today: <blockquote>Wall Street Journal LETTERS FEBRUARY 25, 2011 <a href="http://online.wsj.com/article/SB10001424052748704546704576150783285060852.html?mod=WSJ_Opinion_MIDDLEThirdBucket" style="font-weight: bold;">No Patient Will Ever Say, 'Quick, Watson, the Needle!' </a> Regarding Ray Kurzweil's "<a class="" href="http://online.wsj.com/article/SB10001424052748704409004576146542688952206.html">When Computers Beat Humans on Jeopardy</a>" (op-ed, Feb. 17): Librarians often receive requests for information as cryptic as "Jeopardy!" clues, from people who are sometimes not even sure what they're seeking. Watson is, in essence, a librarian that retrieves facts. Regarding natural language processing and fact-retrieval systems like IBM's Watson, medicine is about cognition. It's about human judgment born of experience in dealing with ambiguity, not just of language but also, and this is critical, of observations, findings, lab data, image interpretation, etc. It is about human intuition, assemblage and the integration of a huge amount of disparate information in ways not well understood even by its practitioners. The end result is not just the recall of a piece of information, obscure as the information might be. I consider predictions of Watson spearheading cybernetic miracles in medicine to imply just as grandiose a valuation to the technology as the statements I heard two decades ago about the health information technology of the day, or even today, "revolutionizing medicine." That has not happened. A cybernetic librarian is no physician. As for me, for now I'll stick to people in my own medical care. Let Mr. Kurzweil see the machine for his ailments. Scot Silverstein, M.D. Philadelphia </blockquote> I am pleased that my counter-marketing-hype opinion on the meme of health IT "revolutionizing medicine" was deemed fit to print by the Journal. Those in senior leadership positions, as are included in the WSJ's readership, need to see that meme challenged. -- SS <a href="http://hcrenewal.blogspot.com/2011/01/ibms-watson-jeopardy-and-revolutioning.html"> </a>

MedInformaticsMD in WSJ again: No Patient Will Ever Say, 'Quick, Watson, the Needle!'

Following along the lines of my Jan. 2011 post IBM's Watson, Jeopardy, and "Revolutionizing Medicine " , the Wall Street Journ...

Đọc thêm »

IBM's Watson, Jeopardy, and "Revolutionizing Medicine"

In the news recently was a story about a new supercomputer doing amazing things. In a technological tour de force, IBM's Watson supercomputer research project has reached a milestone, beating a group of contestants in the TV gameshow <a href="http://www.jeopardy.com/">Jeopardy</a>. <div style="text-align: left;"> </div> <div style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi4R5y1uoDll8zLUmx22rZxiqAHl5hq0tvpaRRKSekUIfyB2becLGwwv1vErfjt3RvXL99H1grtWsHE65PN6auQh3CSEw1sBlb-CbQwFZ2FlB7c2hXGq_x_RGso6s4oS2W95riDNqkRtBqg/s1600/jeopardy.jpg"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5563164871585166706" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi4R5y1uoDll8zLUmx22rZxiqAHl5hq0tvpaRRKSekUIfyB2becLGwwv1vErfjt3RvXL99H1grtWsHE65PN6auQh3CSEw1sBlb-CbQwFZ2FlB7c2hXGq_x_RGso6s4oS2W95riDNqkRtBqg/s320/jeopardy.jpg" style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 274px; height: 205px;" /></a>The TV game show "Jeopardy" </div> Will predictions of advancements in medicine follow? Predictably so: <blockquote><a href="http://www.eweek.com/c/a/IT-Infrastructure/IBMs-Watson-Supercomputer-Beats-Humans-in-Jeopardy-Practice-Match-296135/">IBM's Watson Supercomputer Beats Humans in Jeopardy Practice Match</a> eWeek.com By: Fahmida Y. Rashid 2011-01-13 Watson, IBM's latest DeepQA supercomputer, defeated its two human challengers during a demonstration round of Jeopardy on Jan. 13. The supercomputer will face former Jeopardy champions Ken Jennings and Brad Rutter in a two-game, men-versus-machine tournament to be aired in February. However, the Jeopardy match-up was not the "culmination" of four years of work by IBM Research scientists that worked on the Watson project, but rather, "just the beginning of a journey," Katharine Frase, vice president of industry solutions and emerging business at IBM Research, told eWEEK. Supercomputers that can understand natural human language—complete with puns, plays on words and slang—to answer complex questions will have applications in areas such as health care, tech support and business analytics, David Ferrucci, the lead researcher and principal investigator on the Watson project, said at the media event showcasing Watson at IBM's Yorktown Heights Research Lab. Watson analyzes "real language," or spoken language, as opposed to simple or keyword-based questions, to understand the question, and then looks at the millions of pieces of information it has stored to find a specific answer, said Ferrucci. </blockquote> This is undoubtedly a remarkable accomplishment. Indeed, accompanying the announcements we are also seeing predictions that such supercomputers "will have applications in health care." Indexing of the medical literature, and data mining (for better or worse) from free text come to mind. However, the current irrational exuberance about healthcare IT in 2011 is based on several misconceptions. This leads to predictions such as this ... <blockquote>The technology has to process natural language to understand "what did they mean" versus "what did they say," which has a lot of implications in the health care sector, said Frase. Patients are not using the terms doctors learned in medical school to describe their ailments, but more likely the terms they picked up from their parents growing up, she said. </blockquote> "Patients are not using the terms doctors learned in medical school to describe their ailments"? What medical school(s), exactly, are being spoken of here? It seems as if IT folks think medicine was invented just yesterday. In fact, in medical school, internship, residency and practice we learn all about that, and learn how to 'translate' that information or use it to elicit more information as needed in order to provide care. I'm not sure a multimillion dollar supercomputer is needed for that ... ... and related "platform database" predictions such as this: <blockquote> ... A Watson-like system can take that information and co-relate it against all the medical journals and relevant [who decides that? - ed.] information, and say, "Here's what I think [think? -ed] and why," while showing its evidence for how it came up with the conclusion, according to Frase.</blockquote> (Actually, computers don't think. A more correct statement would be "here are the results of the algorithms that your faithful machine has crunched, using the medical literature as input.") That's quite naïve and idealistic with regard to actual medical decision making. It is a computer technician's oversimplified, reductionist, amateur view regarding biomedicine, a domain of often <a href="http://en.wikipedia.org/wiki/Wicked_problem">wicked complexity</a>. As I intimated above, one key issue is what is "relevant" with regard to information. Consider the issue of the medical literature suffering from numerous conflict of interest and dishonesty-related phenomema making it increasingly untrustworthy, as pointed out by Roy Poses in a Dec. 2010 post "<a href="http://hcrenewal.blogspot.com/2010/12/lancet-emphasizes-threats-to-academic.html">The Lancet Emphasizes the Threats to the Academic Medical Mission</a>", at my Aug. 2009 post "<a href="http://hcrenewal.blogspot.com/2009/08/has-ghostwriting-infected-experts-with.html">Has Ghostwriting Infected The "Experts" With Tainted Knowledge, Creating Vectors for Further Spread and Mutation of the Scientific Knowledge Base?</a>" and <a href="http://hcrenewal.blogspot.com/search/label/pseudo-evidence%20based%20medicine">elsewhere</a> on this blog. Then too, there are plausibility issues in medical research, as expressed in the paper "<a href="http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.0020124">Why Most Published Research Findings Are False</a>", John P. A. Ioannidis, PLoS Medicine 2(8): e124, 2005. Dr. Ioannidis observes: <blockquote>There is increasing concern that most current published research findings are false. The probability that a research claim is true may depend on study power and bias, the number of other studies on the same question, and, importantly, the ratio of true to no relationships among the relationships probed in each scientific field. In this framework, a research finding is less likely to be true when the studies conducted in a field are smaller; when effect sizes are smaller; when there is a greater number and lesser preselection of tested relationships; where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance. Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Moreover, for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. </blockquote> Dealing with these very real-world issues in patient care requires nothing less than human judgment borne of experience, critical thinking skills (emphases on "thinking", which computers cannot do, sorry all you <a href="http://en.wikipedia.org/wiki/HAL_9000">HAL-9000</a> and <a href="http://en.wikipedia.org/wiki/The_Ultimate_Computer">M5</a> fans) and intuition to manage. "Garbage in, garbage out" applies in the extreme. <div style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj54NUfsCx-Pmm61Zbeam-zOBWRhBAgx6qothqp5ellRv_f_oMnXIsWcS8K2Xtr1_2X5vNWPJWPJqcnP0QV6m66Pta0ixSnrGFxZ_kYWLH0Dj1QA55vFYqoRTBvPvonsz5AnDyUuJi2oR1q/s1600/m5.jpg"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5575927899141022466" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj54NUfsCx-Pmm61Zbeam-zOBWRhBAgx6qothqp5ellRv_f_oMnXIsWcS8K2Xtr1_2X5vNWPJWPJqcnP0QV6m66Pta0ixSnrGFxZ_kYWLH0Dj1QA55vFYqoRTBvPvonsz5AnDyUuJi2oR1q/s320/m5.jpg" style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 260px; height: 195px;" /></a>(The Ultimate Computer, Dr. Richard Daystrom's mid-23rd century Multitronic unit, M5. Fun to watch it beat up on <a href="http://images.wikia.com/startrek/images/2/29/Constitutions_formation.jpg">starships Excalibur, Hood, Lexington and Potemkin</a> due to malfunction. Even more fun to watch William Shatner talk it into cybernetic suicide via guilt, and yes, as a teen I knew all the ST trivia cold, but I think sci-fi has gone too far into people's heads.) </div> There are also other computer-vs-human mind issues at play. First, let's look at Watson. Just to play the TV quiz show game show Jeopardy, a game largely about the knowledge and recall of trivia, it took the following: <ul><li>Watson is a breakthrough human achievement in the scientific field of Question and Answering, also known as "QA." The <a href="http://www-03.ibm.com/press/us/en/pressrelease/33233.wss">Watson software is powered by an IBM POWER7 server</a> optimized to handle the massive number of tasks that Watson must perform at rapid speeds to analyze complex language and deliver correct responses to Jeopardy! clues. The system incorporates a number of proprietary technologies for the specialized demands of processing an enormous number of concurrent tasks and data while analyzing information in real time.</li></ul><ul><li><a href="http://www-03.ibm.com/innovation/us/watson/research-team/algorithms.html">An entire team of "algorithm specialists"</a> writing algorithms specialized to the purpose of "the special question processing" needed to answer Jeopardy questions, such as: "On Sept. 1, 1715 Louis XIV died in this city, site of a fabulous palace he built", and "To marry Elizabeth, Prince Philip had to renounce claims to this southern European country's crown."</li><li> <a href="http://latimesblogs.latimes.com/technology/2011/01/ibm-computer-named-watson-will-battle-jeopardy-champs-for-1-million.html">Watson took about four years to build and is made up of 10 racks of [multiprocessor - ed.] IBM servers running Linux with 15 terabytes of memory </a><a href="http://latimesblogs.latimes.com/technology/2011/01/ibm-computer-named-watson-will-battle-jeopardy-champs-for-1-million.html">[presumably fast-access RAM, not hard disk -ed.]</a>, the report said. [as per the LA Times - ed.] Over those four years, IBM has filled Watson with about 200 million pages' worth of information from encyclopedias, dictionaries, books, news and movie scripts, the AP said.</li></ul> <div style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjllrDkbM4zyrUvmBggvXWfT8H_n5BVjW166X1Q1fRpNWpAR-gdlemHQz0UPPZ-ZtybUndKwKgb7whbaqCKmfhy9DjOYnPnbAEWarzT6EDxISvP5Ybz5vdd46lF-qn1j68bbpkIM5ugay8G/s1600/server_blade.jpg"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5563166290700826178" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjllrDkbM4zyrUvmBggvXWfT8H_n5BVjW166X1Q1fRpNWpAR-gdlemHQz0UPPZ-ZtybUndKwKgb7whbaqCKmfhy9DjOYnPnbAEWarzT6EDxISvP5Ybz5vdd46lF-qn1j68bbpkIM5ugay8G/s320/server_blade.jpg" style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 320px; height: 213px;" /></a>A rack-mountable server ("blade"). </div> <div style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjLkv9ctR4kO4KZFzY43DlIAVfOwcmPnEyPY9vG-zALrf2xeuYcT0mChTXvDQ-w_THGGNFNWWyDzgXZJfcW_XCYFXNuWZjgi-Z0xJHuMYZ7s_B62nKt1UjkFmEPaJVawb8slDrH1CWUh6uC/s1600/rack_of_servers.jpg"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5563161488373887826" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjLkv9ctR4kO4KZFzY43DlIAVfOwcmPnEyPY9vG-zALrf2xeuYcT0mChTXvDQ-w_THGGNFNWWyDzgXZJfcW_XCYFXNuWZjgi-Z0xJHuMYZ7s_B62nKt1UjkFmEPaJVawb8slDrH1CWUh6uC/s320/rack_of_servers.jpg" style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 320px; height: 302px;" /></a>Racks of servers, each with multiple advanced CPU's </div> <div style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjjrYT6l_MtNTP0fDPKPAwWphw0r-52n19DGUNTXbOtSI7YtUsD7eMvA3tbXkfpZVL5LCsBrpUMl9W0Mfa5N8t7jSupxZDnsjaE8KlB3v0onZT0owL8e6Fj9ulBloSOuCdLq-WGElDpppC9/s1600/watsonibm.jpg"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5563162581131539810" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjjrYT6l_MtNTP0fDPKPAwWphw0r-52n19DGUNTXbOtSI7YtUsD7eMvA3tbXkfpZVL5LCsBrpUMl9W0Mfa5N8t7jSupxZDnsjaE8KlB3v0onZT0owL8e6Fj9ulBloSOuCdLq-WGElDpppC9/s320/watsonibm.jpg" style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 320px; height: 233px;" /></a>Racks of servers in IBM's Watson supercomputer, all prettied up, HAL 9000-style </div> Second, it will be many years indeed before even the current Watson QA capabilities can be tailored to a domain as complex as biomedicine and made widespread for the hundreds of thousands of practicing physicians and the much larger number of allied healthcare professionals in the U.S. or worldwide. Third, there's this from the same LA Times article linked above: <ul><li>Like its human competitors, Watson won't have Internet access [or access to anything outside its immense local storage - ed.] during the games, so Googling an answer won't be an option, the report said.</li></ul> I see a significant degree of machine-human unfairness right there. A computer has 100% reliable access to information in its storage media. The human mind does not. That's appropriate for a TV game show that tries to test a persons' knowledge of trivia, but that's not how medicine works. What if the match were made more fair, giving the humans error-free access to the same information Watson has stored in its own 15 terabytes and 200 million pages? Fourth, medicine is not about recalling trivial factoids of information based on parsing natural language queries in the "puzzle format" of Jeopardy. As I wrote <a href="http://hcrenewal.blogspot.com/2011/01/google-ceo-eric-schmidt-on-healthcare.html">here</a> and <a href="http://hcrenewal.blogspot.com/2010/01/does-ceo-of-google-use-google.html">here</a>, medicine is not a platform database information retrieval problem. (I would argue medicine, except in simple cases, is in large part a matter of filtering the irrelevant, unlikely, and unreliable, of which there is an exponentially increasing amount, from information relevant to the subtleties of a complex medical situation.) Certainly, today's clinical IT will make little dent in healthcare quality and error reduction, as those issues are not in majority due to record keeping problems of paper vs. electronic, as I pointed out in my Dec, 2010 post "<a href="http://hcrenewal.blogspot.com/2010/12/is-healthcare-it-solution-to-wrong.html">Is Healthcare IT a Solution to the Wrong Problem?</a>". The expectations for today's health IT are grossly exaggerated. How about expert systems technology such as Watson? Regarding NLP and fact retrieval 'tours de force' like IBM Watson, medicine is about cognition, about human judgment born of experience in dealing with ambiguity not just of language but of observations, findings, lab data, image interpretation, etc., about human intuition and assemblage and integration of a huge amount of disparate information in ways not well understood even by its practitioners. The end result is not just recall of a piece of information. I consider a statement such as: <blockquote>... a Watson-like system can take that information and co-relate it against all the medical journals and relevant information, and say, "Here's what I think [actually, as mentioned previously, here's the results of the algorithms - ed.] and why"</blockquote> ... to imply just as grandiose a valuation to the technology as the statements I heard a decade ago about the health IT of the day - or even today - "revolutionizing medicine." I'm not even sure such a capability would be very useful; we already have <a href="http://dxplain.org/dxp/dxp.pl">DXplain</a> developed by domain experts over decades, and that's not had a major impact on healthcare to date. The real breakthrough will be when a cybernetic expert system can take, say, cases from the Case Records of the Massachusetts General Hospital in the NEJM verbatim, and compete as a peer (e.g., as a peer not recognized to be a machine) with a round-table panel of expert physicians with facile access to the medical literature (e.g., PubMed) on the differential diagnosis, how to establish the diagnosis and to rule out others, the treatment strategies, and the likely outcomes, and then participate in the care. When this happens (call this the "NEJM <a href="http://en.wikipedia.org/wiki/Turing_test">Turing Test</a>"), and when such capabilities are affordable and widely available, then medicine will have been revolutionized. Of course, the enormity of the hardware and the algorithmic advances required to make a truly "revolutionary" tool such as this are obviously staggering. Considering that it takes 10 racks of multiprocessor IBM servers with 15 terabytes of memory and a team of varied domain experts writing algorithms for several years to accomplish the NLP advances and lookups to answer Jeopardy-style trivia questions, one can only imagine what a truly useful cybernetic medical assistance system would look like. It should also be remembered that Watson does not think. Humans do. Cybernetic Jeopardy and chess playing accomplishments notwithstanding, I believe a machine even close to passing a "NEJM Turing test" will be a long time in coming. Until then, we should be encouraging better support for human physicians struggling to use their medical expertise in a sea of bureaucracy, stress and overwork (part of which will increasingly be a struggle with <a href="http://www.tinyurl.com/hostileuserexper">mission hostile health IT</a>). Finally, far off as I believe it to be, I do think the hundreds of billions of dollars being devoted to today's health IT would be better devoted to developing a "Dr. Watson" that can pass a medical Turing test as described above, than deploying mission hostile, primitive HIT and developing an unsustainable mega-bureaucracy to support it as in my post <a href="http://hcrenewal.blogspot.com/2011/01/health-it-and-dr-truth-hurts.html">here</a>. This is not to minimize the wonderful accomplishments of the Watson team. I just wish predictions of cybernetic miracles in medicine would be held in abeyance after the lessons of the past fifty years of computers in medicine. In the meantime, perhaps the current Watson might be useful in remediating our very sclerotic and moribund "mainsteam media," especially in the domain of politics. Its reporters and writers can certainly use cybernetic help in their fact-checking and logic, Jeopardy-style, far more so than physicians. -- SS Feb. 23, 2011 addendum: <a href="http://www.urbandictionary.com/define.php?term=oy%20gevalt">Gevalt!</a> From the article "<a href="http://www.computerworld.com/s/article/9209899/IBM_s_Watson_could_usher_in_new_era_of_medicine?taxonomyId=67&pageNumber=2">IBM's Watson could usher in new era of medicine</a>", Sharon Gaudin, Computerworld, February 17, 2011: <blockquote> Jennifer Chu-Carroll, an IBM researcher on the Watson project, said the computer system is a perfect fit for the healthcare field ... Think of some version of Watson being a physician's assistant," Chu-Carroll said. "In its spare time, Watson can read all the latest medical journals and get updated. Then it can go with the doctor into exam rooms and listen in as patients tell doctors about their symptoms. It can start coming up with hypotheses about what ails the patient.</blockquote> Gevalt indeed ... incredible irrational exuberance. We can easily go from Jeopardy to Medicine ... and then to the Moon, in a hot air balloon! (The moon is up, hot air balloons go up, what's the problem?) How many patients has Chu-Carroll seen lately? (Her bio at <a href="http://www.blogger.com/%22Jennifer%20Chu-Carroll,%20an%20IBM%20researcher%20on%20the%20Watson%20project,%20said%20the%20computer%20system%20is%20a%20perfect%20fit%20for%20the%20healthcare%20field%20...%20Think%20of%20some%20version%20of%20Watson%20being%20a%20physician%27s%20assistant,%22%20Chu-Carroll%20said.%20%22In%20its%20spare%20time,%20Watson%20can%20read%20all%20the%20latest%20medical%20journals%20and%20get%20updated.%20Then%20it%20can%20go%20with%20the%20doctor%20into%20exam%20rooms%20and%20listen%20in%20as%20patients%20tell%20doctors%20about%20their%20symptoms.%20It%20can%20start%20coming%20up%20with%20hypotheses%20about%20what%20ails%20the%20patient.%22%22%20%20Gevalt%21%20%20Irrational%20exuberance%20%20--%20we%20can%20easily%20go%20from%20Jeopardy%20to%20Medicine...and%20then%20to%20the%20Moon,%20in%20a%20hot%20air%20balloon%21%20%20%28The%20moon%20is%20up,%20hot%20air%20balloons%20go%20up,%20what%27s%20the%20problem?%29%20%20How%20many%20patients%20has%20Chu-Carroll%20seen%20lately?%20%20%28Her%20bio%20at%20http://researcher.ibm.com/researcher/view.php?person=us-jencc%20is%20down;%20%22The%20server%20at%20researcher.ibm.com%20is%20taking%20too%20long%20to%20respond%22;%20Watson%20must%20be%20taking%20a%20nap%29...">http://researcher.ibm.com/researcher/view.php?person=us-jencc</a> was initially down at this moment; "The server at researcher.ibm.com is taking too long to respond." Watson must be taking a nap. Archive.org says "The connection has timed out. The server at web.archive.org is taking too long to respond." Just like a doctor!) Anyway, it now appears: <blockquote> I am a Research Staff Member at <a href="http://www.research.ibm.com/">IBM T. J. Watson Research Center</a>. I also manage the Knowledge Structures group which focuses on improving advanced search technology through the use of natural language processing and machine learning techniques. Prior to joining IBM in 2001, I spent 5 years as a Member of Technical Staff at <a href="http://www.bell-labs.com/">Lucent Technologies Bell Laboratories</a>. My research interests include question answering, semantic search, natural language discourse processing, and spoken dialogue management. </blockquote> Please, please, please, computer scientists: STOP MAKING THESE PREDICTIONS OF CYBERNETIC MIRACLES JUST AROUND THE CORNER. YOU'VE BEEN DOING IT SINCE THE VACUUM TUBE-BASED MACHINES. STOP! PLEASE! (Maybe first they could give us a computer that does a perfect, lucid, coherent, fluent translation of, say, Russian-to-English, another promise made since the 1950's "<a href="http://en.wikipedia.org/wiki/Robby_the_Robot">Robby the Robot</a>" years?) <div style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjldnVE-YxPUg-hkvX4Hd5X5fYKQAXRofzxvC7_HoF3GWZW6hCxJZc9yKQVZXpYEEjMwu0yQFiY5W6i-FoKaviXmgNELU2r9Lz5wJVjzqMANDpVtr3subr_jGV3-lRnKhzl-0i0hYsvmhPq/s1600/Robbie_Forbidden_Planet.jpg"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5577003659342042578" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjldnVE-YxPUg-hkvX4Hd5X5fYKQAXRofzxvC7_HoF3GWZW6hCxJZc9yKQVZXpYEEjMwu0yQFiY5W6i-FoKaviXmgNELU2r9Lz5wJVjzqMANDpVtr3subr_jGV3-lRnKhzl-0i0hYsvmhPq/s320/Robbie_Forbidden_Planet.jpg" style="display: block; margin: 0px auto 10px; text-align: center; cursor: pointer; width: 320px; height: 162px;" /></a>Robby the Robot in "Forbidden Planet." Lost in Space fans will remember Robby as doing battle with the <a href="http://www.lostinspacerobot.com/">Class M-3 Model B9, General Utility Non-Theorizing Environmental Control </a><a href="http://www.lostinspacerobot.com/">Robot</a> ("Danger, Danger, Will Robinson") as well! </div> I think the essay in today's WSJ by UC Berkeley philosopher <a href="http://en.wikipedia.org/wiki/John_Searle">John Searle</a> is also apropos: <a href="http://online.wsj.com/article/SB10001424052748703407304576154313126987674.html">Watson Doesn't Know It Won on 'Jeopardy!' </a> -- SS Addendum: See my Wall Street Journal Letter to the Editor on these matters <a href="http://hcrenewal.blogspot.com/2011/02/medinformaticsmd-in-wsj-again-no.html" style="font-weight: bold;">at this link</a>. I wrote on a somewhat sarcastic note at this March 2011 post: "<a href="http://hcrenewal.blogspot.com/2011/03/quick-thought-on-cybernetic-medicine.html" style="font-weight: bold;">Here Comes the Judge! A Quick Thought on Cybernetic Medicine: Why Can't Computers Also Do Law?</a>" Also see my Sept. 2011 followup post "<a href="http://hcrenewal.blogspot.com/2011/09/once-again-on-watson-and-reductionistic.html" style="font-weight: bold;">Once Again, on IBM Watson, Cybernetic Miracles and Reductionist Views of Medicine</a>." -- SS

IBM's Watson, Jeopardy, and "Revolutionizing Medicine"

In the news recently was a story about a new supercomputer doing amazing things. In a technological tour de force, IBM's Watson superco...

Đọc thêm »