BOSTON, July 9, 2013 /PRNewswire/ -- Patterns and Predictions, a predictive analytics company, today announced its Big Data initiative "The Durkheim Project*" – to predict suicide at scale using its machine learning data fabric built on technologies from Attivio and Cloudera.
Patterns and Predictions is now providing technology enabling opt-in participation from more than 100,000 U.S. veterans to build a 'big' medical database that will help military mental health experts fight a complex and challenging enemy: the alarming incidence of suicide among veterans.
Cited by a 2012 TIME Magazine cover story ("One A Day"), as a problem of epidemic proportions, suicide rates among veterans are roughly double those of adults in the general U.S. population. TIME also noted that military efforts have struggled to successfully address the suicide crisis due, in part, to a lack of understanding why nothing has worked to stop it.
Patterns and Predictions' founder Chris Poulin, has been working with Dartmouth researchers to address this problem since 2010. "The next generation of predictive analytics tools gives scientific and clinical investigators new hope and resources for solving even the most intractable problems," said Poulin.
In 2011, Patterns and Predictions engaged Big Data analytics experts Attivio and Cloudera and secured a contract with the Defense Advanced Research Projects Agency (DARPA). Concluded in February 2013, staff from Patterns and Predictions, Dartmouth, and the U.S. Veterans Administration conducted an investigation to validate the machine learning data fabric. Initial findings indicated the data model's predictive accuracy was statistically significant (consistent accuracies of 65 percent or more) in predicting suicidality risk among a veteran control group.
Having confirmed the theoretical underpinnings of this work, Patterns and Predictions is leading "Phase 2" technology for The Durkheim Project, a tightly integrated Big Data initiative with one objective: suicidality prediction at scale. "The promise of Durkheim lies in its ability to collect and monitor a diverse repository of complex data, with the hope of eventually providing a real-time triage of interventional actions upon detection of a critical event," said Poulin. At this time, the associated medical study (Dartmouth CPHS #23781) is authorized as observation only and non-interventional.
Tightly Integrated Technologies
Durkheim's event-driven predictions are made possible by Patterns and Predictions' integration of its suicide risk prediction technology (including a Facebook® app, and mobile app for iPhone® and Android®) and database connections with complementary capabilities from Attivio, the leading unified information access platform, and Cloudera, the category leader in Apache Hadoop-based software and services for the enterprise.
- Attivio: Attivio provided code that enables the indexing and dynamic joining of diverse information on a massive scale to make it highly accessible. "Attivio Active Intelligence Engine® offers a schema-less index and patented JOIN technology that our projects have relied on time and again to power our cutting-edge text analytics," said Poulin.
- Cloudera: Patterns and Predictions engaged Cloudera Professional Services to co-develop code in the area of real-time prediction on CDH (Cloudera's Distribution Including Apache Hadoop), the market-leading open source distribution of Hadoop and related projects. "With Cloudera's unique software expertise, we can focus on making The Durkheim Project's risk assessments faster across larger data sets," said Poulin.
Editor's Note: In a July 2 statement, The U.S. Department of Veterans Affairs and Facebook, Inc. announced their participation in The Durkheim Project.
*About The Durkheim Project
"The Durkheim Project" is a medical non-profit initiative. It is named in honor of Emile Durkheim, a founding sociologist whose 1897 publication of "Suicide" defined early text analysis for suicide risk, as well as theoretical explanations. The Durkheim Project is comprised of a multi-disciplinary team of artificial intelligence and medical experts from private companies, The Geisel School of Medicine at Dartmouth, and the U.S. Department of Veterans Affairs. Together these professionals have formed a team dedicated to applied research on suicide. More information about the study — and additional background information — can be found at The Durkheim Project website: www.durkheimproject.org
About Patterns and Predictions
Patterns and Predictions is a predictive analytics firm. Its core Centiment® technology provides unstructured and linguistics driven prediction. It is the technology powering the Durkheim Project's 'big data' analytics network for the assessment of mental health risks. Partners include Bloomberg, The Geisel School of Medicine at Dartmouth, Cloudera, and Attivio. Funding sources include the U.S. Government (DARPA), and customers include Global 100 companies. www.patternsandpredictions.com
Attivio's unified information access platform, the Active Intelligence Engine® (AIE®), redefines the business impact of our customers' information assets, so they can quickly seize opportunities, solve critical challenges and fulfill their strategic vision. Attivio integrates and correlates disparate silos of structured data and unstructured content in ways never before possible. Offering both intuitive search capabilities and the power of SQL, AIE seamlessly integrates with existing BI and big data tools to reveal insight that matters, through the access method that best suits each user's technical skills and priorities. Please visit us at www.attivio.com
Cloudera, the standard for Apache Hadoop in the enterprise, empowers data-driven enterprises to Ask Bigger Questions™ and get bigger answers from all their data at the speed of thought. Cloudera Enterprise, the platform for Big Data, enables organizations to easily derive business value from structured and unstructured data to achieve a significant competitive advantage. Reinventing the economics and performance of Big Data management, Cloudera is the category leader in Apache Hadoop-based software, services and training. CDH (Cloudera's Distribution Including Apache Hadoop), available to download for free at www.cloudera.com/download, is the most comprehensive, tested, stable and widely deployed distribution of Hadoop in commercial and non-commercial environments. www.cloudera.com
+1 (617) 858-1376
This material is based upon work supported by the Defense Advance Research Project Agency (DARPA), and Space Warfare Systems Center Pacific under Contract N66001-11-4006. Also supported by, the Intelligence Advanced Research Projects Activity (IARPA) via the Department of Interior National Business Center contract number N10PC20221. The opinions, findings and conclusions or recommendations expressed in this material are those of the authors(s) and do not necessarily reflect the views of the Defense Advance Research Program Agency (DARPA) and Space, the Naval Warfare Systems Center Pacific, IARPA, DOI/NBC, or the U.S. Government.