New Global Study: Only One-Third of Companies Making Effective Use of Data

HOPKINTON, Mass., Dec. 5, 2011 /PRNewswire/ -- EMC Corporation (NYSE: EMC) today unveiled the findings of the largest-ever global survey of the data science community. Spanning the United States, the United Kingdom, France, Germany, India and China, the EMC Data Science Study reveals and quantifies a rampant scarcity across the globe for the prerequisite skills necessary for a company to capitalize on the opportunities found at the intersection of Big Data and data analytics.  Only one-third of companies are able to effectively use new data to assist their business decision-making, gain competitive advantage, drive productivity growth, yield innovation and reveal customer insights.

The survey revealed that the explosion of digital data created by mobile sensors, social media, surveillance, medical imaging, smart grids and the like — combined with new tools for analyzing it all – has created a corresponding explosion in the opportunity to generate value and insights from the data. As such, the business demand for data scientists has quickly outpaced the supply of talent. 

The EMC Data Science Study respondents included nearly 500 members of the data science community globally including: data scientists and professionals from related disciplines such as data analysts, data specialists, business intelligence analysts, information analysts and data engineers globally, all of whom have IT decision-making authority.

Key Findings

• Informed Decision-making – Only 1/3 of respondents are very confident in their company's ability to make business decisions based on new data.
• Looming Talent Shortage – 65% of data science professionals believe demand for data science talent will outpace the supply over the next 5 years – with most feeling that this supply will be most effectively sourced from new college graduates.
• Barriers to Data Science Adoption – Most commonly cited barriers to data science adoption include: Lack of skills or training (32%) budget/resources (32%), the wrong organizational structure (14%) and lack of tools/technology (10%).
• Customer Insights – Only 38% of business intelligence analysts and data scientists strongly agree that their company uses data to learn more about customers.
• New Technology Fueling Growth – 83% of respondents believe that new tools and emerging technology will increase the need for data scientists.
• Lack of Data Accessibility – Only 12% of business intelligence professionals and 22% of data scientists strongly believe employees have the access to run experiments on data – undermining a company's ability to rapidly test and validate ideas and thus its approach to innovation.
• Advanced Degrees – Data scientists are 3 times as likely as business intelligence professionals to have a Master's or Doctoral degree.
• Augmenting Business Intelligence – Although respondents found an increasing need for data scientists in their firm, only 12% saw today's business intelligence professionals as the most likely source to meet that demand. 
• Higher-Level Skills – Data scientists require significantly greater business and technical skills than today's business intelligence professional.  According to the Data Science Study, they are twice as likely to apply advanced algorithms to data, but also 37% more likely to make business decisions based on that data.
• Love the Work – The study discovered highly favorable attitudes toward the companies where they work. In fact, data scientists believe their IT functions are better aligned and better able to attract talent, are ahead in key technology areas like cloud computing and not surprisingly rate their company's data analysis and visualization abilities very favorably compared to the views of business intelligence professionals.
• Involved Across the Data Lifecycle – Data scientists are more likely than business intelligence professionals to be involved across the data lifecycle--from acquiring new data sets to making business decisions based on the data. This includes filtering and organizing data as well as representing data visually and telling a story with data.
• Tools of the Trade – Data scientists are more likely than business intelligence professionals to use scripting languages, including Python, Perl, BASH and AWK.  Yet, Excel remains the tool of choice for both data scientists and business intelligence executives, followed closely by SQL.

Data Scientists Quotes

Andreas Weigend, Ph.D Stanford, Head of the Social Data Lab at Stanford, former Chief Scientist Amazon.com

"We live in a data-driven world. Increasingly, the efficient operation of organizations across sectors relies on the effective use of vast amounts of data. Making sense of big data is a combination of organizations having the tools, skills and more importantly, the mindset to see data as the new "oil" fueling a company. Unfortunately, the technology has evolved faster than the workforce skills to make sense of it and organizations across sectors must adapt to this new reality or perish."

Michael Driscoll, Ph.D Boston University, Co-Founder and CTO at MetaMarkets

"Neither tools nor people alone can solve the challenges of Big Data.  They must work together and that is the promise of data science.  Despite advances in software tools, the number of people with experience using these tools, and with real-life exposure to large-scale data sets, is small.  Data science is a young field, and its growth will be fueled as much by technology as through the mentorship of new acolytes by leading practitioners." 

EMC Executive Quote  

Jeremy Burton, EVP and Chief Marketing Officer, EMC Corporation

"The Big Data era has arrived in full force, bringing with it an unprecedented opportunity to transform business and the way we work and live. Through the convergence of massive scale-out storage, next-generation analytics and visualization capability, the technology is in place. What's needed to fully realize its value is a vibrant, interconnected, highly-skilled and empowered data science community to reveal relevant trend patterns and uncover new insights hidden within."

Additional Resources:

• Read the EMC Data Science Study in full
• Read Chuck Hollis' blog: "Understanding The New Rock Star: The EMC Data Science Survey"
• Read the EMC Education Services release announcing new training and certification program focused entirely on Data Science & Big Data Analytics
• Connect with EMC via Twitter, Facebook, YouTube, LinkedIn and ECN

About the EMC Data Science Study

EMC conducted an independent research study to measure attitudinal and behavioral profiles of data scientists and business intelligence professionals globally and across industries.  462 IT decision makers who self-identified as either a data scientist or business intelligence professional participated in this market research study through participation with research partner Toluna.  An additional 35 participated by invitation through their previous attendance at the EMC Data Scientist Summit and the online data scientist community Kaggle. The survey was designed to provide a first ever look into the behavioral patterns, thoughts, and needs of the data science community.

About EMC

EMC Corporation is a global leader in enabling businesses and service providers to transform their operations and deliver IT as a service. Fundamental to this transformation is cloud computing.  Through innovative products and services, EMC accelerates the journey to cloud computing, helping IT departments to store, manage, protect and analyze their most valuable asset — information — in a more agile, trusted and cost-efficient way. Additional information about EMC can be found at www.EMC.com.

EMC is a registered trademark of EMC Corporation in the United States and/or other countries. All other trademarks are the property of their owners.  

SOURCE EMC Corporation