Era Software 2022 State of Observability and Log Management Report Reveals Perfect Storm of Massive Data Growth and Need for Innovation

News provided by

Era Software, Inc.

Mar 17, 2022, 09:00 ET

79% state the overall cost of observability and log management will skyrocket in 2022 if current tools don't evolve; 96% report using data effectively to solve problems outweighs just storing data

News summary:

  • Era Software State of Observability and Log Management 2022 research reveals that insights from log data are critical for enterprises
  • Both IT and business teams see high value in collecting and analyzing log data
  • The volume of log data will continue to grow in 2022 and beyond. However, IT teams struggle with the massive growth of data and use various methods to manage the growth of data volumes and their associated costs.

SEATTLE, March 17, 2022 /PRNewswire/ -- Era Software, the observability data management company, today released the findings of the company's 2022 State of Observability and Log Management Report. Over 315 IT executives, cloud application architects, DevOps, and site reliability engineers (SRE) took the survey, sharing perspectives on the current state of exploding data and the struggle to gather valuable insights from the data. For this survey, Era Software defines observability as an evolution of traditional monitoring towards understanding deep insights from analyzing high volumes of logs, metrics, and trace data, collected from a wide variety of modern applications and infrastructure environments.

The survey also reveals that IT teams struggle with the massive growth of data and use various methods to manage data volumes and their associated costs, including prematurely deleting log data. However, according to 78% of the respondents, attempts to manage volumes of log data have had mixed or unwanted results, such as increased incident response times or inability to access needed data.

"We understand very well the risks IT and security organizations face with scaling log management tools. Those risks range from losing critical business insights and increased troubleshooting times to inefficient incident response. We're pushing for evolution in observability data management and will continue to provide innovative alternatives to help customers as they adopt modern solutions to these challenges," said Todd Persen, co-founder and CEO, Era Software.

The 2022 survey suggests that two-thirds of IT organizations require dedicated engineering resources to manage their monitoring tooling, and larger organizations with more log data are more likely to have dedicated teams for tooling management.

"Compared to similar research conducted in 2021, organizations report that observability adoption jumped by 180%. Our research indicates that as organizations mature in implementing observability, the value of critical insights from their log data is greater," said Stela Udovicic, Senior Vice President of Marketing, Era Software. 

Report findings also reveal:

  • Observability data including log data is critically important for organizations. 83% of respondents report that business stakeholders outside of IT use insights from log data. 68% say log data is necessary, but it's tough to work with.
  • IT continues to struggle to keep up with data volumes. 78% work to reduce volumes and costs, but they miss needed data for impact troubleshooting and security analyses. While 96% of IT professionals surveyed report that volumes of log data in their organizations are exploding.   
  • Existing log management tools present challenges and risks related to scalability. 97% of respondents report.
  • Log data is key to observability, and innovation is needed. According to the report, 79% of respondents believe the overall cost of observability data management, including log management activities, will skyrocket in 2022 if current practices and tools don't evolve.  
  • Problems are beyond storing data. 96% report the need also to use the data to solve business problems.
  • Engineering toil. 90% report reducing engineering toil to scale tools helps IT focus on more important work.

The company asked participants about their current use of streaming pipelines (sometimes called observability pipelines or observability data management) to connect, filter, process, and route log data between different "islands" such as Elasticsearch, Logstash, and Kibana (ELK stack), Splunk, offline cold storage (S3, Google Cloud Services, etc.). Adopting observability pipelines is a work in progress, with 65% of organizations evaluating options and 41% considering assessing options.

Report Methodology
The survey collected data from IT practitioners and executives with a working knowledge of their IT operations. Dimensional Research, a third-party research firm, hosted the survey and analyzed the data. Era Software wrote the resulting report. All respondents are IT professionals responsible for managing the availability of cloud application and infrastructure environments with at least 10 TB of log data. Enterprises surveyed have at least 100 employees.

Respondents comprise a third IT executives, a third enterprise (cloud or application) architects, and a third DevOps/SRE/Ops. Industry verticals of the IT professionals surveyed include financial, technology, healthcare, service, retail, manufacturing, etc. Regions surveyed include AMER (77%), followed by EMEA (20%) and APAC (3%).

Additional Resources

About Era Software
Era Software observability data management offers modern IT and security organizations the ability to route, ingest, store, and analyze massive amounts of data to get actionable insights in seconds. With the company's observability and analytics platform, EraSearch, teams eliminate complexity and manage all their log data in real-time at up to 90% lower cost than alternatives. As data volumes grow exponentially, enterprises are often forced to make hard choices about what data to collect, creating critical visibility gaps. Era Software enables IT teams to collaborate and innovate faster with unified access to data. Find out more at www.era.co. Follow us on Twitter and LinkedIn.

Contact: Lori Bertelli, 916-216-2968, [email protected]

SOURCE Era Software, Inc.