Era Software’s 2022 State of Observability and Log Management Report Reveals a Perfect Storm of Massive Data Growth and Need for Innovation

79% say the overall cost of observability and log management will skyrocket in 2022 if current tools don’t evolve; 96% say using data effectively to solve problems trumps simply storing data

News summary:

  • Era Software State of Observability and Log Management 2022 Study Reveals Insights From Log Data Are Critical for Businesses
  • IT and business teams place high value on collecting and analyzing log data
  • The volume of log data will continue to grow in 2022 and beyond. However, IT teams are faced with massive data growth and are using various methods to manage the growth in data volumes and their associated costs.

SEATTLE, March 17, 2022 /PRNewswire/ — Era Software, the observability data management company, today released the findings of the company’s study 2022 State of Observability and Log Management Report. More than 315 IT executives, cloud application architects, DevOps, and site reliability engineers (SREs) responded to the survey, sharing their views on the current state of the data explosion and the difficulty of collecting valuable insights from the data. For this survey, Era Software defines observability as an evolution from traditional monitoring to understanding deep insights from analyzing high volumes of logs, metrics, and trace data, collected from a large variety of modern infrastructure applications and environments.

The survey also reveals that IT teams are struggling with massive data growth and using various methods to manage data volumes and their associated costs, including the premature deletion of log data. However, according to 78% of respondents, attempts to manage volumes of log data have had mixed or undesirable results, such as increased incident response times or the inability to access needed data.

“We fully understand the risks that IT and security organizations face with scaling log management tools. These risks range from loss of critical business information and increased troubleshooting times to ineffective incident response. We are pushing for the evolution of observability data management and will continue to provide innovative alternatives to help customers adopt modern solutions to these challenges,” said Todd Persenco-founder and CEO, era software.

The 2022 survey suggests that two-thirds of IT organizations need dedicated engineering resources to manage their monitoring tools, and larger organizations with more log data are more likely to have teams dedicated to monitoring. tool management.

“Compared to similar research conducted in 2021, organizations report observability adoption has jumped 180%. Our research indicates that as organizations mature in implementing observability, the critical insight value of their log data is greater,” said Stela Udovicic, Senior Vice President. marketing, Era software.

The findings of the report also reveal:

  • Observability data log data is critically important to organizations. 83% of respondents report that business stakeholders outside of IT use information from log data. 68% say log data is necessary, but difficult to use.
  • IT continues to struggle to keep pace with data volumes. 78% are working to reduce volumes and costs, but lack the data needed for impact troubleshooting and security analysis. While 96% of IT professionals surveyed report that log data volumes in their organizations are exploding.
  • Existing log management tools present scalability challenges and risks. 97% of respondents say.
  • Log data is critical to observability and innovation is needed. According to the report, 79% of respondents believe that the overall cost of managing observability data, including log management activities, will skyrocket in 2022 if current practices and tools do not evolve.
  • The problems go beyond data storage. 96% say they also need to use data to solve business problems.
  • Engineering work. 90% say reducing engineering work to scale tools helps IT focus on more important tasks.

The company asked participants about their current use of streaming pipelines (sometimes referred to as observability pipelines or observability data management) to connect, filter, process, and route log data between different “islands” such as Elasticsearch, Logstash and Kibana (ELK stack). Splunk, offline cold storage (S3, Google Cloud Services, etc.). Adopting observability pipelines is a work in progress, with 65% of organizations evaluating options and 41% considering evaluating options.

Report methodology
The survey collected data from IT practitioners and executives with a working knowledge of their IT operations. Dimensional Research, a third-party research company, hosted the survey and analyzed the data. Era Software wrote the resulting report. All respondents are IT professionals responsible for managing the availability of cloud infrastructure and application environments with at least 10 TB of log data. The companies surveyed have at least 100 employees.

Respondents include a third from IT executives, a third from enterprise architects (cloud or application), and a third from DevOps/SRE/Ops. Industry verticals of IT professionals surveyed include finance, technology, healthcare, services, retail, manufacturing, and more.

Additional Resources

About Era Software
Era Software’s Observability Data Management gives modern IT and security organizations the ability to route, ingest, store, and analyze massive amounts of data to gain actionable insights in seconds. With the company’s observability and analytics platform, EraSearch, teams eliminate complexity and manage all their log data in real time at up to 90% less cost than alternatives. As data volumes grow exponentially, businesses are often forced to make tough choices about what data to collect, creating critical visibility gaps. Era Software enables IT teams to collaborate and innovate faster with unified access to data. Learn more about follow us on Twitter and LinkedIn.

Contact: Lori Bertelli916-216-2968, [email protected]

SOURCE Era Software, Inc.

Amanda J. Marsh