摘要:随着软件系统越来越复杂化和分布化，为系统提供具有完善功能的监控服务显得越来越重要.APM（application performance management）系统通过采集软件系统运行时的各项指标数据来分析软件的运行状态，例如CPU、内存使用率、垃圾回收的耗时、QPS等指标.此外，APM系统也会在软件运行中生成各种日志数据.通常来说，它能提供的监控数据分为3种：指标统计数据、链路跟踪（tracing）数据以及离散事件记录.这些数据有助于系统或者服务的维护人员理解运行状态，从而确保系统或者服务的稳定运行.基于开源的APM监控系统——CAT系统，提出了一种针对tracing类型数据的存储设计方案，通过内存块批量写入的方式提升存储效率，并设计了两级索引以提高查询效率.从线上的真实运行数据来看，该方案在写入性能和查询性能方面均有较好的表现.



Abstract:With the software system becoming more and more complex and distributed, it is more and more important to provide monitoring services with complete functions for the system. APM (application performance management) system analyzes the running state of software by collecting various indicator data of software system, such as CPU, memory utilization, the consuming time of garbage collection, QPS. In addition, the APM system can also generate various types of logs during the operation of the software. Generally speaking, it can provide three types of monitoring data:statistic metrics, tracing data, and discrete event records. The data can help the maintenance personnel of the system or service understand the running state, so as to ensure the stable operation of the system or service. Based on the open-source APM monitoring system (i.e., CAT system), this study proposes a storage design scheme for tracing data. It improves the storage efficiency by memory block which is designed for batch writing logs, and query efficiency by the structure of the two-level index. Through analyzing the real on-line running data, the proposed scheme has sound performance in both write performance and query performance.



PDF全文下载地址:

http://jos.org.cn/jos/article/pdf/6234