The blockchain service is a 7×24 hour working software with nodes distributed among hosts on different networks. As operations staff, whether need to pay attention to service work, including service data blocks in the chain can normal synchronization, software process is alive, used to store data space is enough, other nodes is working correctly, so a can real-time, intuitive understanding of these indicators, and there is no active operations staff concern, It is important and necessary to have a monitoring system that can receive service exception alarm notifications in a timely manner.
Therefore, in order to provide better user experience for operation and maintenance personnel, Miape technology developed and opened source the CITA-Monitor monitoring system to Monitor the operation status of CITA blockchain services.
Cita-monitor monitors block chain data, server process status, and host information such as CPU, memory, and disk usage in the running environment.
Dashboard screenshot
In order to make the data situation clear at a glance, we developed a data visualization panel, so that the node administrator can easily understand the operating health status of the node. In addition, we also built in key alarm rules, such as service process status alarm, such as micro service, dependent service process survival; Blockchain data status alarm, such as block height, block interval time, TPS of transaction data; For example, if the disk space is insufficient, you can receive the alarm email immediately after configuring the mailbox. For details about CITA-monitor, go to GitHub.
Feature list
- CITA service process monitoring
CITA microservice and MQ process survival, process CPU, memory usage, IO
- Blockchain data health monitoring
History of node block output height, block output time, block output interval, Quota, volume history, TPS, disk usage, and data directory size growth trend
- Operating environment Monitoring
System load, CPU, memory, disk space usage, network traffic, and number of TCP connections in the running environment of the host
- Fault alarm notification
Support email notification, Slack notification, SMS notification (Pro version)
Monitoring alarm Policies
- Node Network Monitoring (Pro version)
Number of connected nodes, network topology, and geographical location
- Source Authentication and Current Limiting (Pro version)
Identify the source and tools of the request; Restrict access sources and frequency
- JSONRPC Interface Call Analysis (Pro version)
Analyze the request time and request times of RPC methods
Monitoring indicators of the dashboard
- Summary Dashboard
The node list
The latest block height of each node
The CPU usage of each node changes
The node monitoring process is alive. Procedure
- CITA Node Info Dashboard
Node Info – Detailed information about the selected Node, including blockchain data, running environment, and running software information
CITA Meta Data – Chain configuration information, such as Chain Name and creation time
Chain Info – Latest block height, number of consensus nodes, and historical trend of block output from consensus nodes of the Chain
- Host Info Dashboard
Information about hosts running on each node, including system load, CPU, memory, disk usage, and network traffic
- Process Info Dashboard
History of CITA microserver processes, CPU, memory, and I/O changes
- RabbitMQ Dashboard
Change record of RabbitMQ service survival state, channels, consumers, connections, queues, etc
For more details, see monitoring indicator information structure
