Observability
  • Log Service
    • Overview
    • Real-time Logs
      • Real-time Logs Overview
      • Push to Tencent Cloud CLS
      • Push to AWS S3-Compatible COS
      • Push to HTTP Server
    • Offline Logs
    • Related References
      • Field description
        • L7 Access Logs
        • L4 Proxy Logs
      • Real-Time Log Push Filter Conditions
      • Custom Log Push Fields
      • Customizing Log Output Formats
  • Data Analysis
    • Overview
    • Analytics
    • Web Security Analysis
    • Traffic Analysis
    • Cache Analysis
    • Security Analysis
      • Site Security Overview
      • Web Security Analysis
    • L4 Proxy
    • DNS Resolution
    • Related References
      • Sampling Statistics
      • How to use filter condition
      • How to Modify Query Time Range
      • How to Export Statistical Data and Reports
  • AlarmService
    • Custom Statistical Metrics

Real-time Logs Overview

Function Overview

After adding your site to EdgeOne Service, EdgeOne provides you with a wealth of pre-built reports to help you monitor and analyze the operation of your business.In data analysis, you may have more personalized data analysis demands, such as the following data analysis scenarios:
Scenario
Scenario Demands
Deep Data Analysis
Need to specify one or more conditions to find logs that meet the conditions. For example:
By specifying the client IP, query the access statistics (access URL, number of accesses, etc.) within a specified time range.
Refine the analysis of status code distribution by filtering status codes, time, and URLs.
By filtering logs with the action set to "observe", summarize the request header content and other request features carried, and adjust the security policy.
Monitoring Service Metrics
Analyze the quality of EdgeOne Service and the access efficiency of users to detect exceptions in a timely manner. Access efficiency includes overall response time, download speed, origin-pull response time, etc.
Identifying Unauthorized Access
Identify client IPs with behaviors such as unauthorized access by analyzing traffic anomalies, access patterns, and access frequency.
Unified Monitoring of Data from Multiple Cloud Vendors
Build your own data dashboard to monitor application data from multiple cloud vendors.
Storing Logs
Need to reserve full user access logs (including attack interception logs) for more than 30 days.
For the above scenario demands, EdgeOne real-time logging provides the ability to collect and ship logs in real-time, allowing you to ship your logs to Tencent Cloud Log Service (CLS) or your self-built data center, helping you to implement flexible log data retrieval and analysis on your own. Currently, EdgeOne supports shipping logs to the following destinations:
Push to Tencent Cloud CLS: Ship logs to the one-stop log processing service (CLS) provided by Tencent Cloud for further log analysis on CLS.
Push to AWS S3 Compatible COS: Storage buckets compatible with AWS Signature V4 authentication method.
HTTP Service (POST): Ship logs to the specified backend server via HTTP POST requests.

Note:
1. Under normal circumstances, the latency of log delivery is within 5 minutes. To ensure the real-time performance of log delivery, EdgeOne sends logs to the designated destination in batches based on a fixed number of logs or a fixed time period. The default policy prioritizes by the number of logs, 1000 logs per batch; when the number of logs is less than 1000, but the time interval since the last push is 5 seconds, it will trigger a second push.
2. For real-time log fields, refer to Field description.

Billing and Quota Description