Google Cloud Cloud Operations Logging
Google Cloud Cloud Operations Logging
#GCP #data Engineer
Cloud Operations is the stack of services that helps in monitoring, logging, debugging, and remove latencies from the APIs or the google cloud services. We have already seen the Monitoring service from the cloud operations stack. In this lesson, we will understand the rest of the services.
Logging#
Cloud Logging is the centralized log server for all the resources hosted on Google Cloud. All types of logs including the network and access logs are captured and stored in the logging service.
How does this work? What is the architecture that supports this type of centralized logging mechanism? Let’s have a look at Cloud Logging and its components.
The architecture is pretty simple and straightforward. All types of logs of resources are forwarded to the “Cloud Logging API”. At the backend of the logging API, the “Log router” determines if a log should be stored, excluded, or exported based on the filters applied to it.
You can exclude the log from storing and export it to the event processing system at the same time because of parallel filters. “Audit logs” and “Network logs” are the most frequent types of logs which are exported to the long-term storage classes in cloud storage buckets.