Overview
Cloud Monitoring provides visibility into the performance, uptime, and overall health of cloud-powered applications. Cloud Monitoring collects metrics, events, and metadata from Google Cloud, Amazon Web Services, hosted uptime probes, application instrumentation, and a variety of common application components including Cassandra, Nginx, Apache Web Server, Elasticsearch, and many others. Cloud Monitoring ingests that data and generates insights via dashboards, charts, and alerts. Cloud Monitoring alerting helps you collaborate by integrating with Slack, PagerDuty, HipChat, Campfire, and more.
In this lab you'll install monitoring and logging agents to collect information from your instance, which could include metrics and logs from 3rd party apps.
Objectives
In this lab, you learn how to:
Setup and requirements
Read these instructions. Labs are timed and you cannot pause them. The timer, which starts when you click Start Lab, shows how long Google Cloud resources are made available to you.
This hands-on lab lets you do the lab activities in a real cloud environment, not in a simulation or demo environment. It does so by giving you new, temporary credentials you use to sign in and access Google Cloud for the duration of the lab.
To complete this lab, you need:
- Access to a standard internet browser (Chrome browser recommended).
Note: Use an Incognito (recommended) or private browser window to run this lab. This prevents conflicts between your personal account and the student account, which may cause extra charges incurred to your personal account.
- Time to complete the lab—remember, once you start, you cannot pause a lab.
Note: Use only the student account for this lab. If you use a different Google Cloud account, you may incur charges to that account.
How to start your lab and sign in to the Google Cloud console
Click the Start Lab button. If you need to pay for the lab, a dialog opens for you to select your payment method. On the left is the Lab Details pane with the following:
The Open Google Cloud console button
Time remaining
The temporary credentials that you must use for this lab
Other information, if needed, to step through this lab
Click Open Google Cloud console (or right-click and select Open Link in Incognito Window if you are running the Chrome browser).
The lab spins up resources, and then opens another tab that shows the Sign in page.
Tip: Arrange the tabs in separate windows, side-by-side.
Note: If you see the Choose an account dialog, click Use Another Account.
If necessary, copy the Username below and paste it into the Sign in dialog.
student-03-6ac3d0ac18d9@qwiklabs.net
You can also find the Username in the Lab Details pane.
Click Next.
Copy the Password below and paste it into the Welcome dialog.
ir78StaHAbgx
You can also find the Password in the Lab Details pane.
Click Next.
Important: You must use the credentials the lab provides you. Do not use your Google Cloud account credentials.
Note: Using your own Google Cloud account for this lab may incur extra charges.
Click through the subsequent pages:
Accept the terms and conditions.
Do not add recovery options or two-factor authentication (because this is a temporary account).
Do not sign up for free trials.
After a few moments, the Google Cloud console opens in this tab.
Note: To access Google Cloud products and services, click the Navigation menu or type the service or product name in the Search field.
Activate Cloud Shell
Cloud Shell is a virtual machine that is loaded with development tools. It offers a persistent 5GB home directory and runs on the Google Cloud. Cloud Shell provides command-line access to your Google Cloud resources.
Click Activate Cloud Shell at the top of the Google Cloud console.
Click through the following windows:
When you are connected, you are already authenticated, and the project is set to your Project_ID, qwiklabs-gcp-02-356245a0b5cc. The output contains a line that declares the Project_ID for this session:
Your Cloud Platform project in this session is set to qwiklabs-gcp-02-356245a0b5cc
gcloud is the command-line tool for Google Cloud. It comes pre-installed on Cloud Shell and supports tab-completion.
- (Optional) You can list the active account name with this command:
gcloud auth list
- Click Authorize.
Output:
ACTIVE: *
ACCOUNT: student-03-6ac3d0ac18d9@qwiklabs.net
To set the active account, run:
$ gcloud config set account `ACCOUNT`
- (Optional) You can list the project ID with this command:
gcloud config list project
Output:
[core]
project = qwiklabs-gcp-02-356245a0b5cc
Note: For full documentation of gcloud, in Google Cloud, refer to the gcloud CLI overview guide.
Set your region and zone
Certain Compute Engine resources live in regions and zones. A region is a specific geographical location where you can run your resources. Each region has one or more zones.
Run the following gcloud commands in Cloud Shell to set the default region and zone for your lab:
gcloud config set compute/zone "us-west2-c"
export ZONE=$(gcloud config get compute/zone)
gcloud config set compute/region "us-west2"
export REGION=$(gcloud config get compute/region)
Task 1. Create a Compute Engine instance
In the Cloud console, on the Navigation menu (☰), click Compute Engine > VM Instances, then click Create instance.
Fill in the fields as follows, leaving all other fields at the default value:
In the Machine configuration
Enter the values for the following fields:
| Field |
Value |
| Name |
lamp-1-vm |
| Region |
us-west2 |
| Zone |
us-west2-c |
| Series |
E2 |
| Machine |
e2-medium |
Click OS and storage
Select Boot Disk:
- Boot Disk: Debian GNU/Linux 12 (bookworm)
Click Networking
Select the values for Firewall:
- Firewall: Allow HTTP traffic
Once all sections are configured, scroll down and click Create to launch your new virtual machine instance.
Wait a couple of minutes, you'll see a green check when the instance has launched.
Click Check my progress below. A green check confirms you're on track.
Create a Compute Engine instance
Task 2. Add Apache2 HTTP Server to your instance
In the Console, click SSH in line with lamp-1-vm to open a terminal to your instance.
Run the following commands in the SSH window to set up Apache2 HTTP Server:
sudo apt-get update
sudo apt-get install apache2 php7.0
- When asked if you want to continue, enter Y.
Note: If you cannot install php7.0, use php5.
sudo service apache2 restart
Click Check my progress below. A green check confirms you're on track.
Add Apache2 HTTP Server to your instance
- Return to the Cloud Console, on the VM instances page. Click the
External IP for lamp-1-vm instance to see the Apache2 default page for this instance.
Note: If you are unable to find External IP column then click on Column Display Options icon on the right side of the corner, select External IP checkbox and click OK.
Click Check my progress below. A green check confirms you're on track.
Get a success response over External IP of VM instance
Create a Monitoring Metrics Scope
Set up a Monitoring Metrics Scope that's tied to your Google Cloud Project. The following steps create a new account that has a free trial of Monitoring.
When the Monitoring Overview page opens, your metrics scope project is ready.
Install the Monitoring and Logging agents
Agents collect data and then send or stream info to Cloud Monitoring in the Cloud Console.
The Cloud Monitoring agent is a collected-based daemon that gathers system and application metrics from virtual machine instances and sends them to Monitoring. By default, the Monitoring agent collects disk, CPU, network, and process metrics. Configuring the Monitoring agent allows third-party applications to get the full list of agent metrics. On the Google Cloud, Operations website, see Cloud Monitoring Documentation for more information.
In this section, you install the Cloud Logging agent to stream logs from your VM instances to Cloud Logging. Later in this lab, you see what logs are generated when you stop and start your VM.
Note: It is best practice to run the Cloud Logging agent on all your VM instances.
- Run the Monitoring agent install script command in the SSH terminal of your VM instance to install the Cloud Monitoring agent:
curl -sSO https://dl.google.com/cloudagents/add-google-cloud-ops-agent-repo.sh
sudo bash add-google-cloud-ops-agent-repo.sh --also-install
If asked if you want to continue, press Y.
Run the Logging agent install script command in the SSH terminal of your VM instance to install the Cloud Logging agent:
sudo systemctl status google-cloud-ops-agent"*"
Press q to exit the status.
sudo apt-get update
Task 3. Create an uptime check
Uptime checks verify that a resource is always accessible. For practice, create an uptime check to verify your VM is up.
In the Cloud Console, in the left menu, click Uptime checks, and then click Create Uptime Check.
For Protocol, select HTTP.
For Resource Type, select Instance.
For Instance, select lamp-1-vm.
For Check Frequency, select 1 minute.
Click Continue.
In Response Validation, accept the defaults and then click Continue.
In Alert & Notification, accept the defaults, and then click Continue.
For Title, type Lamp Uptime Check.
Click Test to verify that your uptime check can connect to the resource.
When you see a green check mark everything can connect.
Click Create.
The uptime check you configured takes a while for it to become active. Continue with the lab, you'll check for results later. While you wait, create an alerting policy for a different resource.
Task 4. Create an alerting policy
Use Cloud Monitoring to create one or more alerting policies.
In the left menu, click Alerting, and then click +Create Policy.
Click on Select a metric dropdown. Uncheck the Active.
Type Network traffic in filter by resource and metric name and click on VM instance > Interface. Select Network traffic (agent.googleapis.com/interface/traffic) and click Apply. Leave all other fields at the default value.
Click Next.
Set the Threshold position to Above threshold, Threshold value to 500 and Advanced Options > Retest window to 1 min. Click Next.
Click on the drop down arrow next to Notification Channels, then click on Manage Notification Channels.
A Notification channels page will open in a new tab.
Scroll down the page and click on ADD NEW for Email.
In the Create Email Channel dialog box, enter your personal email address in the Email Address field and a Display name.
Click on Save.
Go back to the previous Create alerting policy tab.
Click on Notification Channels again, then click on the Refresh icon to get the display name you mentioned in the previous step.
Click on Notification Channels again if necessary, select your Display name and click OK.
Add a message in documentation, which will be included in the emailed alert.
Mention the Alert name as Inbound Traffic Alert.
Click Next.
Review the alert and click Create Policy.
You've created an alert! While you wait for the system to trigger an alert, create a dashboard and chart, and then check out Cloud Logging.
Click Check my progress below. A green check confirms you're on track.
Create an uptime check and alerting policy
Task 5. Create a dashboard and chart
You can display the metrics collected by Cloud Monitoring in your own charts and dashboards. In this section you create the charts for the lab metrics and a custom dashboard.
In the left menu select Dashboards, and then +Create Custom Dashboard.
Name the dashboard Cloud Monitoring LAMP Qwik Start Dashboard.
Add the first chart
Click on + ADD WIDGET
Select the Line option under Visualization in the Add widget.
Name the Widget title CPU Load.
Click on Select a metric dropdown. Uncheck the Active.
Type CPU load (1m) in filter by resource and metric name and click on VM instance > Cpu. Select CPU load (1m) and click Apply. Leave all other fields at the default value. Refresh the tab to view the graph.
Add the second chart
Click + Add WIDGET and select Line option under Visualization in the Add widget.
Name this Widget title Received Packets.
Click on Select a metric dropdown. Uncheck the Active.
Type Received packets in filter by resource and metric name and click on VM instance > Instance. Select Received packets and click Apply. Refresh the tab to view the graph.
Leave the other fields at their default values. You see the chart data.
Task 6. View your logs
Cloud Monitoring and Cloud Logging are closely integrated. Check out the logs for your lab.
Select Navigation menu > Logging > Logs Explorer.
Select the logs you want to see, in this case, you select the logs for the lamp-1-vm instance you created at the start of this lab:
In the results section you can see the logs for your VM instance.
Check out what happens when you start and stop the VM instance.
To best see how Cloud Monitoring and Cloud Logging reflect VM instance changes, make changes to your instance in one browser window and then see what happens in the Cloud Monitoring, and then Cloud Logging windows.
Open the Compute Engine window in a new browser window. Select Navigation menu > Compute Engine, right-click VM instances > Open link in new window.
Move the Logs Viewer browser window next to the Compute Engine window. This makes it easier to view how changes to the VM are reflected in the logs
In the Compute Engine window, select the lamp-1-vm instance, click the three vertical dots at the right of the screen and then click Stop, and then confirm to stop the instance.
It takes a few minutes for the instance to stop.
Watch in the Logs View tab for when the VM is stopped.
In the VM instance details window, click the three vertical dots at the right of the screen and then click Start/resume, and then confirm. It will take a few minutes for the instance to re-start. Watch the log messages to monitor the start up.
Task 7. Check the uptime check results and triggered alerts
In the Cloud Logging window, select Navigation menu > Monitoring > Uptime checks. This view provides a list of all active uptime checks, and the status of each in different locations.
You will see Lamp Uptime Check listed. Since you have just restarted your instance, the regions are in a failed status. It may take up to 5 minutes for the regions to become active. Reload your browser window as necessary until the regions are active.
Click the name of the uptime check, Lamp Uptime Check.
Since you have just restarted your instance, it may take some minutes for the regions to become active. Reload your browser window as necessary.
Check if alerts have been triggered
In the left menu, click Alerting.
You see incidents and events listed in the Alerting window.
Check your email account. You should see Cloud Monitoring Alerts.
Note: Remove the email notification from your alerting policy. The resources for the lab may be active for a while after you finish, and this may result in a few more email notifications getting sent out.
Solution of Lab
New Solution
https://youtu.be/gHYly90DTQs
curl -LO raw.githubusercontent.com/ePlus-DEV/storage/refs/heads/main/labs/GSP089/lab.sh
source lab.sh
Script Alternative
curl -LO https://raw.githubusercontent.com/Itsabhishek7py/GoogleCloudSkillsboost/refs/heads/main/Cloud%20Monitoring%3A%20Qwik%20Start/abhishekGSP089.sh
sudo chmod +x abhishekGSP089.sh
./abhishekGSP089.sh
Old Solution
https://youtu.be/5XkXekawOfo
curl -LO raw.githubusercontent.com/ePlus-DEV/storage/refs/heads/main/labs/GSP089/old-lab.sh
source old-lab.sh
Script Alternative
curl -LO raw.githubusercontent.com/cloudgoodies/Arcade/refs/heads/main/Cloud%20Monitoring%3A%20Qwik%20Start/GSP089.sh
sudo chmod +x GSP089.sh
./GSP089.sh
Manual
https://www.youtube.com/watch?v=I5KWhLfWnro
