Lesson 098 · AWS Learning Path

AWS 098: EC2 monitoring and troubleshooting

· Published · 9 min read

An EC2 instance moves through pending, running, stopped, hibernated, and terminated states with storage and address changes shown

The real problem

A team recognizes the name EC2 monitoring and troubleshooting but has not connected the feature to a real requirement, identity boundary, network or data path, failure mode, price dimension, and cleanup owner. A plausible configuration could still fail the workload.

Final outcome

The learner will produce a requirement-led artifact for EC2 monitoring and troubleshooting, inspect the matching AWS control plane in the Management Console, run a matching CloudShell or AWS CLI query, interpret the output, diagnose one failure, defend one architecture choice, and prove cleanup or approved retained state.

The practical outcome is not a command transcript. It must show what was expected, what happened, what the result proves, what it does not prove, and which evidence would change the decision.

Learning objectives

By the end of this lesson, the learner can:

  • explain metric boundary;
  • explain basic and detailed monitoring;
  • explain three status checks;
  • explain logs and metrics differ;
  • explain alarm semantics;
  • connect control-plane state to the real data, network, identity, or application behavior;
  • identify cost and cleanup ownership before any optional mutation;
  • troubleshoot from evidence without opening broad access or adding broad permissions.

Relationship model

Requirement
   |
   v
Identity and policy -> AWS configuration -> network or data path -> workload behavior
        |                    |                      |                    |
        +--------------------+----------------------+--------------------+
                                      |
                                      v
                         monitoring, cost, recovery, cleanup

Use this model to separate an AWS object that exists from a result that actually works. Every arrow is a verification boundary.

Prerequisites, permissions, Region, and safety

  • Learning baseline: This sequence assumes practical Linux knowledge but no prior cloud-computing or AWS knowledge. Cloud, networking, security, data, automation, and architecture concepts must come from completed earlier lessons. If a prerequisite checkpoint is incomplete, return to its linked lesson before continuing.
  • Confirm a non-root caller with aws sts get-caller-identity and keep the account number private.
  • Use ap-south-1 unless this lesson explicitly names a second Region.
  • Confirm the intended profile and Region with aws configure list before interpreting an empty result.
  • Use read-only List, Get, and Describe permissions for the named services. Design exercises run locally and require no resource-creation permission.
  • This is a no-create lesson. Console and CLI work is read-only, and every design artifact is created locally.
  • Never publish account IDs, public addresses, ARNs containing private account data, session IDs, presigned URLs, object data, credentials, or KMS material.
  • Do not use root, world-open SSH or RDP, disabled TLS verification, unowned resources, or irreversible retention controls in a training exercise.

Core model

ConceptWhat the learner must understand
Metric boundaryEC2 publishes infrastructure metrics such as CPU, network, disk operations for instance-store devices, and status checks. Guest memory, filesystem use, processes, and application metrics require an agent or application instrumentation.
Basic and detailed monitoringBasic monitoring provides most EC2 metrics at five-minute periods. Paid detailed monitoring provides one-minute periods for eligible EC2 metrics; status-check metrics are already available at one-minute periods.
Three status checksSystem checks represent underlying AWS infrastructure, instance checks represent guest reachability and software, and attached-EBS checks represent reachable I/O for attached volumes on supported Nitro instances.
Logs and metrics differA metric shows a numerical signal over time. Logs provide event detail. Traces connect distributed requests. Each requires retention, access, and cost decisions.
Alarm semanticsPeriod, statistic, threshold, evaluation periods, datapoints to alarm, and missing-data treatment determine when an alarm changes state. An alarm action must match the failure owner.
Evidence orderStart with desired state, EC2 state, status checks, scheduled events, metrics, system log, SSM reachability, guest logs, application health, and dependency health.

How it works

A healthy EC2 status check does not prove a healthy application. Build a layered health model that distinguishes AWS host, guest OS, attached storage, agent, listener, application dependency, user transaction, and business outcome.

Read the result in layers:

  1. Scope: account, Region, VPC, bucket, AZ, endpoint, principal, object version, or resource ARN.
  2. Control plane: the requested configuration exists and reached an expected state.
  3. Behavior: the request, connection, health check, replication, restore, or application result meets the requirement.
  4. Operations: monitoring, failure owner, cost, retention, rollback, and cleanup are known.

Control-plane success is necessary but not sufficient. A resource can be available while policy, routing, DNS, health, data, or application behavior remains wrong.

Architecture decision table

RequirementPreferred directionWhy
Need memory and filesystem utilizationCloudWatch agent or approved observability agentDefault EC2 metrics cannot see guest memory or filesystem state.
Need faster infrastructure signalEvaluate detailed monitoring and alarm periodsPay only when one-minute EC2 metrics change the operational outcome.
System status failure on EBS-backed instanceWait, recover, or stop/start based on policyThe likely owner is the underlying host layer, not the application process.
Application fails while all EC2 checks passInspect listener, logs, dependencies, and synthetic testInfrastructure reachability is only one health layer.

Professional questions normally contain several valid services. State the requirement that selects one option, why the nearest alternative fails it, and what changed requirement would reverse the choice.

AWS Management Console guided practice

Before opening a service page, write the expected account, Region, starting state, and evidence. Do not choose Create, Save, Purchase, Lock, or Delete unless the lesson explicitly authorizes the live track.

  1. Open EC2 Instances, select an instructor-approved instance or supplied capture, and inspect Status and alarms, Monitoring, scheduled events, and system log.
  2. Open CloudWatch Metrics and Alarms; identify namespace, dimensions, period, statistic, threshold, missing-data behavior, and action for one EC2 signal.
  3. Compare infrastructure status with the supplied guest, SSM Agent, listener, and HTTP evidence, then name the first failing layer.

For each step, capture the field name and value in text. A screenshot may support the record but does not replace the explanation. Console labels can evolve, so use the service search and current documentation if a navigation label differs.

CloudShell and AWS CLI practice

CloudShell is the default browser-based command environment taught in AWS 028. AWS 029 and AWS 030 cover local CLI installation and authentication. This lesson therefore does not assume that an unconfigured local shell is ready.

Start every session with:

export AWS_DEFAULT_REGION="ap-south-1"
aws sts get-caller-identity --query Arn --output text
aws configure list

Redact the account portion of the ARN before sharing. Then perform the topic query:

Inspect status, monitoring state, recent CPU data, and alarms without enabling paid detailed monitoring.

aws ec2 describe-instance-status --include-all-instances --query 'InstanceStatuses[].{Id:InstanceId,State:InstanceState.Name,System:SystemStatus.Status,Instance:InstanceStatus.Status,EBS:AttachedEbsStatus.Status}' --output table
aws cloudwatch describe-alarms --state-value ALARM --query 'MetricAlarms[].{Name:AlarmName,Metric:MetricName,Namespace:Namespace,Reason:StateReason}' --output table

Expected interpretation:

Empty results can mean no matching instances or alarms, wrong Region, filters, or insufficient permission. Status output does not prove the HTTP application or guest filesystem is healthy.

Replace every replace-with-... sample value before running its command, and use only an explicitly owned resource. Explain each option first. These queries are read-only; a successful response does not authorize a later create or delete operation.

Practical work

Create p05-observability-baseline.md for the later Auto Scaling application. Define EC2, attached-EBS, ASG, ALB, target-health, application, log, and synthetic signals; owner and response for each; collection interval; retention; cost; missing-data behavior; and a dependency-aware dashboard. Do not enable detailed monitoring or create an alarm.

The evidence package must contain:

  • the problem and final requirement in the learner's own words;
  • caller type and Region with private identifiers redacted;
  • exact planned values, ownership, and cost class;
  • one Console observation and matching CLI or API evidence;
  • one behavior result or supplied data-plane record;
  • one denied, failed, or counterexample result and evidence-led diagnosis;
  • one architecture choice plus the rejected alternative;
  • cleanup proof or explicit retained-state owner, expiry, and next lesson.

Verification standard

Use expected state before observed state. Record timestamps in UTC and preserve the original failure before changing anything. A passing submission answers all four questions:

  1. What exact requirement was tested?
  2. Which evidence proves the AWS configuration?
  3. Which evidence proves the workload behavior?
  4. What remains unproven or requires later monitoring?

If AWS returns no rows, verify account, Region, permission, filters, pagination, resource type, and deletion state before concluding that nothing exists.

Common failures and troubleshooting

SymptomEvidence firstLikely boundarySmallest safe response
object appears missingcaller, Region, filters, pagination, tagsscope or read permissionalign scope before creating a duplicate
state remains pending or unavailableservice state, events, dependencies, quotasdependency or capacitycorrect the named dependency and wait with a bound
AccessDeniedprincipal, action, resource, explicit-deny contextidentity, resource, endpoint, organization, or KMS policychange only the proven policy layer
configuration exists but behavior failsroute, DNS, security, listener, health, logs, object versiondata path or applicationtest the next boundary and change one control
bill is higher than expectedhours, bytes, requests, AZs, addresses, retentioncost model or retained resourcestop optional work and reconcile the ledger
cleanup is blockeddependency inventory and owning servicedeletion order or immutable stateremove owned dependants in reviewed reverse order

Do not troubleshoot by attaching administrator access, opening administration ports to the internet, disabling encryption, retrying uncontrolled creation, deleting unknown resources, or weakening retention.

Cost, cleanup, and retained state

No AWS resource is created. Close CloudShell and remove or redact downloaded evidence.

Cleanup evidence requires terminal state and an after-inventory. Search related ENIs, public IPv4 addresses, EBS volumes and snapshots, load balancers, target groups, Auto Scaling instances, endpoints, logs, S3 versions and delete markers, backup recovery points, and global IAM roles when they apply. Billing data can lag, so schedule a later review.

Architecture and certification decisions

  • Certification coverage: SAA-C03; SOA-C03; SAP-C02; DOP-C02.
  • Exam mapping: SAA D2-D4.
  • Explain service scope, failure boundary, consistency, recovery, security, operations, and price rather than matching a keyword.
  • Treat availability and durability, encryption and authorization, routing and filtering, health and lifecycle, backup and replication, and discount and capacity as separate concepts.
  • Do not reproduce protected certification questions.

Knowledge check

  1. Is guest memory utilization a default EC2 metric?

Expected direction: No. Use an agent or application instrumentation.

  1. Which check normally points to an AWS host problem?

Expected direction: System status check.

  1. Do passed status checks prove the website works?

Expected direction: No. Test the listener and application path.

  1. Why record missing-data treatment?

Expected direction: Missing points must not silently become false health or destructive actions.

Completion gate and assessment

AreaPointsPassing evidence
Requirement and model15Correct scope, terminology, and final outcome
Console evidence15Current path and interpreted fields
CLI or API evidence15Scoped command, expected result, and limitations
Behavior or decision exercise20Reproducible result or defensible architecture reasoning
Troubleshooting15Original symptom, hypothesis, one change, retest, rollback
Security and cost10Least privilege, data protection, current price dimensions
Cleanup and handoff10Terminal-state proof or approved retained-state record

Pass at 80 out of 100 with no critical safety failure. A missing practical artifact, unexplained output, unsafe access, destructive action outside the owned scope, unplanned billed resource, or false cleanup claim requires remediation and a changed retest.

Official sources

Advertisement