AWS 051: Troubleshoot explicit deny, missing allow, trust, and resource-policy failures
The problem
A team uses Troubleshoot explicit deny, missing allow, trust, and resource-policy failures as a label or Console setting without proving the identity, scope, behavior, failure boundary, cost, or operational result. The configuration appears complete but the real requirement remains untested.
Final outcome
The learner will inspect, explain, test, and document Troubleshoot explicit deny, missing allow, trust, and resource-policy failures. The submission must connect the Console and CLI view to the same AWS control, state what the evidence proves, diagnose one likely failure, and make a requirement-based architecture decision.
Learning outcomes
You will be able to:
- explain implicit deny;
- explain explicit deny;
- explain trust failure;
- explain resource-policy failure;
- explain context mismatch;
- distinguish successful configuration from successful workload behavior;
- preserve redacted evidence and complete the stated cleanup or retention decision.
Mental model
requirement
-> identity and permission
-> account, Region, and resource scope
-> configuration or request
-> observable state
-> workload result
-> failure evidence
-> cleanup or controlled retention
Never begin with a create button or a copied command. Start with the result that must be proven and the boundary that must remain protected.
Core facts
| Concept | What it means in practice |
|---|---|
| Implicit deny | No applicable allow means denial. The smallest fix is often one missing action or resource, not administrator access. |
| Explicit deny | An applicable explicit Deny overrides an Allow. Search identity, resource, boundary, session, SCP, RCP, endpoint, and service-specific policy layers. |
| Trust failure | AssumeRole needs caller permission and a target trust relationship, plus surviving organization and condition controls. |
| Resource-policy failure | A bucket, key, queue, topic, function, or endpoint policy can block a request even when the identity policy appears broad. |
| Context mismatch | Wrong Region, account, ARN, tag, VPC endpoint, MFA state, or source identity can make a correct-looking policy inapplicable. |
| Evidence | Capture principal, action, resource, condition context, error code, request ID, CloudTrail event, and simulator limits before editing. |
How to reason about it
Troubleshoot authorization as an intersection and union problem. Establish the exact request, find any explicit deny, identify the required allow, then evaluate every permission ceiling and resource boundary.
The policy simulator is useful but cannot reproduce every live resource policy, SCP, service behavior, or request context. Confirm the correction with the real non-destructive request.
Use the following decision table as a starting point, then change the answer when the scenario changes.
| Requirement | Preferred direction | Why |
|---|---|---|
| No matching allow | Add exact action and resource if justified | Preserve least privilege. |
| Boundary excludes action | Change request or approved boundary design | An identity allow cannot exceed the boundary. |
| Role cannot be assumed | Check both caller allow and target trust | Both sides and conditions matter. |
| KMS-encrypted resource denied | Inspect key policy and grants | Service permission alone may be insufficient. |
Prerequisites, permissions, Region, and cost
Run this lesson as the approved non-root course identity. Begin with aws sts get-caller-identity, confirm the private account record, and set the fixed project Region before any regional query. IAM resources are global within an account, while STS endpoints and the services reached by an identity can be regional.
Use only the read or change actions required for this lesson. An AccessDenied result is evidence to analyse, not permission to switch to root or attach AdministratorAccess. Record the action, resource, principal type, request context, and smallest justified correction.
The listed cost tier is T1 - free or near-free with immediate cleanup. Free Tier eligibility and credits are account-specific. Before a mutating lab, identify every resource that can charge, estimate its duration, start a timer, and write the reverse cleanup order. A budget reports cost after billing data arrives and is not a real-time stop control.
AWS Management Console method
- Open IAM Policy Simulator and test the supplied principal, action, and resource.
- Open the role trust relationship and every attached permission policy and boundary.
- Open CloudTrail Event history and locate the failed request without exposing sensitive parameters.
For every step record the service page, selected account and Region, exact object, visible state, and why that state matters. A Console label or green status is not enough unless it is tied to the final workload outcome.
AWS CLI or API evidence
Simulate a precise request and inspect matched statements.
aws iam simulate-principal-policy --policy-source-arn arn:aws:iam::<account-id>:role/nw-p03-readonly-role --action-names ec2:DescribeAvailabilityZones --resource-arns '*'
The decision and matched statements narrow the policy investigation. They do not reproduce every live resource or organization policy.
Before running the command, replace every placeholder, explain each option, and decide whether the operation is read-only or mutating. Capture the exit code immediately. Redact account IDs, ARNs, public addresses, request identifiers, and personal data before sharing.
The CLI and Console are clients of AWS APIs. Matching state across them increases confidence, but neither substitutes for data-plane or application verification.
Practical work
Create troubleshoot-explicit-deny-missing-allow-trust-and-resource-policy-failures-evidence.md. Record the problem, account and Region preflight, observed Console state, matching CLI result, every decision in the table, one intentional misconception, one failure diagnosis, and the retained-state or cleanup result.
The evidence package must include:
- non-root principal type, account verified privately, and Region;
- exact intended and observed state;
- one Console observation and the matching CLI or API result;
- one successful result and one denied, failed, or counterexample result;
- what each result does not prove;
- cost state and elapsed lab time;
- cleanup evidence or a named retained-state owner and next lesson.
Verification standard
Use three levels of proof:
- Control plane: the object or policy exists with the intended configuration.
- Data plane or behavior: the request, packet, session, storage path, or application does what the requirement states.
- Operations: monitoring, failure diagnosis, cost, ownership, and cleanup are known.
A control-plane response can precede final readiness. Use waiters or state polling where supported, then test the actual behavior. If a request times out, do not assume it failed. Inspect state and use documented idempotency before retrying a mutation.
Troubleshooting method
| Symptom | Evidence first | Smallest safe response |
|---|---|---|
| command cannot authenticate | credential source, expiry, caller preflight | restore approved temporary login |
| access is denied | action, resource, principal, all policy layers | correct only the missing or conflicting control |
| object appears missing | account, Region, filters, pagination, permission | align scope before creating anything |
| configured state exists but behavior fails | route, identity, dependency, logs, service state | test the next boundary in the path |
| cleanup is blocked | dependency inventory and owning service | remove dependants in reviewed reverse order |
Keep the original symptom and timestamp. State one hypothesis, make one reversible change, repeat the original test, and record rollback. Never open a management port to the world, expose credentials, disable TLS verification, format an unknown disk, or add broad permissions as a generic fix.
Architecture and certification decisions
Professional-level questions provide competing valid features. Identify the requirement that decides between them: human or workload identity, same-account or cross-account access, regional or zonal scope, stateful or stateless filtering, durable or ephemeral data, latency, RTO/RPO, cost, or operational ownership.
Explain why the selected option fits and why each plausible alternative fails one stated requirement. Do not rely on feature memorization or reproduce protected certification questions.
Knowledge check
- Can an Allow override explicit Deny?
Expected direction: No.
- Does a boundary grant permission?
Expected direction: No. It limits permissions granted elsewhere.
- What two sides govern AssumeRole?
Expected direction: Caller permission and target trust policy.
- Why inspect CloudTrail?
Expected direction: It records the actual principal, action, time, and request context available for the event.
Cost, cleanup, and retained state
No workload resource should remain unless this lesson explicitly creates and retains one for the next numbered lab.
Cleanup evidence includes the final state query, not only a successful delete response. Search related resources, other Regions used by the lab, retained storage, public IPv4 addresses, logging destinations, and service-managed dependencies. Schedule a later billing review because cost data can lag.
Completion gate
Pass when the practical artifact explains the real problem, matches Console and CLI evidence, answers every knowledge check, diagnoses one failure without broadening access, records cost, and proves cleanup or approved retention. The learner must defend one decision orally and name the requirement that would change it.