Skip to content

[aws_logs] Enable Identity Federation for agentless CloudWatch deployments - #20823

Open
seanrathier wants to merge 4 commits into
elastic:mainfrom
seanrathier:aws_logs/identity-federation
Open

[aws_logs] Enable Identity Federation for agentless CloudWatch deployments#20823
seanrathier wants to merge 4 commits into
elastic:mainfrom
seanrathier:aws_logs/identity-federation

Conversation

@seanrathier

Copy link
Copy Markdown
Contributor

Proposed commit message

Enable Identity Federation (Cloud Connectors) for the Custom AWS Logs integration.

Adds var_groups with a credential selector (Identity Federation, Direct Access Keys, Temporary Access Keys, Assume Role, Shared Credentials), enables agentless deployment mode for the aws-cloudwatch input, and wires use_cloud_connectors into the cloudwatch stream template. The aws-s3 input is pinned to deployment_modes: ["default"] as it is not agentless-eligible. Bumps format_version to 3.6.4 and kibana/agent floors to ^9.6.0. No pipeline hygiene changes needed (no ingest pipelines in this package).

Major version bump (1.8.32.0.0) frees the 1.x namespace for backport-aws_logs-1.x, which will carry patch/minor fixes for users on stacks below ^9.6.0. See elastic/ingest-dev#8788 for the branching strategy.

Part of elastic/ingest-dev#8812.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs. (E2E validation pending)
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices (no dashboards added or changed)

Author's Checklist

Related

🤖 Generated with Claude Code

…ments (ingest-dev#8812)

- Bump format_version 3.3.1 → 3.6.4 (required for var_groups + provider_permissions)
- Bump version 1.8.3 → 2.0.0 (major bump frees 1.x namespace for backport-aws_logs-1.x)
- Bump kibana and agent floors to ^9.6.0 (use_cloud_connectors requires Agent 9.6.0+)
- Add supports_identity_federation var
- Add var_groups with identity_federation, direct_access_key, temporary_access_key,
  assume_role, and shared_credentials options
- Enable agentless deployment mode (beta) on the aws_logs policy template
- Pin aws-s3 input to deployment_modes: [default] (aws-s3 is not agentless-eligible)
- Add use_cloud_connectors to the aws-cloudwatch stream template

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Elastic Docs Style Checker (Vale)

Summary: 1 suggestion found

💡 Suggestions (1): Optional style improvements. Apply when helpful.
File Line Rule Message
packages/aws_logs/changelog.yml 1 Elastic.Versions Use 'later versions' instead of 'newer versions' when referring to versions.

The Vale linter checks documentation changes against the Elastic Docs style guide. To use Vale locally or report issues, refer to Elastic style guide for Vale.

Declares IAM permissions needed for Identity Federation role provisioning
via the IaCP render path.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@seanrathier
seanrathier force-pushed the aws_logs/identity-federation branch from c82c29c to 0692a75 Compare August 19, 2026 21:06
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@seanrathier seanrathier self-assigned this Aug 21, 2026
@seanrathier seanrathier added Integration:aws_logs Custom AWS Logs Team:security-siem-conduit Security SIEM Conduit team [ Previously Security Data Experience - Cloud Services team ] labels Aug 21, 2026
@seanrathier
seanrathier marked this pull request as ready for review August 21, 2026 19:52
@seanrathier
seanrathier requested a review from a team as a code owner August 21, 2026 19:52
Copilot AI lite review requested due to automatic review settings August 21, 2026 19:52

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Enables Identity Federation (Cloud Connectors) and agentless deployment support for the aws_logs integration’s CloudWatch-based collection, aligning the package with Elastic Stack/Agent capabilities introduced in ^9.6.0.

Changes:

  • Bump package to 2.0.0, update format_version to 3.6.4, and raise Kibana/Agent minimum versions to ^9.6.0.
  • Add var_groups credential selector (including Identity Federation) and enable agentless deployment mode at the policy template level, while restricting aws-s3 to default (agent-based) deployments.
  • Wire supports_identity_federation into the CloudWatch stream template via use_cloud_connectors, and document the change in changelog.yml.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated no comments.

File Description
packages/aws_logs/manifest.yml Raises stack/agent floors, adds deployment modes, introduces credential selection var_group, and restricts S3 input to default deployments.
packages/aws_logs/data_stream/generic/agent/stream/aws-cloudwatch.yml.hbs Adds conditional use_cloud_connectors emission for Identity Federation support.
packages/aws_logs/changelog.yml Adds a 2.0.0 changelog entry describing the Identity Federation + agentless updates and version floor bump.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@mergify

mergify Bot commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

Tick the box to add this pull request to the merge queue (same as @mergifyio queue).

  • Queue this pull request

… breaking-change

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings August 24, 2026 19:17
@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

✅ All changelog entries have the correct PR link.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.

Comment on lines +94 to +96
{{#if supports_identity_federation}}
use_cloud_connectors: {{supports_identity_federation}}
{{/if}}
Comment on lines +41 to +49
provider_permissions:
- provider: aws
description: CloudWatch Logs read access for custom log collection.
permissions:
- name: logs:DescribeLogGroups
- name: logs:DescribeLogStreams
- name: logs:FilterLogEvents
- name: logs:GetLogEvents
- name: logs:GetLogGroupFields
@infra-vault-gh-plugin-prod

Copy link
Copy Markdown

💚 Build Succeeded

History

cc @seanrathier

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Integration:aws_logs Custom AWS Logs Team:security-siem-conduit Security SIEM Conduit team [ Previously Security Data Experience - Cloud Services team ]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants