CQRS Design Pattern

A sample implementation of the command query responsibility segregation (CQRS) design pattern using AWS Step Functions

EC2 Instance Isolation

Isolate an EC2 instance suspected in a security incident

EC2 Instance Isolation

Isolate an EC2 instance suspected in a security incident

EC2 Instance Isolation

Isolate an EC2 instance suspected in a security incident

Account Vending Machine

Automate the creation of new AWS accounts in your AWS Organizations with a CloudFormation template that includes your standard basline configuration

Activity State Machine

Wait for an activity worker to complete it's task

Activity State Machine

Wait for an activity worker to complete it's task

Amazon DataZone Update Metadata

Use Step Functions to update the business metadata catalog in Amazon DataZone

Concurrency Controller

A Workflow that uses DynamoDB to implement a semaphore

Concurrency Controller

A Workflow that uses DynamoDB to implement a semaphore

Query Athena S3 data

Process S3 data fetched in Athena Query using Step Functions.

Automated policy orchestrator

Alert administrator on an IAM policy creation event and wait for approval

Automated security orchestrator

This is AWS Step Functions workflow automates the process of verifying if newly created IAM Policies contain any of the predefined list of restricted actions.

Batch execute on redshift

Execute batch statements on redshift

AWS Batch with Lambda

This sample project demonstrates how to use Step Functions to pre-process data with AWS Lambda functions and then orchestrate AWS Batch jobs. Deploying this sample project will create an AWS Step Functions state machine, a Lambda function, and an AWS Batch job.

AWS Batch with Lambda

This sample project demonstrates how to use Step Functions to pre-process data with AWS Lambda functions and then orchestrate AWS Batch jobs. Deploying this sample project will create an AWS Step Functions state machine, a Lambda function, and an AWS Batch job.

AWS Batch with Lambda

This sample project demonstrates how to use Step Functions to pre-process data with AWS Lambda functions and then orchestrate AWS Batch jobs. Deploying this sample project will create an AWS Step Functions state machine, a Lambda function, and an AWS Batch job.

Batch write data to DynamoDB

Transform and batch data to a DynamoDB table

Bedrock blog generator

Use generative AI to build a blog post

Amazon Bedrock Knowledge Base Evaluations

Ingest data into multiple Knowledge Bases and evaluate the performance with your test suite of prompts

Invoke Amazon Bedrock

A Step Functions Workflow for invoking LLM Model on Amazon Bedrock

Customise Amazon Bedrock Cohere Command Light model

The SAM template deploys a Step Functions workflow that creates custom model by fine tuning Amazon Bedrock Cohere Command Light model.

Bulk Video Analysis with Distributed Map State

This sample project demonstrates using Step Functions Distributed Map for bulk analysis of Videos with Amazon Rekognition.

Call HTTP API

Call an HTTP/HTTPS API and return the API response

Call an AWS Fargate microservice with Amazon API Gateway

This demonstrates how to use AWS Step Functions to make a call to Amazon API Gateway to interact with a service on AWS Fargate and to check whether the call succeeded.

Calling Asynchronous API with Callbacks

Invoke an asynchronous API, then pause the state machine and call back on completion.

Message categorization with Amazon Bedrock

Message categorizing with AWS Step Functions, Amazon Bedrock and Amazon Simple Queue Service.

Celebrity identifier

Identify known celebrities from an image file and write corresponding file and celebrity identification values to DynamoDB without custom code.

Chain Of Responsibility Pattern

ATM Money Dispenser representing Chained or Chain of Responsibility Pattern

Chain Of Responsibility Pattern

ATM Money Dispenser representing Chained or Chain of Responsibility Pattern

Chain Of Responsibility Pattern

ATM Money Dispenser representing Chained or Chain of Responsibility Pattern

Event-driven checkout processing workflow

Efficient event-driven order processing with AWS Step Functions

Circuit breaker workflow

Prevent a caller service from retrying another callee service call that has previously caused repeated timeouts or failures. It can also detect when the callee service is functional again.

Common error handling

Catch error from multiple states with a single common error handling state

Configuration Backup Workflow

Configuration backup Workflow based on Resource Types

Orchestrate continuous running Glue Workflow

This workflow demonstrates how to orchestrate a continuous running Glue Workflow.

Cross account access

Use cross-account capability using two AWS accounts

Curbside Pickup App

Process orders and deliver to curb when customer arrives

EventBridge Custom Event

Submit a custom event to EventBridge from a Step Functions workflow

EventBridge Custom Event

Submit a custom event to EventBridge from a Step Functions workflow

EventBridge Custom Event

Submit a custom event to EventBridge from a Step Functions workflow

Data Processing Pattern

Processes images from S3 and extracts metadata and labels, storing them in DynamoDB

Data Processing Pattern

Processes images from S3 and extracts metadata and labels, storing them in DynamoDB

Distributed Batch Import

Reads a JSON file from S3 and saves its contents in batches to a DynamoDB table.

Distributed Map CSV iterator with Terraform

This workflow is an example application of a step function using distributed map. This distributed map iterates over an CSV file that is stored in an S3 bucket.

Distributed Map with CSV file

Example application of a step function using distributed map that iterates over a CSV file.

Distributed Map - DynamoDB Import JSON

Fastest way to marshall JSON data and import to DynamoDB

Distributed Map - Ingest & Analyze Historical Storm Data

Wait for an asynchronous Job to finish before moving onto the next state

Distributed Map - MonteCarlo Simulation

This workflow is an application of a Step Functions distributed map state, implementing a Monte Carlo simulation with parallel calculations.

Distributed map state gif generator

Convert .mp4 and .mov files from S3 into multiple Gif animations for timeline scrubbing.

Distributed Map reduce weather analysis

Process all 37+ GB of NOAA Global Surface Summary of Day.

Dynamic REST API

REST API Gateway asynchronously integrates with Express Step Functionsand put/get/delete items from a DynamoDB table

Dynamically process data with a Map state

This workflow demonstrates dynamic parallelism using a Map state.

Dynamically process data with a Map state

This workflow demonstrates dynamic parallelism using a Map state.

DynamoDB migration

Loops through an Amazon DynamoDB table to update each record

DynamoDB Transfer workflow

Transfers records from one table to another with transformation options

ECS Task with Fargate container

AWS Step functions integration with ECS Task with Fargate container

Either Or Parallel Workflow Pattern

A pattern to implement an either-or logic with parallel processes

Polling EKS inventory across an AWS Organization

This workflow demonstrates polling of EKS Inventory across an AWS Organization

Emit and wait workflow

Implement a callback pattern within your workflow

Event-driven Workflow Monitor

Integrate workflows with event-driven architectures

Event Sourcing Design Pattern

A sample implementation of the event sourcing design pattern using AWS Step Functions

EventBridge replay events

Replays events from Amazon EventBridge based on innitial event time

EventBridge Rules to EventBridge Scheduler Migration

A workflow to automate the migration of EventBridge Rules to EventBridge Scheduler

Email Notification on StepFunction Execution Error

Receive an email alert through SNS during Step Functions error.

Expense analysis workflow

Analyze the picture of an expense receipt stored in Amazon S3 using the AnalyzeExpense API call of Amazon Textract. The extracted expense data is persisted in DynamoDB.

Advanced error handling for tasks in parallel state

This workflow demonstrates an explicit failure when running concurrent tasks in a parallel state.

Generate Thumbnails

Step Functions workflow to generate thumbnails from an image.

gif generator

Convert .mp4 and .mov files from S3 into multiple Gif animations for timeline scrubbing.

GitHub repo views counter

maintain a historic count of GitHub repository views

Human in the Loop

Wait for an approval from a human reviewer before continuing

Human in the Loop

Wait for an approval from a human reviewer before continuing

Human Task with Reminder

Give Human a Task and send Reminder until complete

Idempotent Workflow - CDK

A workflow that uses DynamoDB to implement idempotency

Idempotent Workflow - SAM

A workflow that uses DynamoDB to implement idempotency

Image Processing App

Automate the process of retrieving, merging and archiving cheque images from external web services.

Real-time inventory management

This sample inventory management microservice demonstrates how to manage inventory levels by reserving inventory when a new order is received, alerts on low stock, and triggers purchase orders to replenish inventory

Lambda Orchestration

Orchestrate a series of Lambda Functions

Lambda Orchestration

Orchestrate a series of Lambda Functions

Lambda Orchestration

Orchestrate a series of Lambda Functions

Manage an Amazon EMR Job

Automate Amazon EMR job using Step Functions. Create cluster, add steps, execute synchronously, and terminate cluster. Minimal code for data processing.

Migrate large CSV data sets to Amazon DynamoDB

Streamlines large-scale DynamoDB migrations with parallel processing using the dynamic map state.

Moderated Image Catalog

Moderated image catalog with tagging and content moderation

Moderated Image Catalog

Moderated image catalog with tagging and content moderation

Moderated Image Catalog

Moderated image catalog with tagging and content moderation

Nested workflows

Combine Standard and Express workflows to optimize for cost and performance

Orchestrate an EMR Serverless job

This workflow implements a job submission to Amazon EMR Serverless. The workflow checks for the job status and waits for job completeness before terminating/proceeding

Pagination loop

Use Amazon States language (ASL) to implement a for-loop without writing code

Parallel Human Approval Process

Create a parallel task for multiple approvals

Parallel Translate Text

Translate Text in Parallel and save to DynamoDB

Path based on data

AWS Step Functions state machine that selects the next task based on data

Process High-Volume Messages from Amazon SQS

This sample project demonstrates how to use an AWS Step Functions Express Workflow to process messages or data from a high-volume event source, such as Amazon Simple Queue Service (Amazon SQS).

Process High-Volume Messages from Amazon SQS

This sample project demonstrates how to use an AWS Step Functions Express Workflow to process messages or data from a high-volume event source, such as Amazon Simple Queue Service (Amazon SQS).

Progress tracking pattern

Submit progress updates via Amazon API Gateway WebSocket to the client without polling

Query Athena

Process results from Amazon Athena Queries written to Amazon S3.

Query Athena

How to use an AWS Step Functions state machine to query Athena and get the results by leveraging Step Functionsnative integration with Amazon Athena

Query large datasets

Ingest large datasets in S3, partition with Glue Crawlers, and perform Athena queries. Includes Step Functions, S3, Glue, and SNS.

Query large datasets

Ingest large datasets in S3, partition with Glue Crawlers, and perform Athena queries. Includes Step Functions, S3, Glue, and SNS.

Query large datasets

Ingest large data set in S3, partition with Glue Crawlers, and perform Athena queries. Includes Step Functions, S3, Glue, and SNS.

Quorum with Parallel Workflow Pattern

A pattern to implement a quorum logic with parallel processes

Redshift Serverless UNLOAD

Execute an UNLOAD query on Amazon Redshift Serverless

Request response

Wait for a specified delay, then we will publish to a SNS topic using the Request Response pattern.

Request response

Wait for a specified delay, then we will publish to a SNS topic using the Request Response pattern.

Request response

Wait for a specified delay, then we will publish to a SNS topic using the Request Response pattern.

Retry with exponential backoff

Retry transient errors with exponential backoff

S3 Distributed Map

Read and Transform S3 objects using a distributed map state

Restore multiple files from S3 Glacier storage classes

This project demonstrates how to use Step Functions to orchestrate restoration of multiple files from S3 Glacier storage classes.

S3 to Step Functions to Lambda to Bedrock

Create a Step Functions workflow to summarize S3 objects using Amazon Bedrock.

Saga Pattern

A failure management management pattern that coordinates transactions between multiple microservices to maintain data consistency.

Saga Pattern

A failure management management pattern that coordinates transactions between multiple microservices to maintain data consistency.

Saga Pattern

A failure management management pattern that coordinates transactions between multiple microservices to maintain data consistency.

Sagemaker endpoint maintainer

This workflow showcases cleanup of idle Sagemaker Inference Endpoints receiving no requests.

SageMaker Pipeline Notifications

Be notified when a SageMaker Pipeline execution fails

SageMaker Pipeline Notifications

Be notified when a SageMaker Pipeline execution fails

Scatter-Gather pattern using AWS Lambda and Amazon DynamoDB

Word Filtering Script Generator

Generating scripts that filters certain words from video or audio. When you type the word you want to filter, the video recognizes the word and marks it as '***' in the script.

Word Filtering Script Generator

Generating scripts that filters certain words from video or audio. When you type the word you want to filter, the video recognizes the word and marks it as '***' in the script.

Word Filtering Script Generator

Generating scripts that erase certain words from video or audio. When you type the word you want to filter, the video recognizes the word and marks it as '***' in the script.

Selective checkpointing workflow

Order Request Workflow with Nested Standard and Express State Machines

Bedrock Describe Assets

This workflow demonstrates Bedrock Claude 3 Sonnet vision model capabilities by describing images and generating HTML output.

Step Functions to CloudFormation StackSets

Create a Step Functions workflow to create/delete CloudFormation StackSets in Root Organization unit's linked accounts.

Iot Analytics Dataset Generation

This workflow uses the callback pattern and Distributed Map to create a IoT analytics pipeline.

Migrate RDS to Aurora PostgreSQL

Migrate an RDS PostgreSQL DB instance to Aurora PostgreSQL DB Cluster.

Simple retry

Use AWS Step Functionsnative retry configuration to catch errors and retry tasks

Smart cron job

Use AWS Step Functionsto build a smart cron job.

Smart image cropper

Automatically crop and center pictures of individuals

Speech recognition counter

Report on the use of the common phrase “you know” in media files. These services can automate and reduce the time required to find the use of filler phrases.

Start Athena Query

This workflow use Step Functions and Amazon Athena and AWS Lambda Functions to start an Athena query and send a notification via SNS with query results.

Stateless roundrobin

Selects the next array item in round robin fashion using the Step Functions execution count modulo of the array length.

Step Functions calling API Gateway

This workflow implements an API Gateway call from Step functions.

Step Functions calling API Gateway

This workflow implements an API Gateway call from Step functions.

Lambda Version Cleanup

This workflow demonstrates how to manage and cleanup the number of available versions of an AWS Lambda function.

Serverless Load Generator using Distributed Map

This example creates a serverless load generator using AWS Step Functions to load an AWS Lambda function. It can also be extended to load test other workloads like HTTP endpoints, APIs, or other services that AWS Step Functions support.

Streaming asynchronous results

Push results for state machines using DynamoDB and Lambda response streaming function URL

Support Notifications

Be notified when critical and urgent cases are lodged with AWS Premium Support

Support Notifications

Be notified when critical and urgent cases are lodged with AWS Premium Support

Synchronous API

Trigger via Amazon API Gateway and wait for response

Synchronous Job

Wait for an asynchroous Job to finish before moving onto the next state

Task timer with an expiry date

Efficiently complete user-dependent tasks within a specified timeframe.

Text to Speech Converter

Workflow for reading text files by voice using Amazon polly API.

Text to Speech Converter

Workflow for reading text files by voice using Amazon polly API.

Text to speech converter

Workflow for reading text files by voice using Amazon polly API.

Textract Callback

This workflow implements a callback mechanism for Textract StartDocumentTexDetection.

Train ML Model

This sample project demonstrates how to use Step Functions to pre-process data with AWS Lambda & store in S3, train a ML model & implement batch transformation through Sagemaker. Deploying this sample project will create an AWS Step Functions state machine, a Lambda function, S3 bucket along with required IAM roles & Log Group.

Transfer Data Records

This sample project demonstrates how to read values from an Amazon DynamoDB table and send them to Amazon SQS using AWS Step Functions

UML State Machines as Step Functions

Implementing UML state machine using Step Functions

Video segment detection and editing workflow

AWS Step Functions uses Amazon Rekognition and MediaConvert to detect and edit video segments, removing SMPTE color bars.

Visual Defect Detection

Detect anomalies in an image with Amazon Lookout for Vision

Video-on-demand transcode and deliver workflow

Video-on-demand serverless workflow, with transcoding, delivery and error handling.

Wait for callback

Pause a workflow indefinitely until a task token is returned.