AWS-Logo_White-Color
1.
Launching Spot Instances
Starting the workshop
Creating a Launch Template
Launching EC2 Spot Instances via EC2 Auto Scaling group
Launching EC2 Spot Instances via EC2 Fleet
Creating a Spot Interruption Experiment
Savings Summary
Spot Placement Score (SPS)
Spot Blueprints
(Optional) - Launching an EC2 Spot Instance via the RunInstances API
(Optional) - Launching an EC2 Spot Instance via Spot Fleet request
Learn more
Clean Up
2.
EC2 Auto Scaling
Requirements and Notes
Architecture
Starting the workshop
...At an AWS event
...On your own
Setup with CloudFormation
Using the Cloud9 Environment
Setup AWS CLI and other tools
Clone the GitHub repo
Create an EC2 launch template
Deploy the AWS Elastic Load Balancer
Create an EC2 Auto Scaling Group
Browse to the web app
Using Dynamic Scaling in ASG
Stress the app with AWS Systems Manager
Resilience with Spot Instances
Finished!
Cleanup
Learn more
3.
Containers with ECS
Prerequisites
Introduction
Introduction to Containers
Introduction to ECS
Scaling ECS Workloads
Starting the workshop
...At an AWS event
...On your own (self-paced)
Setup the Workspace environment
Deploy CloudFormation Stack
Setup Cloud9 Environment
Resize Cloud9 Instance Root Volume
Setup AWS CLI and clone the workshop repo
Using Spot Instances with Auto Scaling groups capacity providers
Architecture
Create an ECS cluster
Create On-Demand Auto Scaling Group and Capacity Provider
Selecting Spot Instance Types
Create EC2 Spot Auto Scaling Group and Capacity Provider
Setup default capacity provider strategy
Visualizing ECS Scaling Metrics
Create an ECS service
ECS Managed Scaling
EC2 Spot Interruption Handling in ECS
Using AWS Fargate Spot capacity providers
Add Fargate capacity providers to ECS Cluster
Create ECS Fargate Tasks
Create ECS Fargate service
Cleanup
Conclusion
4.
Containers with EKS
Start the workshop
...at an AWS event
...on your own
Test the Cluster
Install Kube-ops-view
Add EKS managed Spot workers
EKS managed node groups
Select Instance Types for Diversification
Create EKS managed node groups with Spot capacity
Spot Best Practices and Interruption Handling
Deploy an example Microservice
Monte Carlo Pi Template
Tolerations and Affinity
Deploy Application
Autoscale Cluster and Application
Configure Cluster Autoscaler (CA)
Scale Cluster with CA
Configure Horizontal Pod Autoscaler (HPA)
Stress test the Application
(Optional) Add self managed Spot workers
Create self managed node groups with Spot Instances
Deploy AWS Node Termination Handler
Test Autoscaling of Cluster and Application
Self managed Spot workers cleanup
(Optional) Running cost optimized and resilient Jenkins jobs
Create Spot workers for Jenkins
Setting up Jenkins server
Increasing resilience
Running Jenkins jobs
Auto scaling Jenkins nodes
Jenkins cleanup
Cleanup
Conclusion
What Have We Accomplished
5.
EKS and Karpenter
Start the workshop
...on your own
...at an AWS event
Test the Cluster
EKS Console Credentials
Install Kubernetes Tools
Install Helm CLI
Deploy the Metric server
Install Kube-ops-view
Karpenter
Set up the environment
Install Karpenter
Set up the Provisioner
Automatic Node Provisioning
Consolidation
Deploying Multiple Provisioners
EC2 Spot deployments
Multi-Architecture deployments
Using Alternative Provisioners
Scaling App and Cluster
Build the Microservice
Deploy the Microservice
Configure HPA
Stress-test the sytem
Use FIS to Interrupt a Spot Instance
Cleanup
Conclusion
What Have We Accomplished
6.
ML Model Training
Starting the workshop
...At an AWS event
...On your own
Prerequisites
Create an Amazon SageMaker Notebook Instance
Running Notebooks
Accessing JupyterLab
Configuring Libraries for Managed Spot Training
Running Notebooks
Understanding and Reporting on Savings
Cleanup
7.
Spark apps with EMR
Starting the workshop
...at an AWS event
...on your own
EMR Instance Fleets
Right sizing Spark executors
Selecting instance types
Launch a cluster - Step 1
Launch a cluster - Step 2
Launch a cluster - Steps 3&4
Fleet configuration options
Examining the cluster
Tracking Spot interruptions
Creating the Spot Interruption Experiment
Interrupting a Spot Instance
Verifying the app's results
Analyzing costs
Cleanup
Call to Action
8.
CI/CD and Test Workloads
Jenkins
Workshop Preparation
Lab 1: Reduce the cost of builds using Amazon EC2 Spot Fleet
Lab 2: Deploy testing environments using Spot & Launch Templates
Code snippet: The Test Environment CloudFormation template
Code snippet: The SpotCICDWorkshop_ManageTestEnvironment Lambda function
Lab 3: Externalise state data to add resiliency to Jenkins
Lab 4: Using containers backed by Spot instance in Auto Scaling Groups
Workshop Cleanup
GitLab
Starting the workshop
...At an AWS event
...On your own
Workshop Preparation
Create a GitLab repository
Configure GitLab runners on Spot instances
Building the demo app
Deploying Amazon EKS on Spot instances
Installing the demo app into Amazon EKS
Workshop Cleanup
9.
Rendering with AWS Batch
Architecture
Starting the workshop
... At an AWS event
... On your own
Rendering pipeline
Creating your Docker image
AWS Batch
Creating the compute environment
Creating the job queue
Registering the job definition
Workflow orchestration
Monitoring and results
AWS Fault Injection Simulator
Creating the experiment
Starting a new rendering job
Running the experiment
Monitoring the experiment
Clean Up
Final Thoughts
10.
EC2 Workloads at Scale
Requirements and Notes
Architecture
Starting the workshop
...At an AWS event
...On your own
Setup with CloudFormation
Using the Cloud9 Environment
Setup AWS CLI and other tools
Clone the GitHub repo
Create an EC2 launch template
Deploy the database with Amazon RDS
Deploy the AWS Elastic Load Balancer
Create an EC2 Auto Scaling Group
Seed the database with application data
Deploy to the ASG with CodeDeploy
Using Dynamic Scaling in ASG
Stress the app with AWS Systems Manager
Increasing resilience when using Spot Instances
Finished!
Cleanup
Learn more
11.
Efficient EC2 Auto Scaling
Starting the workshop
...At an AWS event
...On your own
Amazon EC2 Auto Scaling
Predictive scaling
Working with Custom Metrics
Create Predictive Scaling Policy
Review the outcome of predictive scaling
Configure Dynamic scaling
Take control of instance Lifecycle
Measure the Launch Speed of Instances
Warm pools
How Warm Pools work?
Launch From Warm Pool
Cleanup
Finished!
Learn more
12.
Pricing Financial Derivatives with AWS Batch
Architecture
Starting the workshop
... At an AWS event
... On your own
Risk pipeline
Creating your Docker image
AWS Batch
Creating the compute environment
Creating the job queue
Registering the job definition
Workflow orchestration
Monitoring and results
Clean Up
Final Thoughts
More
Amazon EC2 Spot Instances
Authors
Resources
Feedback / Questions?
English
Clear History
Github Repo
EC2 Spot Workshops
Star
Fork
Site Info
Privacy
Site Terms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Edit this page
Amazon EC2 Spot Workshops
>
EKS and Karpenter
> Start the workshop
Getting Started
To start the workshop, follow one of the following depending on whether you are…
…
running the workshop on your own (in your own account)
, or
…
attending an AWS hosted event (using AWS provided hashes)
Site Info
Privacy
Site Terms