For this workshop, please ignore warnings about the version of pip being used.
Uninstall the AWS CLI 1.x by running:
sudo pip uninstall -y awscli
Install the AWS CLI 2.x by running the following command:
curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
unzip awscliv2.zip
sudo ./aws/install
. ~/.bash_profile
Confirm you have a newer version:
aws --version
Create an SSH Key pair so you can then SSH into the EMR cluster
aws ec2 create-key-pair --key-name emr-workshop-key-pair --query "KeyMaterial" --output text > emr-workshop-key-pair.pem
chmod 400 emr-workshop-key-pair.pem
Install JQ
sudo yum -y install jq