Aws Devops Elasticsearch At Aws With Terraform And Ansible

0

1

2

3

4

5

Posted on 22 Nov 10:20 | by mitsumi | 5 views

Published 11/2022
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz
Language: English | Size: 1.81 GB | Duration: 3h 33m

AWS devops. How to deploy Elasticsearch cluster at AWS using Opensearch, ECS, EC2 with terrafrom and ansible

What you'll learn
How to deploy HA Elasticsearch cluster using AWS Opensearch
How to deploy HA Elasticsearch cluster using AWS ECS
How to deploy HA Elasticsearch cluster using AWS EC2
Elasticsearch autoscaling
Elasticsearch cluster conceptions and performance
AWS IAM, VPC, ECS, Opensearch, security groups
Docker and Docker swarm
Requirements
Terraform/Ansible basics
AWS basic conceptions, e.g VPC, EC2, subnets, security groups...
Good knowledge at docker and at least basic knowledge at docker orchestration
Active AWS account
Description
The course consists of 5 main modules.Teh first one is about how to deploy ES as an AWS service, which is called OpenSearch. Here I will tell you about interesting OpenSearch pitfalls that I discovered during my commercial practice. And believe me - you will not find that information at AWS documentation. You will get a ready terraform module for deploying the Opensearch cluster and we will analyze it step by step together.In the 2d part I will show how to deploy an ES cluster at ECS (Elastic Container Service). And again we will use the terraform modules for that. I will show you why you can't use Fargate in that case and how many problems should be resolved to deploy ES at ECS.Next course section is about how to deploy ES at EC2 instances using docker swarm. I will prove to you that it is the easiest and at the same time the most cheap way to deploy ES at almost any cloud for most small and middle companies with a steady growth pattern. You will get ready terraform modules that will allow you to prepare AWS infrastructure and ansible modules for deploying HA ES cluster upon it.The 4th part is devoted to autoscaling possibilities of ES cluster using different deployment approaches. We will talk about what we really can autoscale, when we can use it and what big limitations we have in case of working with ES.5th module is devoted to the theory. If you are already familiar with ES cluster conceptions and everything that is related to shards and ES performance - then you can skip it. But if not - that is the place where you have to start from.
Overview
Section 1: Introduction
Lecture 1 Promo introduction video
Lecture 2 Course road map
Section 2: Initial terraform configuration aspects
Lecture 3 Terraform repository code structure and environment configuration
Lecture 4 Pre-init terraform module
Section 3: AWS skeleton configuration
Lecture 5 Network architecture scheme
Lecture 6 Part 1: Network terraform module - vpc, subnets, cidr
Lecture 7 Part 2: Network terraform module - routing tables and security groups
Lecture 8 Part 3: Network terraform module implementation
Lecture 9 Terraform bastion module
Section 4: Deploying an Elasticsearch cluster using AWS Openseach
Lecture 10 What is OpenSearch?
Lecture 11 Part 1: Terraform OpenSearch module - security and permissions
Lecture 12 Part 2: Terraform OpenSearch module - cluster configuration
Lecture 13 Part 3: Terraform OpenSearch module - network, logs and storage
Lecture 14 Part 4: Terraform OpenSearch module - CW alarms, variables
Lecture 15 Apply terraform OpenSearch module, domain endpoint and opensearch dashboard
Lecture 16 OpenSearch monitoring
Lecture 17 Short summary and essential notices that appeared from real commercial practice
Section 5: Deploying an ES cluster using AWS ECS
Lecture 18 What is ECS and why not Fargate but EC2
Lecture 19 ECS base components and architecture scheme
Lecture 20 Elasticsearch Docker file and AWS ECR
Lecture 21 ECS IAM profile terraform module
Lecture 22 ECS EC2 terraform module
Lecture 23 ECS cluster terraform module
Lecture 24 Elasticsearch at AWS ECS - short summary
Section 6: Deploying an ES cluster using AWS EC2 and docker swarm
Lecture 25 What is docker swarm and why it is not dead
Lecture 26 Docker swarm architecture
Lecture 27 EC2 terraform module
Lecture 28 Ansible inventory, docker and docker swarm ansible roles
Lecture 29 Ansible Elasticsearch role
Lecture 30 Elasticsearch and docker swarm - short summary
Section 7: Autoscaling and Elasticsearch
Lecture 31 Autoscaling at Elasticsearch at AWS
Section 8: Course summary - which deployment scenarios is better?
Lecture 32 Course summary - which deployment scenarios is better?
Section 9: Elasticsearch theory
Lecture 33 Inside a cluster
Lecture 34 ElasticSearch - shards and performance
Lecture 35 Indexing secretes
Software engineers, devops engineers,Everybody who likes ElasticSearch and want to get more knowledge around it