Deploy Epiphany Cluster

Source

This page generated from : https://github.com/epiphany-platform/epiphany

Overview

Epiphany at its core is a full automation of Kubernetes and Docker plus additional builtin services/components like :

• Kafka or RabbitMQ for high speed messaging/events
• Prometheus and Alertmanager for monitoring with Graphana for visualization
• Elasticsearch and Kibana for centralized logging
• HAProxy for loadbalancing
• Postgress for storage
• KeyCloak for authentication

Epiphany can run on as few as one node (laptop, desktop, server) but the real value comes from running 3 or more nodes for scale and HA. Nodes can be added or removed at will depending on data in the manifest. Everything is data driven so simply changing the manifest data and running the automation will modify the environment.

We currently use Terraform and Ansible for our automation orchestration. All automation is idempotent so you can run it as many times as you wish and it will maintain the same state unless you change the data. If someone makes a "snow flake" change to the environment (you should never do this) then simply running the automation again will put the environment back to the desired state.

Preparation

1. Prepare Local Machine

Local machine, can be Windows 10 as used in this case.
In this local machine, install following dependencies :

• Python 3.7 : How to Install Python in Windows
• PIP : How to Install PIP in Windows
• Pipenv : How to Install Pipenv in Windows
• Docker : How to Install Docker in Windows 10

2. Prepare Cluster Machines

Cluster machine for epiphany must be build on Linux Ubuntu. Single machine or multiple machines.
In each machine, there must be user 'operations'. This user must be root and can be run sudo without password.

Step by Step

1. Pull Epicli Docker Image to Our Local Machine
In this case, we use local machine Windows 10 with Windows PowerShell.

  Syntac     :   PS C:\Users\idiksub> docker pull epiphanyplatform/epicli:[TAG]
  Example    :   PS C:\Users\idiksub> docker pull epiphanyplatform/epicli:0.5.1

2. Run Epicli Docker Image

  Syntac     :   PS C:\Users\idiksub> docker run -it -v LOCAL_DIR:/shared --rm epiphanyplatform/epicli:TAG
  Example 1  :   PS C:\Users\idiksub> docker run -it -v C:\Users\idiksub\Desktop\"ABB 2"\Project\Epiphany:/shared --rm epiphanyplatform/epicli/epicli:0.5.1
  Example 2  :   PS C:\Users\idiksub> docker run -it -v C:\Users\idiksub\Desktop\"ABB 2"\Project\Epiphany:/shared --rm komang/epicli:0.5.1

3. Test & Understand How Epicli Work

  bash-5.0# epicli --help

4. Generate Cluster Definition

We can generate cluster with minimum definition :

  Syntac     :  bash-5.0# epicli init -p [type] -n [cluster_name]
  Example    :  bash-5.0# epicli init -p any -n demomin

Or we also can generate cluster with full definition :

  Syntac     :  bash-5.0# epicli init -p [type] -n [cluster_name] --full
  Example    :  bash-5.0# epicli init -p any -n demofull --full

In this step, we'll get yml file as the cluster configuration.
We need to modify some values ((like our AWS secrets, directory path for SSH keys).
Once we are done with the yaml file, we can apply it.

5. Apply YAML File

  Syntac     :  bash-5.0# epicli apply -f [file_name]
  Example    :  bash-5.0# epicli apply -f demomin.yaml

Troubleshooting

Perl Package Not Installed

If we found error like below screenshoot where the message said "perl package is not installed" and "dpkg: error processing package libdpkg-perl", then we need to insatll the perl package manually into the cluster VM.

  root@gejoreuy:~# apt-get update -y
  root@gejoreuy:~# apt-get dist-upgrade
  root@gejoreuy:~# apt-get install -y libdpkg-perl