Docker is the most powerful tool to do the development and run the application. Docker helps us to resolve multiple problems by providing an isolated environment but have own challenges. Like accessing an application running inside a container.
This blog will help you to access your application from the container without doing the port mapping. You have just passed the container hostname and port to access the application from the host machine.
To achieve this we will be using a dns-proxy-server. Please use the following link to download the utility.
Let’s start the dns-proxy-server using docker in the Linux instance.
Presto is distributed query engine which uses multiple data sources like Hadoop, S3, Azure Blob storage and many more. This blog will help you to integrate presto with the HDInsight cluster.
HDInsight is an Azure managed big data platform that used the most popular open-source tools like Spark, Hive, Kafka and other tools. This blog will not focus on HDInsight Cluster.
We are using Spark 2.4 (HDI 4.0) cluster. To launch the cluster you need an Azure account go to the HDInsight service and create a cluster with the required resources.
Presto architecture has the following components
The database is always a critical part of the business and when it's about to migrate it we need to think about various points like integrity and availability.
This blog will help you to migrate the MySQL database from the local data centre to the cloud. We will be going to use the following tool stack
Percona Xtrabackup is an open-source utility that helps you to take the backup and restore it in an efficient way. Also, you can take incremental backups. …
Over the weekend I was working on a big data platform & during the POC I found that in big data platform libraries are very important. If you used different version things will not work as expected.
This blog will help you to integrate apache spark with Azure blob storage as a data lake.
For this activity we need followings
- Azure Account(Blob Storage)
- Linux Instance
Let’s start with Azure Blob Storage. For that, you need an Azure account and create a storage account like below
This blog will help you to integrate Jenkins with ECR efficiently and secure way. So for that, we need an AWS account, ECR(Elastic Container Repository ), Jenkins, and IAM Role.
Following are ways to push and pull a docker image from ECR in Jenkins
So when we using AWS CLI or AWS Role we used to run the below command to login into the ECR repo.
aws ecr get-login
This will generate a token using AWS role or Credentials which valid for 12 hours. …
With time innovation is advancing each hour simultaneously troubleshooting turns out to be really difficult. At the point when we are running microservices in kubernetes its turns out to be more unpredictable to discover the course cause why things are coming up short. Today we are talking about how easily we can troubleshoot issues in kubernetes.
Assume we have deployed an application in kubernetes and in a specific span, we are getting 502 blunder code or when we do the deployments, restart Pods some requests are failing.
To start the troubleshooting we have to identify a point from where we…
This guide will help you configure Bitbucket Pipelines to automatically deploy a containerized application to Kubernetes. We’ll create a deployment in Kubernetes to run multiple instances of our application, then package a new version of our Node.js app in a new version of a Docker image and push this image to DockerHub. Finally, we’ll update our deployment using Pipelines to release the new Docker image without a service outage.
1: Need to push your code into the bitbucket repository.
4: Create CI/CD pipeline by using the yml file.
To build a node.js application we need to…
The majority of businesses now are using Docker to run applications. They devote a lot of time, energy, and resources to stabilize their success and invest heavily in a variety of advanced observation techniques. Despite this, they are experiencing poor performance and the containers are being stressed as a result of the heavy traffic flow. The motive of this blog is to help those running Java applications on docker containers in getting optimal performance.
A lot of times people complain that the application does not seem to be running as well as it did on the server. …