Using Jenkins, Docker and CI/CD for Serverless Applications

Hi, I am developing a freelance project with aws lambda. I used Jenkins and docker for CI/CD. Jenkins runs pipelines on containers. In this Tutorial I will show you how I set my environment.I am using Macintosh so firstly i installed docker on my machine. i used this url to download and install docker (). you also can find windows version of Docker in this site.I need Jenkins. I prefer to run Jenkins in docker container. It will be easy and clean. I found a docker image for Jenkins. You can find it in this site . If you don't have knowledge about docker image you can look at . Basically docker runs container as machine. Docker creates containers over images. For example in this image, there are Linux and Jenkins. When Docker create a container over this image we have a machine that has been installed Linux and Jenkins.How can we set up this container. Let begin, we pull image file from docker hub. Docker downloaded the image file and extracted it. Now we can see image file.We can run a container over this image. we can use this command.it starts correctly and we can use Jenkins until shut down the container. But there will be a problem after that. In Next run we can't find any our pipelines or configurations which we had created. Because docker run container over image file and image file is immutable file. I mean when we define a pipeline in Jenkins, Jenkins save it into container file system not into image file. When we shut down container all of them fly. We have to use Volumes to fix that problem.Volumes are used to persist container file system into our real machine file system. We have to define new Volume to keep Jenkins_home directory that is in container. it is very simple we should change run command.

-v

means Volume. If there is no volume it creates automatically. You can look at for additional information. Basically we define new volume that is name jenkins_home and mount the path which is in container file system that is

/var/jenkins_home

. After that when we shut down container, our changes do not fly. Because all files under

/var/jenkins_home

folder keep into Volume.

Now we can call url of Jenkins on browser. Jenkins says that we should be unlock it. We need initialAdminPassword. When we execute above command we can see logs. In these logs we can see initialAdminPassword.

We enter this hex code into page of Jenkins. We pass below steps;

• Install suggested plugins
• Create first admin user
• Instance Configuration
• Start using Jenkins.

We finished first part of Tutorial. We have a Jenkins instance.We can start implement pipeline. This pipeline will do below steps;

• All below steps will run on another docker container
• Pull my project from git(bitbucket) that is lambda project that has coded with nodejs.
• deploy lambda to AWS with serverless framework..

We need new image for this container. It is a simple linux machine. we pull new container from docker hub.We have a docker on local machine. But Jenkins is running on the container. So Jenkins need to connect our docker. We have to create a bridge between container and Docker. We can fix the problem with Volume defination.

docker.sock file is used for socket listening. After added these volumes to command line, "

docker.sock

" mounted to "

docker.sock

" in localmachine. If we use

-v

with real path on the localmachine, it means mount. And if we use $() , it means run command.

-v $(which docker):$(which docker)

means, if "which docker" runs on container , docker runs "which container" on localmachine and returns result to container. We have to add this parameter because jenkins runs "which docker" to find docker.

We have to change privileges of this file because jenkins user can't acces this file. We need connect to container with root user.we can run this command and run container.we can run below command and open a terminal for the container. Basically we run bash command on container with root user. We can change privileges of file.One importing point, container name can't be used two times. when shut down container you have to remove container.

After that you can use

--name

jenkins next time.

We can implement pipeline now. Click "New Item" under menu. Enter an Item Name. Select PipeLine and click ok.Select PipeLine section on screen. Firstly pipeline create a new container and exec all commands on the container.You can look at logs via jenkins. it should look like that,We can pull project from bitbucket.Firstly we should define a user on Jenkins who can access bitbucket.Click Credentials/System on menu. And click Global Credentials on screen. Menu changes and we can see Add Credentials on new menu. Click Add Credentials and define your user that has been already defined on bitbucket.Important point is ID field. We will use this value of field when we pull project from bitbucket.We go to configuration page of pipeline. We write pipeline script to pull project from bitbucket.Save it and run pipeline. Click "Build Now".PipeLine run and pull project from bitbucket. Now we has finished step 2. Next step is run unit test. We need npm. Normally we can use npm plug-in. But we need create a new image file for serverless and I prefer to use npm which is in the new image file, instead of plug-in. So we will create an image file that has npm and serverless framework.Firstly we pull image file that has node .We will add serverless framework into the image. we run container from node.Now we are inside container. We are installing serverless framework.Now I can create a new image file from this container. We run below command in local machine.We exit docker container.We have a new image for serverless and we can use this image in Jenkins. We can use the pipeline which will deploy our serverless application to aws.You should change name of image file and add below steps to your pipeline.We should define user information to access aws services. If you don't have a aws user, you can look at this . I have already a user. I will setup my user credentials like this.So we created a new Image for serverless framework and deployed an appication to aws. I hope it will be useful for you.