visit
To explain this, I’m going to have to recap on some old work with a particular focus on co-evolution.
Amazon Interactive Video Service (Amazon IVS) gives us a few amazing features that enable interactivity.
This article talks about regulations and why ethereum can be the computer of the world.
When a Lambda function invocation crashes due to an uncaught application error, for example, AWS may automatically retry the same request.
Regardless of your developer background, it’s inevitable you’ve heard the term Serverless in the past year. The word has been buzzing around in my ears for longer than I dare say. For too long have I been putting off looking into it in more detail. Well here goes nothing.
DevOps is one of the most in-demand skills from employer and there are many job opportunities lying for full stack developers, distinguished engineers and DevOps professionals. If you are an experienced Java programmer or a full-stack web developer, and want to become a DevOps engineer then you have come to the right place.
Jenkins Pipeline is a powerful tool when you are using Jenkins to automate your deployments. Flexible and customized actions split between stages are a good reason to try this feature.
Amazon EC2 is a service that allows you businesses to run their application in AWS cloud. You can easily set up a virtual machine and perform all your computation on it. In this post, we will teach you the basics of Amazon EC2.
The story of how I transformed from a naive full-stack engineer struggling with AWS and PaaS providers to loving my life and achieving DevOps bliss.
Learn the difference between server snapshots and server backups with the pros and cons of each, and some examples of when to use them.
This is a short series that I wanted to share for a long time about the basics of “Cost Optimization” on AWS.
The Serverless movement has gained a bit of momentum in the past few months. Everybody seems to be talking about it. Some would even call it a revolution! But, let’s not get too excited. Don’t be like me. I get too hyped up about cool stuff like this, and start writing articles. If this is all new to you, here’s a piece I wrote a while back, explaining the core concepts.
FedEx
This article summarizes our learnings at SSENSE in applying WAS' Step Functions; what worked, what didn’t, and what should be improved in its ecosystem.
In this tutorial, we're looking at the AWS Secrets Manager as a way of managing credentials in Python scripts, with an example use case.
A short post on how to generate dynamic open graph images using puppeteer-core and chrome-aws-lambda for sharing on instant messaging platforms online.
With VOD streaming viewers may enjoy accessible media whenever and wherever they choose it. This way you'll keep visitors on the site longer. Learn here how!
I want to invite you all to block your website traffic from Russia and Belarus to show support for the Ukrainian people. Let me show you how to do just that.
Brief guide how to deploy websites with Gitlab CI to AWS S3
Before talking about AWS infrastructure first we will see What is the cloud? What is AWS? There are many definitions, but the one that is most relevant to is the idea of an on-demand, pay-as-you-go, IT services that are delivered over the internet.
Comparing cloud services? Read our Lambda vs ECS guide. Consider programming language, pricing, and the benefits.
Tips to pass AWS Solutions Architect - Associate certificate exam
In this video course, you'll learn the basics of AWS tags and Terraform with an S3 bucket.
Do you love event-driven programming? Let's take a look at triggering AWS Lambda functions from AWS SNS messages.
For organizations looking for a way to “democratize” data science, it is a must that data models are accessible to the enterprise in a very simple way. In our context, this is part of “model operationalization.” There are other solutions out there to serve data models which is a very common problem for data scientists.
Multi-cloud asset inventory for AWS, Azure, GCP.
Docker allows developers to package applications in containers. This article will show you how to create your own container, upload it to the repository.
In case you haven't heard, Amazon accidentally sent an email template to a user early this year.
This article demonstrates how to use AWS Textract to extract text from scanned documents in an S3 bucket.
We are a devops consulting firm specializing in managed cloud services. We manage infrastructure, modernize apps, and migrate you to the cloud.
Learn how to provision an AWS EKS Kubernetes cluster with Terraform. See a full step-by-step tutorial.
Amazon Web Services (AWS)is an online cloud computing platform Amazon. This guide will explain how to create an instance in Ec2.
Seamlessly create nested and repeatable data structures with the new Object field.
We break down how to easily deploy your new website on Amazon Lightsail in less than 5 minutes. Get your code up and running and get back to doing what you want
Building a Serverless Data Pipeline to Analyze Meetup data
A helpful checklist for upgrading Amazon EKS.
Want to take a laugh at yet another boring list, right? I’ll try to surprise you with a list of unique tools that you probably still don’t know!
Dive into the new year’s top cloud and infra-tech trends, straight from a cloud and infrastructure technology fanatic.
In this article, we'll cover some tricks and tips to get started and keep using AWS for free.
Recently, I have been helping a client implement an event-sourced system. In the process, I put together a very simple demo app which is available on GitHub here.
One of the biggest challenges of cloud computing is the issue of data sovereignty and how it affects business based on the individual countries regulations.
Learn how to build a cloud-managed version of any open-source project with this complete guide.
What happens when you combine an awesome idea with a driven leader? You get an exciting product, like Zeet, which automates your DevOps tasks.
It is no news that Cloud Computing technology has come to stay.
Learn how to deploy a Node.js application to AWS Lambda using the Serverless Framework and Dashbird for insights.
AWS S3 is one of the most fundamental services of AWS Cloud.
This article will explain how to set up a Private Ethereum Blockchain using Go Ethereum (Geth) - the official Go implementation of the Ethereum protocol.
My Coding Laptop is Smaller, Faster, and Cheaper than Yours and it lives in an AWS Data Center!
Here you will find the most common issues when working with Step Functions, especially when starting with the service.
Sentiment analysis uses AI to identify the core emotion behind a piece of text. In this article, we will look at how to build a sentiment analyzer using AWS Comprehend.
Malformed Lambda proxy response is a common configuration error in a serverless architecture. Learn what causes this error and how to fix it.
In part 2, we'll go over deploying serverless API to AWS Cloud with Terraform.
Problem statement
When we enable the key rotation it would reduce the chance that a compromised customer master key (CMK) could be used without your knowledge to access AWS resources.
First of all, this post is not about refining the AWS concepts and also it’s not about testing your skills on AWS or anything related to enhancing your learning in Cloud computing.
8 Must-Know Tricks to Use S3 More Effectively in Python: In this article, we’ll look at various ways to leverage the power of S3 in Python.
In this tutorial, you'll define AWS resources using Terraform and how resource definitions translate to actual resources created on AWS
If you’re like me, a sucker for event-driven programming, you’ll want to continue reading. Today we’ll take a look at triggering AWS Lambda functions from AWS SNS messages. I’ve covered a few interesting topics regarding serverless architectures and AWS already, but nothing like this yet. Dig down, and get ready. Let’s go.
When you deploy an API to API Gateway, throttling is enabled by default in the stage configurations.
If you have B2C applications, you have to deal with support tickets and emails. According to user size, it can be difficult to handle emails with a person or manage same email address with multiple people for support mails.
As we all know, the on-demand capacity mode of DynamoDB is great but can be cost-prohibitive in some cases (up to seven times more expensive than the Provisioned Capacity mode).
Serverless infrastructure is changing the way we architect applications and it’s also changing the way we code and work as developers. The development is moving away from our laptop and into the cloud. It’s the start of cloud-native development.
Blockchains are notoriously challenging network structures to scale, both in performance - such as latencies, throughput, and number of validators - as well as in feature sets - such as customizability of the bytecode that the blockchain executes.
Going serverless has many benefits, but it's not without its issues. Learn about the most common serverless challenges & how to overcome them.
Connect to Salesforce from AWS Glue jobs using the CData JDBC Driver hosted in Amazon S3.
From the basic to advanced concepts of AWS own service for identity and access management: users, groups, permissions for resources and much more.
In this article I have mentioned what auto-scaling is all about and what benefits it holds in a cloud computing environment, especially with respect to Amazon.
Serverless 101, FaaS, Functions as a Service, AWS Lambda, Azure Functions, Google Cloud Functions, Serverless
Amazon Elastic Kubernetes Service (EKS) is one of the leading managed Kubernetes solutions.
What is OpenSearch in a nutshell? What's the history between Elasticsearch vs OpenSearch? The role of AOS in serverless architectures, setting up & monitoring.
Spoiler alert: It's AWS for the win.
Scheduling website content is hard. Most content management systems (CMS) have features for publishing products, blog articles, and other types of platform-related content, but what about simply scheduling HTML? As developers sometimes we want to show a section of our website during a certain time frame.
So AWS gives startups $100k in free credits. Google and Azure have similar programs for startups. Then why isn’t every startup CTO starting on the Big Cloud?
A dive into jemalloc, the memory allocator which can massively reduce memory consumption of Ruby workloads
AWS Identity and Access Management (IAM) is a web service that helps us securely control access to AWS resources. We can control authentication (who can signed in) and authorization (who has permissions to use resources) using IAM.
NestJS is a progressive Node. js framework that helps build server-side applications.
You may create cutting-edge, scalable apps to suit your demands with AWS (Amazon Web Services), which gives you the control and ongoing spending optimization you need.
Unlimited cloud storage for storing photos, videos, and files using the Telegram App. The best alternative to Google Drive and Google Photos.
I recently worked on implementing CloudFront for s3 bucket files. Most of the tutorials were doing that using console management(UI) but we at Blue Sky Analytics prefer “code as infrastructure”. So I had to do this using CloudFormation. With the help of a few StackOverflow links and tutorials, I was able to write CloudFormation Template.
In this article, we’ll look at ten underrated activities in engineering for which allocating more time can be beneficial.
AWS Elastic Container Service(ECS) makes it very easy for anyone to run and manage their docker container applications on cloud. All one has to do is create a cluster and provide the name of the docker image to pull and run as a service in the cluster.
Why the AWS, Azure, and GCP CLIs need to die
Cloud expertise is currently one of the most sought-after tech skills out there, and cloud jobs are some of the highest paying in the industry. But how does one break into this exciting field?
As a Serverless computing service, Lambda already saves hundreds of thousands of dollars for many companies out there. While traditional server-based infrastructures usually lead to overprovisioning and waste, the Serverless pay-per-use model enables cost-effective cloud spending.
In my past life, I was an auditor and performed hundreds of cybersecurity readiness assessments. These were sometimes called “gap analysis” and the essential purpose of these assessments were to provide organizations with the answers to the test for their upcoming official assessment.
A simple example of setting up SecurityHub at the Organization level with Terraform.
How to build a tech stack if you run an early-stage startup.
Have you ever had questions about running your containers on AWS? If so, this upcoming, Developers, Let's Code session is for you!
This tutorial explains how to deploy a Java Springboot app in AWS Free Tier
While we know the many benefits of going serverless - reduced costs via pay-per-use pricing models, less operational burden/overhead, instant scalability, increased automation - the challenges are often not addressed as comprehensively. The understandable concerns over migrating can stop any architectural decisions and actions being made for fear of getting it wrong and not having the right resources. This article discusses the common concerns around going serverless and our advice to minimise their impact.
Anybody with a bit of experience working with AWS has had that time at the start of the month where you get that shockingly high bill in your inbox.
Today we’ll finally clarify IAM, specifically when to use Users vs Roles. With the visuals and examples I’ll share, you’ll realize it’s surprisingly simple.
Serverless is a modern computing model that employs Function-as-a-service architecture and manages the backend and scaling automatically with low cost and high concurrency.
Application example built with Angular 14 and hosted on Amazon S3 (Simple Storage Service) using GitHub Actions.
First off, this is not a critique of Amazon’s Elastic Beanstalk — it’s a great service that allows you to deploy web applications without having a lot of in-house DevOps expertise. If you’re a young startup looking to deploy your web app on a tight schedule — it’s naturally a tempting choice, but sometimes it’s the wrong choice.
Containerization has come a long way and containers have completely revolutionized the way companies build, test, package and deliver software today. Containers are good for packaging any software. Big or small. Microservices are great candidates to be packaged and delivered with container images. With Microservices architecture, the large monolith is decoupled into several mini services that work independently.
Hello guys, after Pluralsight made their 7000+ expert-led online courses for free for one month, now Udemy has also launched the "Udemy FREE Resource Center" where you find a collection of Udemy's best free content from some of their best instructors.
API Economy is taking off exponentially and its every business need to expose their digital services and assets in a secure way. I'll walkthrough in this article how one can take a API-first , design first approach to take into the account, the needs of API consumers and various steps that lead to creating a Developer Portal using all the tools that we've currently. Please note that these tools have alternatives in the market, but these are what got me to the goal post in the fastest way and case could differ for others.
A step by step guide on how to use the AWS step function to retry Lambda and send notifications when errors occur in Lambda.
Disclaimer: This is NOT a press release by Netflix. Just my honest review of tech that helps us binge great content without hassle.
Comparison of top observability and debugging tools to help you monitor Python in AWS Lambda.
Our guide in creating FastAPI abstraction that allows us to query the AWS Glue metadata catalog - a Data Discovery API for AWS Data Lake.
This article shows how to set up the Cognito UserPools JWT authentication flow and how it will integrate with an Angular Web Application.
Let’s face it — AWS is a convoluted web of so many services and can be really difficult to wrap one’s head around. That’s certainly how I felt, the first time I deployed a Node.js app to the service. PSA I love Clis but definitely not a fan of the Elastic Beanstalk Cli.
Automate thankless tasks like splitting grocery bills using a Telegram Bot and AWS.
Serverless computing enables you to run functions without provisioning resources. Most of the top cloud providers offer good serverless options, but this article offers a review of storage options for serverless on AWS. First, you will learn about the core principles of storage and data persistence in serverless computing, and then you'll discover what serverless options are available on AWS for databases, microservices, IoT, and storage synchronization.
4 Ways to run amplify project from existing GitHub repo.
Tips on how to reduce your node app size and the benefits of doing this.
This post will help you to learn how to deploy your React applications to production. We are going to use Docker and NGINX to secure API keys and proxy requests
Happy Serverless September 2020! We at Coding Sans love working with serverless technology. This is why we decided to publish a report with the latest serverless trends this year. We partnered up with nine other companies who share our love to make it happen.
A couple of weeks ago I passed the Certified Kubernetes Administrator (CKA) exam with 7 days of prep. Here’s how I did it.
I have some exciting news to share with you about the Serverless Step Functions plugin.
Leading researchers like Karl Friston describe AI as "active inference" —creating computational statistical models that minimize prediction-error. The human brain operates much the same way, also learning from data. A common argument goes:
Amazon RDS is the SQL Database service provided by AWS. In this blog post, learn about Amazon RDS and its feature through a comic explanation
We recently wrote about whether API Gateway can act as a Load Balancer. The answer is yes and, in many cases, they are substitutes for each other. But how should we choose which one to use?
In our last few posts, we've looked at how to auto-record Amazon Interactive Video Service (Amazon IVS) live streams to Amazon S3.
About Unbundling AWS
Amazon AI/ML Stack
Learn the difference between Cloud-Based, Cloud-Enabled, and Cloud-Native Applications.
AWS data pipelines are one of the best mechanisms to transfer data from one storage to another storage with a different data type. While transferring data from pipelines, there are several techniques which can be used to optimize the process of copying data. In this article, the scenario would be copying 3 CSV format files which are stored in S3 bucket, to 3 Dynamodb tables.
AWS API Gateway is a great service but can be quite expensive, and even cost-prohibitive in some cases.
This article describes one of the many ways to import data into AWS DynamoDB database. The option explained here uses Amazon EMR and Hive. Using Amazon EMR and Hive you can quickly and efficiently process large amounts of data, such as importing data from Amazon S3 into a DynamoDB table.
This article will explain how to build serverless functions on the primary cloud providers services: Azure and AWS.
By default the aws cli stored key id and secret in plaintext in a well known location. What could go wrong?!?
As a recent Bootcamp grad I wanted to put my new React skills to work and tie in my older skills with AWS. I built out my new portfolio site, using React, and I thought to myself, “can I host this in an S3 bucket?” The first task is deploying to S3, which was pretty straightforward and there are many good resources that you can find with a little googling, like this one, stepping through how to do that.
What is boto3 and how to use it? We look at how boto3 works and how it can help us interact with various AWS services.
TL;DR: yes, API Gateway can replace what a Load Balancer would usually provide, with a simpler interface and many more features on top of it. The downside is that it doesn’t come cheap.
79% of surveyed firms have recently experienced a cloud data breach. In this article, we examined various recommended practices that can help you stay safe.
When talking about infrastructure drift, you often get knowing glances and heated answers. Recording gaps in your infra between what you expected to be and the reality of what is, is a well known and widespread issue bothering hundreds of DevOps teams around the globe.
Firecracker is a Virtual Machine Monitor, written in Rust that Amazon Web Services use to power it’s Serverless Compute services — Lambda and Fargate. Firecracker makes use of Linux’s Kernel-based Virtual Machine virtualisation infrastructure to provide its products with MicroVMs.
In this tutorial, we will go through the steps required to configure an S3 bucket to host a React.js web application
These are the Best AWS Blogs from thousands of AWS blogs on the web using search and social metrics. Subscribe to these websites because they are actively working to educate, inspire, and empower their readers with frequent updates and high-quality information.
Below you can see the demo of the final application. Online demo is available here.
In many cases, custom metrics may be useful to make more ad-hoc configuration of autoscaling in AWS. For example, a custom metric can allow an autoscaling group to react more rapidly on spikes or to take into account the health state of hosts for concurrency based metrics. Let's see how to set up a custom metric and autoscaling policy for an autoscaling group with an application load balancer and target group using AWS Console.
In 2018, OpenAI released a study that found the compute power used by the largest AI training runs has doubled every 3.5 months since 2012. From autonomous vehicles to DNA analysis, there's little doubt the demand for machine learning and AI is driving the supply of increased computing power today.
AWS Cognito is an identity management service that lets you sync all your user information in one place in a simple, secure, and scalable way.
We recently released Cosmic Functions (public beta). We’re excited to help teams build amazing modern products together with new serverless solutions.
AWS KMS Security and Key Management
What does it mean for your organization?
Amazon Web Services (AWS) recently announced, among many other important updates, the release of the new service “AWS Lake Formation” at the AWS re:Invent in Las Vegas. This article provides a brief explanation of what the service does. Furthermore, it explains why it can be important for your organization.WE LOVE SPOT AND YOU SHOULD TOO
Cloudwatch is an AWS service that allows storage and monitoring of your application logs from an array of AWS services. This can be really useful for creating alerts to notify developers when a certain threshold of errors has been hit, but sometimes we might need to deeply analyse our logs, not only to spot errors but to find insights into our application and improve performance. This is where an ELK (Elasticsearch, Logstash, Kibana) stack can really outperform Cloudwatch. ELK allows us to collate data from any source, in any format, and to analyse, search and visualise the data in real time.
When developing an application it is important to have assets resized for different capabilities, screen sizes, and resolutions. This is important for many reasons.
If you're new to Ruby on Rails development sooner or later you'll have to create an Amazon AWS account. And if you already have any experience you know what I meant.
Aggregating into data lakes is the solution of today — but are Federated Sources the solution of tomorrow?
Lambda vs GRPC vs Choreography vs HTTP / REST
There are many ways to reduce AWS Lambda costs. In this article, we'll take you through the AWS Lambda cost optimization strategies that have worked for us.
Every time facing a task of configuring how the system should scale out and scale in, we decide what metrics and policies will be more effective. I have already described CPU based policies and what challenges they may have. But what if this is not an option, i.e. the service is represented by legacy application, written years ago, not well documented, etc. and we still want to run it in Cloud and autoscale?
Two buzzwords walk into a bar… No? Yeah, let’s not go there. If you feel like this, you’re in the right place. Both containers and serverless have been the cool new kid on the block for the last few years, and the popularity simply isn’t dying down.
I’ve dabbled a fair share in the dark arts of Serverless. Digging into the various pros and cons of not having dedicated servers, or instances you can call your own. Even if they technically are not. They’re just in some undisclosed server farm somewhere floating in the cloud.
Cloud computing – everything you need to know
Firdavs KasymovIn this multi-part series, I'll transform a new application into a multi-tenant experience running in the Heroku ecosystem. This article focuses on the object model, design, architecture, and security.
In this article I want to show what I used to pass the exam, how I went through the exam process and what services I would recommend to pay attention to.
AWS Lambda is an event-driven computing cloud with many uses. Here are some of the best AWS Lambda use cases >>
A look at why enterprises are slow in moving to Kubernetes.
I wanted to start a serverless project, and one of the primary headaches aside from architecting the workflow and deciding which lambda functions need to be created is a simple and yet effective CICD workflow.
How to create a construct based on other constructs in the same stack without forcing the developer to call a method for each? That's exactly what aspects do!
AI companies have been struggling with Big Data environments and analytical and machine learning pipelines for years. Organizations expect to start driving value from AI and machine learning within a few months, but, on average, it takes from four months to a year to even launch an AI MVP.
I have been working in web technology for more than 20 years. I spent the first five years of my career as a full-stack developer. Back then, we used the term webmaster. I would set up servers (which included e-mail and FTP), order domain names, create databases and order SSL certificates. I would code the backend and the frontend, plus open up Photoshop to do a little bit of design and UX from time to time. I was the scrum master and the business analyst plus I would support customers and project manage their websites. These tasks and job titles were all just part of being a webmaster. You crafted the web by yourself, and it lived in a box in the room next door, occasionally you would have to go in and check on it, maybe even restart it.
Later in my career, I saw an opportunity to specialise. Living and working in London, I saw the increasing need for the expert. Recruiters started to ring me, asking about specialist job titles. I very much enjoyed the visual element of working in the browser and JavaScript was growing in power and clearly here to stay.Not so long ago, a job requirement pushed me into the world of FaaS, and I was thrilled. I had dreams of abstraction — eliminating all that tedious work no developer likes doing. “We are not operations engineers!” I exclaimed proudly. “We should not need to dabble in the dark arts of the Linux Shell.”
Learn everything about AWS Lambda triggers in this guide, including Amazon DynamoDB integration and 3 common ways to trigger AWS Lambda.
When we are using NodeJS as the runtime for AWS Lambdas, JavaScript is the default language. However, due to the lack of typing check in JavaScript, from time to time, buggy codes are deployed to Lambda inadvertently. Such as a small typo like this:
Every big Cloud service provider offers you guaranteed SLAs availability about 99.95 %, and this percentage of availability can make you think that cloud is perfect for a SQL Server deployment which requires High Availability. Azure and AWS are the two giants of cloud services, and their geographical distribution of data centers can leverage you to think of cloud for a SQL server development configured with disaster recovery.
How can serverless technology be used in tandem with blockchains? Find out how we built an AWS Lambda function to monitor NFT supplies.
Blockchain storage is appearing rapidly across the market. With a few companies doing intensive R&D in this space to offer a more secure, cheaper and responsive offering.
Set up two named domain websites on one server host
The success of DevOps lies in the right way of implementation. Here, are some best DevOps practices for successful DevOps transformation in 2022 and beyond.
In this article, you'll learn about cloud concepts such as what is cloud computing, the advantages of using cloud computing, cloud computing types, and more.
Amazon recently released Textract in the Asia Pacific (Sydney), thus i decided to write a javascript OCR demo using Amazon Textract.
Node-RED bridges the finest pieces and abridges backyard to market delivery. This article intends to teach readers to host a secure & highly available Node-RED instance. For a couple of weeks, I worked on a project where I need to secure my Node-RED. By going through the blogs and post, everything seems very scattered on the internet and haven't found any article with end-to-end Node-RED execution as a secured frontend client accessible on the web. Thus thought to share my experience with you.
AWS API Gateway Explained With Real Web App - React Lambda
handoff is a serverless data pipeline orchestration framework simplifies the process of deploying ETL/ELT tasks to AWS Fargate.
Lightsail is an easy-to-use alternative to EC2, offering everything you need to build websites and simple web applications.
I can’t believe not many people are talking about this AWS feature. It’s a game changer!
In this AWS EMR cost optimization guide, you'll understand AWS EMR pricing model, practical tips for controlling AWS EMR costs and resources for monitoring your
Today we explain AWS and how it blows a door open for the poor to achieve the American dream.
Explore two automation solutions that use automation to optimize cloud costs: CAST AI vs Spot.io and see which one is a better pick for you.
Find out what were the 22 most important serverless updates from re:Invent 2021. Announcements, updates and more - serverless edition >>
A while back, a client asked me “how can I share business logic between services in a Node.js monorepo?”. So here it is!
Let’s say that you have spent the last 2 years developing your enterprise services in either of the two cloud providers and now you decide to start using the other one. A possible scenario that would bring about such a requirement could be a migration from one cloud service provided to the other.
My stack to build a SaaS with Next JS and serverless backend. A full-stack react SaaS boilerplate template to kickstart any project.
In this article, we'll look at what are the security hazards in serverless and what factors will drive its development in the following years.
What is it?
Five books you must read if you are going serverless including books by Eric Evans, Richard Rodger, Chris Richardson, and more.
Here are five lesser-known AWS capabilities you can leverage to become an AWS automation pro.
Kubecost's Spot Commander recommends optimal cluster configurations, letting Kubernetes users take advantage of spot node savings to streamline your processes.
The final goal of this guide is to create a scalable and reproducible setup of the Django Web Application on AWS using Terraform.
When I started working in Go and AWS Lambda, one of the difficulties that I faced was unit testing. I had a decent idea about what is unit testing and knew how to do it in Ruby but in Go, I had no idea because I was a beginner.
Serverless Cloud allows you to build your applications without having to worry about the creation and management of cloud services. It does this by abstracting
To deploy a telegram bot in C # seems is difficult, but I want to show that it is not. In this article I will give an example of publishing it on AWS.
Being a developer is amazing. Writing code, solving problems and thinking of ingenious solutions for complicated algorithms is what we live for. But, the grass is not always so green on this side of the fence. Sooner or later you need to get your hands dirty and deploy the app you worked so hard on. Deployments are not always easy. To be blunt, they can be incredibly hard and time-consuming. That’s what we’ll solve in this tutorial.
[Updated - 1st March, 2020] : Course updated, now you can control your connected light either using Google Assistant or Alexa. Kindly check out the Bonus section at the end of the course.
Hold on tight: the HTTP protocol is terribly flawed(*) and when it comes to user authentication this problem screams loudly.
When first looking into serverless migration and its architecture, it can feel like you’re staring down an endless shopping aisle of critical serverless tools that all need to be put into your basket straight away. Some services seem to offer the same function, while others can feel wildly different - both, as a result, can instill some doubts as to what is really necessary for your business and serverless application.
Technology touches almost every corner of the world economy. Even when it’s an indirect relation, in many cases tech is an essential, vital part of our societies. It just can’t fail without causing too much distress and losses. Not only financially, but especially to the human aspect.
The story of how Serverless came to be.
In this article, we'll be discussing everything you need to know about the basics of AWS Lambda error handling.
You can now build your serverless workloads in a Docker container with AWS Lambda. We gave it a try and here's our review (with ETL examples).
Not so long ago I started exploring server-side rendered single-page applications. Yeah, try saying that three times fast. Building products for startups has taught me SEO is a must if you want an online presence. But, you also want the performance SPAs can provide.
Ever since AWS made a serverless option of AWS RDS Aurora generally available, I’ve been on the edge of my seat, eagerly anticipating all the various possibilities. It would mean a breakthrough in building serverless architectures. No more managing connection pools with SQL. No more worrying about capping out available connections. This would make it viable to use serverless for database intensive operations.
What is Terraform?
AWS Data pipelines are used to move data between different storages. In this article, we discuss how to deploy data pipelines in different regions and how the settings are different from region to region.
Guide on How to do CRUD operations like DynamoDB GetItem, PutItem, DeleteItem and UpdateItem using AWS Serverless and NodeJS.
Event Driven Automation for AWS Permission Set Assignments
Hi, I am developing a freelance project with aws lambda. I used Jenkins and docker for CI/CD. Jenkins runs pipelines on containers. In this Tutorial I will show you how I set my environment.
Once upon a time, not so long ago, a word caught my ear. Lambda. That struck a chord, remembering the good old days of playing Half-Life as a kid. Little did I know what AWS Lambda was, and how incredibly awesome it is. If you’re intrigued, stick around. I’ll only take a few minutes out of your already busy day, and you surely won’t mind.
If you're getting started with AWS and you're interested to build your web applications using AWS services, then you're in the right place.
In this article, we will look at the NoSQL database service offered by AWS called DynamoDB and how to perform basic database operations with it
How I created a web and mobile application within an hour without coding
With the rise of cloud computing and modern distributed systems, we also witnessed the rise of a new practice area: DevOps.
I have got 7000 odd Linkedin connections and whenever I open my feed I see people posting a screenshot of certificates.
Start capturing website user data in 5 minutes or less with no developer resources or coding experience needed.
If you follow the Microsoft development community at all, you’ve most likely already heard of the new web development framework called Blazor. If you haven’t heard of it, here’s an overview from the product site:
Terraform is a powerful tool to have in your toolset.
Retraining Machine Learning Model, Model Drift, Different ways to identify model drift, Performance Degradation
Decentralized storage is a promising development, and its rapid implementation in 2021-2022 shows promise for the tech systems powering these networks.
Let’s get into the action and dig into some of the key requirements of how to operate workloads securely in AWS.
When does migrating to Amazon RDS make sense and when it does not
AWS just released CloudWatch Synthetic service a few days ago.
For this Tech Stack in 10, I'm diving into some best practices for using authentication in your full stack application with AWS Cognito, DynamoDB, and AppSync.
Amazon Web Services is a cloud service platform which offers content delivery, database storage and many other functionalities and infrastructure on demand in order to help businesses to scale and grow with “pay as you go” pricing method.
Imagine the situation, you have a legacy system partially migrated to multiple services and used by the relatively small amount of concurrent users. And one day stakeholders want to create an open API and expose the system to external clients with the load significantly higher than the existing system can handle, and it should be scalable to handle in the future even more.
Handling large images has always been a pain in my side since I started writing code. Lately, it has started to have a huge impact on page speed and SEO ranking. If your website has poorly optimized images it won’t score well on Google Lighthouse. If it doesn’t score well, it won’t be on the first page of Google. That sucks.
Static websites are a brilliant way to create performant sites. My website is built using Gatsby and hosted on Amazon S3. I have created a simple script to help you quickly upload your site to S3 by running one simple command in your project terminal.
Blue Sky Analytics is a big data and AI start-up that uses geospatial data to monitor environmental parameters. Our goal is to become the Bloomberg of Environmental data for environmental monitoring, ESG (environment, social, and governance) due-diligence and climate risk assessment.
Knowing how to build REST API with latest tech is cool. You know what's even cooler? It's being able to deploy it to the cloud! I'll walk you through the process of building simple, server-less application using GO, AWS (Lambda, API Gateway, Dynamodb) and Terraform.
The popularity of hiring vendors for handling application backend has spiked tremendously over the last 5 years. On the one hand, startup owners go serverless to save infrastructure costs and pay for resources as they go
(Photo by Fanny Rascle on Unsplash)
Do you like boxing fights? This evening I bring you a head-to-head battle between Redis Streams and AWS SQS. If you are interested which technology is better and which will end up on the ground, check it up!
This is a run-through of setting up a website with Eleventy, a simple static site generator. I’m going to try to list out all the relevant steps so you can follow along if you are attempting a similar project. I made a gallery site meant to showcase graphic artwork.
AWS Amplify is a framework that lets you develop a web or mobile application quickly, by accessing the backend cloud services offered by AWS. In this article, we are going to learn how to use AWS Amplify in React Native by building a fully functional login and registration flow.
This is a list of items that has helped me to build, run and scale microservices efficiently and securely.
As we know with great power comes great responsibility, on-demand backups are the real saviour if your Dynamo DB got corrupted abruptly. Also, it helps you to meet the compliance requirements for the ages if your client keeps bothering you like your Ex. But I don't have the tenacity to initiate the Backup every day. Hence, I devise a Serverless solution for all the lazy people like me out there to automate the DynamoDB backup. Where, we can explicitly mention the backup intervals, table names and backup retention period. I have achieved this using a conjunction of AWS services like Cloudformation, Lambda and Cloudwatch.
AWS Step Functions is a great service for orchestrating multi-step workflows with complex logic. It’s fast to implement, relatively easy to use and just works. The problem is its price.
In this blog, I am going to show you how we can use rekognition for image analysis using lambda function.we will be going to perform label detection and object detection for an image so basically we are performing image analysis in this blog.
Amazon introduced the DeepComposer music synthesizer and the eponymous cloud-based music creation service based on generative adversarial neural networks. Using them, the user can set the main melody on the synthesizer and get a full song, in which the original part is supplemented with drums, guitar and other instruments.
To make the choice between 3 market giants (Azure, AWS, and Google Cloud) clearer, we've conducted research on the pricing plans for DevOps services.
If you are looking for DevOps Interview Questions and answers, you are on the right page and below are some Real-time DevOps Interview Questions common in 2020. Go through all of them to crack your next interview.
Going back to the 10 of December 2017, AWS introduced AWS Single Sign-On, a service that makes it easy for you to centrally manage SSO access to multiple AWS accounts and business applications.
Set Up an IMAP Postfix E-Mail Server with Dovecot on AWS.
There is an interesting discussion going on around how Serverless is more of a spectrum rather than a binary choice.
What if I told you it can be done with zero dependencies? Hope you’re up for a challenge because that’s exactly what we’ll be doing.
When building for large-scale use, using Rust certainly feels worth it both from a cost perspective (factor x3 saved) and from a performance perspective.
This can be applied whenever you need to extend your EBS volume size avoiding to stop the instance and detach the volume.
Let's review a particular project in detail and the cost of infrastructure maintenance. And so, we have an internal WEB application that consists of a static website on React, a backend on Go, and a database DynamoDB. All code is stored on Github and for CI/CD we use Github Actions. The infrastructure code is defined in Terraform.
So you’ve decided to choose AWS as the primary provider of your cloud service and now you’re looking into setting up your environment. You’ve got your project to be deployed and all you have left to do is choose an AWS instance that will run your machine image. But now, like many others before you, you are stumped by the countless choices of EC2 instances out there.
Amazon CloudFront is highly secure, managed service for content delivery by providing useful, and security supporting features. Learn more in the blog.
The AWS Snow Family is a group of three products that solved the problem of slow data transfers and edge computing associated with cloud storage.
The top AWS tools for SRE Adoption: CloudWatch, CloudTrail, Elastic Load Balancers, Health Checks, GuardDuty, and infrastructure security.
Using JavaScript, APIs, and Markup as the foundation of the Jamstack ecosystem, developers may create new applications.
please delete this
In this article, we’ll walk through an example architecture for building your own notification service with AWS, and show you how to implement it in Node.js.
Introduction
AWS DynamoDB changed the database game in Serverless and continues to do so, as its design repeatedly proves its huge value.
In this article, we'll deep dive into all the basics to help you hit the ground running when it comes to AWS RDS.
I'll show how to use Macie to scan any database, inclusive on-premises, to discover sensitive data on tables.
One of the benefits of Serverless architectures is the possibility of scaling applications without worrying about load balancers and clusters of servers. While services like AWS Lambda hold their promises on this area, there are usually misconceptions about how they work.
Serverless security: How important are logs to secure a serverless app? Here's what and how to log based on the industry best practices.
An outage (also known as downtime) is a period of time when a given service or system is unavailable, failing to provide and perform its primary functionality.
Cloud migration is already past the cautious exploratory phase. We bring to your attention: List of Top 10 AWS cloud migration tools. In 5 years, as much as 98% of businesses will be relying on some cloud software and technologies. That makes perfect sense when you consider the benefits of infrastructure, data, and cloud application migration:
Amazon Web Services (AWS) had a second in a row-major outage a few days ago. Most likely Slack, Zoom and Notion were affected by this.
I want to tell you this story because I wasted about 14 hours to realize how to achieve it correctly.
Credits: Thanks to our sponsor Amazon, the Advancing Women in Product Team: Keshav Attrey, Reeba Monachan Attrey, Kanika Kapoor, Alok Gupta, Jackie Yen, our AWIP volunteers and our panelists.
We can apply latency injection to APIs created with API Gateway and AWS Lambda. Our approach should allow us to configure when to add arbitrary delay (and how much) to our API endpoints to ensure inter-service communications are tuned with proper timeout values.
In this article, you'll get an overview of the need-to-knows for error handling Python in AWS Lambda.
It is not a rare case when an application running on Google Kubernetes Engine (GKE) needs to access Amazon Web Services (AWS) APIs. Any application has needs. Maybe it needs to run an analytics query on Amazon Redshift, access data stored in Amazon S3 bucket, convert text to speech with Amazon Polly or use any other AWS service. This multi-cloud scenario is common nowadays, as companies are working with multiple cloud providers.
VPC is the topic that flies under the radar of many Software Developers, despite being present in every AWS account (well, maybe not for accounts created before 2009...but that's unlikely). There are a few reasons for this I can think of:
Problem statement:
SageMaker is a fully managed service that enables developers to build, train, test and deploy machine learning models at scale.
Part 1 of this series provides detailed description on GraphQL server and how to start setting it up using springboot, Schema Definition Language (SDL) and its types.
Open-source evolution
Terraform is a great (and dominant) infrastructure automation tool. It is multi-cloud, can build all sorts of resources, and in some cases supports API calls to build resources before the native tooling from cloud providers does.
What do in-flight refueling maneuvers and cloud-to-cloud migration have in common?
[Updated - 14 December, 2020] : Course updated, Now you can run the NodeRED Instance in any AWS Region, which uses secure HTTPS connection using self-signed Certificate (Generated during boot up) & set non-default Password & Username to login to NodeRED Admin Dashboard.]
Serverless technology is spreading across the SaaS industry like wildfire, including the Video Streaming industry. Is it a good idea?
The global pandemic now may have hit many sectors of the economy, but it doesn’t appear to have hampered the cloud computing market. According to the latest forecast from Gartner, the public cloud market is likely to grow 6.4% in 2020 to reach $ 242.7 billion.
In this blog, I am going to show you how we can use rekognition for image analysis using AWS CLI. So you can test the image analysis on your local machine. We will be going to perform label detection and object detection for an image so basically we are performing image analysis in this blog by using AWS CLI.
Migrating to serverless? Learn the steps and what to bear in mind in each stage, from preparation to migration and post-transition.
One of the benefits of serverless is the pay-per-use pricing model you get from the platform. That is, if your code doesn’t run, you don’t pay for them!
How can you improve serverless architecture with Amazon Web Services? Explore unconventional AWS Lambda use cases.
Outlined below is the setup for a AWS lambda function which combines fetching the HTML for a URL, stripping it back to just the essential article content, and then converting it to Markdown. To deploy it you’ll need an AWS account, and to have the serverless framework installed.
The concept of a microservice perfectly fits the structure of a serverless function, which easily enables deployment and runtime isolation for different services. On the storage side, services such as DynamoDB also make it easier to have independent databases for each microservice and scale them independently (when required or desirable).
Why should I learn AWS?
Should you increase Lambda memory? It might sound crazy, but increasing your AWS Lambda memory could actually lower your bills. Find out how.
It may be a requirement of your business to move a good amount of data periodically from one public cloud to another. More specifically, you may face mandates requiring a multi-cloud solution. This article covers one approach to automate data replication from AWS S3 Bucket to Microsoft Azure Blob Storage container using Amazon S3 Inventory, Amazon S3 Batch Operations, Fargate, and AzCopy.
Follow these steps to understand how to deploy a CakePHP application to the cloud. While some cloud providers offer simple solutions, you will notice that others require a bit more technical know-how for you to deploy an app.
In Part 1 of our Complete AWS Lambda Handbook for Beginners, we gave a refresher on the fundamentals of AWS Lambda and what is AWS Lambda. In this post, we’ll look at AWS Lambda pricing, some interesting Lambda facts and examples of great AWS Lambda use cases in your serverless application.
The cloud has taken a PR beating recently. Two systems seemingly too big to fail did: CloudFlare and AWS S3. The former was a security issue that caused sensitive data to show up in search results, the latter brought nearly the entire Internet down for the better part of a day on February 28, 2017.
Welcome to second part of the DevSecOps series. In the second part, we will turn ON/OFF the inbuilt led of ESP32 using AWS Device Shadow Service. Before starting, let's do a recap, in Part 1 we have connected the ESP32 MCU with AWS and able to publish Messages to IoT Core. The following series split into two parts (refer below) with very simple and clear instructions to provision a CI/CD pipeline adhering to DevSecOps principles in AWS. Everything covered from scratch you won't face any difficulty understanding. In case of any clarification, drop me a note on LinkedIn. Feel free to explore them with ease, skip to the one which is relevant to you.
Building a custom authentication flow using Amazon Cognito and MetaMask
AWS CDK is a relatively new framework that aims for faster development of AWS Cloud stacks when compared to AWS CloudFormation and AWS SAM. This article will present how to deploy a complete AWS CodePipeline using AWS CDK and troubleshoot all common issues that may occur in the process of creating the CDK application. For additional information about the framework, read the previous article named “How AWS CDK facilitates the development process of AWS Cloud Stacks”.
Using BigQuery, Airflow, and Amazon Personalize to Build a machine learning workflow
We discuss quite a bit about going serverless for SMEs and startups, however it’s often those with an already huge infrastructure, such as enterprises, that can find the move and change daunting. We see many companies from the likes of Coca-Cola to Netflix managing it but what does it look like in action? In this article, we share some best practices and insights on the serverless designs that can scale massively and represent enterprise models. For a real life example, you can also check out how Shamrock Trading Corp migrated to serverless from a traditional cluster - psst, they’re also giving away their winning strategy for a smooth transition.
In this article, we're discussing AWS Lambda Layers, Lambda Extensions, and Docker image for Lambda. How and when to use which?
Imagine reading something, and never losing track of that information.
As builders of an MLOps platform, we often get asked whether serverless is the right compute architecture to deploy models. The cost savings touted by serverless seem extremely appealing for ML workloads as for other traditional workloads.
It's crucial to safeguard CloudTrail logs and enhance the security of them, to meet compliance regulatory requirements and internal business needs.
DevSecOps is the new buzz and definitely a potential candidate to scare people in the ever-changing software industry. When I heard the term for the first time, my inner voice said it out loud, "When just this Happened, and why SEC is sandwich between them ?". Later on, to look cool, I started adding DevSecOps on my profile, but the dire consequence was a complete disappointment. DevSecOps isn't just restricted to understand security by heart & fit it with DevOps. A good analogy would be not to imagine your ex with someone, especially with your girlfriend/wife. It is all about "Shift left on Security" i.e. to introduce security as early as possible in the SDLC. Though I am not going to bore you with the definitions and concepts as I am a practical person. Thus, my objective here is to demonstrate how DevSecOps works in reality. The following series split into two parts (refer below) with very simple and clear instructions to provision a CI/CD pipeline adhering to DevSecOps principles in AWS. Everything covered from scratch you won't face any difficulty understanding. In case of any clarification, drop me a note on LinkedIn. Feel free to explore them with ease, skip to the one which is relevant to you.
Application example built with Angular 14 and adding the map MapLibre component using the Amazon Amplify Geo and Amazon Location Service services.
Ever since software engineering became a profession, we have been trying to serve users all around the globe. With this comes the issue of scaling and how to solve it. Many times these thoughts of scaling up our software to unimaginable extents are premature and unnecessary.
What is the actual cost of serverless? Worried about the cost of your Lambdas? Lower your serverless cost without slowing down your business.
Don’t you just hate it when APIs are failing and you have absolutely no clue why? Now imagine you don’t have access to the VM, cluster or container where your software is running. Want me to continue with this nightmare?
Being informed and relevant aren’t enough to catch a moving target that’s disappearing every 24 hours.
A diff algorithm outputs the set of differences between two inputs. These algorithms are the basis of a number of commonly used developer tools. Yet understanding the inner workings of diff algorithms is rarely necessary to use said tools.
In this article, we're covering 4 tips for AWS Lambda optimization for production. Covering error handling, memory provisioning, performance and more.
We will deploy a serverless infrastructure based on AWS Lambda for uploading images (and any other files) with private storage in an AWS S3-based bucket.
Quite an exciting title, isn’t it? I was hyped when I heard AWS was adding support for custom runtimes and layers for AWS Lambda. This means you can now build your own custom artifacts, enabling you to share and manage common code between functions.
Cloud-in-a-box originally seemed like the perfect compromise, letting enterprises reinvent their aging data centers for today’s IT, built around a cloud-based model. It offered some of the important advantages of public cloud, like better optimization of computer resources and self-service.
Amazon web services (AWS) is a powerful platform for almost every webservice you can imagine. With AWS API Gateway and Lambda you are able to create REST API’s with ease! API gateway is enables you to create the API. Lambda lets you execute code when the API is invoked. This code can be in many programming languages like Python or Node.JS.
As you read this post — possibly on your smartphone — it’s easy to forget how many modern technologies we take for granted.
What Is Traffic Mirroring (aka Replication) ?
Over the last few weeks I have been working with a very ambitious client – Solve, who is building a new murder mystery game. They are doing some really cool things technically, and are building an entirely serverless stack.
In the "Moving Away From AWS and Onto Heroku" article, I provided an introduction of the application I wanted to migrate from Amazon's popular AWS solution to Heroku. While AWS is certainly meeting the needs of my customer (my mother-in-law), I am hoping for a solution that allows my limited time to be focused on providing business solutions instead of getting up to speed with DevOps processes.
Node-RED bridges the finest pieces and abridges backyard to market delivery. This article intends to teach readers to host a secure & highly available Node-RED instance. For a couple of weeks, I worked on a project where I need to secure my Node-RED.
While using any services from AWS you can do it via their API,Console or CLI tool like amplify, amplify was designed specifically to work with AWS and to make it easier for developers to deploy applications on the cloud just by running some commands, In this blog i will be showing you how can you create an Appsync API with Amplify, It will have auto generated resolvers for all the queries,mutation and DynamoDB as the database.Yes you read that right everything will be created for you by AWS using cloudformation which acts as template for all the services that you will be needing. So before we get started i encourage you to install Amplify CLI on your computer and configure it with your Credentials. Let’s get started now.
When using Docker to run applications security is a major concern, but it can sometimes be easy to forget as we focus first on functionality. This doesn't need to be the case, as AWS Elastic Container Registry (ECR) can now be setup to automatically scan images on push, and provide feedback on any vulnerabilities that need to be addressed.
As you probably already know, Step Functions is a serverless Workflow Service provided by Amazon Web Services (AWS). There’s a lot to discuss about this service, and you’ll find plenty of vital information in our AWS Step Functions: The Ultimate Guide as well as in our series of articles that’ll dive deep into various aspects regarding this AWS service.
Deploying a web app to AWS Amplify provides a way to host your frontend web app on the internet using its services for free which provisions a URL you can share
Experiencing issues with AWS Lambda? Explore these four popular AWS Lambda debug methods to quickly rid yourself of troublesome bugs.
I have been using Lambda in production for about four years now personally, and three years professionally at Volta. Initially, I shipped Lambdas because it was easier than managing servers. At Volta, we now exclusively use server-less services because they are the smartest option for our workloads if we remember to support them correctly. This is a cheat sheet, a checklist of all the things you might want to remember when shipping something new to ensure it runs successfully.
In the fall of 2018, I decided it was time to put my application design and development knowledge to use in order to provide a modernized solution for my mother-in-law’s small business.
Last week, someone asked me “Is caching still relevant for serverless applications?”
A deep dive into the performance characteristics of RDS Proxy vs RDS
In this article, we’ll investigate use cases for which data engineers may need to interact with NoSQL database, as well as the pros and cons.
A majority of companies prefer to focus their resources on other things rather than on scalability, which causes massive problems in the future, especially once they grow to one million users. The objective of building a robust serverless application is to succeed in making it scalable and powerful at the same time.
Having recently worked with young web developers who were exposed for the first time to proper production infrastructure, I received many questions about the various components that one can find in the architecture of a "Web service". These questions clearly expressed the confusion (and sometimes the frustration) of developers who understand how to create endpoints in a high-level language such as Node.js or Python, but were never introduced to the complexity of what happens between the user's browser and their framework of choice. Most of the time they don't know why the framework itself is there in the first place.
Learn about the best practices for AWS Cloudwatch Alerts and Dashbird Alarms, to not miss out on critical info about your serverless app.
Why are cloud costs so high? In part, it's because the very companies that offer cloud services are raising their prices. But there are other factors too.
Considered to be the best practices in AWS, one of the most popular ways to maximize AWS's potential is to utilize multiple accounts.
The concepts of social distancing, contactless approach and safety first have now become the new normal in our present COVID induced downturn.
As companies continue to evolve in the digital age, they are starting to readily approach the world of cloud computing.
Nowadays, JSON Web Tokens are the most common way of proving identity information to APIs. The concepts behind JWTs are also quite easy to understand, and it takes only a couple of minutes to have the most basic authentication running.
Full disclosure: I'm the CTO of //rungutan.com - the first API Load Testing SaaS platform, 100% Serverless, API driven, finally available for SMBs, the company which has built this open-source software - Stackuchin.
In my previous blog post, I went through how to create a maintenance mode page for your application, and how to implement it using Terraform and github pages. But the website is just one part of an Application, and often there’s also a public (or private) API that also needs to have a maintenance mode. Let’s see how we can do that using Terraform on API Gateway.
For many years, enterprise cloud computing has been a careful balance – and sometimes an epic battle – between what is possible and what is practical on the ground. This dichotomy has led to a lot of confusion, which in turn can hold back development.
Are you trying to decide if you should use MongoDB or DocumentDB? With the recent controversy surrounding licensing with MongoDB, it can be confusing to decide which option is right for your company or project. Amazon decided the core MongoDB code is challenging to scale while remaining highly available. Amazon wrote their implementation, which is compatible with the Apache 2.0 open source MongoDB 3.6 API. MongoDB, Inc. has also recently changed their license to make future imitations more difficult. To do this, they created an entirely new license called the Server Side Public License.
The cloud has been a hot topic for the last several years. However, it is not always easy to understand how to use this particular tool because of information overload and massive marketing activities performed by vendors.
With the advent of new tools, automation and orchestration are having an immense impact on easing the burden of moving to the cloud.
This is a comic conversation tutorial between two guys that will explain the Auto Scaling concept easily.
Amazon Elasticsearch Service recently added support for k-nearest neighbor search. It enables you to run high scale and low latency k-NN search across thousands of dimensions with the same ease as running any regular Elasticsearch query.
The idea behind SSO it’s pretty simple, you login into only one place and can use multiple applications.
Storage may be a large part of every enterprise architecture.
In this article, I propose to understand what cloud technologies are, to see their differences from solutions, to consider these key characteristics and models.
Get started creating IaC using CloudFormation templates.
I have been working on a large AppSync project for a client these past few months. The initial version of the app was built in just a few weeks, but the client has commissioned additional features and the project has kept growing. At the time of writing, this project has over 200 AppSync resolvers and 600 CloudFormation resources.
In this article we are going to consider the two most common methods for Autoscaling in EKS cluster:
This article discusses how AWS Config, Fugue, and CloudYali can be used for cloud version control.
The Problem with Publicly Accessible AWS Resources and how to solve it
At Bearer, we are a polyglot engineering team. Both in spoken languages and programming languages. Our stack is made up of services written in Node.js, Ruby, Elixir, and a handful of others in addition to all the languages our agent library supports. Like most teams, we balance using the right tool for the job with using the right tool for the time.
Data lakes are an essential component in building any future-proof data platform. In this article, we round up 7 reasons why you need a data lake.
In the wake of the COVID-19 pandemic, cloud service solutions have been thrown into the limelight as companies and organisations across the globe grapple with the rapid shift to remote working and learning. With the widespread closure of non-essential organisations and businesses forcing organisations’ leaders to consider new and innovative approaches to shifting their businesses online, the move to cloud computing has become a far greater priority than ever before. The industry statistics demonstrate this: according to new figures from analyst firm Gartner, by the end of 2020 we will have seen the global public cloud services market reach $266.4 billion, up from $227.8 billion in 2019.
If you run a web application in the cloud, sooner or later you have to deal with security and protect it from malicious input. AWS WAF Security Automations can be a handy alternative to expensive or more complex security products.
Hi all! I'm Dmytro Dziubenko, Co-founder & CTO of Corefy, a white label SaaS platform that empowers clients to launch their own payment systems in a few clicks. Our platform helps numerous payment providers and companies successfully cover all their payment acceptance needs. The key value of our platform for clients is that it eliminates the difficulties of payment provider integrations. After a single integration with us, clients get access to hundreds of ready-made integrations with PSPs and acquirers worldwide, allowing them to connect any payment method easily.
Mr. X has been working on a very interesting, and meticulously written web application involving some heavy computation and a complete test suite. He architects the system well and chooses to host his application over AWS.
For the past few hours, I've been working on dockerizing a Nuxt.js server-side rendering app to be deployed to AWS Elastic Container Service (ECS). I hit a stone wall when environment variables are not properly injected on runtime on ECS.
I am a big fan of leet code so when we decided to have a code challenge in our team I thought it wouldn’t be a bad idea to build one which should include pretty basic functionalities like:
After analyzing the requirements of your application and coming up with an AWS architecture, here is our guide to validating your architecture.
AWS certification has been rated as one of the most valuable IT certifications globally. One of the key reasons behind this is the huge popularity of AWS systems, and its wide prevalence in the cloud industry.
Sysdig is a universal system visibility tool with support for containers. What makes Sysdig special, is that it hooks itself into the machine's kernel and segregates the information on a per-container basis.
Top 5 Picks on Serverless Announcements at AWS re:Invent
Looking forward to the new decade, it would be tempting to speculate where the cloud industry could be heading. With tech developments in the cloud shop, by 2022, sectors like AI-Web, IoT, Blockchain, Space Cloud Computing, etc. are assumed to reach new heights.
Have you ever wished you could combine the portability of containers, with the scalability of Lambda functions? Well, now you can!
A deep dive into how AWS billing works and an intricate series of steps to discover the location of the firehose of data
Want to get your hands dirty with Machine Learning / Deep Learning, but have a Java background and not sure where to start? Then read on! This article is about using an existing Java skillset and ramp-up your journey to start building deep learning models.
Amazon Web Services makes getting your data into their Relational Database Service (RDS) relatively easy. Import costs are free, and you can store up to 100 terabytes across all your instances. AWS hosts your relational databases in the cloud, and their engineers handle patching, monitoring, availability, and some security concerns.
In 2004, I was eager for a challenge. I embarked on an adventure of completing a Computer Science Bachelors degree. Fast forward to today and the adventure continues. I’ve been building products for 12 years for a variety of industries from finance to ecommerce, retail, real estate, hospitality and more.
While testing whether Free CDNs performed better than premium CDNs, I discovered many free CDNs are actually performing faster than Amazon CloudFront.
Overview
An innovative platform with Presto and Alluxio as a data orchestration layer to support online services with instantaneous response within the gaming industry.
In the final part of his series, the author provides a retrospective of using Heroku for the very first time, detailing the new design and lessons learned.
Think back to the last time you worked in a distributed system, did you consider using something other than RESTful HTTP calls as the method of communication between components in this system?
Many clients have asked me “how do I record custom metrics from Lambda?”.
How to Migrate a Wordpress Site from Godaddy, Bluehost, Hostgator, to AWS LIghtsail Using the Duplicator Plugin Database Copy Method
Application example built with Angular 14 with authentication using the Amazon Cognito service.
Welcome to the Serverless world. One of the first things you’ll hear about is AWS Lambda - and you’ll continue to keep hearing about it! While architecture can be serverless without Lambdas involved, it’s very often the key component within a serverless application. In the first post of this 3-part AWS Lambda Handbook series, we run through what is AWS Lambda, dialling back to basics with the various terminology, how to create a Lambda function and how to run it.
In this article, we discuss the 6 most common pitfalls of AWS Lambda with Kinesis trigger that are usually spotted only in production.
A solution using CloudWatch rules and alternative solutions.
Learn what headless browsers are, what are the use cases, how to implement serverless services and run Chrome headless in AWS Lambda.
How to Interact with AWS (Amazon Web Services) cloud from your local machine.
AWS Lambda has a cool feature that can be both a blessing and a nightmare for a serverless application, depending on whether it’s properly handled by our code: the retry behavior.
In a previous post we discussed how to auto-subscribe a CloudWatch Log Group to a Lambda function using CloudWatch Events. So that we don’t need a manual process to ensure all Lambda logs would go to our log aggregation service.
The AWS CDK is a software development framework to define cloud infrastructure as code and provision it through CloudFormation. The CDK integrates fully with AWS services and allows developers to use high-level construct to define cloud infrastructure in code.
We'll run through how to build and configure a CI/CD pipeline to deploy your business's website using AWS, Terraform & Gitlab.
Join us in the journey of learning Terraform. This blog series aims to provides a guidance for essentials to be known while working with Terraform.
Since 2014 when AWS launched AWS Lambda and kickstarted the serverless movement, going serverless has grown exponentially for organizations of all sizes from one-man start-ups to huge listed global enterprises. While there are some challenges to this new architecture, the ways moving to serverless can transform a business often far outweigh these.
In past years, innovation in cloud services has made it quite convenient to host static websites. Since they don't require servers, these sites are usually faster, more secure, and cheaper to host/maintain than their dynamic counterparts; making them perfect for something like your new landing page.
What exactly is AWS Karpenter, how does it work, and how does it differ from CAST AI autoscaling mechanisms? Here's the answer.
Introduction
There are some proven operational and security practices to significantly reduce the occurrence and impact of security breaches in the cloud.
This is true for the most part, but Serverless apps also have a certain property that can make their deployment and maintenance time consuming.
The beginning of the year is the perfect time to clean up and optimize. This also applies to your AWS bill. I've composed practical tips on how to cut costs with small effort.
AWS Amplify allows you to build an application from Figma and import the components into React. With the help of Amplify, the tool creates reusable components
What can go wrong when you don’t keep up with your developer community
Working with AWS can be quite a complex task at times, due to the fact that well composed architectures and solid infrastructures might be troublesome to deploy and maintain in the long run. A main software development goal is to always optimize the development flow by making processes as simple as possible, from the programming language to each and every framework to be used in the project.
GitHub Actions is one of the most powerful tools that you can use if you are storing our code on this service repository. The idea is simple, you can design a complex workflow using automated tasks (called actions) in order to be activated and run when a commit is done in your repository.
What is the most involved attack flow yet? We will break down all of the steps a threat actor took to successfully exfiltrate data out of an AWS account.
TL;DR: AWS Cognito offers robust handling of user Authentication flows, including via Social Providers such as Google and Facebook. Here we describe a Higher Order Component for your ReactJS Web App, and how to configure Cognito.
What are spot instances and how to use them to slash your cloud bill? Here are 6 key steps you need to take before getting a spot instance.
Here’s how we used AWS Cognito’s authorizer to enable users to have developer API access restricted to their user data using Client Id/Secret.
This article will give you a basic understanding of the main AWS features and will be useful for those who are just starting to get acquainted with the platform
As a startup founder of an HR SaaS called HR Partner, I found myself being ‘on call’ virtually 24/7. I had hundreds of customers in countries all over the world, and this resulted in my email and support centre notifications going off around the clock.
In this short article, we’ll be exploring some quick git commands that can help us in digging through our repositories’ history of commits.
A distributed architecture brings in several challenges when it comes to operability and monitoring. Here, one may be dealing with tens if not hundreds of microservices, each of which may or may not have been built by the same team.
In this article, we will take a look at each one of the machine learning tools offered by AWS and understand the type of problems they try to solve for their customers.
Logging and Monitoring… this I tell you, brother. You can't have one without the other.
A comparisons between AWS services - Kinesis, SQS, SNS - that allow you to decouple sending and receiving data (including Python examples).
Welcome to SIMPLE LEARNING AWS Cloud Home Automation, Zero to Hero Series. In the third part, we are going to create a web-endpoint that will trigger remote execution in ESP32 by securely switching ON/OFF the ESP32 inbuilt led from a website hosted in Node-RED. Before starting, let's do a recap, in Part 1, we have connected the ESP32 MCU with AWS and able to publish Messages to IoT Core and in Part 2 we have uploaded another code which interacts with Things Shadow to control ESP32 inbuilt led using MQTT client. The following series split into four parts (refer below) with very simple and clear instructions to provision a home automation system to control house appliances through the web. Everything has been covered from scratch you won't face any difficulty understanding. In case of any clarification, drop me a note on LinkedIn. Feel free to explore them with ease, skip to the one which is relevant to you.
Running any application in production assumes reliable monitoring to be in place and serverless applications are no exception.
Are you looking to transform your software development process? If yes, this blog post provides an introduces to orchestrating the CI-CD pipeline with AWS.
Best Practices of Serverless at Scale
Being event-driven is a key characteristic of a serverless architecture. Often our Lambda functions would publish events to SNS topics or Kinesis streams instead of calling downstream APIs directly.
This article is written by Kareem Ayesh and Yasser El-Sayed.
With Docker, we have three ways to add code to Lambda that isn’t directly part of our Lambda function. What does this mean?
In an ideal world, Docker containers should be ephemeral without any reliance on external storage. In the microservice world, this is achievable when services are connecting to external databases, queues, and other services.
As a freelance cloud architect, I spend my time reviewing and playing with the latest and greatest industry trends. Technologies like Kubernetes, ElasticSearch, and Prometheus fill my home and business infrastructure. After many hours of painful configuration and tweaking, they are now tuned to work exactly the way I want.
Your website will be accessible with http. To access it with https do this three extra steps:
My primary goal is to find a solution that allows my limited time to be focused on providing business solutions instead of getting up to speed with DevOps processes.
This is a guest blog contributed by datasapiens’ Juraj Pohanka, Koen Michiels and Sam Gilbert. This article described how engineers at datasapiens brought down S3 API costs by 200x by implementing Alluxio as a data orchestration layer between S3 and Presto.
How to launch a Node js app behind an Nginx proxy on Amazon EC2 instance in a step by step walkthrough.
Do you know why microservice design is so popular within the development of BI tools? The answer is clear: it helps to develop scalable and flexible solutions. But microservice architecture has a great drawback. Its performance usually requires great improvements.
This is a comprehensive research of the top cloud service providers, as well as some second-tier market players.
In early 2020 the PlaceExchange SRE team was challenged to build support for the company's first gRPC application that would run on Amazon's Elastic Kubernetes Service (EKS). Our usage of third-party geocoding APIs was beginning to exceed the cost of implementing our own service, and so we decided to build one with a gRPC interface. We had already operated EKS for several months with RESTful services and felt confident in our ability to deliver a platform capable of hosting multiple instances of the API for our developers to work concurrently. Given our extensive use of per-developer environments (namespaces) and adherence to the infrastructure as code model, it seemed natural to extend this pattern to support gRPC services.
The use of serverless computing has become a must nowadays, and some of you may already know a thing or two about Amazon Web Services like Lambda Functions, Step Functions, and other services AWS provides. However, if this is the first time you hear about them – fantastic!
To be Always On in uncertain times, mundane must be your new black.
How could serverless help move your business faster and outpace competitors? With serverless, you don't need to worry about anything except your code.
Learn the common pitfalls of moving to the cloud and how you can avoid them to truly benefit from the cloud’s elasticity.
Nowadays, the public cloud has become the tech solution of choice for many companies, including Amazon, Netflix, and Facebook. Why? The reason is simple - due to flexible nature, public cloud solutions allow businesses to save money on unused resources. Moreover, cloud hosting is a perfect way to save time on managing and maintaining the data centers in which your data is stored since these are the responsibilities of your cloud service provider.
The Basics
What are the roles and responsibilities of DevOps engineer.
Before we dive into the fun part of getting keys shared amongst cloud providers, there are a variety of tools required to get this tutorial working.
AWS EKS + Terraform + Cloudskiff do the job
In this article you'll find out how the AWS Well-Architected Framework came to be, how it evolved and how it should be implemented in 2021.
Are you looking to make a jump in your technical career? Want to get trained or certified on AWS, Azure, Google Cloud Platform, DevOps, Kubernetes, Python, or another in-demand skill?
A strong and mature trend in modern cloud software development is to implement components that are:
I have been working with a US client to build a first-of-its-kind app for managing medical consents. It falls under HIPAA compliance and it’s paramount that we do not allow unauthorized access to user data.
Chris Hickman and Jon Christensen of Kelsus and Rich Staats of Secret Stache continue their discussion on growing high-performing remote and international engineering teams.
The AWS Lambda service allows us to easily deploy and run our own code, without worrying too much about the underlying infrastructure (when compared to non-serverless technologies). It essentially scales infinitely (with great power comes great responsibility), and can be connected with a bunch of other services, like API Gateway, S3, AppSync, DynamoDB, etc.
What's this all about eh?
Amy Tom talks to Pavel Denisjuk about AWS Lambda and serverless applications. Pavel is the Co-Founder and CTO at Webiny.
What if you could just migrate between cloud providers in seconds while achieving the best cost and performance combination? CAST AI connects them
AWS customers build microservices on 3 common patterns: API-driven, event-driven, & data streaming. The blog covers the common characterics of microservices.
13 different things that you can learn today if you want to be a tech entrepreneur or a better engineer to make an application and ship it to your customers!
A while ago, we covered the invocation (trigger) methods supported by Lambda and the integrations available with the AWS catalog.
Introduction:
In the last 6 months, we put 100% of our focus on addressing this feedback and getting Webiny to the next level. Today we present the Webiny v5 release.
This is part of a series of articles discussing strategies to implement serverless architectural design patterns. We continue to follow this literature review. Although we use AWS serverless services to illustrate concepts, they can be applied in different cloud providers.
In this tutorial, we'll get to learn how to use the AWS S3. First, learn what is S3, the core parts of S3 that are the Buckets, Access Point, and Objects.
Game changers emerge when you are deep in the trenches laying the foundation.
All you need to know to get started about Terraform Syntax.
Managing applications at scale often comes up as one of the biggest concerns for businesses; How can it work smoothly? How do we monitor so many resources? How do we maintain best practices with constantly evolving infrastructure? In this article, we run through the best approach for operational excellence looking at serverless monitoring strategy, serverless alerting strategy, and security and compliance best practices.
Hey there. You just created your first AWS account, and you can't wait to dive into all the exciting services and technologies that AWS has to offer you to start to build the next big thing. But, wait for a second... are you going to log-in with your root account credentials? Or it's better to generate a new user? Or maybe use a role?
Amazon Web Service (AWS) is an all-inclusive cloud computing marketplace by Amazon. It serves as an on-demand cloud computing platform that offers multifarious cloud computing models and deployment tools.
Deploy Django on Kubernetes in a few clicks without even Dockerizing your application.
How to choose the right cloud provider for your business? Read this updated 2021 pricing comparison for AWS vs. Azure vs. Google Cloud.
As an AWS Community Builder, I truly enjoyed attending AWS' re:Invent 2020 conference this year, diving into cloud technology, devops, databases & innovation.
There is often the need to check whether your production system is working as expected. Playwright is a great way to test if everything is going to plan.
With around 50% developers CKA or CKAD certified, we share our experiences, study material, mistakes to avoid, FAQ, etc. about the CKA and CKAD certification.
Authentication is a way for applications to confirm user identity before granting permission or entry to a website.
Learn how an infrastructural Customer Data Platform can help you overcome common machine learning challenges with this use case tutorial.
This is the first time we've used React to broadcast live streaming our brain data
Responding to the Serverless Revolution
In this article, we list the seven reasons why and how serverless computing enables useful engineering practices.
Amazon ECS Anywhere gives customers the ability to run Amazon ECS on any infrastructure using the same cloud-based, fully managed, highly scalable container orchestration service and control plane they use in AWS today.