Using LVM to Serve Old Laptop as a Cloud Storage Engine Service at home with all External Hard Drive

Using LVM to Serve Old Laptop as a Cloud Storage Engine Service at home with all External Hard Drives.I have a very old experimental Toshiba laptop with a 640GB (596 GB usable) HDD and an optical drive. And lately, my brother was curious in converting the laptop storage into a Storage Engine for all of us at home. This will allow us to share files easily among us.We installed OS in a 120 GB SSD and moved this HDD to a HDD case. We have another external Seagate HDD with 1 TB. And we wanted to have a single storage partition where we could save files without any thoughts of storing at partition 1 or partition 2.We were able to achieve a whooping 1.6TB partition using LVM. We can even extend it dynamically to more size with more Hard Disks attached. This post is about how we achieve that. By the end of the post, it will make sure that you will able to achieve similar results. :) At the end, I will point to some open source softwares which we used to host it as a storage service at home.

Please note that system administration understanding is extremely important. If you are not an experienced System Engineer, please do not try this.

Illustrative figure, on what we will be achieving.Before I jump into the implementation, would like to put in and share some basic disks concept.

LVM — Logical Volume Management.

It is a storage device management technology which gives us the power to pool and abstract the physical layout of the component individual devices for easier and flexible administration.We can use to accumulate multiple storage system into a single groups and get a combined space. It is much more flexible than the traditional systems. Volumes can be resized dynamically.

Physical Volumes
These are regular storage devices. They provide space to store the logical volumes. They are used by the LVM as raw building material as a higher level of abstraction.Logical Volumes
It corresponds to partitions holding a file system. They can span across multiple disks, and do not have to be physically contiguous. They are the primary components that users and applications interact with.Volume Groups
It is a named collection of physical and logical volumes. They abstract the characteristics of the underlying devices and functions as a unified logical device with combined storage capacity.So, now we understand the basics. Lets implement this.

We need to have LVM Physical Device. So, assuming that the disks partitions are deleted and raw disks can be seen when you fire, fdisk -l . We will follow the below steps to create scalable volumes.

Create LVM Physical Volume

The output tells that there are 2 disks available. We will create their physical volumes.

Create a LVM Volume Group

Once the physical volumes are created, they can grouped using vgcreateas shown below:

Create a LVM Logical Volume Partition

Finally the logical volume can be created as below:-L is to specify the size of the Logical Volume. Multiple Logical Volumes with smaller size can be created.-n is to specify the name of the logical volumelast parameter is for Volume Group Name from where logical volume will be createdYou can query sudo lvsto see the logical volume partitions

Its time create a file system and mount it.

We are now ready to create a file system in the logical volume and mount it for use.

Extending an existing volume with a new external hard disk space

In future, if more disks are to be added, then the logical volume can be extended in similar way. A quick set of commands are here:Pretty Simple. Huh?

So, how does it really look like?

My hulkstorageis whooping 2TB and I do not have to really bother about pushing files to any specific harddisk anymore. These things can be done from from a folder insideHost this partition over network so that you can mount that in you laptops/development zones.a self hosted storage engine can be served to share files across all people at home. :)

Storage Engine

Hosting this local storage for home is pretty simple, actually. I started inside with docker. Running it is fairly simple.After the server starts, the local server is accessible at port 8989.References:This keeps motivating to contribute more. Feel free to follow me, .