All about File System and Pendrive formatting

For long time, I have been delaying the proper understanding about all types of filesystems we see while formatting disk-drives/pendrives. But today I decided to drill down, investigate and better document it one place taking some 1/2 an hour. So, here it is.

How to format disk-drive/pen-drive in windows/linux

It's almost same in both OS, right click on the drive -> Format->Start->Ok
But in between we come across 4 options for Filetypes . In Windows-XP/windows7 (FAT, FAT32, NTFS and exFAT) and in Linux(FAT, ext2, ext4 and encrypted FAT). We will not see FAT and FAT32 if our drive memory is > 32 GB. So what is the difference between these file systems and which one should we choose? Let’s look at the advantages of each.

Various Filetypes

Advantages of NTFS  over FAT & FAT32:

• read/write files > 4 GB and up to maximum partition size. (So, if your jump drive stores oftenly HD movies or big setup file > 4GB. NTFS is best suited.)
• In NTFS partition memory created are > 32GB.
• Better file compression filesystem used, hence better space management.
• better space management = less fragmentation.
• allows more clusters on larger drives = less wasted space.
• add user permissions to individual files and folders (Windows Professional).
• on-the-fly file encryption using EFS (Encrypting File System in Windows XP and 7).

Advantages of FAT & FAT32 over NTFS:

• compatible with virtually all operating systems.
• takes up less space on USB drive.
• less disk writing operations = faster and less memory usage.

exFAT Compared To FAT & FAT32:

• read/write files larger than 4 GB.
• create drive partitions larger than 32 GB.
• better space management = less fragmentation.

Because of the above reasons FAT & FAT32 are best suited for drives < 32 GB and in the scenerios where you oftenly stores files of size > 2 or 4 GB, respectively. In other words, any regular sized hard drive (32 GB +) should be formatted with NTFS.
However, due to the way NTFS works it is not recommended for flash drives, even when they are >  32 GB. This is where exFAT comes in. It unites the essential advantages of FAT (small, fast) and NTFS (large file size supported) in a way that is optimal for flash/jump/thumb drives. Though the FAT & FAT32 are the only file systems that are cross-platform compatible. But, NTFS is also supported by Linux, but it requires a hack or third party application to work on the Mac. exFAT on the other hand is supported in Snow Leopard, but drivers are required for Linux.
If for compatibility or speed reasons you want to go with FAT or FAT32, always go with FAT32, unless you are dealing with a device of 2 GB or smaller.

Which Allocation Unit Size Works Best?

Hard/Pen drives consists internally clusters and the allocation unit size tells the memory size of a single cluster. The file system records the state/content of each cluster in File Allocation Table, i.e. whether it is free or occupied. Once a file is written to a cluster, the cluster is occupied, regardless of whether or not there is still space (even if is only partially filled and tail pointer is not the last pointer)
Hence, it's correct to say that larger clusters size leads to more wasted or left-out space. While smaller clusters makes disk slow in copying/loading with content but less space wastages. Also small clusters leads to glitiches in playing HD videos because of slower transfer rate.
So the optimal allocation unit size depends on what exactly you want to store in your drive. If you want to store large files on that drive, a large cluster size is better as the drive will be faster. If, however, you want to store small files or run programs off your flash drive, a smaller cluster size will help preserve space.
Conclusion: large drive and/or large files = large allocation unit size.
Hence for 1GB USB/pen drive, select 512 bytes (FAT32) or 32 KB (FAT). But, on a 1 TB external hard drive select 64 KB (NTFS). For optimum speedy transfer. Because if memory is less, the space optimisation takes over transfer rate.

So, what is Volume Label?

It's basically name of your drive that's visible to everyone, whereever it mounts/connects. But based on the filesystem you use, Label has some differences regarding permissible length of label. allowed special character etc.

Volume Labels in NTFS:

• maximum of 32 characters.
• no tabs.
• will be displayed with uppercase and lowercase, as entered.

Volume Labels in FAT:

• maximum of 11 characters.
• none of the following characters: * ? . , ; : / \ | + = < > [ ]
• no tabs.
• will be displayed as all uppercase.

Spaces are allowed regardless of the file system.
It's always suggestible to keep your contact no. as your Volume Label (in case it's missed or lost, somebody can contact you.)

[Please like/share/comment if you find it useful !]