Folders (directories) are the primary organisational unit in file systems, allowing users to group related files hierarchically. Folders can contain files and sub-folders, creating a tree-like directory structure for efficient file management.