Yes, everything in the "Fuel file structure" is lowercase.
The module directory name is the lowercase version of the namespace. That paragraph in the docs needs to be better formulated. If your module has the namespace "Admin", the folder is "admin".