Thumbscrews allow for quick and easy (without any additional tools) fastening of case side panels, power supplies and other parts with coarse threads - so you don't need to look for a screwdriver, but can finally install and remove all components by hand.
Furthermore, the screws are robust, functional and visually appealing.