No not all bacteria have capsules. However they do have cell membranes to protect them.

Also not all bacteria have flagella or glucoslim Stiftung Warentest pili.