The auto-filter provides a feature of removing ‘All‘options by simply clicking the down arrow in the auto-filter heading.

You can scroll down to ‘Customize‘ in the dropdown and then uncheck the ‘Show ―All Value‘ attribute. It can be activated by checking the field again.