Tableau takes time to place a filter in context. When a filter is set as context one, the software creates a temporary table for that particular context filter. This table will reload each time and consists of all values that are not filtered by either Context or Custom SQL filter.