Bricks Query Filters read filter state from URL parameters, either the default brx_FILTERID=value format or a custom filter nice name configured on the filter element.
Custom WordPress rewrite vars like tax and color are not automatically treated as Bricks filter state just because WordPress resolves the archive URL. The archive/template route can still load correctly, but the Bricks filter controls need matching Bricks URL parameters/nice names, or custom code needs to translate those rewrite vars into the query/filter state you want.
So the practical options are:
use the normal Bricks filter URL parameters/nice names, or
add custom code that reads the rewrite vars and applies the matching taxonomy/meta query to the Bricks query.