By default, a filter applied in one table does not affect a rollup in another table. A rollup field will roll up data from all records in the target linked table, regardless of whether or not those records have been filtered in some way.
If you wish to use a rollup field, but have it only aggregate values from certain linked records in each cell, you can use a conditional rollup.