Replication filters configured in my.cnf are ignored if slave reset and reconfigured

This MariaDB instance is using multi source replication and has 4 masters.
We have separate replication filters on each of the master connections, configured in my.cnf.
When we issue a RESET SLAVE ALL for one of the connections, where replication filters are in effect, and then we create the connection again with CHANGE MASTER 'connection name' TO.... , the replication filters are now ignored and we need to restart the server to bring them back in effect.