Establishing connection from single IP to two routers

Is it possible to run aiobfd from single server and establish BFD with two routers without introducing second IP to the server?

I can't have two established BFD sessions as I'm having Dropping packet from x as it doesn't match any configured remote.