Are there any limitations when using I2S on the BTM511?

Yes, the external I2S circuit should be slave and BTM511 should be I2S master. In addition, the external I2S circuit should not require a high frequency synchronization clock (12 MHz or 24 MHz). The BTM511 is not capable of creating this.