Can I write my own code for the DSP within the BTM511?

No, not generally. The DSP in the BTM511 is used for certain audio processing algorithms supplied by CSR such as Clear Voice Capture (CVC) and Music Manager. If you have a specific DSP requirement please contact support.