If you're getting inconsistent behavior when using the CC3000e with your mobile device in Bluetooth mode, the problem may be with your client software and how it handles Bluetooth connections, and not with the speakerphone.
Please refer to the support forums for your client software (ex. Skype, Jabber, Lync) for more information.