Remove primary flags from hearing aid also.

Bug: 124277691
Bug: 124014853
Test: manual with BluetoothAudioHAL enabled / disabled
Change-Id: Ibc86687a6a6c2f0767a213ccd408e7bb5de98985
Signed-off-by: Dhina17 <dhinalogu@gmail.com>