Some audio hals do not implement get/set audio_port, even though the
device hal version should have it. Function not implemented gets mapped
to invalid operation, so just ignore invalid operation failures.

Change-Id: I1ceaa7aa4467d48f8e492ea6c7de87ed0a9570fa
(cherry picked from commit cc082e030b5eac6f53fa83d2943fc49b09c513a1)