feat: reduce overhead to remove callbacks by using sets to store callbacks

[bdraco]

No description provided.

[codecov]

Codecov Report

Attention: 16 lines in your changes are missing coverage. Please review.

Comparison is base (c549b1c) 49.53% compared to head (469a8df) 49.84%.
Report is 1 commits behind head on main.

Files	Patch %	Lines
src/habluetooth/manager.py	27.27%	16 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #27      +/-   ##
==========================================
+ Coverage   49.53%   49.84%   +0.31%     
==========================================
  Files          12       12              
  Lines         959      959              
  Branches      164      164              
==========================================
+ Hits          475      478       +3     
+ Misses        467      464       -3     
  Partials       17       17              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.