Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make class Message unhashable #262

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

ttanay
Copy link

@ttanay ttanay commented Mar 3, 2019

The class Message defines a __eq__ method, but, does not define a
__hash__ method. This makes it unhashable in Python 3. But, it is
hashable in Python 2.

Issue: #261

The class Message defines a __eq__ method, but, does not define a
__hash__ method. This makes it unhashable in Python 3. But, it is
hashable in Python 2.
@coveralls
Copy link

coveralls commented Mar 3, 2019

Coverage Status

Coverage increased (+0.0008%) to 91.701% when pulling ea930a3 on ttanay:hashable-Message into 1211a8d on google:master.

@@ -758,6 +758,8 @@ class Order(Message):

"""

__hash__ = object.__hash__
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think hash should be consistent with implementation of __eq__, so that equal messages have equal hashes.

@ttanay
Copy link
Author

ttanay commented Mar 11, 2019

Hi @tvalentyn
Thanks for reviewing.

I've made the change. PTAL.

@@ -1060,6 +1058,10 @@ def __ne__(self, other):
"""
return not self.__eq__(other)

def __hash__(self):
"""Hash by __tags"""
return hash(self.__tags)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking closer at this, self.__tags is a dictionary, which is unhashable. Looks like we have two options:

  • Keep the class unhashable.
  • Hash over contents of __tags or it's subset, if we can consider Message objects immutable, which we probably cannot.

Is there a reason to believe Message objects are immutable? If not, I think making them unhashable makes most sense.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

self.__tags is a dict! I missed that, sorry 🤦‍♂️

I think Message should be mutable. Therefore, it should be unhashable.
This class is hashable in Python 2. Making it unhashable would break compatibility in Python 3. But, that is also an option.

If we make it unhashable, we should add __hash__ = None to the class to keep the behaviour consistent in Python 2 as well.
OR
If we want to keep behaviour consistent in Python 3, while not breaking compatibility, we should add __hash__ = object.__hash__ to the class.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are good reasons why in Python 3 __hash__ is not implemented by default, in this light, I think the better way to keep compatibility would be to set __hash__ = None. This may require cascading changes for Py2 users of apitools. But same/similar changes would still be needed in downstream codebase to make relevant code Python3-compatible, so that may encourage users of apitools to fix their code sooner than later.

Copy link
Author

@ttanay ttanay Mar 11, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree! I'll make that change :)

@ttanay ttanay changed the title Add __hash__ to class Message to make it hashable in Python 3 Make class Message unhashable Mar 11, 2019
@ttanay
Copy link
Author

ttanay commented Mar 11, 2019

@tvalentyn Made the change 🚀
PTAL :)

@tvalentyn
Copy link
Contributor

Looks good to me.

@tvalentyn
Copy link
Contributor

Looping in @houglum who is a committer in this repo - PTAL, thank you.

@houglum
Copy link
Contributor

houglum commented Mar 12, 2019

Sorry for the delay, didn't see this until late.

I'll pull this change into our submodule of apitools in gsutil tomorrow, then run all the integration tests to make sure we weren't relying on this. Please do @ me if I forget :)

@tvalentyn
Copy link
Contributor

Thank you @houglum . No worries :)

@houglum houglum self-requested a review March 13, 2019 01:14
Copy link
Contributor

@houglum houglum left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All the gsutil integration tests still pass after pulling in these changes. And the changes look sane :) LGTM.

@ttanay
Copy link
Author

ttanay commented Mar 25, 2019

Can this be merged?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants