Skip to content

Improve Strict Equality To Account For Named Closures #852

Closed

Description

@rmorshea

Current Situation

Right now, strictly_equal does not understand how to check if named closures are the same. Here's an example of such a closure:

def add(first):
    def inner(second):
        return first + second
    return inner

incr = add(1)
assert incr(2) == 3

Here, while add(1) is not add(1) both produce the same behavior, IDOM won't recognize that they're the same.

Proposed Actions

It turns out that we can fairly reliable look at a function's __qualname__, __closure__, and __defaults__ to determine whether it's the same function. The logic to check this would look like:

def function_is_strictly_equal(f1, f2):
    return (
        f1.__qualname__ == f2.__qualname__
        and "<lamba>" not in f1.__qualname__
        and all(strictly_equal(c1, c2) for c1, c2 in zip(f1.__closure__, f2.__closure__))
        and all(strictly_equal(c1, c2) for c1, c2 in zip(f1.__defaults__, f2.__defaults__))
    )

The catch here is that technically, a user could do the following:

def make_closures(x):
    def do_something(y): ...
    do_something_else = do_something

    def do_something(z): ...

    return do_something, do_something_else

f1, f2 = make_closures()
assert not function_is_strictly_equal(f1, f2)  # will fail

This will fail because both functions, while they may implement different logic, have the same qualname. This is basically the same reason that we cannot compare lambdas. Since they all have the same name.

There may be ways to work around this. For example, f1 and f1 were defined on different lines. You could check this using __code__.co_firstlineno.

Activity

  1. Archmonger commented on Dec 8, 2022

    @Archmonger
    Contributor

    Alternatively, for function defs we can check if their code is equal using string equality

  2. rmorshea commented on Dec 8, 2022

    @rmorshea
    CollaboratorAuthor

    I think we could probably skip the qualname check and allow lambda comparisons by, as you say, just checking byte code equivalence.

  3. Archmonger commented on Dec 8, 2022

    @Archmonger
    Contributor

    I would think the same applies to named closures as well. This would make the implementation for all function types the same.

    But to be bullet proof, would need to also check if the __file__ and lineno are also equivalent, since technically the same function definition can be copy pasted with potentially different decorators.

  4. rmorshea commented on Dec 8, 2022

    @rmorshea
    CollaboratorAuthor

    True. Though technically, all we really care about is whether, given the same inputs, the output is the same (assuming the function is pure). The file name then, only matters in so far as there might be different globals that the function is referencing.

  5. added
    priority-2-moderateShould be resolved on a reasonable timeline.
    type-revisionAbout a change in functionality or behavior
    and removed on Dec 30, 2022
  6. added this to the milestone on Dec 30, 2022
  7. modified the milestones: , on Jan 29, 2023
  8. removed this from the milestone on Feb 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    priority-2-moderateShould be resolved on a reasonable timeline.type-revisionAbout a change in functionality or behavior

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions