Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Long running tests #139

Open
phadej opened this issue Mar 26, 2024 · 0 comments
Open

Long running tests #139

phadej opened this issue Mar 26, 2024 · 0 comments

Comments

@phadej
Copy link
Collaborator

phadej commented Mar 26, 2024

There are too many tests which take too much time, running all tests locally is becoming "let's me brew some tea and forget what I was working on"

lsm-tree
  Test.Database.LSMTree.Generators
    WriteBuffer
      Shrinking satisfies invariant:                              TIMEOUT (6.01s)
        Timed out after 6s
        Use -p '/WriteBuffer.Shrinking satisfies invariant/' to rerun this test only.
    LogicalPageSummaries
      Shrinking satisfies invariant:                              TIMEOUT (6.04s)
        Timed out after 6s
        Use -p '/LogicalPageSummaries.Shrinking satisfies invariant/' to rerun this test only.
  Test.Database.LSMTree.Internal.Integration
    With multi-page values
      prop_inMemRunLookupAndConstruction:                         TIMEOUT (6.04s)
        Timed out after 6s
        Use -p '/With multi-page values.prop_inMemRunLookupAndConstruction/' to rerun this test only.
    Without multi-page values
      prop_inMemRunLookupAndConstruction:                         TIMEOUT (6.03s)
        Timed out after 6s
        Use -p '/Without multi-page values.prop_inMemRunLookupAndConstruction/' to rerun this test only.
  Database.LSMTree.Internal.Run.BloomFilter
    No false negatives
      mkBloomEasy:                                                TIMEOUT (6.04s)
        Timed out after 6s
        Use -p '/No false negatives.mkBloomEasy/' to rerun this test only.
      mkBloomST:                                                  TIMEOUT (6.04s)
        Timed out after 6s
        Use -p '$0=="lsm-tree.Database.LSMTree.Internal.Run.BloomFilter.No false negatives.mkBloomST"' to rerun this test only.
      mkBloomST_Monkey:                                           TIMEOUT (6.04s)
        Timed out after 6s
        Use -p '/No false negatives.mkBloomST_Monkey/' to rerun this test only.
    Verify FPR
      mkBloomEasy:                                                TIMEOUT (6.01s)
        Timed out after 6s
        Use -p '/Verify FPR.mkBloomEasy/' to rerun this test only.
      mkBloomST:                                                  TIMEOUT (6.01s)
        Timed out after 6s
        Use -p '$0=="lsm-tree.Database.LSMTree.Internal.Run.BloomFilter.Verify FPR.mkBloomST"' to rerun this test only.
      mkBloomST_Monkey:                                           TIMEOUT (6.01s)
        Timed out after 6s
        Use -p '/Verify FPR.mkBloomST_Monkey/' to rerun this test only.
  Database.LSMTree.Internal.Run.Construction
    PageAcc
      prop_paddedToDiskPageSize with trivially partitioned pages: TIMEOUT (6.00s)
        Timed out after 6s
        Use -p '/prop_paddedToDiskPageSize with trivially partitioned pages/' to rerun this test only.
      prop_paddedToDiskPageSize with partitioned pages:           TIMEOUT (6.00s)
        Timed out after 6s
        Use -p '/prop_paddedToDiskPageSize with partitioned pages/' to rerun this test only.
      prop_pageBuilderMatchesPrototype:                           TIMEOUT (6.00s)
        Timed out after 6s
        Use -p '/prop_pageBuilderMatchesPrototype/' to rerun this test only.
  Test.Database.LSMTree.Internal.Run.Index.Compact
    (De)serialisation
      test Chunks generator
        Shrinking satisfies invariant:                            TIMEOUT (6.00s)
          Timed out after 6s
          Use -p '/test Chunks generator.Shrinking satisfies invariant/' to rerun this test only.
  Test.Database.LSMTree.Internal.Serialise
    SerialisedKey Eq and Ord laws
      Eq transitivity:                                            TIMEOUT (6.00s)
        Timed out after 6s
        Use -p '/Eq transitivity/' to rerun this test only.

15 out of 171 tests failed (14.41s)

It's fine to have CI run a bit longer, but I'd prefer locally for individual test cases to run promptly.

Note how the rest of the test-suite runs fast, on my multicore machine in 14seconds. Having even one test-case which takes 20 seconds makes everything slow.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant