minitest-bisect version 1.7.0 has been released!

Published 2023-07-06 @ 13:46

Hunting down random test failures can be very very difficult, sometimes impossible, but minitest-bisect makes it easy.

minitest-bisect helps you isolate and debug random test failures.

If your tests only fail randomly, you can reproduce the error consistently by using --seed <num>, but what then? How do you figure out which combination of tests out of hundreds are responsible for the failure? You know which test is failing, but what others are causing it to fail or were helping it succeed in a different order? That’s what minitest-bisect does best.

Changes:

1.7.0 / 2023-07-06

• 1 major enhancement:

  • Extend bisect_methods to do “inverse” run (eg false positives) via -n=/RE/ argument.

• 4 minor enhancements:

  • Added example_inverse.rb
  • Collapsed examples from directories to individual files.
  • Refactor: push command generation from #run down to #bisect_methods.
  • build_files_cmd no longer calls reset (zero effect change).

• 4 bug fixes:

  • 100% documentation coverage.
  • Fix server process ID to be a string to match rest of args.
  • Fix shebang cmd on bin/minitest_bisect.
  • Print known bad methods with found culprit methods in final run.
• home: https://github.com/seattlerb/minitest-bisect
• rdoc: http://docs.seattlerb.org/minitest-bisect