I have a many testcases in a common_test and while the total elapsed time in the report is a fairly friendly number (79 seconds), yet the whole test suite runs for more than 20 minutes, which is not only unfriendly, but kind of kept me complacent about optimizing the test run. After all, if a specific testcase runs for (according to the report) 0.090286 second, then there’s not much point in optimizing it - but when I looked at the report, the same testcase was “Started at 2025-04-02 14:10:59” and “Ended at 2025-04-02 14:11:05”, which is off by a magnitude of 2 and definitely worths optimizing.
What is going on here, why is the reported elapsed time so tiny compared to the actual time it took to run the test? Is the init_per_testcase and end_per_testcase not counted for this case? I’m using OTP 26.2.5.5 and the same thing happens on Linux and OS X. I’m running the tests using rebar3 version 3.22.1 with the equivalent of rebar3 --name ct --sys_config=config/sys.config --readable true --cover --verbose true