You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If I have something like @b rand(1000) sort!, the first eval is much slower than subsequent evals within a given sample, which violates benchmarking assumptions and results in weird results. For example, @b rand(1000) sort! reports a super fast runtime while @b rand(100_000) sort! is realistic.
I guess most of these cases can be detected by systematically running a second evaluation after the first one? Of course it's debatable whether the benefit outweighs the cost
If I have something like
@b rand(1000) sort!
, the first eval is much slower than subsequent evals within a given sample, which violates benchmarking assumptions and results in weird results. For example,@b rand(1000) sort!
reports a super fast runtime while@b rand(100_000) sort!
is realistic.See: compintell/Mooncake.jl#140
The text was updated successfully, but these errors were encountered: