summary-always updates benchmarks twice, fails with gh-pages

[Kha]

If summary-always is true, we call first writeBenchmark, then writeSummary.

github-action-benchmark/src/index.ts

Lines 13 to 17 in 060e110

	await writeBenchmark(bench, config);
	if (config.summaryAlways) {
	await writeSummary(bench, config);
	}

But both of these call writeBenchmarkToGitHubPages by default, so we will create the commit twice. In fact we don't even get that far because the second invocation's git fetch will fail to update the gh-pages branch because of the new commit available only locally when auto-push is false.

Example run: https://github.com/Kha/nale/actions/runs/4375198974/jobs/7656891394

[embano1]

Another issue is with the rendering, see: https://github.com/timbray/quamina/actions/runs/4393672754 (example) where the numbers are markdown formatted but not properly rendered.

[Kha]

@embano1 You should probably open a separate issue for that

[embano1]

Yeah, was too lazy as yours was top of list when I just checked...sorry for polluting your issue. #159

[ClementWalter]

has anyone started to work on this?

[ktrz]

I believe this was fixed by #214
Will verify that tomorrow

[ktrz]

Verified!
It is fixed on v1.19.0