Fix race on the string interning #10659

Job	Run time
lint	2m 44s
test	43m 10s
build	4m 4s
CodeQL	7m 29s
integration-configs-db	2m 53s
integration (requires_docker)	7m 18s
integration (integration_alertmanager)	4m 4s
integration (integration_backward_compatibility)	10m 24s
integration (integration_memberlist)	8m 25s
integration (integration_querier)	15m 11s
integration (integration_ruler)	5m 43s
integration (integration_query_fuzz)	4m 38s
deploy_website	0s
deploy	0s
	1h 56m 3s

Provide feedback