Fix race on the string interning #10662

Job	Run time
lint	4m 19s
CodeQL	6m 52s
test	38m 45s
build	4m 1s
integration-configs-db	2m 44s
integration (requires_docker)	7m 19s
integration (integration_alertmanager)	4m 24s
integration (integration_backward_compatibility)	10m 50s
integration (integration_memberlist)	7m 31s
integration (integration_querier)	15m 5s
integration (integration_ruler)	5m 43s
integration (integration_query_fuzz)	4m 42s
deploy	0s
deploy_website	0s
	1h 52m 15s

Provide feedback