Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix data race in babylon_e2e_test.go #519

Open
Tracked by #478
bap2pecs opened this issue Jul 16, 2024 · 0 comments
Open
Tracked by #478

fix data race in babylon_e2e_test.go #519

bap2pecs opened this issue Jul 16, 2024 · 0 comments

Comments

@bap2pecs
Copy link
Contributor

bap2pecs commented Jul 16, 2024 •
edited
Loading

data race message 
$ make test-e2e-babylon                                 [23:56:41]
Killed processes 28806 
rm -rf ~/.babylond ~/.wasmd ~/.bcd
cd tools; \
        go install -trimpath github.com/babylonchain/babylon/cmd/babylond
?       github.com/babylonchain/finality-provider/itest [no test files]
# github.com/babylonchain/finality-provider/itest/babylon.test
ld: warning: '/private/var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/go-link-4073787328/000036.o' has malformed LC_DYSYMTAB, expected 98 undefined symbols to start at index 1626, found 95 undefined symbols starting at index 1626
?       github.com/babylonchain/finality-provider/itest/cosmwasm/wasmd  [no test files]
?       github.com/babylonchain/finality-provider/itest/test-manager    [no test files]
=== RUN   TestFinalityProviderLifeCycle
    babylon_node_handler.go:148: babylon log file: /var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/zBabylonTest1627348500/babylon.log
Starting babylond with command:  /Users/zidong/go/bin/babylond start --home=/var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/zBabylonTest1627348500/node0/babylond --log_level=trace --trace
service injective.evm.v1beta1.Msg does not have cosmos.msg.v1.service proto annotation
service injective.evm.v1beta1.Msg does not have cosmos.msg.v1.service proto annotation
    babylon_test_manager.go:113: Babylon node is started
    babylon_test_manager.go:169: The test manager is running with 1 finality-provider(s)
    utils.go:100: Public randomness for fp c282ce458147902ca9cc8ad9e9d482ae90a308a4accd0ec745f54e7186ee7225 is successfully committed at height 100
    base_test_manager.go:174: successfully submitted a BTC delegation
    base_test_manager.go:207: delegations are pending
    base_test_manager.go:227: delegations are active
    babylon_e2e_test.go:50: the block at height 8 is finalized
--- PASS: TestFinalityProviderLifeCycle (58.66s)
=== RUN   TestDoubleSigning
    babylon_node_handler.go:148: babylon log file: /var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/zBabylonTest837602325/babylon.log
Starting babylond with command:  /Users/zidong/go/bin/babylond start --home=/var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/zBabylonTest837602325/node0/babylond --log_level=trace --trace
service injective.evm.v1beta1.Msg does not have cosmos.msg.v1.service proto annotation
service injective.evm.v1beta1.Msg does not have cosmos.msg.v1.service proto annotation
    babylon_test_manager.go:113: Babylon node is started
    babylon_test_manager.go:169: The test manager is running with 1 finality-provider(s)
    utils.go:100: Public randomness for fp be9b96af43180cb87e1c06bae8b540c92d3c3a0df642f5105502825cbb2d9bda is successfully committed at height 100
    base_test_manager.go:174: successfully submitted a BTC delegation
    base_test_manager.go:207: delegations are pending
    base_test_manager.go:227: delegations are active
    babylon_e2e_test.go:82: the block at height 8 is finalized
    babylon_test_manager.go:254: the block is finalized at 8
    babylon_e2e_test.go:99: the equivocation attack is successful
    babylon_test_manager.go:265: the finality-provider instance be9b96af43180cb87e1c06bae8b540c92d3c3a0df642f5105502825cbb2d9bda is shutdown
--- PASS: TestDoubleSigning (89.34s)
=== RUN   TestMultipleFinalityProviders
    babylon_node_handler.go:148: babylon log file: /var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/zBabylonTest559497796/babylon.log
Starting babylond with command:  /Users/zidong/go/bin/babylond start --home=/var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/zBabylonTest559497796/node0/babylond --log_level=trace --trace
service injective.evm.v1beta1.Msg does not have cosmos.msg.v1.service proto annotation
service injective.evm.v1beta1.Msg does not have cosmos.msg.v1.service proto annotation
    babylon_test_manager.go:113: Babylon node is started
    babylon_test_manager.go:169: The test manager is running with 3 finality-provider(s)
==================
WARNING: DATA RACE
Read at 0x00c002741260 by goroutine 2010:
  runtime.mapaccess1_faststr()
      /opt/homebrew/Cellar/go/1.22.4/libexec/src/runtime/map_faststr.go:13 +0x40c
  cosmossdk.io/x/tx/signing.(*Context).getGetSignersFn()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:337 +0xd4
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:352 +0x54
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Previous write at 0x00c002741260 by goroutine 2001:
  runtime.mapaccess2_faststr()
      /opt/homebrew/Cellar/go/1.22.4/libexec/src/runtime/map_faststr.go:108 +0x42c
  cosmossdk.io/x/tx/signing.(*Context).getGetSignersFn()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:344 +0x144
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:352 +0x54
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Goroutine 2010 (running) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40

Goroutine 2001 (finished) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40
==================
==================
WARNING: DATA RACE
Read at 0x00c001b58ff8 by goroutine 2010:
  cosmossdk.io/x/tx/signing.(*Context).getGetSignersFn()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:337 +0xe0
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:352 +0x54
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Previous write at 0x00c001b58ff8 by goroutine 2001:
  cosmossdk.io/x/tx/signing.(*Context).getGetSignersFn()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:344 +0x150
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:352 +0x54
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Goroutine 2010 (running) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40

Goroutine 2001 (finished) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40
==================
==================
WARNING: DATA RACE
Read at 0x00c0029601a0 by goroutine 2010:
  cosmossdk.io/x/tx/signing.(*Context).makeGetSignersFunc.func5()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:310 +0x94
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:357 +0x98
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Previous write at 0x00c0029601a0 by goroutine 2001:
  cosmossdk.io/x/tx/signing.(*Context).makeGetSignersFunc()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:212 +0x5c4
  cosmossdk.io/x/tx/signing.(*Context).getGetSignersFn()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:340 +0x100
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:352 +0x54
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Goroutine 2010 (running) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40

Goroutine 2001 (finished) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40
==================
==================
WARNING: DATA RACE
Write at 0x00c000ca5990 by goroutine 2010:
  cosmossdk.io/x/tx/signing.(*Context).makeGetSignersFunc.func5()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:311 +0xdc
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:357 +0x98
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Previous write at 0x00c000ca5990 by goroutine 2001:
  cosmossdk.io/x/tx/signing.(*Context).makeGetSignersFunc()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:178 +0x64
  cosmossdk.io/x/tx/signing.(*Context).getGetSignersFn()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:340 +0x100
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:352 +0x54
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Goroutine 2010 (running) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40

Goroutine 2001 (finished) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40
==================
    utils.go:100: Public randomness for fp a00a23fb92c3c3dc7fa3e8068728ab9b5ca8a758d031766c19156a901e318750 is successfully committed at height 100
==================
WARNING: DATA RACE
Write at 0x00c000ca5990 by goroutine 2017:
  cosmossdk.io/x/tx/signing.(*Context).makeGetSignersFunc.func5()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:311 +0xdc
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:357 +0x98
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Previous read at 0x00c000ca5990 by goroutine 2010:
  cosmossdk.io/x/tx/signing.(*Context).makeGetSignersFunc.func5()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:312 +0x118
  cosmossdk.io/x/tx/signing.(*Context).GetSigners()
      /Users/zidong/go/pkg/mod/cosmossdk.io/x/[email protected]/signing/context.go:357 +0x98
  github.com/cosmos/cosmos-sdk/codec.ProtoCodec.GetMsgAnySigners()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:311 +0x188
  github.com/cosmos/cosmos-sdk/codec.(*ProtoCodec).GetMsgV1Signers()
      /Users/zidong/go/pkg/mod/github.com/cosmos/[email protected]/codec/proto_codec.go:328 +0xc0
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.getFeePayer()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:182 +0x350
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).LogSuccessTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/log.go:110 +0x67c
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).waitForTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:458 +0x580
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx.gowrap1()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0xc8

Goroutine 2017 (running) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40

Goroutine 2010 (finished) created at:
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).broadcastTx()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:397 +0x6d4
  github.com/cosmos/relayer/v2/relayer/chains/cosmos.(*CosmosProvider).SendMessagesToMempool()
      /Users/zidong/go/pkg/mod/github.com/cosmos/relayer/[email protected]/relayer/chains/cosmos/tx.go:185 +0x274
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2.1()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:88 +0xf4
  github.com/babylonchain/babylon/client/client.(*Client).accessKeyWithLock()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/keys.go:41 +0x1b8
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs.func2()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:87 +0x148
  github.com/avast/retry-go/v4.Do.func1()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:115 +0x30
  github.com/avast/retry-go/v4.DoWithData[go.shape.interface {}]()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:179 +0x8f8
  github.com/avast/retry-go/v4.Do()
      /Users/zidong/go/pkg/mod/github.com/avast/retry-go/[email protected]/retry.go:118 +0x70
  github.com/babylonchain/babylon/client/client.(*Client).ReliablySendMsgs()
      /Users/zidong/go/pkg/mod/github.com/babylonchain/[email protected]/client/client/tx.go:85 +0x58c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsgs()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:95 +0xac
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).reliablySendMsg()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:91 +0x1c
  github.com/babylonchain/finality-provider/clientcontroller/babylon.(*BabylonConsumerController).CommitPubRandList()
      /Users/zidong/Documents/Projects/babylon-finality-provider/clientcontroller/babylon/consumer.go:128 +0x34c
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).CommitPubRand()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:773 +0x334
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).retryCommitPubRandUntilMaxRetry()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:691 +0x48
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).randomnessCommitmentLoop()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:302 +0x244
  github.com/babylonchain/finality-provider/finality-provider/service.(*FinalityProviderInstance).Start.gowrap2()
      /Users/zidong/Documents/Projects/babylon-finality-provider/finality-provider/service/fp_instance.go:136 +0x40
==================
    base_test_manager.go:174: successfully submitted a BTC delegation
    utils.go:100: Public randomness for fp 74f53f882a381c573a3b58e1312e6c157bc3434427dddd1ddbed3c2a6eb38613 is successfully committed at height 100
    base_test_manager.go:174: successfully submitted a BTC delegation
    utils.go:100: Public randomness for fp 7e100fc3ddf768881ac019a3b13852697e912b830244e5efec95ebf0ffd74349 is successfully committed at height 100
    base_test_manager.go:174: successfully submitted a BTC delegation
    base_test_manager.go:207: delegations are pending
    base_test_manager.go:227: delegations are active
    babylon_test_manager.go:254: the block is finalized at 15
    testing.go:1398: race detected during execution of test
--- FAIL: TestMultipleFinalityProviders (116.40s)
=== RUN   TestFastSync
    babylon_node_handler.go:148: babylon log file: /var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/zBabylonTest1333322223/babylon.log
Starting babylond with command:  /Users/zidong/go/bin/babylond start --home=/var/folders/9_/q4wsdnh14_s60_74cd2rbztm0000gp/T/zBabylonTest1333322223/node0/babylond --log_level=trace --trace
service injective.evm.v1beta1.Msg does not have cosmos.msg.v1.service proto annotation
service injective.evm.v1beta1.Msg does not have cosmos.msg.v1.service proto annotation
    babylon_test_manager.go:113: Babylon node is started
    babylon_test_manager.go:169: The test manager is running with 1 finality-provider(s)
    utils.go:100: Public randomness for fp 3b3865b7ecc419eff8d15cf838abc15cba50b8a25a998222d8a08e6f330d770a is successfully committed at height 100
    base_test_manager.go:174: successfully submitted a BTC delegation
    base_test_manager.go:207: delegations are pending
    base_test_manager.go:227: delegations are active
    babylon_e2e_test.go:174: the block at height 8 is finalized
    babylon_test_manager.go:254: the block is finalized at 8
    babylon_test_manager.go:283: restarting the finality-provider instance
    babylon_test_manager.go:254: the block is finalized at 19
    babylon_e2e_test.go:185: the latest finalized block is at 19
    babylon_e2e_test.go:189: the current block is at 20
--- PASS: TestFastSync (106.27s)
FAIL
FAIL    github.com/babylonchain/finality-provider/itest/babylon 372.252s
FAIL
make: *** [test-e2e-babylon] Error 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@bap2pecs