upgrade to 0.71 failed

[martap79]

Hi All,
Upgraded to 0.71 from 0.63 and was met with these errors while running code that works fine on 0.6.3. Tried 0.7.0 and getting same errors. Is this a bug or am I doing something wrong here?

Traceback (most recent call last):
File "/Users/mar/Documents/Projects/ter/dev/cardano.py", line 40, in
txid = store.run_order(PRICE)
File "/Users/mar/Documents/Projects/ter/dev/plutusnft.py", line 237, in run_order
self.build_tx(self.assetid)
File "/Users/mar/Documents/Projects/ter/dev/plutusnft.py", line 231, in build_tx
self.signed_tx = builder.build_and_sign([psk], wallet_addr, True)
File "/Users/mar/.local/share/virtualenvs/ter-qrzsOKNS/lib/python3.10/site-packages/pycardano/txbuilder.py", line 1160, in build_and_sign
tx_body = self.build(
File "/Users/mar/.local/share/virtualenvs/ter-qrzsOKNS/lib/python3.10/site-packages/pycardano/txbuilder.py", line 868, in build
self._update_execution_units(
File "/Users/mar/.local/share/virtualenvs/ter-qrzsOKNS/lib/python3.10/site-packages/pycardano/txbuilder.py", line 1096, in _update_execution_units
estimated_execution_units = self._estimate_execution_units(
File "/Users/mar/.local/share/virtualenvs/ter-qrzsOKNS/lib/python3.10/site-packages/pycardano/txbuilder.py", line 1124, in _estimate_execution_units
setattr(tmp_builder, f.name, deepcopy(getattr(self, f.name)))
File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/copy.py", line 146, in deepcopy
y = copier(x, memo)
File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/copy.py", line 231, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/copy.py", line 172, in deepcopy
y = _reconstruct(x, memo, *rv)
File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/copy.py", line 271, in _reconstruct
state = deepcopy(state, memo)
File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/copy.py", line 146, in deepcopy
y = copier(x, memo)
File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/copy.py", line 231, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/copy.py", line 161, in deepcopy
rv = reductor(4)
TypeError: cannot pickle '_cbor2.CBORTag' object

[cffls]

v0.7+ starts to make a deep copy of datum and redeemer during fee estimation, which will become more accurate. The error above seems to be raised when datum or redeemer were deep copied, because python doesn't know how to deep copy CBORTags, which usually appears in datum or redeemer. We need to find out which object that contained CBORTag caused this problem. Could you please add a print statement in your txbuilder file at line 1124, rerun your script, and share the output here?

        for f in fields(self):
            if f.name not in ("context",):
                print(f"Deep copying attr: {f.name}, val: {getattr(self, f.name)}") # Add this line
                setattr(tmp_builder, f.name, deepcopy(getattr(self, f.name)))

[martap79]

below the (relevent) output.

Deep copying attr: _inputs_to_redeemers, val: {{'input': {
  'index': 0,
  'transaction_id': TransactionId(hex='b1282394a5b74bbb5bde67548b40c5a3d7bc47a685da1986b7e8c4fa4b403210'),
},
 'output': {
  'address': addr1qxdqmeusfplu90mqhhlv797s78pvadfzthmrmnvjujcl3z6jm46fl7qyvaqg5l9zjdveduxsqugl83v0vh5f8afdgjdq5pey74,
  'amount': {
    'coin': 1323170,
    'multi_asset': {ScriptHash(hex='d43838619d4d2a463e50525df3dce0b5c88b7d8760adb89662c66a66'): {AssetName(b'TestClub85'): 1}},
  },
  'datum': None,
  'datum_hash': None,
  'post_alonzo': False,
  'script': None,
}}: {
  'data': CBORTag(122, []),
  'ex_units': {'mem': 0, 'steps': 0},
  'tag': {'__objclass__': <enum 'RedeemerTag'>, '_name_': 'SPEND', '_value_': 0},
}}
Traceback (most recent call last):

what I have in my code that may be relevent to this is:

redeemerdata = cbor2.CBORTag(122, [])
redeemer = Redeemer(RedeemerTag.SPEND, redeemerdata)
builder.add_script_input(utxo[0], script, datum, redeemer)

[cffls]

Thanks @martap79 , this is helpful. The problem is that the redeemer data is not deep copiable. You can try replacing redeemerdata with a custom subclass of PlutusData:

>>> class MyData(PlutusData):
...    CONSTR_ID=1
    
>>> a = MyData()
>>> a.to_primitive()
CBORTag(122, [])

>>> from copy import deepcopy
>>> b = deepcopy(a)
>>> b.to_primitive()
CBORTag(122, [])

[martap79]

tx Jerry, quickly tried your suggestion and indeed got further, but errors out on another copy:

Deep copying attr: _should_estimate_execution_units, val: True
Traceback (most recent call last):
  File "/Users/mar/Documents/Projects/ter/dev/cardano.py", line 40, in <module>
    txid = store.run_order(PRICE)
  File "/Users/mar/Documents/Projects/ter/dev/plutusnft.py", line 244, in run_order
    self.build_tx(self.assetid)
  File "/Users/mar/Documents/Projects/ter/dev/plutusnft.py", line 238, in build_tx
    self.signed_tx = builder.build_and_sign([psk], wallet_addr, True)
  File "/Users/mar/.local/share/virtualenvs/ter-qrzsOKNS/lib/python3.10/site-packages/pycardano/txbuilder.py", line 1161, in build_and_sign
    tx_body = self.build(
  File "/Users/mar/.local/share/virtualenvs/ter-qrzsOKNS/lib/python3.10/site-packages/pycardano/txbuilder.py", line 868, in build
    self._update_execution_units(
  File "/Users/mar/.local/share/virtualenvs/ter-qrzsOKNS/lib/python3.10/site-packages/pycardano/txbuilder.py", line 1102, in _update_execution_units
    raise TransactionBuilderException(
pycardano.exception.TransactionBuilderException: Cannot find execution unit for redeemer: {
  'data': {},
  'ex_units': {'mem': 0, 'steps': 0},
  'tag': {'__objclass__': <enum 'RedeemerTag'>, '_name_': 'SPEND', '_value_': 0},
} in estimated execution units: {'spend:1': {'mem': 2481646, 'steps': 695041252}}

[cffls]

Thanks @martap79 . Could you try including this fix commit in your txbuilder and try again?

[martap79]

yep. that resolved it for me... many thanks, @cffls !
I'll wait for your official updated release to upgrade.