RemoteDisconnectError on cursor.fetchall()

[willtho89]

Hi,

for an internal project, we need to regularly get data from caluclated insights. I wrote a simple automation to get the data on a schedule using the cursor.fetchall() method.

Unfortunately this fails roughly half the time with a RemoteDisconnectError. We expect roughly 5.000.000 rows and i suspect one of the QuerySubmitter.get_next_batch(cur.connection, cur.next_batch_id) fails and won't retry.

def query_cdp(config: CDPConfig):
    from log_helper import logger

    # init CDP cursor
    conn = SalesforceCDPConnection(
        SF_LOGIN_URL, SF_USERNAME, SF_PASSWORD, SF_CLIENT_ID, SF_CLIENT_SECRET
    )

    # Query CDP
    logger.info(f"[{config.file_name}] Run CDP query '{config.query}'")
    cur = conn.cursor()
    cur.execute(config.query)
    return cur.fetchall()

Is there any retry method built-in? Can't find one on first glance