You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm not sure a ThreadPoolExecutor is necessarily the right tool for what we want to do here. Each query doesn't really need its own thread as we aren't doing anything super CPU intensive, and we will arguably want to send more than 30 or so queries at a time. I find this answer to be very informative about the differences: https://stackoverflow.com/a/61360215
I would like to advocate for using asyncio as I think it's more suited for this task, as well as being cleaner in code (no literal parsing of the html response)
The text was updated successfully, but these errors were encountered:
I'm not sure a ThreadPoolExecutor is necessarily the right tool for what we want to do here. Each query doesn't really need its own thread as we aren't doing anything super CPU intensive, and we will arguably want to send more than 30 or so queries at a time. I find this answer to be very informative about the differences: https://stackoverflow.com/a/61360215
I would like to advocate for using asyncio as I think it's more suited for this task, as well as being cleaner in code (no literal parsing of the html response)
The text was updated successfully, but these errors were encountered: