Execution Engine Development
This milestone is dedicated to developing the engine responsible for executing the web crawlers. The main features include implementing functions for executing the crawler in general, from a specific node based on cached data, and a step-by-step execution mode that allows users to manually control the execution process. Additional features could include e…
This milestone is dedicated to developing the engine responsible for executing the web crawlers. The main features include implementing functions for executing the crawler in general, from a specific node based on cached data, and a step-by-step execution mode that allows users to manually control the execution process. Additional features could include error handling for execution failures, a system for pausing and resuming execution, and performance optimizations to ensure efficient execution of the web crawlers.