652261b774Added support for known hub URLs in scout_logic.py to handle Playwright timeouts and errors more effectively. Updated fetching logic to prioritize known URLs when encountering issues, enhancing reliability in link extraction.
main
Lars2026-01-31 18:42:42 +0100
8000642eaeUpdated scout_logic.py to clarify the strategy for identifying the entry or overview page (Hub) for research reports, enhancing the prompt for link analysis to focus on Hub URLs rather than final download pages.Lars2026-01-31 18:39:08 +0100
f7b328b7f2Refined timeout strategy in scout_logic.py for URL fetching, introducing separate timeouts for 'commit' and 'domcontentloaded' states, and enhanced logging for better error visibility during page loading attempts.Lars2026-01-31 18:33:44 +0100
beb80e9eafRefactored timeout handling in scout_logic.py to improve URL fetching reliability, added detailed logging for error tracking, and implemented a total timeout for Playwright operations to prevent indefinite hangs.Lars2026-01-31 18:28:26 +0100
b3e9a6455bEnhanced main.py and scout_logic.py with improved timeout handling for URL fetching, added logging for better request tracking, and optimized page loading strategy to prevent hangs on heavy pages.Lars2026-01-31 18:25:23 +0100
46b59d2c5cUpdated docker-compose.yml to clarify port mapping, modified Dockerfile.worker to enable access logging, and added logging functionality in main.py for request tracking.Lars2026-01-31 18:19:41 +0100
3542e4564bUpdated docker-compose.yml to change the port mapping from 8000 to 8010 for the worker service.Lars2026-01-31 18:15:15 +0100
9dd44af2d4Updated scout_logic.py to use the new Stealth class for bot detection evasion, replacing the previous stealth_async function call.Lars2026-01-31 18:13:40 +0100
a18801a6aaRefactored import statement for playwright_stealth in scout_logic.py to align with updated package structure.Lars2026-01-31 18:11:33 +0100
9c5f769455Added playwright-stealth dependency and refactored link fetching logic in scout_logic.py to enhance bot detection evasion and implement HTTP/2 fallback handling.Lars2026-01-31 18:08:40 +0100
afee46933fEnhanced scout_logic.py with improved browser configuration to bypass bot detection, added URL normalization functions, and implemented robust error handling for fetching links.Lars2026-01-31 18:04:49 +0100
6e813daf69Updated project structure and added initial configuration files.Lars2026-01-31 17:36:48 +0100