Commit Graph

11 Commits

Author SHA1 Message Date
beb80e9eaf Refactored timeout handling in scout_logic.py to improve URL fetching reliability, added detailed logging for error tracking, and implemented a total timeout for Playwright operations to prevent indefinite hangs. 2026-01-31 18:28:26 +01:00
b3e9a6455b Enhanced main.py and scout_logic.py with improved timeout handling for URL fetching, added logging for better request tracking, and optimized page loading strategy to prevent hangs on heavy pages. 2026-01-31 18:25:23 +01:00
46b59d2c5c Updated docker-compose.yml to clarify port mapping, modified Dockerfile.worker to enable access logging, and added logging functionality in main.py for request tracking. 2026-01-31 18:19:41 +01:00
3542e4564b Updated docker-compose.yml to change the port mapping from 8000 to 8010 for the worker service. 2026-01-31 18:15:15 +01:00
9dd44af2d4 Updated scout_logic.py to use the new Stealth class for bot detection evasion, replacing the previous stealth_async function call. 2026-01-31 18:13:40 +01:00
a18801a6aa Refactored import statement for playwright_stealth in scout_logic.py to align with updated package structure. 2026-01-31 18:11:33 +01:00
9c5f769455 Added playwright-stealth dependency and refactored link fetching logic in scout_logic.py to enhance bot detection evasion and implement HTTP/2 fallback handling. 2026-01-31 18:08:40 +01:00
afee46933f Enhanced scout_logic.py with improved browser configuration to bypass bot detection, added URL normalization functions, and implemented robust error handling for fetching links. 2026-01-31 18:04:49 +01:00
6e813daf69 Updated project structure and added initial configuration files. 2026-01-31 17:36:48 +01:00
bd0e602b09 initialer Setup 2026-01-31 12:11:16 +01:00
24964cd507 readme hinzugefügt 2026-01-31 12:02:18 +01:00