Block a user
8000642eae
Updated scout_logic.py to clarify the strategy for identifying the entry or overview page (Hub) for research reports, enhancing the prompt for link analysis to focus on Hub URLs rather than final download pages.
f7b328b7f2
Refined timeout strategy in scout_logic.py for URL fetching, introducing separate timeouts for 'commit' and 'domcontentloaded' states, and enhanced logging for better error visibility during page loading attempts.
beb80e9eaf
Refactored timeout handling in scout_logic.py to improve URL fetching reliability, added detailed logging for error tracking, and implemented a total timeout for Playwright operations to prevent indefinite hangs.
b3e9a6455b
Enhanced main.py and scout_logic.py with improved timeout handling for URL fetching, added logging for better request tracking, and optimized page loading strategy to prevent hangs on heavy pages.
46b59d2c5c
Updated docker-compose.yml to clarify port mapping, modified Dockerfile.worker to enable access logging, and added logging functionality in main.py for request tracking.
3542e4564b
Updated docker-compose.yml to change the port mapping from 8000 to 8010 for the worker service.
9dd44af2d4
Updated scout_logic.py to use the new Stealth class for bot detection evasion, replacing the previous stealth_async function call.
a18801a6aa
Refactored import statement for playwright_stealth in scout_logic.py to align with updated package structure.
9c5f769455
Added playwright-stealth dependency and refactored link fetching logic in scout_logic.py to enhance bot detection evasion and implement HTTP/2 fallback handling.
afee46933f
Enhanced scout_logic.py with improved browser configuration to bypass bot detection, added URL normalization functions, and implemented robust error handling for fetching links.
cb1d1ada8e
Update authoring guidelines, knowledge design manual, and Obsidian integration guide for Section Types and Intra-Note-Edges (WP-26)