ross/statdx
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
e3d081cbff72dcb3c4a1c66817743f3e3ba2e2bd
statdx/scrapers
T
History
Ross e3d081cbff Add scripts for capturing network responses and extracting document content 
- Implement capture_with_cdp.py to capture all network response bodies using Chrome DevTools Protocol.
- Create extract_sections.py to extract sections from STATdx snapshot HTML files into JSON Lines.
- Add unpack_document_content.py to extract `documentHtml` from captured JSON bodies and save as HTML files.
- Update .gitignore to include playwright_profile.
2025-10-14 17:44:20 +01:00
..
capture_with_cdp.py
Add scripts for capturing network responses and extracting document content
2025-10-14 17:44:20 +01:00
extract_sections.py
Add scripts for capturing network responses and extracting document content
2025-10-14 17:44:20 +01:00
parse_captured_json.py
Add Playwright-based scraping and login scripts for STATdx
2025-10-14 13:46:39 +01:00
save_xhr_requests.py
Add Playwright-based scraping and login scripts for STATdx
2025-10-14 13:46:39 +01:00
statdx_capture_after_login.py
Add Playwright-based scraping and login scripts for STATdx
2025-10-14 13:46:39 +01:00
statdx_debug_capture.py
Add Playwright-based scraping and login scripts for STATdx
2025-10-14 13:46:39 +01:00
statdx_live_capture.py
Add Playwright-based scraping and login scripts for STATdx
2025-10-14 13:46:39 +01:00
statdx_play_chrome.py
Add scripts for capturing network responses and extracting document content
2025-10-14 17:44:20 +01:00
statdx_playwright.py
Refactor logging to use Loguru in Playwright scripts for improved logging capabilities
2025-10-14 14:09:19 +01:00
statdx_requests.py
Add Playwright-based scraping and login scripts for STATdx
2025-10-14 13:46:39 +01:00
unpack_document_content.py
Add scripts for capturing network responses and extracting document content
2025-10-14 17:44:20 +01:00