13 Commits

Author SHA1 Message Date
Ross 97898e14d2 . 2025-11-02 21:45:44 +00:00
Ross f8775d1f7e . 2025-10-21 21:56:33 +01:00
Ross 1e36a4957c . 2025-10-20 08:40:33 +01:00
Ross f1bfdd8e7a 1 2025-10-19 17:54:25 +01:00
Ross 66512aa439 Enhance document processing in scrapers
- Updated pediatric multiple sclerosis article reference ID.
- Improved document_to_markdown.py to handle differential diagnoses, tables, anatomy, and cases more effectively.
- Added logging for cached entries of DDX, Tables, Anatomy, and Cases.
- Adjusted file pattern matching to process all JSON files by default.
- Fixed document ID extraction logic for various data types.
2025-10-18 15:41:33 +01:00
Ross 5983ca3252 . 2025-10-18 15:20:26 +01:00
Ross 96d0de8e1a . 2025-10-18 13:27:30 +01:00
Ross fbf4ab926b feat: Enhance document processing by caching image groups and document summaries 2025-10-18 13:13:42 +01:00
Ross 90ac197cbe feat: Cache and manage image group metadata for enhanced document processing 2025-10-18 09:20:57 +01:00
Ross 2585d69fbe feat: Implement image candidate discovery and association in document processing 2025-10-18 08:44:33 +01:00
Ross 9aea602295 feat: Add new articles on Allergic Bronchopulmonary Aspergillosis, Finger-in-Glove Sign, and Tracheal Dilatation; update content index and document conversion script 2025-10-18 07:51:33 +01:00
Ross 2f8df5f820 Add comprehensive articles on Vascular Dementia and Wallerian Degeneration
- Created a detailed article for Vascular Dementia covering key facts, terminology, imaging findings, differential diagnoses, pathology, clinical issues, and diagnostic checklist.
- Developed an extensive article on Wallerian Degeneration including key facts, terminology, imaging features, differential diagnoses, pathology, clinical issues, and diagnostic checklist.
2025-10-17 22:11:27 +01:00
Ross efbfd301f0 Add new markdown files for various documents and implement document conversion script
- Created markdown files for CDC Diagnostic Criteria for Creutzfeldt-Jakob Disease and multiple media documents.
- Added a script to convert JSON documents containing HTML into markdown format.
- Implemented functions to extract titles and HTML content from JSON files.
- Enhanced markdown generation with support for various HTML elements including tables, lists, and images.
- Included error handling and logging for file processing.
2025-10-14 21:03:40 +01:00