ross/statdx
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Enhance document processing in scrapers

Browse Source 
- Updated pediatric multiple sclerosis article reference ID.
- Improved document_to_markdown.py to handle differential diagnoses, tables, anatomy, and cases more effectively.
- Added logging for cached entries of DDX, Tables, Anatomy, and Cases.
- Adjusted file pattern matching to process all JSON files by default.
- Fixed document ID extraction logic for various data types.
This commit is contained in:
Ross
2025-10-18 15:41:33 +01:00
parent 5983ca3252
commit 66512aa439
71 changed files with 1176 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs_md/_content_index.json
+6 -1
View File
@@ -88,5 +88,10 @@
"f35b6dbc1d9f98fa77f868b46be06ad935c6bd8cb21c097618e9fb7c870d6230": "docs_md/articles/abdominal-wall_e708af38-508f-4404-b7c5-6b8c7d75804f.md",
"8a9c49bc68cd13c13e4ddc861027a12218654f819a9f76168474b1fc73a0ec2a": "docs_md/articles/pediatric-multiple-sclerosis-brain_f2592b04-f800-4235-9eea-a43f2bf4adfe.md",
"4e977f1c936ad0d45f648c71caa71eb3e0a2861613d98486c67a7ae7e7d645fa": "docs_md/articles/pediatric-multiple-sclerosis-brain_f2592b04-f800-4235-9eea-a43f2bf4adfe.md",
"b4963a83151184a207f483e2fd95830a5e41c3c4458c34a336244b8cf134dac8": "docs_md/articles/basal-ganglia-calcification_f8dc8f27-f256-480d-9393-7ec3495a3d27.md"
"b4963a83151184a207f483e2fd95830a5e41c3c4458c34a336244b8cf134dac8": "docs_md/articles/basal-ganglia-calcification_f8dc8f27-f256-480d-9393-7ec3495a3d27.md",
"3a2b0f129238fa3f39cb073e83f13064fa0cdfd2cc585f04f9be2f5a7ea3da12": "docs_md/articles/abnormal-shape-configuration-of-corpus-callosum_238ca32d-6bc6-4f5a-81b1-6601dd605856.md",
"53919621aff547d056eac0b8674d81ad3012c3073fdc9f27a64fc681d5382faa": "docs_md/articles/multiple-sclerosis_89599954-599e-4410-a517-eb22125cedfb.md",
"f4890842b9b14f09b4038a4682ee817694e2836b090aa6e49254e1662a56a43d": "docs_md/articles/adem_a3fafeb7-5861-4364-beb8-c0e30220564e.md",
"8569745887f0021202b010280755c902ea806cd98ec898028e32945d4db91be1": "docs_md/articles/basal-ganglia-calcification_f8dc8f27-f256-480d-9393-7ec3495a3d27.md",
"4bbbeae327c5726a423634c1b953a71aa49870f801ef90e85a59bc908f362aed": "docs_md/articles/multiple-sclerosis_89599954-599e-4410-a517-eb22125cedfb.md"
}