de67c7b0b1
feat(pdf): add PDF client, scraper, parser, and end-to-end tests
...
- Introduce PDF submodule with client, scraper, and generic parser
- Add filesystem PDF client and test-only mock routing
- Add end-to-end PDF scrape → parse tests with typed output
- Mirror HTML module architecture for consistency
- Expose PDF primitives via omniread public API
2026-01-02 18:59:36 +05:30
390eb22e1b
moved html mocks to html sub folder and updated conftest.py to read from new location with better path and endpoint handling
2026-01-02 18:44:26 +05:30
358abc9b36
feat(api): expose core and html primitives via top-level package exports
...
- Re-export Content and ContentType from omniread.core
- Re-export HTMLScraper and HTMLParser from omniread.html
- Define explicit __all__ for stable public API surface
2026-01-02 18:36:29 +05:30
07293e4651
feat(testing): add end-to-end HTML scraping and parsing tests with typed parsers
...
- Add smart httpx MockTransport routing based on endpoint paths
- Render HTML fixtures via Jinja templates populated from JSON data
- Introduce explicit, typed HTML parsers for semantic and table-based content
- Add end-to-end tests covering scraper → content → parser → Pydantic models
- Enforce explicit output contracts and avoid default dict-based parsing
2026-01-02 18:31:34 +05:30
fa14a79ec9
simple test case
2026-01-02 18:20:03 +05:30
55245cf241
added validation for content type
2026-01-02 18:19:47 +05:30
202329e190
refactor(html-scraper): normalize Content-Type and inject httpx client
...
- Inject httpx.Client for testability and reuse
- Validate and normalize Content-Type header before returning Content
- Emit ContentType.HTML instead of raw header strings
- Avoid per-request client creation
- Preserve metadata while allowing caller overrides
2026-01-02 18:08:46 +05:30
f59024ddd5
added pydantic
2026-01-02 18:08:37 +05:30
32ee43e77a
omni read basic modules
2025-12-31 14:28:50 +05:30
c0959cb8d1
init commit
2025-12-31 13:00:10 +05:30
