A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
Role in this project:
Full-stack Developer Contributions:96 commits, 1 PR, 5 pushes in 5 years 6 months
Contributions summary:Jeremy primarily contributed to the `Upton` web-scraping framework by implementing and refining URL resolution logic, including handling of relative URLs, query parameters, and page anchors. They also introduced caching mechanisms, including support for human-readable filenames, to improve performance. Additionally, the user focused on improving code style, updating dependency versions, and addressing bug fixes, while also adding the ability to sleep between requests to prevent overloading the target servers.
csswebscraping
Extract tables from PDF files
Role in this project:
Back-end Developer Contributions:2 releases, 1 review, 29 commits in 4 years 3 months
Contributions summary:Jeremy primarily worked on refactoring the codebase, specifically renaming namespaces and updating imports to reflect these changes. They also addressed a bug related to PDFBox logging and made several changes to support right-to-left (RTL) text rendering in the PDF extraction process. Furthermore, the user modified core classes such as `TextChunk`, `TextElement`, and `Page` to handle directionality, improve text ordering, and integrate RTL functionality. The user also renamed command line arguments.
pdf-filesextracting-tablespdfsextraction-engine