KEMBAR78
Write pdf in map by lhoestq · Pull Request #7487 · huggingface/datasets · GitHub
Skip to content

Conversation

@lhoestq
Copy link
Member

@lhoestq lhoestq commented Mar 28, 2025

Fix this error when mapping a PDF dataset

pyarrow.lib.ArrowInvalid: Could not convert <pdfplumber.pdf.PDF object at 0x13498ee40> with type PDF: did not recognize Python value type when inferring an Arrow data type

and also let map() outputs be lists of images or pdfs

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@lhoestq lhoestq merged commit 94ccd1b into main Mar 28, 2025
8 of 15 checks passed
@lhoestq lhoestq deleted the write-pdf-in-map branch March 28, 2025 17:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants