-
Notifications
You must be signed in to change notification settings - Fork 3k
Comparing changes
Open a pull request
base repository: huggingface/datasets
base: 4.1.1
head repository: huggingface/datasets
compare: 4.2.0
- 13 commits
- 55 files changed
- 7 contributors
Commits on Sep 18, 2025
-
Configuration menu - View commit details
-
Copy full SHA for b5b1ba0 - Browse repository at this point
Copy the full SHA b5b1ba0View commit details
Commits on Sep 24, 2025
-
* init docs * update * Update loading_methods.mdx --------- Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 5dc1a17 - Browse repository at this point
Copy the full SHA 5dc1a17View commit details
Commits on Sep 25, 2025
-
Configuration menu - View commit details
-
Copy full SHA for 27c2e70 - Browse repository at this point
Copy the full SHA 27c2e70View commit details
Commits on Sep 26, 2025
-
feat: avoid some copies in torch formatter (#7787)
* feat: avoid some copies in torch formatter * fix: handle kwargs * fix: run ruff * fix: handle dtype * fix: handle non writable np arrays * fix: remove comment map_nested * fix: adjust import for lint
Configuration menu - View commit details
-
Copy full SHA for c412a6f - Browse repository at this point
Copy the full SHA c412a6fView commit details
Commits on Oct 1, 2025
-
Support huggingface_hub v0.x and v1.x (#7783)
* Let's test like this * code quality * add back requests * install transformers from source * will it work? * to remove later: don't fail fast * don't fail fast * fix test fixture * fix OfflineModeIsEnabled test * huggingface_hub 1.0.0 even if deps latest * will be broken but better * pip list in CI * revert branch * install latest only in latest tests * offline * get back to normal * better * ofc * why not * as before * this time is good * fix yaml format * system * fix import in o.x * :/ * Bump minimal version to 0.25.0 * x-compatible offline helper * code quality * fix utils tests * fixing last bits * x-version compat * final commit
Configuration menu - View commit details
-
Copy full SHA for a0c786c - Browse repository at this point
Copy the full SHA a0c786cView commit details
Commits on Oct 7, 2025
-
Configuration menu - View commit details
-
Copy full SHA for 095c7dc - Browse repository at this point
Copy the full SHA 095c7dcView commit details -
Sample without replacement option when interleaving datasets (#7786)
* Sample without replacement option * Exit early for non arrow iterable. * Add new stopping strategy * Remove sample_with_replacement argument * fix CyclingMultiSourcesExamplesIterable.shard_data_sources * Add sampling without replacement logic for map style datasets. * Update process.mdx * Update stream.mdx --------- Co-authored-by: Petru Radulescu <petradul@amazon.com> Co-authored-by: Quentin Lhoest <lhoest.q@gmail.com> Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 6f2502c - Browse repository at this point
Copy the full SHA 6f2502cView commit details
Commits on Oct 9, 2025
-
Add parquet scan options and docs (#7801)
parquet scan options and docs
Configuration menu - View commit details
-
Copy full SHA for 4e18df1 - Browse repository at this point
Copy the full SHA 4e18df1View commit details -
More Parquet streaming docs (#7803)
* more parquet stream arg docs * minor * minor
Configuration menu - View commit details
-
Copy full SHA for cfcdfce - Browse repository at this point
Copy the full SHA cfcdfceView commit details -
Less api calls when resolving data_files (#7805)
less api calls when resolving data_files
Configuration menu - View commit details
-
Copy full SHA for 02ee330 - Browse repository at this point
Copy the full SHA 02ee330View commit details -
Parquet: add
on_bad_fileargument to error/warn/skip bad files (#7806)add on_bad_file
Configuration menu - View commit details
-
Copy full SHA for 5eec91a - Browse repository at this point
Copy the full SHA 5eec91aView commit details -
Configuration menu - View commit details
-
Copy full SHA for fd8d287 - Browse repository at this point
Copy the full SHA fd8d287View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7e1350b - Browse repository at this point
Copy the full SHA 7e1350bView commit details
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff 4.1.1...4.2.0