KEMBAR78
Prevent NPE in `deallocate_pages` by p-e-w · Pull Request #688 · turboderp-org/exllamav2 · GitHub
Skip to content

Conversation

@p-e-w
Copy link
Contributor

@p-e-w p-e-w commented Nov 29, 2024

If deallocate_pages is called on a job for which allocate_pages has not been called (see iterate_start_jobs for conditions under which this is true), allocated_pages is None, raising a NPE when attempting to iterate.

In particular, this prevents clear_queue from working. In practice, this problem readily occurs when starting a few jobs and then calling clear_queue.

turboderp and others added 2 commits November 13, 2024 05:56
If `deallocate_pages` is called on a job for which `allocate_pages`
has not been called (see `iterate_start_jobs` for conditions under
which this is true), `allocated_pages` is `None`, raising a NPE
when attempting to iterate.

In particular, this prevents `clear_queue` from working. In
practice, this problem readily occurs when starting a few jobs
and then calling `clear_queue`.
@p-e-w p-e-w changed the base branch from master to dev November 29, 2024 04:54
@p-e-w p-e-w changed the base branch from dev to master November 29, 2024 04:54
@p-e-w
Copy link
Contributor Author

p-e-w commented Nov 29, 2024

@turboderp

I tried to rebase this, but it appears that 735fa7b is not in dev for some reason. Not sure what to do here.

@turboderp turboderp changed the base branch from master to dev December 1, 2024 21:00
@turboderp turboderp merged commit db78601 into turboderp-org:dev Dec 1, 2024
@turboderp
Copy link
Member

This is fine, the temp build actions was just me saving some time, I'll delete it after. The next release won't take long because there's a bunch of other bugfixes to push out soon

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants