-
Notifications
You must be signed in to change notification settings - Fork 25.7k
[ao][docs] Add description of qconfig and qengine to quantization page #63582
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ao][docs] Add description of qconfig and qengine to quantization page #63582
Conversation
Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
🔗 Helpful links
💊 CI failures summary and remediationsAs of commit c97c77e (more details on the Dr. CI page): 💚 💚 Looks good so far! There are no failures yet. 💚 💚 This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.Please report bugs/suggestions to the (internal) Dr. CI Users group. |
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
docs/source/quantization.rst
Outdated
| 1. Quantization Config (Qconfig): Specifies how weights and activations are to be quantized. Qconfig is needed to create a quantized model. | ||
| 2. Backend: Refers to kernels that support quantization, usually with different numerics. | ||
| 3. Quantization engine (torch.backends.quantization.engine): When a quantized model is executed, the qengine specifies which | ||
| backed is to be used for execution. It is important to ensure that the qengine is consistent with the Qconfig. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
typo: backed -> backend
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is the new line here required?
|
|
||
| The corresponding implementation is chosen automatically based on the PyTorch build mode. | ||
| The corresponding implementation is chosen automatically based on the PyTorch build mode, though users | ||
| have the option to override this by setting `torch.backends.quantization.engine` to `fbgemm` or `qnnpack`. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
maybe adding a small code-block here specifying how to override would be helpful
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks good, left a few comments inline
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
|
@raghuramank100 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator. |
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656) [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656) [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656) [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656) [ghstack-poisoned]
…ization page" Summary: Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. Test Plan: Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656) [ghstack-poisoned]
Pull Request resolved: #63582 Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used. ghstack-source-id: 137051719 Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656/)
|
This pull request has been merged in b9275a4. |
Stack from ghstack:
Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.
Test Plan:
Reviewers:
Subscribers:
Tasks:
Tags:
Differential Revision: D30658656