KEMBAR78
[ao][docs] Add description of qconfig and qengine to quantization page by raghuramank100 · Pull Request #63582 · pytorch/pytorch · GitHub
Skip to content

Conversation

@raghuramank100
Copy link
Contributor

@raghuramank100 raghuramank100 commented Aug 19, 2021

Stack from ghstack:

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: D30658656

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Aug 19, 2021

🔗 Helpful links

💊 CI failures summary and remediations

As of commit c97c77e (more details on the Dr. CI page):


💚 💚 Looks good so far! There are no failures yet. 💚 💚


This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
1. Quantization Config (Qconfig): Specifies how weights and activations are to be quantized. Qconfig is needed to create a quantized model.
2. Backend: Refers to kernels that support quantization, usually with different numerics.
3. Quantization engine (torch.backends.quantization.engine): When a quantized model is executed, the qengine specifies which
backed is to be used for execution. It is important to ensure that the qengine is consistent with the Qconfig.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

typo: backed -> backend

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is the new line here required?


The corresponding implementation is chosen automatically based on the PyTorch build mode.
The corresponding implementation is chosen automatically based on the PyTorch build mode, though users
have the option to override this by setting `torch.backends.quantization.engine` to `fbgemm` or `qnnpack`.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe adding a small code-block here specifying how to override would be helpful

Copy link
Contributor

@supriyar supriyar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good, left a few comments inline

…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
@raghuramank100
Copy link
Contributor Author

@raghuramank100 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656)

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656)

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656)

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656)

[ghstack-poisoned]
…ization page"

Summary:
Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656)

[ghstack-poisoned]
raghuramank100 pushed a commit that referenced this pull request Aug 31, 2021
Pull Request resolved: #63582



Current quantization docs do not define qconfig and qengine. Added text to define these concepts before they are used.
ghstack-source-id: 137051719

Differential Revision: [D30658656](https://our.internmc.facebook.com/intern/diff/D30658656/)
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in b9275a4.

@facebook-github-bot facebook-github-bot deleted the gh/raghuramank100/52/head branch September 4, 2021 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants