KEMBAR78
Mention AMD GPU compatibility in README by JonLiuFYI · Pull Request #1954 · lm-sys/FastChat · GitHub
Skip to content

Conversation

JonLiuFYI
Copy link
Contributor

Why are these changes needed?

This PR updates the README with information about running models on AMD GPUs, which was missing before. This includes extra installation notes and a remark that Vicuna-13B with --load-8bit works on an RX 6800 XT just like it does with some other graphics cards.

Commit bd476f9 in this PR also fixes a typo.

Related issue number (if applicable)

Closes #104

Checks

NOTE: this PR only changes the README, so these checks aren't relevant.

  • I've run format.sh to lint the changes in this PR.
  • I've included any doc changes needed.
  • I've made sure the relevant tests are passing (if applicable).

@JonLiuFYI
Copy link
Contributor Author

@merrymercy I don't have reviewer access, so please check out my update for #104.

@merrymercy merrymercy merged commit 62459e9 into lm-sys:main Jul 14, 2023
@merrymercy
Copy link
Member

merrymercy commented Jul 14, 2023

@JonLiuFYI thanks! It is merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

AMD Support

2 participants