KEMBAR78
Add CUDA support via cuBLAS by ggerganov · Pull Request #834 · ggml-org/whisper.cpp · GitHub
Skip to content

Add CUDA support via cuBLAS #834

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 7 commits into from
Apr 30, 2023
Merged

Add CUDA support via cuBLAS #834

merged 7 commits into from
Apr 30, 2023
+97 −46

Conversation

@ggerganov
Copy link
Member

@ggerganov ggerganov commented Apr 29, 2023 •
edited
Loading

Usage:

# install CUDA from https://developer.nvidia.com/cuda-downloads

# compile with cuBLAS support
make clean
WHISPER_CUBLAS=1 make -j

@ggerganov ggerganov mentioned this pull request Apr 29, 2023
Closed
@ggerganov ggerganov merged commit 5fd1bdd into master Apr 30, 2023
@ggerganov ggerganov deleted the cublas branch April 30, 2023 09:14
@Destroy666x Destroy666x mentioned this pull request Sep 12, 2023
Closed
jacobwu-b pushed a commit to jacobwu-b/Transcriptify-by-whisper.cpp that referenced this pull request Oct 24, 2023
@ggerganov
whisper : add GPU support via cuBLAS (ggml-org#834)
475201c 
* make : add WHISPER_CUBLAS

* make : fix CUBLAS build

* whisper : disable Flash Attention + adjust memory buffers

* whisper : remove old commented code

* readme : add cuBLAS instructions

* cmake : add WHISPER_CUBLAS option

* gitignore : ignore build-cublas
jacobwu-b pushed a commit to jacobwu-b/Transcriptify-by-whisper.cpp that referenced this pull request Oct 24, 2023
@ggerganov
whisper : add GPU support via cuBLAS (ggml-org#834)
c7d3e70 
* make : add WHISPER_CUBLAS

* make : fix CUBLAS build

* whisper : disable Flash Attention + adjust memory buffers

* whisper : remove old commented code

* readme : add cuBLAS instructions

* cmake : add WHISPER_CUBLAS option

* gitignore : ignore build-cublas
landtanin pushed a commit to landtanin/whisper.cpp that referenced this pull request Dec 16, 2023
@ggerganov
whisper : add GPU support via cuBLAS (ggml-org#834)
8d56873 
* make : add WHISPER_CUBLAS

* make : fix CUBLAS build

* whisper : disable Flash Attention + adjust memory buffers

* whisper : remove old commented code

* readme : add cuBLAS instructions

* cmake : add WHISPER_CUBLAS option

* gitignore : ignore build-cublas
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
@ggerganov @iThalay
whisper : add GPU support via cuBLAS (ggml-org#834)
e550f4d 
* make : add WHISPER_CUBLAS

* make : fix CUBLAS build

* whisper : disable Flash Attention + adjust memory buffers

* whisper : remove old commented code

* readme : add cuBLAS instructions

* cmake : add WHISPER_CUBLAS option

* gitignore : ignore build-cublas
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@ggerganov