wchess

Voice-controlled chess using Whisper

Online demo: https://ggml.ai/whisper.cpp/wchess.wasm/

wchess-0.mp4

Command-line tool

mkdir build && cd build
cmake -DWHISPER_SDL2=1 ..
make -j

./bin/wchess -m ../models/ggml-base.en.bin

Move: start

a b c d e f g h
r n b q k b n r 8
p p p p p p p p 7
. * . * . * . * 6
* . * . * . * . 5
. * . * . * . * 4
* . * . * . * . 3
P P P P P P P P 2
R N B Q K B N R 1

White's turn
[(l)isten/(p)ause/(q)uit]:

TODO

Fix bugs in the chess moves logic
Improve web-browser audio capture - sometimes it does not record the voice properly
Add support for more languages by making the generated grammar string multilingual
Explore ways to improve the dynamic grammar to be narrower

PRs welcome!

Thanks

chessboardjs for the neat chessboard JS library used in this demo