Kbd-Audio – Tools For Capturing And Analysing Keyboard Input Paired With Microphone Capture

0
23
Kbd-Audio - Tools For Capturing And Analysing Keyboard Input Paired With Microphone Capture

This is a set of command-line and GUI instruments for capturing and analyzing audio information. The most attention-grabbing software is named keytap – it could possibly guess pressed keyboard keys solely by analyzing the audio captured from the pc’s microphone.


Build directions
Dependencies:

Linux and Mac OS

git clone https://github.com/ggerganov/kbd-audio
cd kbd-audio
git submodule replace --init
mkdir construct && cd construct
cmake ..
make

Windows

(todo, PRs welcome)

Tools

document-full
Record audio to a uncooked binary file on disk
Usage: ./document-full output.kbd

play-full
Playback a recording captured by way of the document-full software
Usage: ./play-full enter.kbd

document
Record audio solely whereas typing. Useful for gathering coaching information for keytap
Usage: ./document output.kbd

play
Playback a recording created by way of the document software
Usage: ./play enter.kbd

keytap
Detect pressed keys by way of microphone audio seize in actual-time. Uses coaching information captured by way of the document software.
Usage: ./keytap-gui input0.kbd [input1.kbd] [input2.kbd] …
Live demo (WebAssembly threads required)

keytap2 (work in progress)
Detect pressed keys by way of microphone audio seize. Uses statistical data (n-gram frequencies) concerning the language. No coaching information is required. The ‘recording.kbd’ enter file must be generated by way of the document-full software and comprises the audio information that will probably be analyzed. The ‘n-gram.txt’ file has to include n-gram possibilities for the corresponding language.
Usage: ./keytap2-gui recording.kbd n-gram.txt

Feedback
Any suggestions concerning the efficiency of the instruments is very appreciated. Please drop a remark here.

MoreTip.com

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.