chrissewell/whisperX
1
0
Fork 0
mirror of https://github.com/m-bain/whisperX.git synced 2025-07-01 18:17:27 -04:00
Code Issues Packages Projects Releases Wiki Activity

init commit

Browse Source
This commit is contained in:
Max Bain
2022-12-14 18:59:12 +00:00
parent 9791862c45
commit 9f6fa61160
38 changed files with 105726 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
whisperx/assets/multilingual/added_tokens.json Normal file
View File

@ -0,0 +1 @@
{"<|endoftext|>": 50257}

50000
whisperx/assets/multilingual/merges.txt Normal file
View File

File diff suppressed because it is too large Load Diff

1
whisperx/assets/multilingual/special_tokens_map.json Normal file
View File

@ -0,0 +1 @@
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}

1
whisperx/assets/multilingual/tokenizer_config.json Normal file
View File

@ -0,0 +1 @@
{"unk_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "bos_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "eos_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "add_prefix_space": false, "model_max_length": 1024, "special_tokens_map_file": null, "name_or_path": "multilingual", "errors": "replace", "tokenizer_class": "GPT2Tokenizer"}

1
whisperx/assets/multilingual/vocab.json Normal file
View File

File diff suppressed because one or more lines are too long