{"id":23593,"date":"2025-01-02T16:24:19","date_gmt":"2025-01-02T08:24:19","guid":{"rendered":"http:\/\/139.9.1.231\/?p=23593"},"modified":"2025-02-14T15:24:33","modified_gmt":"2025-02-14T07:24:33","slug":"speech-datasets-collection","status":"publish","type":"post","link":"http:\/\/139.9.1.231\/index.php\/2025\/01\/02\/speech-datasets-collection\/","title":{"rendered":"Speech Datasets Collection-\u8bed\u97f3\u6570\u636e\u96c6\u6c47\u603b"},"content":{"rendered":"\n

\u6765\u6e90\uff1ahttps:\/\/github.com\/RevoSpeechTech\/speech-datasets-collection<\/a><\/em><\/p>\n\n\n\n

\u6587\u672c\u7ffb\u8bd1\u6570\u636e\u96c6\uff1ahttps:\/\/opus.nlpl.eu\/<\/a><\/strong><\/p>\n\n\n\n

openslr \u4e0b\u8f7d\uff1a<\/strong><\/h2>\n\n\n\n

1\uff09\u4fee\u6539\u4e3a\u56fd\u5185\u5730\u5740<\/p>\n\n\n\n

\u4f8b\u5982 aishell\uff0c\u9ed8\u8ba4\u7684run.sh\u91cc\u5199\u7684\u662fwww.openslr.org\/resources\/33<\/strong>\uff0c\u9700\u8981\u6539\u4e3a\u56fd\u5185\u7ad9\u70b9\uff0chttp:\/\/openslr.magicdatatech.com\/resources\/33<\/strong>\u3002<\/p>\n\n\n\n

\u5176\u4ed6\u76ee\u5f55\u53ef\u4ee5\u770b\uff1a http:\/\/openslr.magicdatatech.com\/resources.php<\/a><\/p>\n\n\n\n

\u5728\u4f7f\u7528 wget<\/code> \u4e0b\u8f7d\u6587\u4ef6\u65f6\uff0c\u5982\u679c\u9047\u5230\u4e0b\u8f7d\u901f\u5ea6\u6162\u7684\u95ee\u9898\uff0c\u53ef\u4ee5\u901a\u8fc7\u4ee5\u4e0b\u51e0\u79cd\u65b9\u6cd5\u52a0\u901f\u4e0b\u8f7d\uff1a<\/p>\n\n\n\n

1. \u4f7f\u7528\u591a\u4e2a\u8fde\u63a5<\/h3>\n\n\n\n

wget<\/code> \u9ed8\u8ba4\u53ea\u4f7f\u7528\u5355\u4e2a\u8fde\u63a5\u8fdb\u884c\u4e0b\u8f7d\uff0c\u4f46\u662f\u4f60\u53ef\u4ee5\u4f7f\u7528 aria2<\/code> \u8fd9\u79cd\u5de5\u5177\uff0c\u5b83\u652f\u6301\u591a\u7ebf\u7a0b\u4e0b\u8f7d\uff0c\u663e\u8457\u52a0\u901f\u4e0b\u8f7d\u901f\u5ea6\u3002aria2<\/code> \u53ef\u4ee5\u901a\u8fc7\u4ee5\u4e0b\u547d\u4ee4\u5b89\u88c5\uff1a<\/p>\n\n\n\n

sudo apt install aria2  # For Ubuntu\/Debian\nbrew install aria2  # For macOS\n<\/code><\/pre>\n\n\n\n
\u7136\u540e\u4f60\u53ef\u4ee5\u4f7f\u7528 aria2<\/code> \u4e0b\u8f7d\u6587\u4ef6\uff1a<\/p>\n\n\n\n
aria2c -x 16 -s 16 <URL>\n<\/code><\/pre>\n\n\n\n
-x 16<\/code> \u8868\u793a\u4f7f\u7528 16 \u4e2a\u8fde\u63a5\u6765\u4e0b\u8f7d\u6587\u4ef6\uff0c-s 16<\/code> \u8868\u793a\u5c06\u4e0b\u8f7d\u6e90\u5206\u4e3a 16 \u4e2a\u90e8\u5206\u3002<\/p>\n\n\n\n
2. \u4f7f\u7528 --limit-rate<\/code> \u9650\u5236\u4e0b\u8f7d\u901f\u5ea6<\/h3>\n\n\n\n
\u867d\u7136\u8fd9\u5e76\u4e0d\u4f1a\u76f4\u63a5\u52a0\u901f\u4e0b\u8f7d\uff0c\u4f46\u5982\u679c\u4e0b\u8f7d\u7684\u901f\u5ea6\u4e0d\u7a33\u5b9a\uff0c\u8bbe\u7f6e\u4e00\u4e2a\u5408\u7406\u7684\u901f\u7387\u9650\u5236\u53ef\u4ee5\u907f\u514d\u5e26\u5bbd\u6ce2\u52a8\u5f71\u54cd\u901f\u5ea6\u3002\u5728\u547d\u4ee4\u4e2d\u52a0\u4e0a --limit-rate<\/code> \u53c2\u6570\uff1a<\/p>\n\n\n\n
wget --limit-rate=1m <URL>\n<\/code><\/pre>\n\n\n\n
\u8fd9\u5c06\u9650\u5236\u4e0b\u8f7d\u901f\u5ea6\u4e3a\u6bcf\u79d2 1 MB\u3002<\/p>\n\n\n\n
3. \u542f\u7528\u65ad\u70b9\u7eed\u4f20<\/h3>\n\n\n\n
\u5982\u679c\u4e0b\u8f7d\u8fc7\u7a0b\u4e2d\u65ad\uff0c\u53ef\u4ee5\u4f7f\u7528 -c<\/code> \u6216 --continue<\/code> \u53c2\u6570\u6765\u542f\u7528\u65ad\u70b9\u7eed\u4f20\uff0c\u4ece\u4e2d\u65ad\u7684\u5730\u65b9\u7ee7\u7eed\u4e0b\u8f7d\uff1a<\/p>\n\n\n\n
wget -c <URL><\/code><\/pre>\n\n\n\n
This is a curated list of open speech datasets for speech-related research (mainly for Automatic Speech Recognition).<\/p>\n\n\n\n
Over 110<\/strong> speech datasets are collected in this repository, and more than 70<\/strong> datasets can be downloaded directly without further application or registration.<\/p>\n\n\n\n
Notice:<\/strong><\/p>\n\n\n\n
  1. This repository does not show corresponding License of each dataset. Basically it’s OK to use these datasets for research purpose only. Please make sure the License is suitable before using for commercial purpose.<\/li>
  2. Some small-scale speech corpora are not shown here for concision.<\/li><\/ol>\n\n\n\n
    1. Data Overview<\/a><\/h3>\n\n\n\n
    Dataset Acquisition<\/strong><\/th>Sup\/Unsup<\/strong><\/th>All Languages (Hours)<\/strong><\/th>Mandarin (Hours)<\/strong><\/th>English (Hours)<\/strong><\/th><\/tr><\/thead>
    download directly<\/td>supervised<\/td>199k +<\/td>2110 +<\/td>34k +<\/td><\/tr>
    download directly<\/td>unsupervised<\/td>530k +<\/td>1360 +<\/td>68k +<\/td><\/tr>
    download directly<\/td>total<\/td>729k +<\/td>3470 +<\/td>102k +<\/td><\/tr>
    need application<\/td>supervised<\/td>53k +<\/td>16740 +<\/td>50k +<\/td><\/tr>
    need application<\/td>unsupervised<\/td>60k +<\/td>12400 +<\/td>57k +<\/td><\/tr>
    need application<\/td>total<\/td>113k +<\/td>29140 +<\/td>107k +<\/td><\/tr>
    total<\/td>supervised<\/td>252k +<\/td>18850 +<\/td>84k +<\/td><\/tr>
    total<\/td>unsupervised<\/td>590k +<\/td>13760 +<\/td>125k +<\/td><\/tr>
    total<\/td>total<\/td>842k +<\/td>32610 +<\/td>209k +<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n