{"id":192,"date":"2014-07-09T22:15:11","date_gmt":"2014-07-09T13:15:11","guid":{"rendered":"https:\/\/www.dogrow.net\/nnet\/?p=192"},"modified":"2025-06-11T22:50:49","modified_gmt":"2025-06-11T13:50:49","slug":"blog15","status":"publish","type":"post","link":"https:\/\/www.dogrow.net\/nnet\/blog15\/","title":{"rendered":"(15) cuda-convnet\u3067MNIST\u81ea\u52d5\u8a8d\u8b58(\u305d\u306e2)"},"content":{"rendered":"<p><a href=\"https:\/\/www.dogrow.net\/nnet\/blog14\/\">(14) cuda-convnet\u3067MNIST\u81ea\u52d5\u8a8d\u8b58<\/a> \u306b\u7d9a\u304d\u3001\u4eca\u5ea6\u306f\u3061\u3087\u3063\u3068\u30ea\u30c3\u30c1\u306a\u30ec\u30a4\u30e4\u30fc\u69cb\u6210\u3067\u8a66\u3057\u3066\u307f\u308b\u3002<\/p>\n<h1 class=\"my_h\">1. \u5b9f\u9a13\u5185\u5bb9<\/h1>\n<p>\u3061\u3087\u3063\u3068\u30ea\u30c3\u30c1\u306a\u30ec\u30a4\u30e4\u30fc\u69cb\u6210\u306f\u3053\u3093\u306a\u611f\u3058\u3002<br \/>\n[IN]-<span style=\"color: #0000ff;\">[CONV]<\/span>&#8211;<span style=\"color: #ff0000;\">[POOL]<\/span>&#8211;<span style=\"color: #0000ff;\">[CONV]<\/span>&#8211;<span style=\"color: #ff0000;\">[POOL]<\/span>-[OUT]\u306e\u7d50\u5408\u3067\u3001<span style=\"color: #0000ff;\">[CONV] <\/span>\u3068 <span style=\"color: #ff0000;\">[POOL]<\/span> \u306f\u540416\u679a\u306e\u539a\u307f\u3092\u6301\u305f\u305b\u3066\u3044\u308b\u3002<\/p>\n<pre>[data]\r\ntype=data\r\ndataIdx=0\r\n\r\n[labels]\r\ntype=data\r\ndataIdx=1\r\n\r\n[conv1]\r\ntype=conv\r\ninputs=data\r\nchannels=1\r\nfilters=16\r\npadding=0\r\nstride=1\r\nfilterSize=5\r\ninitW=0.0001\r\npartialSum=1\r\nsharedBiases=1\r\nneuron=tanh[1,1]\r\n\r\n[pool1]\r\ntype=pool\r\npool=max\r\ninputs=conv1\r\nstart=0\r\nsizeX=2\r\nstride=2\r\noutputsX=0\r\nchannels=16\r\n\r\n[conv2]\r\ntype=conv\r\ninputs=pool1\r\nfilters=16\r\npadding=0\r\nstride=1\r\nfilterSize=5\r\nchannels=16\r\nneuron=tanh[1,1]\r\ninitW=0.01\r\npartialSum=1\r\nsharedBiases=1\r\n\r\n[pool2]\r\ntype=pool\r\npool=avg\r\ninputs=conv2\r\nstart=0\r\nsizeX=2\r\nstride=2\r\noutputsX=0\r\nchannels=16\r\n\r\n[fcOut]\r\ntype=fc\r\noutputs=10\r\ninputs=pool2\r\ninitW=0.01\r\ninitB=0.1\r\n\r\n[probs]\r\ntype=softmax\r\ninputs=fcOut\r\n\r\n[logprob]\r\ntype=cost.logreg\r\ninputs=labels,probs\r\n<\/pre>\n<p>\u5b66\u7fd2\u7387\u3001momentum\u3001L2\u6b63\u5247\u5316\u4fc2\u6570\u306f\u3053\u3093\u306a\u611f\u3058\u3002<\/p>\n<pre>[conv1]\r\nepsW=0.01\r\nepsB=0.01\r\nmomW=0.9\r\nmomB=0.9\r\nwc=0.0001\r\n\r\n[conv2]\r\nepsW=0.01\r\nepsB=0.01\r\nmomW=0.9\r\nmomB=0.9\r\nwc=0.0001\r\n\r\n[fcOut]\r\nepsW=0.01\r\nepsB=0.01\r\nmomW=0.9\r\nmomB=0.9\r\nwc=0.0001\r\n\r\n[logprob]\r\ncoeff=1\r\n<\/pre>\n<h1 class=\"my_h\">2. \u5b9f\u884c\u7d50\u679c<\/h1>\n<p>1epoch\u5b8c\u4e86\u6642\u70b9\u3067\u6b63\u89e3\u7387\u304c <span class=\"my_fc_blueBBig\">93.3%<\/span> (error rate=0.0670)<br \/>\n10epoch\u5b8c\u4e86\u6642\u70b9\u3067\u6b63\u89e3\u7387\u304c <span class=\"my_fc_blueBBig\">98.0%<\/span> (error rate=0.0194)<\/p>\n<pre>=========================\r\n1.1... logprob:  1.066792, 0.262400 (1.194 sec)\r\n1.2... logprob:  0.411331, 0.117200 (0.622 sec)\r\n1.3... logprob:  0.342615, 0.099900 (0.623 sec)\r\n1.4... logprob:  0.316771, 0.091300 (0.623 sec)\r\n1.5... logprob:  0.282887, 0.084500 (0.623 sec)\r\n1.6... logprob:  0.230386, 0.063700 \r\n======================Test output======================\r\nlogprob:  0.221841, 0.067000 \r\n---\r\n10.1... logprob:  0.073848, 0.020500 (0.623 sec)\r\n10.2... logprob:  0.074025, 0.020300 (0.623 sec)\r\n10.3... logprob:  0.074177, 0.020200 (0.622 sec)\r\n10.4... logprob:  0.077257, 0.023000 (0.623 sec)\r\n10.5... logprob:  0.077007, 0.024400 (0.622 sec)\r\n10.6... logprob:  0.063696, 0.017700 \r\n======================Test output======================\r\nlogprob:  0.068057, 0.019400 \r\n<\/pre>\n<p>\u5b9f\u969b\u306e\u81ea\u52d5\u8a8d\u8b58\u7d50\u679c\u3092\u898b\u3066\u307f\u308b\u3068\u2026<\/p>\n<pre>[user@linux]$ SAVEDATA=..\/save\/MNIST\/ConvNet__2014-07-09_22.10.42\/\r\n[user@linux]$ python ..\/cuda-convnet-read-only\/shownet.py -f $SAVEDATA --show-preds=probs\r\n<\/pre>\n<p><a href=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_03.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-193\" src=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_03.png\" alt=\"20140709_03\" width=\"333\" height=\"317\" srcset=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_03.png 333w, https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_03-300x285.png 300w\" sizes=\"auto, (max-width: 333px) 100vw, 333px\" \/><\/a><br \/>\n<a href=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_04.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-194\" src=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_04.png\" alt=\"20140709_04\" width=\"377\" height=\"370\" srcset=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_04.png 377w, https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_04-300x294.png 300w\" sizes=\"auto, (max-width: 377px) 100vw, 377px\" \/><\/a><\/p>\n<p><span class=\"my_fc_deeppinkBBig\">\u65e2\u5b58\u306e\u5b66\u7fd2\u7d50\u679c\u3092\u4f7f\u7528\u3057\u3066\u30c6\u30b9\u30c8\u3060\u3051\u5b9f\u884c\u3057\u305f\u3044\u3068\u304d\u306f&#8230;<\/span><br \/>\nconvnet.py\u306e\u5f15\u6570\u306f\u4e0b\u8a18\u306e3\u500b\u3060\u3051\u3067\u3088\u3044\u3002<\/p>\n<pre>\r\npython convnet.py -f xxxx\/ConvNet__2014-07-08_00.22.30 --test-only=1 --test-range=6\r\n<\/pre>\n<hr class=\"my_hr_bottom\">\n","protected":false},"excerpt":{"rendered":"<p>(14) cuda-convnet\u3067MNIST\u81ea\u52d5\u8a8d\u8b58 \u306b\u7d9a\u304d\u3001\u4eca\u5ea6\u306f\u3061\u3087\u3063\u3068\u30ea\u30c3\u30c1\u306a\u30ec\u30a4\u30e4\u30fc\u69cb\u6210\u3067\u8a66\u3057\u3066\u307f\u308b\u3002 1. \u5b9f\u9a13\u5185\u5bb9 \u3061\u3087\u3063\u3068\u30ea\u30c3\u30c1\u306a\u30ec\u30a4\u30e4\u30fc\u69cb\u6210\u306f\u3053\u3093\u306a\u611f\u3058\u3002 [IN]-[CONV]&#8211;[POOL\u2026 <span class=\"read-more\"><a href=\"https:\/\/www.dogrow.net\/nnet\/blog15\/\">\u7d9a\u304d\u3092\u8aad\u3080 &raquo;<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,10,18],"tags":[],"class_list":["post-192","post","type-post","status-publish","format-standard","hentry","category-cuda","category-cuda-convnet","category-mnist"],"views":2754,"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/posts\/192","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/comments?post=192"}],"version-history":[{"count":16,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/posts\/192\/revisions"}],"predecessor-version":[{"id":2547,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/posts\/192\/revisions\/2547"}],"wp:attachment":[{"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/media?parent=192"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/categories?post=192"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/tags?post=192"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}