{"id":179,"date":"2014-07-09T21:56:01","date_gmt":"2014-07-09T12:56:01","guid":{"rendered":"https:\/\/www.dogrow.net\/nnet\/?p=179"},"modified":"2025-06-11T22:50:39","modified_gmt":"2025-06-11T13:50:39","slug":"blog14","status":"publish","type":"post","link":"https:\/\/www.dogrow.net\/nnet\/blog14\/","title":{"rendered":"(14) cuda-convnet\u3067MNIST\u81ea\u52d5\u8a8d\u8b58(\u305d\u306e1)"},"content":{"rendered":"<p><a href=\"https:\/\/www.dogrow.net\/nnet\/blog12\/\">(12) cuda-convnet\u7528MNIST\u30c7\u30fc\u30bf\u3092\u4f5c\u308b(\u305d\u306e2)<\/a>\u3067 <span class=\"my_fc_deeppinkB\">batches.meta<\/span> \u3092\u4f5c\u308a\u3001<br \/>\n<a href=\"https:\/\/www.dogrow.net\/nnet\/blog13\/\">(13) cuda-convnet\u7528MNIST\u30c7\u30fc\u30bf\u3092\u4f5c\u308b(\u305d\u306e3)<\/a>\u3067 <span class=\"my_fc_deeppinkB\">data_batch_n<\/span> \u3092\u4f5c\u308a\u3001<br \/>\n\u3044\u3088\u3044\u3088 <span class=\"my_fc_deeppinkB\">cuda-convnet \u3067 MNIST<\/span> \u3092\u5b66\u7fd2\uff06\u30c6\u30b9\u30c8\u3057\u3066\u307f\u308b\u3002<\/p>\n<h1 class=\"my_h\">1. \u5b9f\u9a13\u5185\u5bb9<\/h1>\n<p>\u307e\u305a\u306f <a href=\"https:\/\/www.dogrow.net\/nnet\/blog4\/\">(4) \u30b7\u30f3\u30d7\u30eb\u69cb\u6210\u306e\u521d\u7248\u306f\u6b63\u89e3\u738791%<\/a> \u3067\u6700\u9ad8\u30b9\u30b3\u30a2\u3092\u8a18\u9332\u3057\u305f<br \/>\n\u300c4\u5c64 [784]-[256]-[64]-[10] \u306e\u6b63\u89e3\u738791.9%\u300d<br \/>\n\u306b\u8fd1\u3044\u30ec\u30a4\u30e4\u30fc\u69cb\u6210\u3067\u8a66\u3057\u3066\u307f\u308b\u3002<\/p>\n<p>\u30ec\u30a4\u30e4\u30fc\u306e\u69cb\u6210\u306f\u3053\u3093\u306a\u611f\u3058\u3002<\/p>\n<pre>[data]\r\ntype=data\r\ndataIdx=0\r\n\r\n[labels]\r\ntype=data\r\ndataIdx=1\r\n\r\n[fc1]\r\ntype=fc\r\ninputs=data\r\noutputs=256\r\ninitW=0.1\r\nneuron=logistic\r\n\r\n[fc2]\r\ntype=fc\r\ninputs=fc1\r\noutputs=64\r\ninitW=0.1\r\nneuron=logistic\r\n\r\n[fcOut]\r\ntype=fc\r\noutputs=10\r\ninputs=fc2\r\ninitW=0.1\r\ninitB=0.1\r\n\r\n[probs]\r\ntype=softmax\r\ninputs=fcOut\r\n\r\n[logprob]\r\ntype=cost.logreg\r\ninputs=labels,probs\r\n<\/pre>\n<p>\u5b66\u7fd2\u7387\u3001momentum\u3001L2\u6b63\u5247\u5316\u4fc2\u6570\u306f\u3053\u3093\u306a\u611f\u3058\u3002<\/p>\n<pre>[fc1]\r\nepsW=0.05\r\nepsB=0.05\r\nmomW=0.9\r\nmomB=0.9\r\nwc=0.00001\r\n\r\n[fc2]\r\nepsW=0.05\r\nepsB=0.05\r\nmomW=0.9\r\nmomB=0.9\r\nwc=0.00001\r\n\r\n[fcOut]\r\nepsW=0.05\r\nepsB=0.05\r\nmomW=0.9\r\nmomB=0.9\r\nwc=0.00001\r\n\r\n[logprob]\r\ncoeff=1\r\n<\/pre>\n<h1 class=\"my_h\">2. \u5b9f\u884c\u7d50\u679c<\/h1>\n<p>1epoch\u5b8c\u4e86\u6642\u70b9\u3067\u6b63\u89e3\u7387\u304c <span class=\"my_fc_blueBBig\">88.5%<\/span> (error rate=0.1146)<br \/>\n10epoch\u5b8c\u4e86\u6642\u70b9\u3067\u6b63\u89e3\u7387\u304c <span class=\"my_fc_blueBBig\">93.6%<\/span> (error rate=0.0640)<\/p>\n<pre>=========================\r\n1.1... logprob:  1.470148, 0.409900 (0.660 sec)\r\n1.2... logprob:  0.599354, 0.162500 (0.102 sec)\r\n1.3... logprob:  0.474667, 0.133800 (0.102 sec)\r\n1.4... logprob:  0.441993, 0.130400 (0.102 sec)\r\n1.5... logprob:  0.427795, 0.127700 (0.102 sec)\r\n1.6... logprob:  0.363772, 0.107600 \r\n======================Test output======================\r\nlogprob:  0.382512, 0.114600 \r\n---\r\n======================================================= (0.150 sec)\r\n10.1... logprob:  0.215052, 0.064400 (0.103 sec)\r\n10.2... logprob:  0.224370, 0.068200 (0.102 sec)\r\n10.3... logprob:  0.226908, 0.070900 (0.102 sec)\r\n10.4... logprob:  0.212489, 0.065500 (0.102 sec)\r\n10.5... logprob:  0.231503, 0.069500 (0.102 sec)\r\n10.6... logprob:  0.192322, 0.057600 \r\n======================Test output======================\r\nlogprob:  0.209273, 0.064000 \r\n<\/pre>\n<p>\u5b9f\u969b\u306e\u81ea\u52d5\u8a8d\u8b58\u7d50\u679c\u3092\u898b\u3066\u307f\u308b\u3068&#8230;<\/p>\n<pre>[user@linux]$ SAVEDATA=..\/save\/MNIST\/ConvNet__2014-07-09_21.45.35\/\r\n[user@linux]$ python ..\/cuda-convnet-read-only\/shownet.py -f $SAVEDATA --show-preds=probs\r\n<\/pre>\n<p><a href=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_01.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-180\" src=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_01.png\" alt=\"20140709_01\" width=\"340\" height=\"314\" srcset=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_01.png 340w, https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_01-300x277.png 300w\" sizes=\"auto, (max-width: 340px) 100vw, 340px\" \/><\/a><br \/>\n<a href=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_02.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-181\" src=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_02.png\" alt=\"20140709_02\" width=\"338\" height=\"321\" srcset=\"https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_02.png 338w, https:\/\/www.dogrow.net\/nnet\/wp-content\/uploads\/2014\/07\/20140709_02-300x284.png 300w\" sizes=\"auto, (max-width: 338px) 100vw, 338px\" \/><\/a><\/p>\n<hr class=\"my_hr_bottom\">\n","protected":false},"excerpt":{"rendered":"<p>(12) cuda-convnet\u7528MNIST\u30c7\u30fc\u30bf\u3092\u4f5c\u308b(\u305d\u306e2)\u3067 batches.meta \u3092\u4f5c\u308a\u3001 (13) cuda-convnet\u7528MNIST\u30c7\u30fc\u30bf\u3092\u4f5c\u308b(\u305d\u306e3)\u3067 data_batch_n \u3092\u4f5c\u308a\u3001 \u3044\u3088\u2026 <span class=\"read-more\"><a href=\"https:\/\/www.dogrow.net\/nnet\/blog14\/\">\u7d9a\u304d\u3092\u8aad\u3080 &raquo;<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,10,18],"tags":[],"class_list":["post-179","post","type-post","status-publish","format-standard","hentry","category-cuda","category-cuda-convnet","category-mnist"],"views":2720,"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/posts\/179","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/comments?post=179"}],"version-history":[{"count":20,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/posts\/179\/revisions"}],"predecessor-version":[{"id":2546,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/posts\/179\/revisions\/2546"}],"wp:attachment":[{"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/media?parent=179"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/categories?post=179"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dogrow.net\/nnet\/wp-json\/wp\/v2\/tags?post=179"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}