14.5.7.5.1 Convolutional Neural Networks Implementation Issues

Chapter Contents (Back)
Convolutional Neural Networks. Neural Networks. Deep Nets. CNN.

Cao, Y.Q.[Yong-Qiang], Chen, Y.[Yang], Khosla, D.[Deepak],
Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition,
IJCV(113), No. 1, May 2015, pp. 54-66.
Springer DOI 1506
BibRef

Kim, I.J.[In-Jung], Choi, C.[Changbeom], Lee, S.H.[Sang-Heon],
Improving discrimination ability of convolutional neural networks by hybrid learning,
IJDAR(19), No. 1, March 2016, pp. 1-9.
WWW Link. 1602
BibRef

Xu, G., Wu, H.Z., Shi, Y.Q.,
Structural Design of Convolutional Neural Networks for Steganalysis,
SPLetters(23), No. 5, May 2016, pp. 708-712.
IEEE DOI 1604
Computer architecture BibRef

Nogueira, K.[Keiller], Penatti, O.A.B.[Otávio A.B.], dos Santos, J.A.[Jefersson A.],
Towards better exploiting convolutional neural networks for remote sensing scene classification,
PR(61), No. 1, 2017, pp. 539-556.
Elsevier DOI 1705
BibRef
Earlier: A2, A1, A3:
Do deep features generalize from everyday objects to remote sensing and aerial scenes domains?,
EarthObserv15(44-51)
IEEE DOI 1510
Accuracy. Evaluation of convolutional networks. BibRef

Kuo, C.C.J.[C.C. Jay],
Understanding convolutional neural networks with a mathematical model,
JVCIR(41), No. 1, 2016, pp. 406-413.
Elsevier DOI 1612
Convolutional neural network (CNN) BibRef

Chellappa, R.[Rama],
The changing fortunes of pattern recognition and computer vision,
IVC(55, Part 1), No. 1, 2016, pp. 3-5.
Elsevier DOI 1612
Convolutional Neural Networks BibRef

Xu, C., Lu, C., Liang, X., Gao, J., Zheng, W., Wang, T., Yan, S.,
Multi-loss Regularized Deep Neural Network,
CirSysVideo(26), No. 12, December 2016, pp. 2273-2283.
IEEE DOI 1612
Computer architecture BibRef

Montavon, G.[Grégoire], Lapuschkin, S.[Sebastian], Binder, A.[Alexander], Samek, W.[Wojciech], Müller, K.R.[Klaus-Robert],
Explaining nonlinear classification decisions with deep Taylor decomposition,
PR(65), No. 1, 2017, pp. 211-222.
Elsevier DOI 1702
Deep neural networks BibRef

Lapuschkin, S., Binder, A., Montavon, G.[Grégoire], Müller, K.R.[Klaus-Robert], Samek, W.[Wojciech],
Analyzing Classifiers: Fisher Vectors and Deep Neural Networks,
CVPR16(2912-2920)
IEEE DOI 1612
BibRef

Fan, J.P.[Jian-Ping], Zhao, T.Y.[Tian-Yi], Kuang, Z.Z.[Zhen-Zhong], Zheng, Y.[Yu], Zhang, J.[Ji], Yu, J.[Jun], Peng, J.Y.[Jin-Ye],
HD-MTL: Hierarchical Deep Multi-Task Learning for Large-Scale Visual Recognition,
IP(26), No. 4, April 2017, pp. 1923-1938.
IEEE DOI 1704
Atomic layer deposition. Large-scale. BibRef

Du, B.[Bo], Xiong, W.[Wei], Wu, J.[Jia], Zhang, L.F.[Le-Fei], Zhang, L.P.[Liang-Pei], Tao, D.C.[Da-Cheng],
Stacked Convolutional Denoising Auto-Encoders for Feature Representation,
Cyber(47), No. 4, April 2017, pp. 1017-1027.
IEEE DOI 1704
Convolution BibRef

Geng, J., Wang, H., Fan, J., Ma, X.,
Deep Supervised and Contractive Neural Network for SAR Image Classification,
GeoRS(55), No. 4, April 2017, pp. 2442-2459.
IEEE DOI 1704
feature extraction BibRef

Malik, J.[Jitendra],
Technical Perspective: What Led Computer Vision to Deep Learning?,
CACM(60), No. 6, June 2017, pp. 82-83.
DOI Link 1706
Discusses next paper BibRef

Krizhevsky, A.[Alex], Sutskever, I.[Ilya], Hinton, G.E.[Geoffrey E.],
ImageNet Classification with Deep Convolutional Neural Networks,
CACM(60), No. 6, June 2017, pp. 84-90.
DOI Link 1706
Survey, Convolutional Networks. BibRef

Pan, X.Q.[Xia-Qing], Chen, Y.[Yueru], Kuo, C.C.J.[C.C. Jay],
Design, analysis and application of a volumetric convolutional neural network,
JVCIR(46), No. 1, 2017, pp. 128-138.
Elsevier DOI 1706
Convolutional, neural, network BibRef

Mishkin, D.[Dmytro], Sergievskiy, N.[Nikolay], Matas, J.[Jiri],
Systematic evaluation of convolution neural network advances on the Imagenet,
CVIU(161), No. 1, 2017, pp. 11-19.
Elsevier DOI 1708
CNN BibRef


Kossaifi, J.[Jean], Khanna, A.[Aran], Lipton, Z.[Zachary], Furlanello, T.[Tommaso], Anandkumar, A.[Anima],
Tensor Contraction Layers for Parsimonious Deep Nets,
Tensor17(1940-1946)
IEEE DOI 1709
Complexity theory, Computer vision, Tensile stress BibRef

Narodytska, N., Kasiviswanathan, S.,
Simple Black-Box Adversarial Attacks on Deep Neural Networks,
PRIV17(1310-1318)
IEEE DOI 1709
Computer vision, Knowledge engineering, Network architecture, Neural networks, Robustness, Training BibRef

Guo, J.[Jia], Potkonjak, M.[Miodrag],
Pruning ConvNets Online for Efficient Specialist Models,
ECVW17(430-437)
IEEE DOI 1709
Biological neural networks, Computational modeling, Computer vision, Convolution, Memory management, Sensitivity, analysis BibRef

Lin, J.H., Xing, T., Zhao, R., Zhang, Z., Srivastava, M., Tu, Z., Gupta, R.K.,
Binarized Convolutional Neural Networks with Separable Filters for Efficient Hardware Acceleration,
ECVW17(344-352)
IEEE DOI 1709
Backpropagation, Convolution, Field programmable gate arrays, Filtering theory, Hardware, Kernel, Training BibRef

Liu, X., Li, S., Kan, M., Shan, S., Chen, X.,
Self-Error-Correcting Convolutional Neural Network for Learning with Noisy Labels,
FG17(111-117)
IEEE DOI 1707
Biological neural networks, Face, Neurons, Noise measurement, Noise robustness, Switches, Training BibRef

Araújo, T.[Teresa], Aresta, G.[Guilherme], Almada-Lobo, B.[Bernardo], Mendonça, A.M.[Ana Maria], Campilho, A.[Aurélio],
Improving Convolutional Neural Network Design via Variable Neighborhood Search,
ICIAR17(371-379).
Springer DOI 1706
BibRef

Ibrahim, A.[Ahmed], Abbott, A.L.[A. Lynn], Hussein, M.E.[Mohamed E.],
Input Fast-Forwarding for Better Deep Learning,
ICIAR17(363-370).
Springer DOI 1706
BibRef

Hernández, G.[Gerardo], Zamora, E.[Erik], Sossa, H.[Humberto],
Comparing Deep and Dendrite Neural Networks: A Case Study,
MCPR17(32-41).
Springer DOI 1706
BibRef

Xu, X., Todorovic, S.,
Beam search for learning a deep Convolutional Neural Network of 3D shapes,
ICPR16(3506-3511)
IEEE DOI 1705
Computational modeling, Computer architecture, Knowledge transfer, Shape, Solid modeling, Three-dimensional displays, Training BibRef

Gwon, Y.[Youngjune], Cha, M.[Miriam], Kung, H.T.,
Deep Sparse-coded Network (DSN),
ICPR16(2610-2615)
IEEE DOI 1705
Backpropagation, Computer architecture, Dictionaries, Encoding, Neural networks, Nonhomogeneous media, Training BibRef

Teerapittayanon, S., McDanel, B., Kung, H.T.,
BranchyNet: Fast inference via early exiting from deep neural networks,
ICPR16(2464-2469)
IEEE DOI 1705
Entropy, Feedforward neural networks, Inference algorithms, Optimization, Runtime, Training BibRef

Pham, T., Tran, T., Phung, D., Venkatesh, S.,
Faster training of very deep networks via p-norm gates,
ICPR16(3542-3547)
IEEE DOI 1705
Computer architecture, Feedforward neural networks, Logic gates, Road transportation, Standards, Training BibRef

Tabernik, D.[Domen], Kristan, M.[Matej], Wyatt, J.L., Leonardis, A.[Aleš],
Towards deep compositional networks,
ICPR16(3470-3475)
IEEE DOI 1705
Computational modeling, Convolution, Cost function, Mathematical model, Neural networks, Standards, Visualization BibRef

Kabkab, M., Hand, E., Chellappa, R.,
On the size of Convolutional Neural Networks and generalization performance,
ICPR16(3572-3577)
IEEE DOI 1705
Boolean functions, Databases, Feedforward neural networks, Probability distribution, Testing, Training BibRef

Uchida, K., Tanaka, M., Okutomi, M.,
Coupled convolution layer for convolutional neural network,
ICPR16(3548-3553)
IEEE DOI 1705
Cells (biology), Convolution, Optical imaging, Photonics, Photoreceptors, Retina, Training BibRef

Wang, Y.Q.[Ye-Qing], Li, Y.[Yi], Porikli, F.M.[Fatih M.],
Finetuning Convolutional Neural Networks for visual aesthetics,
ICPR16(3554-3559)
IEEE DOI 1705
Computer vision, Feature extraction, Machine learning, Neural networks, Semantics, Training, Visualization, Deep learning, visual, aesthetics BibRef

Burlina, P.,
MRCNN: A stateful Fast R-CNN,
ICPR16(3518-3523)
IEEE DOI 1705
Bayes methods, Filtering, Graphics processing units, Object detection, Proposals, Target tracking, ConvNets, Deep Learning, Fast R-CNN, Region CNNs in Video, Region, Proposals BibRef

Tobías, L., Ducournau, A., Rousseau, F., Mercier, G., Fablet, R.,
Convolutional Neural Networks for object recognition on mobile devices: A case study,
ICPR16(3530-3535)
IEEE DOI 1705
Biological neural networks, Computational modeling, Computer architecture, Feature extraction, Kernel, Mobile handsets, Training, Convolutional Neural Networks, Deep Learning, Machine Learning, Mobile Devices, Object, Detection BibRef

Afridi, M.J., Ross, A., Shapiro, E.M.,
L-CNN: Exploiting labeling latency in a CNN learning framework,
ICPR16(2156-2161)
IEEE DOI 1705
Biomedical imaging, Computer architecture, Labeling, Magnetic resonance imaging, Microprocessors, Testing, Training BibRef

Ghaderi, A., Athitsos, V.,
Selective unsupervised feature learning with Convolutional Neural Network (S-CNN),
ICPR16(2486-2490)
IEEE DOI 1705
Classification algorithms, Convolutional codes, Kernel, Neural networks, Search problems, Support vector machines, Training, Artificial Neural Networks, Classification and Clustring, Deep, Learning BibRef

Käding, C.[Christoph], Rodner, E.[Erik], Freytag, A.[Alexander], Denzler, J.[Joachim],
Fine-Tuning Deep Neural Networks in Continuous Learning Scenarios,
DeepVisual16(III: 588-605).
Springer DOI 1704
BibRef

Kirillov, A., Schlesinger, D., Zheng, S., Savchynskyy, B., Torr, P.H.S., Rother, C.,
Joint Training of Generic CNN-CRF Models with Stochastic Optimization,
ACCV16(II: 221-236).
Springer DOI 1704
BibRef

Opitz, M.[Michael], Possegger, H.[Horst], Bischof, H.[Horst],
Efficient Model Averaging for Deep Neural Networks,
ACCV16(II: 205-220).
Springer DOI 1704
BibRef

Gao, Y., Liu, Z., Wang, D.,
Error models of finite word length arithmetic in CNN accelerator design,
VCIP16(1-4)
IEEE DOI 1701
Analytical models BibRef

Shaheen, F.[Fatma], Verma, B.[Brijesh], Asafuddoula, M.,
Impact of Automatic Feature Extraction in Deep Learning Architecture,
DICTA16(1-8)
IEEE DOI 1701
Biological neural networks BibRef

Mhalla, A.[Ala], Maamatou, H.[Houda], Chateau, T.[Thierry], Gazzah, S.[Sami], Ben Amara, N.E.[Najoua Essoukri],
Faster R-CNN Scene Specialization with a Sequential Monte-Carlo Framework,
DICTA16(1-7)
IEEE DOI 1701
Approximation algorithms BibRef

Mao, F.L.[Feng-Ling], Xiong, W.[Wei], Du, B.[Bo], Zhang, L.[Lefei],
Stochastic Decorrelation Constraint Regularized Auto-Encoder for Visual Recognition,
MMMod17(II: 368-380).
Springer DOI 1701
BibRef

Liu, Y.[Yu], Guo, Y.M.[Yan-Ming], Lew, M.S.[Michael S.],
On the Exploration of Convolutional Fusion Networks for Visual Recognition,
MMMod17(I: 277-289).
Springer DOI 1701
BibRef

Ujiie, T., Hiromoto, M., Sato, T.,
Approximated Prediction Strategy for Reducing Power Consumption of Convolutional Neural Network Processor,
ECVW16(870-876)
IEEE DOI 1612
BibRef

Honari, S.[Sina], Yosinski, J.[Jason], Vincent, P.[Pascal], Pal, C.[Christopher],
Recombinator Networks: Learning Coarse-to-Fine Feature Aggregation,
CVPR16(5743-5752)
IEEE DOI 1612
BibRef

Hu, P.Y.[Pei-Yun], Ramanan, D.[Deva],
Bottom-Up and Top-Down Reasoning with Hierarchical Rectified Gaussians,
CVPR16(5600-5609)
IEEE DOI 1612
BibRef

Lavin, A.[Andrew], Gray, S.[Scott],
Fast Algorithms for Convolutional Neural Networks,
CVPR16(4013-4021)
IEEE DOI 1612
BibRef

Misra, I.[Ishan], Shrivastava, A.[Abhinav], Gupta, A.[Abhinav], Hebert, M.[Martial],
Cross-Stitch Networks for Multi-task Learning,
CVPR16(3994-4003)
IEEE DOI 1612
Learn shared representations. BibRef

Hu, H.X.[He-Xiang], Zhou, G.T.[Guang-Tong], Deng, Z.W.[Zhi-Wei], Liao, Z.C.[Zi-Cheng], Mori, G.[Greg],
Learning Structured Inference Neural Networks with Label Relations,
CVPR16(2960-2968)
IEEE DOI 1612
Network for each layer of representation. BibRef

Szegedy, C.[Christian], Vanhoucke, V.[Vincent], Ioffe, S.[Sergey], Shlens, J.[Jon], Wojna, Z.[Zbigniew],
Rethinking the Inception Architecture for Computer Vision,
CVPR16(2818-2826)
IEEE DOI 1612
scale-up CNN recognition to larger number of classes. BibRef

Zhang, Z.M.[Zi-Ming], Chen, Y.T.[Yu-Ting], Saligrama, V.[Venkatesh],
Efficient Training of Very Deep Neural Networks for Supervised Hashing,
CVPR16(1487-1495)
IEEE DOI 1612
BibRef

Jain, A.[Ashesh], Zamir, A.R.[Amir R.], Savarese, S.[Silvio], Saxena, A.[Ashutosh],
Structural-RNN: Deep Learning on Spatio-Temporal Graphs,
CVPR16(5308-5317)
IEEE DOI 1612
Award, CVPR, Student. BibRef

Xie, L., Wang, J., Wei, Z., Wang, M., Tian, Q.,
DisturbLabel: Regularizing CNN on the Loss Layer,
CVPR16(4753-4762)
IEEE DOI 1612
BibRef

Smith, L.N.,
Cyclical Learning Rates for Training Neural Networks,
WACV17(464-472)
IEEE DOI 1609
Computational efficiency, Computer architecture, Neural networks, Schedules, Training, Tuning BibRef

Smith, L.N., Hand, E.M., Doster, T.,
Gradual DropIn of Layers to Train Very Deep Neural Networks,
CVPR16(4763-4771)
IEEE DOI 1612
BibRef

Cohen, N., Sharir, O., Shashua, A.,
Deep SimNets,
CVPR16(4782-4791)
IEEE DOI 1612
BibRef

Shankar, S., Robertson, D., Ioannou, Y., Criminisi, A., Cipolla, R.[Roberto],
Refining Architectures of Deep Convolutional Neural Networks,
CVPR16(2212-2220)
IEEE DOI 1612
BibRef

Chen, H.G., Jayasuriya, S., Yang, J., Stephen, J., Sivaramakrishnan, S., Veeraraghavan, A., Molnar, A.,
ASP Vision: Optically Computing the First Layer of Convolutional Neural Networks Using Angle Sensitive Pixels,
CVPR16(903-912)
IEEE DOI 1612
BibRef

Wang, J.D.[Jing-Dong], Yuille, A.L.[Alan L.], Tian, Q.[Qi],
InterActive: Inter-Layer Activeness Propagation,
CVPR16(270-279)
IEEE DOI 1612
BibRef

Jacobsen, J.H., van Gemert, J.C.[Jan C.], Lou, Z., Smeulders, A.W.M.,
Structured Receptive Fields in CNNs,
CVPR16(2610-2619)
IEEE DOI 1612
BibRef

Lebedev, V., Lempitsky, V.,
Fast ConvNets Using Group-Wise Brain Damage,
CVPR16(2554-2564)
IEEE DOI 1612
BibRef

Rastegar, S., Baghshah, M.S.[Mahdieh Soleymani], Rabiee, H.R., Shojaee, S.M.,
MDL-CW: A Multimodal Deep Learning Framework with CrossWeights,
CVPR16(2601-2609)
IEEE DOI 1612
BibRef

Moosavi-Dezfooli, S.M., Fawzi, A., Frossard, P.,
DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks,
CVPR16(2574-2582)
IEEE DOI 1612
BibRef

Wu, J.X.[Jia-Xiang], Leng, C.[Cong], Wang, Y.H.[Yu-Hang], Hu, Q.H.[Qing-Hao], Cheng, J.[Jian],
Quantized Convolutional Neural Networks for Mobile Devices,
CVPR16(4820-4828)
IEEE DOI 1612
Implementations. BibRef

Xie, L.X.[Ling-Xi], Tian, Q.[Qi], Flynn, J.[John], Wang, J.D.[Jing-Dong], Yuille, A.L.[Alan L.],
Geometric Neural Phrase Pooling: Modeling the Spatial Co-Occurrence of Neurons,
ECCV16(I: 645-661).
Springer DOI 1611
BibRef

Jin, X.J.[Xiao-Jie], Chen, Y.P.[Yun-Peng], Dong, J.[Jian], Feng, J.[Jiashi], Yan, S.C.[Shui-Cheng],
Collaborative Layer-Wise Discriminative Learning in Deep Neural Networks,
ECCV16(VII: 733-749).
Springer DOI 1611
BibRef

Goo, W.[Wonjoon], Kim, J.Y.[Ju-Yong], Kim, G.[Gunhee], Hwang, S.J.[Sung Ju],
Taxonomy-Regularized Semantic Deep Convolutional Neural Networks,
ECCV16(II: 86-101).
Springer DOI 1611
BibRef

Shen, L.[Li], Lin, Z.C.[Zhou-Chen], Huang, Q.M.[Qing-Ming],
Relay Backpropagation for Effective Learning of Deep Convolutional Neural Networks,
ECCV16(VII: 467-482).
Springer DOI 1611
BibRef

Wang, Z.Y.[Zhen-Yang], Deng, Z.D.[Zhi-Dong], Wang, S.[Shiyao],
Accelerating Convolutional Neural Networks with Dominant Convolutional Kernel and Knowledge Pre-regression,
ECCV16(VIII: 533-548).
Springer DOI 1611
BibRef

Zhou, H.[Hao], Alvarez, J.M.[Jose M.], Porikli, F.M.[Fatih M.],
Less Is More: Towards Compact CNNs,
ECCV16(IV: 662-677).
Springer DOI 1611
BibRef

Shrivastava, A.[Abhinav], Gupta, A.[Abhinav],
Contextual Priming and Feedback for Faster R-CNN,
ECCV16(I: 330-348).
Springer DOI 1611
BibRef

Yu, D.[Dan], Wu, X.J.[Xiao-Jun],
VLAD Is not Necessary for CNN,
TASKCV16(III: 492-499).
Springer DOI 1611
BibRef

Bach, S.[Sebastian], Binder, A.[Alexander], Müller, K.R.[Klaus-Robert], Samek, W.[Wojciech],
Controlling explanatory heatmap resolution and semantics via decomposition depth,
ICIP16(2271-2275)
IEEE DOI 1610
Computational modeling BibRef

Pang, J., Lin, H., Su, L., Zhang, C., Zhang, W., Duan, L., Huang, Q., Yin, B.,
Accelerate convolutional neural networks for binary classification via cascading cost-sensitive feature,
ICIP16(1037-1041)
IEEE DOI 1610
Acceleration BibRef

Pasquet, J., Chaumont, M., Subsol, G., Derras, M.,
Speeding-up a convolutional neural network by connecting an SVM network,
ICIP16(2286-2290)
IEEE DOI 1610
Computational efficiency BibRef

Carvalho, M., Cord, M., Avila, S., Thome, N., Valle, E.,
Deep neural networks under stress,
ICIP16(4443-4447)
IEEE DOI 1610
Computational modeling BibRef

Park, W.S., Kim, M.,
CNN-based in-loop filtering for coding efficiency improvement,
IVMSP16(1-5)
IEEE DOI 1608
Convolution BibRef

Moons, B.[Bert], de Brabandere, B.[Bert], Van Gool, L.J.[Luc J.], Verhelst, M.[Marian],
Energy-efficient ConvNets through approximate computing,
WACV16(1-8)
IEEE DOI 1606
Approximation algorithms BibRef

Liao, Z., Carneiro, G.,
On the importance of normalisation layers in deep learning with piecewise linear activation units,
WACV16(1-8)
IEEE DOI 1606
Data models BibRef

Li, N., Takaki, S., Tomiokay, Y., Kitazawa, H.,
A multistage dataflow implementation of a Deep Convolutional Neural Network based on FPGA for high-speed object recognition,
Southwest16(165-168)
IEEE DOI 1605
Acceleration BibRef

Hsu, F.C., Gubbi, J., Palaniswami, M.,
Learning Efficiently- The Deep CNNs-Tree Network,
DICTA15(1-7)
IEEE DOI 1603
learning (artificial intelligence) BibRef

Yang, Z.C.[Zi-Chao], Moczulski, M.[Marcin], Denil, M.[Misha], de Freitas, N.[Nando], Smola, A.[Alex], Song, L.[Le], Wang, Z.Y.[Zi-Yu],
Deep Fried Convnets,
ICCV15(1476-1483)
IEEE DOI 1602
Adaptive systems BibRef

Ionescu, C., Vantzos, O., Sminchisescu, C.,
Matrix Backpropagation for Deep Networks with Structured Layers,
ICCV15(2965-2973)
IEEE DOI 1602
Backpropagation BibRef

Yang, B., Yan, J., Lei, Z., Li, S.Z.,
Convolutional Channel Features,
ICCV15(82-90)
IEEE DOI 1602
Boosting BibRef

Girshick, R.,
Fast R-CNN,
ICCV15(1440-1448)
IEEE DOI 1602
Computer architecture BibRef

Highlander, T.[Tyler], Rodriguez, A.[Andres],
Very Efficient Training of Convolutional Neural Networks using Fast Fourier Transform and Overlap-and-Add,
BMVC15(xx-yy).
DOI Link 1601
BibRef

Zou, X.Y.[Xiao-Yi], Xu, X.M.[Xiang-Min], Qing, C.M.[Chun-Mei], Xing, X.F.[Xiao-Fen],
High speed deep networks based on Discrete Cosine Transformation,
ICIP14(5921-5925)
IEEE DOI 1502
Accuracy BibRef

Chapter on Pattern Recognition, Clustering, Statistics, Grammars, Learning, Neural Nets, Genetic Algorithms continues in
Convolutional Neural Networks for Object Detection and Segmentation .


Last update:Sep 18, 2017 at 11:34:11