https://oldena.lpnu.ua/handle/ntb/52534| Title: | Implementation of Neural Networks with Help of a Data Flow Virtual Machine |
| Authors: | Kharchenko, Kostyantyn Beznosyk, Oleksandr Romanov, Valeriy |
| Affiliation: | National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute” |
| Bibliographic description (Ukraine): | Kharchenko K. Implementation of Neural Networks with Help of a Data Flow Virtual Machine / Kostyantyn Kharchenko, Oleksandr Beznosyk, Valeriy Romanov // Data stream mining and processing : proceedings of the IEEE second international conference, 21-25 August 2018, Lviv. — Львів : Lviv Politechnic Publishing House, 2018. — P. 407–410. — (Hybrid Systems of Computational Intelligence). |
| Bibliographic description (International): | Kharchenko K. Implementation of Neural Networks with Help of a Data Flow Virtual Machine / Kostyantyn Kharchenko, Oleksandr Beznosyk, Valeriy Romanov // Data stream mining and processing : proceedings of the IEEE second international conference, 21-25 August 2018, Lviv. — Lviv Politechnic Publishing House, 2018. — P. 407–410. — (Hybrid Systems of Computational Intelligence). |
| Is part of: | Data stream mining and processing : proceedings of the IEEE second international conference, 2018 |
| Conference/Event: | IEEE second international conference "Data stream mining and processing" |
| Issue Date: | 28-Feb-2018 |
| Publisher: | Lviv Politechnic Publishing House |
| Place of the edition/event: | Львів |
| Temporal Coverage: | 21-25 August 2018, Lviv |
| Keywords: | neural networks data flow virtual machine JSON activation functions |
| Number of pages: | 4 |
| Page range: | 407-410 |
| Start page: | 407 |
| End page: | 410 |
| Abstract: | The main goal of this paper is to show how a neural network can be implemented with help of the data flow management system at a virtual machine. As an example, the three-layer neural network realization has been investigated to solve a simple XOR function with two inputs and one output. For that purpose, a sigmoid command required to make a neuron activation function has been added into the data flow virtual machine. It is presented in the paper that neural networks can be described as data flows with help of the declarative approach on a base of the JSON format. |
| URI: | https://ena.lpnu.ua/handle/ntb/52534 |
| ISBN: | © Національний університет „Львівська політехніка“, 2018 © Національний університет „Львівська політехніка“, 2018 |
| Copyright owner: | © Національний університет “Львівська політехніка”, 2018 |
| URL for reference material: | http://download.tensorflow.org/paper/whitepaper2015.pdf https://github.com/Theano https://mxnet.apache.org/ https://www.microsoft.com/en-us/cognitive-toolkit/ https://keras.io/ https://github.com/torch/torch7 http://torch.ch/ http://caffe.berkeleyvision.org/ |
| References (Ukraine): | [1] K. V. Kharchenko, “Extension of the LLVM virtual machine with parallel instructions to implement a message transfer system,” 2012 System analysis and information technology 14th Int. Conf., Kyiv, Ukraine, p. 302, 24 April 2012. [2] K. V. Kharchenko, “Dataflow control paradigm and dataflow graphic presentation in SOA,” East-European journal for advanced technologies, no. 3/9 (69), pp. 22-29, 2014. [3] K. V. Kharchenko, “An Architecture and Test Implementation of Data Flow Virtual Machine,” 2016 System analysis and information technology 18th Int. Conf., Kyiv, Ukraine, p. 268, 30 May – 2 June 2016. [4] K. Kharchenko, O. Beznosyk and V. Romanov, “A Set of Instructions for Data Flow Virtual Machine,” IEEE First Ukraine Conference on Electrical and Computer Engineering (UKRCON 2017), Kyiv, Ukraine, pp. 931-934, 29 May – 2 June 2017. [5] B. Lu, B. L. Evans and D. V. Tosic, "Simulation and Synthesis of Artificial Neural Networks Using Dataflow Models in Ptolemy," 4th Seminar on Neural Network Applications in Electrical Engineering NEUREL-97, Belgrade, Serbia, pp. 84-89, Sep. 8-9, 1997. [6] M. Bacis, G. Natale, E. Del Sozzo and M. D. Santambrogio, “A pipelined and scalable dataflow implementation of convolutional neural networks on FPGA,” 2017 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), Lake Buena Vista, FL, pp. 90-97, 2017. [7] Y. H. Chen, J. Emer and V. Sze, "Using Dataflow to Optimize Energy Efficiency of Deep Neural Network Accelerators," in IEEE Micro, vol. 37, no. 3, pp. 12-21, 2017. [8] Jeffrey Dean et al. (2015, November 9). TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems [Online]. Available: http://download.tensorflow.org/paper/whitepaper2015.pdf [9] Theano GitHub [Online]. Available: https://github.com/Theano [10] MXNet: A Scalable Deep Learning Framework [Online]. Available: https://mxnet.apache.org/ [11] Microsoft Cognitive Toolkit [Online]. Available: https://www.microsoft.com/en-us/cognitive-toolkit/ [12] Keras Documentation [Online]. Available: https://keras.io/ [13] Torch GitHub [Online]. Available: https://github.com/torch/torch7 [14] Torch. Scientific computing for LuaJIT [Online]. Available: http://torch.ch/ [15] Caffee Deep Learning Framework [Online]. Available: http://caffe.berkeleyvision.org/ |
| References (International): | [1] K. V. Kharchenko, "Extension of the LLVM virtual machine with parallel instructions to implement a message transfer system," 2012 System analysis and information technology 14th Int. Conf., Kyiv, Ukraine, p. 302, 24 April 2012. [2] K. V. Kharchenko, "Dataflow control paradigm and dataflow graphic presentation in SOA," East-European journal for advanced technologies, no. 3/9 (69), pp. 22-29, 2014. [3] K. V. Kharchenko, "An Architecture and Test Implementation of Data Flow Virtual Machine," 2016 System analysis and information technology 18th Int. Conf., Kyiv, Ukraine, p. 268, 30 May – 2 June 2016. [4] K. Kharchenko, O. Beznosyk and V. Romanov, "A Set of Instructions for Data Flow Virtual Machine," IEEE First Ukraine Conference on Electrical and Computer Engineering (UKRCON 2017), Kyiv, Ukraine, pp. 931-934, 29 May – 2 June 2017. [5] B. Lu, B. L. Evans and D. V. Tosic, "Simulation and Synthesis of Artificial Neural Networks Using Dataflow Models in Ptolemy," 4th Seminar on Neural Network Applications in Electrical Engineering NEUREL-97, Belgrade, Serbia, pp. 84-89, Sep. 8-9, 1997. [6] M. Bacis, G. Natale, E. Del Sozzo and M. D. Santambrogio, "A pipelined and scalable dataflow implementation of convolutional neural networks on FPGA," 2017 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), Lake Buena Vista, FL, pp. 90-97, 2017. [7] Y. H. Chen, J. Emer and V. Sze, "Using Dataflow to Optimize Energy Efficiency of Deep Neural Network Accelerators," in IEEE Micro, vol. 37, no. 3, pp. 12-21, 2017. [8] Jeffrey Dean et al. (2015, November 9). TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems [Online]. Available: http://download.tensorflow.org/paper/whitepaper2015.pdf [9] Theano GitHub [Online]. Available: https://github.com/Theano [10] MXNet: A Scalable Deep Learning Framework [Online]. Available: https://mxnet.apache.org/ [11] Microsoft Cognitive Toolkit [Online]. Available: https://www.microsoft.com/en-us/cognitive-toolkit/ [12] Keras Documentation [Online]. Available: https://keras.io/ [13] Torch GitHub [Online]. Available: https://github.com/torch/torch7 [14] Torch. Scientific computing for LuaJIT [Online]. Available: http://torch.ch/ [15] Caffee Deep Learning Framework [Online]. Available: http://caffe.berkeleyvision.org/ |
| Content type: | Conference Abstract |
| Appears in Collections: | Data stream mining and processing : proceedings of the IEEE second international conference |
| File | Description | Size | Format | |
|---|---|---|---|---|
| 2018_Kharchenko_K-Implementation_of_Neural_407-410.pdf | 112.07 kB | Adobe PDF | View/Open | |
| 2018_Kharchenko_K-Implementation_of_Neural_407-410__COVER.png | 594.11 kB | image/png | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.