\ud83d\udd11<\/strong> In 6 minutes you will learn:<\/strong><\/span><\/p>\r\n \r\n Although there are different categories of neural networks, each having different topology and architecture, the underlying concept of every type is the same \u2014 i.e.\u00a0being similar in action and structure to the human brain<\/strong>. We will be focusing on two types of neural networks, Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) in this tutorial. Moreover, our goal is to tell you about the different types of datasets that are available online and which you can utilize for your own CNNs and RNNs projects. So, let\u2019s begin!<\/p>\r\n[\/vc_column_text][\/vc_column][\/vc_row][vc_section full_width=”stretch_row” pix_over_visibility=”” css=”.vc_custom_1650444445523{padding-top: 80px !important;padding-bottom: 80px !important;background-color: #f8f9fa !important;}” el_id=”pix_section_program”][vc_row full_width=”stretch_row” pix_particles_check=””][vc_column content_align=”text-center” offset=”vc_col-lg-offset-0 vc_col-lg-12 vc_col-md-offset-1 vc_col-md-10″] Neural Networks form the basis of Deep Learning which in turn is a subfield of Machine Learning. Like we said before, in these networks, the algorithms are inspired by the human brain. Basically, a neural network takes in data\u00a0(as input)<\/em>, trains itself to recognize the patterns within the data\u00a0(learning)<\/em>, and then uses this learning (learned weights) to predict outputs for a new set of data which is similar in nature to the input data\u00a0(output).<\/em><\/p>\r\n Neural networks are made up of layers of neurons where each neuron acts as the core processing unit of the network. The\u00a0Simple Neural Network\u00a0<\/em>has roughly three layers:<\/p>\r\n\r\n Simple visualized differences between\u00a0Simple Neural Network\u00a0<\/strong>and\u00a0Deep Neural Network<\/strong><\/p>\r\n \r\n Neural networks can be more complex and this complexity is added by the addition of more hidden layers. A neural network that is made up of more than three layers i.e. has one input layer, several hidden layers, and one output layer is known as a\u00a0Deep Neural Network<\/em>. These networks are what support and underpin the idea and concepts of Deep Learning where the model basically trains itself to process and predict from data.<\/p>\r\n \r\n Then, how does a Deep Neural Network work? One quick way to understand the working of a deep neural network can be done using the example of handwritten digit recognition, MNIST tutorial from our previous article (click here to learn more<\/a>!). We won\u2019t go into detail about this tutorial here, but be sure to check it out!<\/p>\r\n[\/vc_column_text][\/vc_column][\/vc_row][\/vc_section][vc_row pix_particles_check=””][vc_column] Like we said before, there are a whole bunch of neural networks that differ by topology and structure and are used for different purposes. Some common examples include Perceptrons, Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Hopfield Network, and so on. In this tutorial, we will be shedding light on\u00a0CNNs\u00a0<\/em>and\u00a0RNNs<\/em>.<\/p>\r\n[\/vc_column_text][vc_column_text css=”.vc_custom_1655948269010{border-top-width: 1px !important;padding-top: 60px !important;padding-bottom: 30px !important;border-top-color: rgba(0,0,0,0.2) !important;border-top-style: solid !important;}”]\r\n CNNs are quite different from other deep neural networks as they treat data as spatial. They are commonly applied to image processing problems as they are able to detect patterns in images, but can also be used for other types of input like audio. CNNs have the following layers:<\/p>\r\n \r\n – Convolution\r\n– Activation Layer (typically use ReLU)\r\n– Pooling\r\n– Fully Connected<\/p>\r\n \r\n CNNs are typically used to compare images piece by piece. The pieces that a CNN looks for are called features. CNNs are able to detect similarities between different images much better as compared to whole image matching schemes because their technique is to find rough feature matches in roughly the same position in two or more images.<\/p>\r\n \r\n What sets a CNN apart from other deep neural networks is the fact that in CNNs, input data is fed through convolutional layers. In these layers, instead of having neurons being connected to every neuron in the previous layer, a neuron is instead only connected to other neurons that are close to it i.e., each neuron only concerns itself with neighboring neurons. This connectivity pattern is inspired by the organization of the animal visual cortex and greatly simplifies the connections in a network and enables it to uphold the spatial aspect of a dataset.<\/p>\r\n \r\n In the ReLU layer, every negative value from the filtered images is replaced by 0 to avoid these values from summing up to 0. The ReLU transform function activates a neuron only if the input is above a certain value i.e., if the input is below 0, the output is 0. Next is the Pooling layer in which the image stack is shrunk to a smaller size. The final layer is the fully connected layer where the actual classification happens. Here, the filtered and shrunken images are put together into a single list and the predictions are made. RNNs are a type of neural network which are designed to recognize patterns in sequences of data e.g. in text, handwriting, spoken words, etc. Apart from language modeling and translation, RNNs are also used in speech recognition, image captioning, etc.<\/p>\r\n \r\n RNNs are unique in the sense that in RNNs, every neuron in a hidden layer receives an input with a specific delay in time. This is particularly useful for situations where previous information is needed in current iterations to make a decision. For example, if you are trying to predict the next word in a sentence, you first need to know the previously used words. To access previous information, RNNs contain loops that allow the previous information to persist. You can think of an RNN as multiple copies of the same network, where each copy is passing a message\/information to the next document.<\/p>\r\n \r\n In RNNs, the model size does not increase with the increased input size and can process inputs and share any lengths and weights across time. RNNs have some drawbacks as well. Firstly, the computational speed is slow because the model takes historical information into account. Also, RNNs cannot remember information from a long time ago and cannot consider any future input for the current state.<\/p>\r\n\r\n\r\n There are a lot of training datasets that you can find online and can make use of in your Deep Learning tasks and projects be it image datasets, natural language processing datasets, audio\/speech datasets, etc. Some examples of such datasets include:<\/p>\r\n \r\n Apart from finding training datasets online, you can only go for ready to use datasets offered by Machine Learning libraries like\u00a0TensorFlow<\/a>\u00a0and\u00a0Scikit-learn<\/a>. Such libraries allow you to download preprocessed datasets and load them directly into your programs for use.<\/p>\r\n[\/vc_column_text]\r\n \t
What is a Neural Network?<\/h2><\/div>[vc_column_text css=”.vc_custom_1655947509075{padding-top: 40px !important;}”]\r\n
\r\n \t
![\"\"](\"https:\/\/blog.datumo.com\/en\/wp-content\/uploads\/2022\/06\/12.png\")
![\"\"](\"https:\/\/blog.datumo.com\/en\/wp-content\/uploads\/2022\/06\/13.png\")
\r\nWhat are the Different Types of Neural Networks?<\/h2><\/div><\/div><\/div>[vc_column_text css=”.vc_custom_1655947956155{padding-top: 60px !important;padding-bottom: 40px !important;}”]\r\n
Convolutional Neural Networks (CNNs):<\/strong><\/h5>\r\n \r\n
![\"\"](\"https:\/\/blog.datumo.com\/en\/wp-content\/uploads\/2022\/06\/ddd.png\")
<\/p>\r\n[\/vc_column_text][vc_column_text css=”.vc_custom_1655948515670{border-top-width: 1px !important;padding-top: 60px !important;padding-bottom: 30px !important;border-top-color: rgba(0,0,0,0.2) !important;border-top-style: solid !important;}”]\r\nRecurrent Neural Networks (RNNs):<\/strong><\/h5>\r\n \r\n
![\"\"](\"https:\/\/blog.datumo.com\/en\/wp-content\/uploads\/2022\/06\/0_sQjhyo0pTZ-D_suH.png\")
Training Datasets for Deep Learning<\/strong><\/h5>\r\n \r\n
\r\n \t