MAKER
Neural networks that process sequential data must have three functions: Temporality: Features must be entered one at a time in order. Variable length: To process a sample of length n, the hidden layer must appear n times. Context dependency: Remember the previous feature and use it at the right moment. To design a learning model …
Continue reading “2019.12.10(pm): RNN(Recurrent Neural Network)”
The autoencoder is a neural network that receives the feature vector x and outputs the same or similar vector x ‘. The figure below shows the structure of an autoencoder. Since the output must be the same as the input, the number of nodes in the output layer and the number of nodes in the …
After the release of Perceptron in 1958, the New York Times published a shocking article on the 8th of July that a computer would be developed that would soon walk, speak, and recognize self. But in 1969, Marvin Minsky devised a multilayer perceptron (MLP) to solve the XOR problem, and said there is no way …
Perceptron has the limitation that it can only handle situations where linear separation is possible. The problem of XOR classification is that the perceptron has a 75% accuracy rate because one sample is wrong no matter which decision line is used. In 1969, Marvin Minsky’s Perceptrons, the father of artificial intelligence, revealed this fact, and …
As there are various problems to be solved by machine learning, there are various types of machine learning. In the past, machine learning algorithms were largely divided into supervised learning and unsupervised learning. Recently, as reinforcement learning becomes more important, it is being divided into supervised learning, unsupervised learning, and reinforced learning. Supervised learning In …
Continue reading “2019.12.08(am): Types of Machine Learning”
Machine learning problems can be divided into classification and regression. Classification is a matter of which class the data belongs to, and regression is a problem of predicting consecutive numbers in the input data. As such, the output value of the neural network can be obtained using the identity function and the softmax function. This …
The Monte Carlo method is a term for an algorithm that probabilistically calculates the value of a function using random numbers. Frequently used in mathematics and physics, it is used to approximate calculations when the value to be calculated is not represented in closed form or is complex. Stanislaw Ulam is named after Monte Carlo, …
Let’s talk about the cost function again. The cost function for learning the weights of the Adaline (Adaptive Linear Neuron) is defined in relation to the i th observation in the training data set as follows: where the ϕ is an activation function. To find the weights that minimize our cost function, we can use …
Continue reading “2019.12.01(pm): Stochastic Gradient Decent method”
This article describes the gradient descent method, one of the basic function optimization methods. The gradient descent method is one of the representative ways to apply the concept of differential to optimization problems and is to find the local minimum of a function. The gradient descent method is also called steepest descent method. Gradient descent …
Today we will look at the concept of linear regression. The dictionary meaning of regression means “return to the origin state.” The term begins with the British geneticist Francis Galton studying the laws of inheritance. In studying the relationship between parents and children’s heights, Galton surveyed and tabulated the averages of heights of fathers and …
Continue reading “2019.11.30(pm): Machine Learning – Linear Regression”