An Introduction of Recurrent Neural Networks
Last time I have explained what is statistical arbitrage strategy that is applied by quantitative hedge funds. I mentioned the machine learning algorithms such as Recurrent Neural Networks (RNN) and Long Short Term Memory (LSTM), which are used as foundation to predict action of stock price. This time I will dig deeper and explore what is RNN (mainly) and LSTM, and how they work in practice. Normally when learning about machine learning, we start with linear and multi-linear regression. These are fundamental concepts for building a Feed-Forward Neural Networks, which allows information to flow only in the forward direction, from input layer, through hidden layers, and to the output layer. There are no cycles or loops in the network. Below is the flow chart of a feed-forward neural network: The problem with FFN is that decisions are based on the current input. It does not memorize the past data, so there is no future scope. That’s why it is used in general regression and classific...