The goal of our project is to identify the best security to be traded using an existing trading engine.\u00a0 In short, the key deliverable from our project will be code which selects the best of 18 potential leveraged ETFs to trade in over the ensuing month (based primarily on volatility and momentum).\u00a0 The existing momentum-based trading engine will then initiate trades based on shorter-term variations in momentum indicators.<\/p>\n\n\n\n
To this end, we intend to rely upon machine learning methods, potentially including deep learning.\u00a0 Deep learning is a technique which has gained enormous momentum in adoption during the past five years.\u00a0 It is based on neural networks, which are patterned after the learning methods of the brain to an extent.\u00a0 I find this interesting because I remember neural networks being the cause of excitement during the 1990s, after which they fell out of favor for an extended period of time.\u00a0 In fact, I once proposed such a solution to a mechanical engineering problem when I was completing my first degree, to which a professor whom I respected a great deal responded \u201cwhat you\u2019re describing is a neural network, and they don\u2019t work in practice.\u201d<\/p>\n\n\n\n
As such, it was a bit of a revelation to me when I discovered a year or so ago that deep learning is essentially a modern incarnation of methods which were previously dismissed by a very competent community.\u00a0 I have held an interest in learning about deep learning for quite some time, but this will be the first time that I have had an opportunity to get any hands-on experience. \u00a0Now that I am beginning preparation for an implementation, I have been wondering why neural networks feel out of favor and how there has been such a resurgence with deep learning recently.\u00a0 Following is quick summary of what I have found.<\/p>\n\n\n\n
What is a neural network?<\/strong><\/p>\n\n\n\n To greatly oversimplify, a neural network is mesh of nodes which are interconnected with weights and thresholds.\u00a0 When the input of one network meets the specified threshold, it triggers an output to nodes in the subsequent layer.\u00a0 A neural network must be comprised of at least three layers (an input, and output and additional intermediate layers which perform processing.\u00a0 The name harkens to the fact that this architecture mimics the processing structure of biological neurons in the brain.\u00a0 The benefit of a neural network is that it is flexible and can be applied to a wide range of image\/pattern recognition patterns.\u00a0 With repeated use and exposure to more data, the network can be optimized (i.e. \u201clearn\u201d) to perform better.<\/p>\n\n\n\n Why did neural networks fall out of favor?<\/strong><\/p>\n\n\n\n The general concept and approach of neural networks has not changed so much since the last century.\u00a0 This begs the question, why did they fall out of favor then and why the resurgence now?\u00a0 The simple answer is that several prerequisites for widespread adoption have only been met within the past 20 years.<\/p>\n\n\n\n One factor is the adequacy of available resources, particularly process and storage.\u00a0 Deep learning applications are compute-intensive, hence processors only reached a performance and cost point which would lend itself to widespread application within the past 20 years.\u00a0 The recent wave of virtualization (including cloud computing) has further accelerated this trend.<\/p>\n\n\n\n A second factor is the extent of data available.\u00a0 Widespread adoption of internet and the world wide web has driven creation and ingestion of a volume of data which was virtually unimaginable in the 1990s.\u00a0 Moreover, through its intended use, much of this data is prequalified in such a way that it can be readily used for training and testing models.\u00a0 Moreover, it has made possible the adoption of various applications which can benefit from machine learning, thus creating both the opportunity and demand for neural networks.<\/p>\n\n\n\n What triggered the recent explosion in deep learning interest?<\/strong><\/p>\n\n\n\n The key development most responsible for the surge in deep learning\u2019s popularity was the success of AlphaGo.\u00a0 Go is a game in which two players alternate turns placing colored stones on a gridded game board with the goal of surrounding their opponent\u2019s stones or areas on the board.\u00a0 Although conceptually straightforward, the game has a vast number of potential permutations and requires layers of strategy which far exceed those of chess.\u00a0 Although computers have been competitive with the best human players for quite some time, most experts did not believe that a computer would ever be able to achieve a sufficient level of intuition to defeat a human player.<\/p>\n\n\n\n AlphaGo achieved this feat using a deep learning approach, with which it decisively defeated the current European champion in 2015.\u00a0 This accomplishment was topped the following year when an updated version defeated the original in 100 consecutive matches.\u00a0 This was particularly noteworthy because the updated version relied upon unsupervised learning.\u00a0 Collectively these two achievements highlighted the potential of a previously discarded technique, thus triggering a virtual gold rush for adoption and implementation.<\/p>\n\n\n\n It is interesting to note that although the metrics on which decisions were made are recorded and available to researchers, not all of them are fully understandable by humans.\u00a0 This is also true of other problems (such as protein folding) which have successfully incorporated deep learning.\u00a0 Thus the implication would seem to be that this technique has enabled computers to tease out certain actionable patterns which are currently beyond our ability to comprehend.<\/p>\n","protected":false},"excerpt":{"rendered":" The goal of our project is to identify the best security to be traded using an existing trading engine.\u00a0 In short, the key deliverable from our project will be code which selects the best of 18 potential leveraged ETFs to trade in over the ensuing month (based primarily on volatility and momentum).\u00a0 The existing momentum-based […]<\/p>\n","protected":false},"author":11946,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-31","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/posts\/31","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/users\/11946"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/comments?post=31"}],"version-history":[{"count":1,"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/posts\/31\/revisions"}],"predecessor-version":[{"id":32,"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/posts\/31\/revisions\/32"}],"wp:attachment":[{"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/media?parent=31"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/categories?post=31"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.oregonstate.edu\/carltjoh\/wp-json\/wp\/v2\/tags?post=31"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}