<?xml version="1.0"?>
<!DOCTYPE article SYSTEM "C:\nlm\converter\journal-publishing-dtd-2.0\journalpublishing.dtd">
<article>
<front>
<journal-meta>
<journal-id journal-id-type="publisher">IJDSBDA</journal-id>
<journal-title>International Journal of Data Science and Big Data Analytics</journal-title>
<issn pub-type="epub">2710-2599</issn>
<publisher>
<publisher-name>SvedbergOpen</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="other">ijdsbda-1-3-005</article-id>
<doi-group>
<article-doi><ext-link ext-link-type="uri" xmlns:xlink="https://doi.org/" xlink:href="10.51483/IJDSBDA.1.3.2021.27-51">10.51483/IJDSBDA.1.3.2021.27-51</ext-link></article-doi>
</doi-group>
<article-categories>
<subj-group>
<subject>Research Paper</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Evaluation and Potential Improvements of a Deep Reinforcement Learning Model for Automated Stock Trading</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Jager</surname><given-names>Rainer</given-names></name>
<xref ref-type="aff" rid="aff001"><sup>1</sup></xref>
<xref ref-type="corresp" rid="cor001"><sup>&#x002A;</sup></xref>
</contrib>
</contrib-group>
<aff id="aff001"><sup>1</sup><instname>Student of Computing &#x0026; Mathematical Sciences, University of Waikato</instname>, <instaddress>Hamilton 3216</instaddress>, <instcountry>New Zealand</instcountry>., E-mail: <email>rj63@students.waikato.ac.nz</email></aff>
<author-notes>
<corresp id="cor001"><sup>&#x002A;</sup>Corresponding author: Rainer Jager, <instname>Student of Computing &#x2026; Mathematical Sciences, University of Waikato</instname>, <instaddress>Hamilton 3216</instaddress>, <instcountry>New Zealand</instcountry>. E-mail: <email>rj63@students.waikato.ac.nz</email></corresp>
</author-notes>
<pub-date pub-type="ppub">
<month>11</month>
<year>2021</year>
</pub-date>
<volume>1</volume>
<issue>3</issue>
<fpage>27</fpage>
<lpage>51</lpage>
<abstract>
<title>Abstract</title>
<p>The basis of this analysis is a model presented at the ACM International Conference in New York on AI in Finance in October 2020 (Yang <italic>et al</italic>., 2020). The authors claim that the introduced deep reinforcement learning ensemble model outperforms the Dow Jones Industrial Average Index, and the three individual algorithms that form the ensemble in terms of the risk-adjusted returns measured by the Sharpe ratio. Furthermore, it is claimed that the ensemble is more robust and reliable than the individual agents (Yang <italic>et al</italic>., 2020). We evaluate these claims for statistical significance. As some weaknesses of the model become evident, we suggest a work-around and show the results with the suggested alteration. Finally, we combine all the findings and present an alternative model.</p>
</abstract>
<kwd-group>
<title>Keywords</title>
<kwd>Deep reinforcement learning</kwd>
<kwd>Dow Jones</kwd>
<kwd>Algorithms</kwd>
<kwd>Automated stock trading</kwd>
</kwd-group>
<counts>
<ref-count count="11"/>
<page-count count="25"/>
</counts>
</article-meta>
</front>
<back>
<ref-list>
<title>References</title>
<ref id="bib001"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Bortz</surname><given-names>J&#x00FC;rgen.</given-names></name></person-group> (<year>1993</year>). <source>Statistik f&#x00FC;r Sozialwissenschaftler</source>. <edition>4<sup>th</sup></edition> Edition, <publisher-name>Springer</publisher-name>.</citation></ref>
<ref id="bib002"><citation citation-type="web"><month>January</month> <day>22</day>, <year>2021</year>, webpage: <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink"
xlink:href="https://therobusttrader.com/what-percentage-of-trading-is-algorithmic/#:~:text=In%20the%20U.S.%20stock%20market,is%20generated%20through%20algorithmic%20trading">https://therobusttrader.com/what-percentage-of-trading-is-algorithmic/#:~:text=In%20the%20U.S.%20stock%20market,is%20generated%20through%20algorithmic%20trading</ext-link>.</citation></ref>
<ref id="bib003"><citation citation-type="web"><month>February</month> <day>4</day>, <year>2021</year>, webpage: <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink"
xlink:href="https://openai.com/blog/better-exploration-with-parameter-noise/">https://openai.com/blog/better-exploration-with-parameter-noise/</ext-link></citation></ref>
<ref id="bib004"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Fischer</surname></name><name><surname>Thomas</surname><given-names>G.</given-names></name></person-group>. (<year>2018</year>). <article-title>Reinforcement Learning in Financial Markets &#x2013; A Survey. FAU Discussion Papers in Economics 12/2018</article-title>. <source>Friedrich-Alexander University Erlangen-Nuremberg. Institute for Economics, 2-4 and 38-39</source>.</citation></ref>
<ref id="bib005"><citation citation-type="web"><month>January</month> <day>23</day>, <year>2021</year>. webpage: <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink"
xlink:href="https://towardsdatascience.com/creating-a-custom-openai-gym-environment-for-stock-trading-be532be3910e">https://towardsdatascience.com/creating-a-custom-openai-gym-environment-for-stock-trading-be532be3910e</ext-link></citation></ref>
<ref id="bib006"><citation citation-type="web"><month>January</month> <day>23</day>, <year>2021</year>. webpage:<ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink"
xlink:href="https://github.com/AI4Finance-LLC/Deep-Reinforcement-Learning-for-Automated-Stock-Trading-Ensemble-Strategy-ICAIF-2020">https://github.com/AI4Finance-LLC/Deep-Reinforcement-Learning-for-Automated-Stock-Trazazding-Ensemble-Strategy-ICAIF-2020</ext-link>, model folder, models.py, line 57.</citation></ref>
<ref id="bib007"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Kenechukwu</surname><given-names>Anadu.</given-names></name><name><surname>Mathias</surname><given-names>Kruttli.</given-names></name><name><surname>Patrick</surname><given-names>McCabe.</given-names></name><name><surname>Emilio</surname><given-names>Osambela.</given-names></name></person-group> (<year>2018</year>). <article-title>The Shift from Active to Passive Investing: Risks to Financial Stability?</article-title>. <source>Working Paper | SRA 18-04 | August 27, 2018</source>. Last Revised: <date-in-citation content-type="access-date">May 15, 2-3</date-in-citation>.</citation></ref>
<ref id="bib008"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Kestner</surname><given-names>Lars.</given-names></name></person-group> (<year>2003</year>). <article-title>Quantitative Trading Strategies</article-title>. <source>Harnessing the Power of Quantitative Techniques to Create a Winning Trading Program</source>. <edition>1st</edition> Edition, <publisher-name>McGraw Hill</publisher-name>.</citation></ref>
<ref id="bib009"><citation citation-type="web"><person-group person-group-type="author"><name><surname>Silver</surname><given-names>David.</given-names></name></person-group> (<year>2021</year>). <month>January</month> <day>22</day>, webpage: <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink"
xlink:href="https://www.youtube.com/watch?v=x5Q79XCxMVc">https://www.youtube.com/watch?v=x5Q79XCxMVc</ext-link></citation></ref>
<ref id="bib010"><citation citation-type="web"><person-group person-group-type="author"><name><surname>Yang</surname><given-names>Hongyang.</given-names></name><name><surname>Liu</surname><given-names>Xiao-Yang.</given-names></name><name><surname>Zhong</surname><given-names>Shan.</given-names></name><name><surname>Walid</surname><given-names>Anwar.</given-names></name></person-group> (<year>2020</year>). <article-title>Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy</article-title>. <month>September</month> <day>11</day>, 2020. Available at SSRN: <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink"
xlink:href="https://ssrn.com/abstract=3690996">https://ssrn.com/abstract=3690996</ext-link> or <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink"
xlink:href="http://dx.doi.org/10.2139/ssrn.3690996">http://dx.doi.org/10.2139/ssrn.3690996</ext-link></citation></ref>
<ref id="bib011"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Zuckerman</surname><given-names>Gregory.</given-names></name></person-group> (<year>2019</year>). <source>The Man Who Solved the Market: How Jim Simons Launched the Quant Revolution</source>, <fpage>331</fpage>&#x2013;<lpage>332</lpage>.</citation></ref>
</ref-list>
</back>
</article>