<?xml version="1.0"?>
<!DOCTYPE article SYSTEM "C:\nlm\converter\journal-publishing-dtd-2.0\journalpublishing.dtd">
<article>
<front>
<journal-meta>
<journal-id journal-id-type="publisher">IJDSBDA</journal-id>
<journal-title>International Journal of Data Science and Big Data Analytics</journal-title>
<issn pub-type="epub">2710-2599</issn>
<publisher>
<publisher-name>SvedbergOpen</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="other">ijdsbda-1-1-003</article-id>
<doi-group>
<article-doi><ext-link ext-link-type="uri" xmlns:xlink="https://doi.org/" xlink:href="10.51483/IJDSBDA.1.1.2021.43-54">10.51483/IJDSBDA.1.1.2021.43-54</ext-link></article-doi>
</doi-group>
<article-categories>
<subj-group>
<subject>Research Paper</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Using ordinal data to assess distance learning</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Norris</surname><given-names>Matthew</given-names></name>
<xref ref-type="aff" rid="aff001"><sup>1</sup></xref>
<xref ref-type="corresp" rid="cor001"><sup>*</sup></xref>
</contrib>
</contrib-group>
<aff id="aff001"><sup>1</sup><instname>Georgia Institute of Technology</instname>, <instaddress>North Ave NW, Atlanta, GA 30332</instaddress>, <instcountry>United States</instcountry>. E-mail: <email>mdnorris@gatech.edu</email></aff>
<author-notes>
<corresp id="cor001"><sup>*</sup>Corresponding author: Matthew Norris, <instname>Georgia Institute of Technology</instname>, <instaddress>North Ave NW, Atlanta, GA 30332</instaddress>, <instcountry>United States</instcountry>. E-mail: <email>mdnorris@gatech.edu</email></corresp>
</author-notes>
<pub-date pub-type="ppub">
<month>02</month>
<year>2021</year>
</pub-date>
<volume>1</volume>
<issue>1</issue>
<fpage>43</fpage>
<lpage>54</lpage>
<abstract>
<title>Abstract</title>
<p>While academic research into educational technology has established flipped classrooms and formative assessment as effective and superior to traditional instruction and assessment, implementation of these new methods has been slow and piecemeal. The end of the 2020 spring semester saw nearly every classroom move to distance learning due to Covid-19. This distance learning required instructors to adopt fundamental features of flipped classrooms and formative assessment and provided an opportunity to study the significance of individual elements of these learning methods and their statistical relationship to one another. Likert Scale-style surveys were completed by high school students who were taking a mathematics class via distance learning. The Likert responses were treated as ordinal data, not continuous, and assessed on the presence or lack of stochastic dominance amongst the survey responses by the Kruskal-Wallis test and post hoc testing. This targeted the efficacy of individual techniques within formative assessment and flipped classrooms. The techniques that demonstrated significance individually were then examined with correlation and clustering analyses to determine if relationships existed and if those relationships were consistent with the literature on educational technology. The research methods used were tailored to fit the unique nature of the collected data and designed to assess whether core philosophies of flipped classrooms and formative assessment could be adopted individually, as wholesale adoption has proven to be quite difficult.</p>
</abstract>
<kwd-group>
<title>Keywords</title>
<kwd>Ordinal data</kwd>
<kwd>flipped class rooms</kwd>
<kwd>Distance learning</kwd>
<kwd>Formative assessment</kwd>
</kwd-group>
<counts>
<ref-count count="18"/>
<page-count count="12"/>
</counts>
</article-meta>
</front>
<back>
<ref-list>
<title>References</title>
<ref id="bib001"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ak&#x00E7;aylr</surname><given-names>G.</given-names></name><name><surname>Ak&#x00E7;aylr</surname><given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>The flipped classroom: A review of its advantages and challenges</article-title>. <source>Computers &#x0026; Education</source>, <volume>126</volume>, <fpage>334</fpage>&#x2013;<lpage>345</lpage>.</citation></ref>
<ref id="bib002"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Black</surname><given-names>P.</given-names></name><name><surname>Wiliam</surname><given-names>D.</given-names></name></person-group> (<year>2009</year>). <article-title>Developing the theory of formative assessment</article-title>. <source>Educational Assessment, Evaluation and Accountability.</source> <volume>21</volume>(<issue>1</issue>), <fpage>5</fpage>&#x2013;<lpage>31</lpage>. doi:<pub-id pub-id-type="doi">10.1007/s11092-008-9068-5</pub-id></citation></ref>
<ref id="bib003"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Cartwright</surname><given-names>M.</given-names></name><name><surname>Kloos</surname><given-names>H.</given-names></name><name><surname>Mano</surname><given-names>Q.</given-names></name><name><surname>Hord</surname><given-names>C.</given-names></name></person-group> (<year>2018</year>). <article-title>Child guided math practice: The role of regulator emotional selfefficacy for children experience homelessness</article-title>. <source>CogSci</source>.</citation></ref>
<ref id="bib004"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname><given-names>A.</given-names></name><name><surname>Jang</surname><given-names>S.</given-names></name></person-group> (<year>2010</year>). <article-title>Motivation in online learning: testing a model of self?determination theory</article-title>. <source>Computers in Human Behavior</source>, <volume>26</volume>, <fpage>741</fpage>&#x2013;<lpage>752</lpage>.</citation></ref>
<ref id="bib005"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gikandi</surname><given-names>J.W.</given-names></name><name><surname>Morrow</surname><given-names>D.</given-names></name><name><surname>Davis</surname><given-names>N.E.</given-names></name></person-group> (<year>2011</year>). <article-title>Online formative assessment in higher education: A review of the literature</article-title>. <source>Computers &#x0026; Education,</source> <volume>57</volume>(<issue>4</issue>), <fpage>2333</fpage>&#x2013;<lpage>2351</lpage>. doi:<pub-id pub-id-type="doi">10.1016/j.compedu.2011.06.004</pub-id></citation></ref>
<ref id="bib006"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guraya</surname><given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>Combating the COV?D-19 outbreak with a technology-driven e-flipped classroom model of educational transformation</article-title>. <source>Journal of Taibah University Medical Sciences,</source> <volume>15</volume>(<issue>4</issue>), <fpage>253</fpage>&#x2013;<lpage>254</lpage>.</citation></ref>
<ref id="bib007"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kirschner</surname><given-names>P.A.</given-names></name></person-group> (<year>2017</year>). <article-title>Stop propagating the learning styles myth</article-title>. <source>Computers &#x0026; Education</source>, <volume>106</volume>, <fpage>166</fpage>&#x2013;<lpage>171</lpage>. doi:<pub-id pub-id-type="doi">10.1016/ j.compedu.2016.12.006</pub-id></citation></ref>
<ref id="bib008"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lai</surname><given-names>C.L.</given-names></name><name><surname>Hwang</surname><given-names>G. J.</given-names></name></person-group> (<year>2016</year>). <article-title>A self-regulated flipped classroom approach to improving students&#x2019; learning performance in a mathematics course</article-title>. <source>Computers &#x0026; Education</source>, <volume>100</volume>, <fpage>126</fpage>&#x2013;<lpage>140</lpage>.</citation></ref>
<ref id="bib009"><citation citation-type="other"><person-group person-group-type="author"><name><surname>McCallum</surname><given-names>S.</given-names></name><name><surname>Milner</surname><given-names>M.</given-names></name></person-group> (<year>2020</year>). <article-title>The effectiveness of formative assessment: student views and staff reflections</article-title>, <source>Assessment &#x0026; Evaluation in Higher Education</source>, DOI: <pub-id pub-id-type="doi">10.1080/02602938.2020.1754761</pub-id></citation></ref>
<ref id="bib010"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Martinelli</surname><given-names>S.M.</given-names></name><name><surname>Chen</surname><given-names>F.</given-names></name><name><surname>DiLorenzo</surname><given-names>A.N.</given-names></name><name><surname>Mayer</surname><given-names>D.C.</given-names></name><name><surname>Fairbanks</surname><given-names>S.</given-names></name><name><surname>Moran</surname><given-names>K.</given-names></name><name><surname>Schell</surname><given-names>R. M.</given-names></name></person-group> (<year>2017</year>). <article-title>Results of a flipped classroom teaching approach in anesthesiology residents</article-title>. <source>J Grad Med Educ,</source> <volume>9</volume>(<issue>4</issue>).</citation></ref>
<ref id="bib011"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Pashler</surname><given-names>H.</given-names></name><name><surname>McDaniel</surname><given-names>M.</given-names></name><name><surname>Rohrer</surname><given-names>D.</given-names></name><name><surname>Bjork</surname><given-names>R.</given-names></name></person-group> (<year>2008</year>). <article-title>Learning styles: concepts and evidence</article-title>. <source>Psychological Science in the Public Interest</source>, <fpage>9</fpage>.</citation></ref>
<ref id="bib012"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rotellar</surname><given-names>C.</given-names></name><name><surname>Cain</surname><given-names>J.</given-names></name></person-group> (<year>2016</year>). <article-title>Research, perspectives, and recommendations on implementing the flipped classroom</article-title>. <source>American Journal of Pharmaceutical Education,</source> <volume>80</volume>(<issue>2</issue>).</citation></ref>
<ref id="bib013"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sadler</surname><given-names>D.</given-names></name></person-group> (<year>1989</year>). <article-title>Formative assessment and the design of instructional systems</article-title>. <source>Instructional Science,</source> <volume>18</volume>(<issue>2</issue>), <fpage>119</fpage>&#x2013;<lpage>144</lpage>.</citation></ref>
<ref id="bib014"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sadler</surname><given-names>D.</given-names></name></person-group> (<year>1998</year>). <article-title>Formative assessment: Revisiting the territory</article-title>. <source>Assessment in Education,</source> <volume>5</volume>(<issue>1</issue>), <fpage>77</fpage>&#x2013;<lpage>85</lpage>.</citation></ref>
<ref id="bib015"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Selvi</surname><given-names>K.</given-names></name></person-group> (<year>2010</year>). <article-title>Motivating factors in online courses</article-title>. <source>Procedia Social and Behavioral Sciences</source>, <volume>2</volume>, <fpage>819</fpage>&#x2013;<lpage>824</lpage>.</citation></ref>
<ref id="bib016"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname><given-names>K.H.</given-names></name><name><surname>Wang</surname><given-names>T.H.</given-names></name><name><surname>Wang</surname><given-names>W.L.</given-names></name><name><surname>Huang</surname><given-names>S.C.</given-names></name></person-group> (<year>2006</year>). <article-title>Learning styles and formative assessment strategy: enhancing student achievement in Web-based learning</article-title>. <source>Journal of Computer Assisted Learning,</source> <volume>22</volume>(<issue>3</issue>), <fpage>207</fpage>&#x2013;<lpage>217</lpage>.</citation></ref>
<ref id="bib017"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yen</surname><given-names>T.</given-names></name></person-group> (<year>2020</year>). <article-title>The performance of online teaching for flipped classroom based on covid-19 aspect</article-title>. <source>Asian Journal of Education and Social Studies,</source> <volume>8</volume>(<issue>3</issue>), <fpage>57</fpage>&#x2013;<lpage>64</lpage>.</citation></ref>
<ref id="bib018"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zainuddin</surname><given-names>Z.</given-names></name><name><surname>Halili</surname><given-names>S.H.</given-names></name></person-group> (<year>2016</year>). <article-title>Flipped classroom research and trends from different fields of study</article-title>. <source>The International Review of Research in Open and Distributed Learning,</source> <volume>17</volume>(<issue>3</issue>). doi:<pub-id pub-id-type="doi">10.19173/irrodl.v17i3.2274</pub-id></citation></ref>
</ref-list>
</back>
</article>