Course signals at Purdue: Using learning analytics to increase student success, Proceedings of the 2nd International Conference on Learning Analytics and Knowledge LAK ’12, Vancouver, B
Trang 1Learning Analytics: Assisting Universities with
Student Retention
2015 Final Report - Part 2 Appendices
Charles Darwin University
Batchelor Institute of Indigenous Tertiary Education
Griffi th University Murdoch University The University of Newcastle
Deborah West
Charles Darwin University
http://www.letstalklearninganalytics.edu.au/
Trang 2Support for the production of this report has been provided by the Australian Government Office for Learning and Teaching The views expressed in this report do not necessarily reflect the views of the Australian Government Office for Learning and Teaching.
With the exception of the Commonwealth Coat of Arms, and where otherwise noted, all material presented in this document is provided under Creative Commons Attribution-ShareAlike 4.0 International License http://creativecommons.org/licenses/by-sa/4.0/
The details of the relevant licence conditions are available on the Creative Commons website(accessible using the links provided) as is the full legal code for the Creative Commons Attribution-ShareAlike 4.0 International License http://creativecommons.org/licenses/by-sa/4.0/legalcode
Requests and inquiries concerning these rights should be addressed to:
Office for Learning and Teaching
Department of Education and Training
Trang 3Appendix E – Impact Statement 15
Appendix F – Completed Dissemination Activities 18
Appendix G – Scheduled Dissemination Activities 19
Appendix H – High Level Framework Summary 20
Appendix I – Discussion Questions 22
Appendix J – Evaluation Report 26
Trang 4Appendix A - DVC Certification
Trang 5Appendix B – References
ACODE (2014) Benchmarks for Technology Enhanced Learning Retrieved 12 May, 2015 from
http://www.acode.edu.au/pluginfile.php/579/mod_resource/content/3/TEL_Benchmarks.pdf
Australian Government Department of Education and Training (2014) 2013 Student Data:
Appendix 4 - Attrition, Success and Retention Retrieved 26 May, 2015 from
https://www.education.gov.au/selected-higher-education-statistics-2013-student-data
Arnold, K., Lonn, S., & Pistilli, M (2014) An exercise in institutional reflection: The Learning
Analytics Readiness Instrument (LARI) Proceedings of the 4th International Conference on
Learning Analytics and Knowledge (LAK ‘14), Indianapolis, IN, USA
doi:10.1145/2567574.2567621
Arnold, K & Pistilli, M (2012) Course signals at Purdue: Using learning analytics to increase
student success, Proceedings of the 2nd International Conference on Learning Analytics and
Knowledge (LAK ’12), Vancouver, British Columbia, Canada doi:10.1145/2330601.2330666
Baer, L., Norris, D., Duin, A., & Brodnick, R (2013) Crafting transformative strategies for personalized learning/analytics Proceedings of the 3 rd International Conference on Learning Analytics and Knowledge (LAK ’13), Leuven, Belgium doi:10.1145/2460296.2460354
Baker, R., & Yacef, K (2009) The state of educational data mining in 2009: A review and
future visions Journal of Educational Data Mining, 1 (1), 3-17
Balacheff, N., & Lund, K (2013) Multidisciplinarity vs multivocality: The case of “Learning
Analytics” Proceedings of the 3 rd International Conference on Learning Analytics and
Knowledge (LAK ’13), Leuven, Belgium doi:10.1145/2460296.2460299
Beer, C., Jones, D & Clark, D (2012) Analytics and complexity: Learning and leading for the
future Proceedings Future Challenges: Sustainable Futures, ascilite, Wellington, NZ
Retrieved April 13, 2015 from
http://eprints.usq.edu.au/23092/2/Beer_Jones_Clark_ascilite_2012_PV.pdf
Behrendt, L., Larkin, S., Griew, R., & Kelly, P (2012) Review of Higher Education Access and Outcomes for Aboriginal and Torres Strait Islander People: Final Report Canberra: AustralianGovernment Retrieved May, 12, 2012 from
aboriginal-and-torres-strait-islander-people-0
http://docs.education.gov.au/documents/review-higher-education-access-and-outcomes-Bradley, D., Noonan, P., Nugent, H., & Scales, B (2008) Review of Australian Higher
Education: Final Report Canberra: Department of Education, Employment and Workplace Relations Retrieved May, 12, 2015 from www.mq.edu.au/pubstatic/public/download.jsp? id=111997
Trang 6Buckingham Shum, S., & Ferguson, R (2012) Social learning analytics Educational
Technology & Society, 15(3), 3-26.
Camilleri, V., de Freitas, S., Montebello, M., & McDonagh Smith, P (2013) A case study ‐
inside virtual worlds: Use of analytics for immersive spaces Proceedings of the 3 rd
International Conference on Learning Analytics and Knowledge (LAK ’13), Leuven, Belgium
doi:10.1145/2460296.2460341
Campbell, J., DeBlois, P., & Oblinger, D (2007) Academic analytics: A new tool for a new era,
Educause Review, July/August 2007 Retrieved May 12, 2015 from
https://net.educause.edu/ir/library/pdf/ELIWEB0710.pdf
Campbell, J., and Oblinger, D (2007) Academic analytics: White paper Educause Retrieved
12 May, 2015 from http://net.educause.edu/ir/library/pdf/pub6101.pdf
Chaloux, B., & Miller, G (2013) E-learning and the transformation of higher education Chapter 1 (pp 3-23) in G Miller, M Benke, B Chaloux, L Ragan, R Schroeder, W Smutz,
Wayne, K Swan, (Eds.) Leading the e-Learning transformation in higher education: meeting
the challenges of technology and distance education Stirling, VA: Stylus Publishing.
Chatti, M., Dyckhoff, A., Schroeder, U., & Thüs, H (2012) A reference model for learning
analytics International Journal of Technology Enhanced Learning, 4(5/6), 318–331.
Chowdry, H., Crawford, C., Dearden, L., Goodman, A., & Vignoles, A (2013), Widening
participation in higher education: analysis using linked administrative data Journal of the
Royal Statistical Society: Series A (Statistics in Society), 176: 431–457 doi:
10.1111/j.1467-985X.2012.01043.x
Clarke, J., Nelson, K., & Stoodley, I (2013) The place of higher education institutions in
assessing student engagement, success and retention: Proceedings Higher Education
Research and Development Society of Australasia, Auckland, New Zealand Retrieved May
12, 2015 from http://eprints.qut.edu.au/60024/2/60024.pdf
Clow, D (2013) MOOCs and the funnel of participation Proceedings of the 3 rd International Conference on Learning Analytics and Knowledge (LAK ’13), Leuven, Belgium
doi:10.1145/2460296.2460332
Dawson, S., Gašević, D., Siemens, G., & Joksimovic, S (2014) Current state and future
trends: A citation network analysis of the learning analytics field Proceedings of the 4th
International Conference on Learning Analytics and Knowledge (LAK ‘14), Indianapolis, IN,
USA
doi:10.1145/2567574.2567585
Dawson, S., Tan, J., & McWilliam, E (2011) Measuring creative potential: Using social
network analysis to monitor a learners’ creative capacity Australian Journal of Educational
Technology, 27(6), 924-942.
Trang 7Dekker, G., Pechenizkiy, M and Vleeshouwers, J (2009) Predicting students’ drop out: a case
study Proceedings of the 2nd International Conference on Educational Data Mining (EDM
'09), Cordoba, Spain
http://www.educationaldatamining.org/EDM2009/uploads/proceedings/dekker.pdf
Diaz, D (2000) Comparison of student characteristics, and evaluation of student success, in
an online health education course Unpublished doctoral dissertation, Nova Southeastern
University Retrieved 12 May 2015 from
http://home.earthlink.net/~davidpdiaz/LTS/pdf_docs/dissertn.pdf
Department of Industry, Innovation, Climate Change, Science, Research and Tertiary
Education (DIICCSRTE) (2012a) 2011 full year higher education student statistics Appendix 2
– Equity Groups Canberra: Australian Government Retrieved 18 June, 2013 from
http://www.innovation.gov.au/HigherEducation/HigherEducationStatistics/StatisticsPublications/Pages/2011StudentFullYear.aspx
Department of Industry, Innovation, Climate Change, Science, Research and Tertiary
Education (DIICCSRTE) (2012b) 2011 full year higher education student statistics Appendix 4
- attrition, progress and retention Canberra: Australian Government Retrieved 14 June 2013
from
http://www.innovation.gov.au/HigherEducation/HigherEducationStatistics/StatisticsPublications/Pages/2011StudentFullYear.aspx
Department of Industry, Innovation, Climate Change, Science, Research and Tertiary
Education (DIICCSRTE) (2013a) Students: selected higher education statistics 2012
(Appendix 2: equity data) Canberra: DIICCSRTE.
Department of Industry, Innovation, Climate Change, Science, Research and Tertiary
Education (DIICCSRTE) (2013b) Moving to an enhanced indicator of higher education
students’ socio-economic status Canberra: DIICCSRTE.
EDUCAUSE (2010) 7 Things you should know about analytics Retrieved May 12, 2015 from
http://www.educause.edu/ir/library/pdf/ELI7059.pdf
EduTech Wiki (2013) Learning analytics Retrieved 14 June, 2013 from
http://edutechwiki.unige.ch/en/Learning_analytics#Introduction
Ferguson, R., (2012) Learning analytics: drivers, developments and challenges International
Journal of Technology Enhanced Learning, 4(5/6), 304–317.
Fiaidhi, J (2014) The next step for learning analytics IT PRO/Institute of Electrical and
Electronics Engineers, September/October 2014 Retrieved May 12, 2015 from
https://www.computer.org/csdl/mags/it/2014/05/mit2014050004.pdf
Frankola, K (2001) Why online learners drop out Retrieved May 12, 2015 from
http://www.workforce.com/articles/why-online-learners-drop-out
Trang 8Gallagher, M (2014) Micro-economic reform of the Australian higher education industry:
Implications of the Abbott Government’s Budget of 13 May 2014 Address to the EduTECH
Higher Education Leaders Congress, Brisbane, Australia Retrieved May 10, 2015 from
pdf_version.pdf
https://go8.edu.au/sites/default/files/docs/article/edutech_presentation_-_4_june_2014-Gašević, D., Mirriahi, N., Long, P., & Dawson, S (2014) Editorial – inaugural issue of the
Journal of Learning Analytics Journal of Learning Analytics, 1(1), 1–2.
Goldstein, P., & Katz, R (2005) Academic analytics: The uses of management information
and technology in higher education ECAR Research Study, Vol 8 Retrieved May 10, 2015
Heathcote, E., & Dawson, S (2005) Data mining for evaluation, benchmarking and reflective
practice in a LMS Proceedings e-Learn 2005: World conference on e-Learning in corporate,
government, healthcare & higher education, Vancouver, Canada Retrieved April 13, 2015
from http://eprints.qut.edu.au/2368/1/2368.pdf
Holman, C., Aguilar, S., & Fishman, B (2013) GradeCraft: what can we learn from a
game-inspired learning management system Proceedings of the 3 rd International Conference on Learning Analytics and Knowledge (LAK ’13), Leuven, Belgium
doi:10.1145/2460296.2460350
James, R., Krause, K-L., & Jennings, C (2010) The first year experience in Australian
universities: Findings from 1994 to 2009 Centre for the Study of Higher Education,
Melbourne: University of Melbourne Retrieved May 10, 2015 from
http://www.cshe.unimelb.edu.au/research/experience/docs/FYE_Report_1994_to_2009.pdf
Kennedy, G., Corrin, L., Lockyer, L., Dawson, S., Williams, D., Mulder, R., Khamis, S &
Copeland, S (2014) Completing the loop: returning learning analytics to teachers
Proceedings Rhetoric and Reality: Critical perspectives on educational technology, 31st ascilite Conference, Dunedin, New Zealand Retrieved May 12, 2015 from
http://www.academia.edu/12074024/Completing_the_loop_returning_learning_analytics_to_teachers
Kift, S (2009) Articulating a transition pedagogy to scaffold and to enhance the first year
student learning experience in Australian higher education: Final report ALTC Senior
Fellowship Retrieved April 14, 2015 from pedagogy-report-qut-2009
Trang 9http://www.altc.edu.au/resource-transition-Kift, S., Nelson, K., & Clarke, J (2010) Transition pedagogy: A third generation approach to
FYE - A case study of policy and practice for the higher education sector The International
Journal of the First Year in Higher Education, 1(1), 1-20.
Koshy, P (2014) Student equity performance in Australian higher education: 2007 to 2012 National Centre for Student Equity in Higher Education (NCSEHE), Perth: Curtin University
Macfadyen, L., & Dawson, S (2010) Mining LMS data to develop an ‘early warning system’
for educators: A proof of concept Computers & Education, 54(2), 588-599.
Mirriahi, N., & Dawson, S (2013) The pairing of lecture recording data with assessment
scores: A method of discovering pedagogical impact Proceedings of the 3 rd International Conference on Learning Analytics and Knowledge (LAK ’13), Leuven, Belgium
doi:10.1145/2460296.2460331
Mirriahi, N., Gašević, D., Long, P., & Dawson, S (2014) Scientometrics as an important tool
for the growth of the field of learning analytics Journal of Learning Analytics, 1(2), 1 4.‐
Nelson, K., Clarke, J., Stoodley, I., & Creagh, T (2014) Establishing a framework for
transforming student engagement, success and retention in higher education institutions
Final Report 2014, Canberra, Australia: Australian Government Office for Learning &
Teaching
Nelson, K., Kift, S., & Clarke, J (2012) A transition pedagogy for student engagement and first-year learning, success and retention In I Solomonides, A Reid & P Petocz (Eds.)
Engaging with learning in higher education Faringdon, UK: Libri Publishing.
Norris, D., Baer, L & Offerman, M (2009) A national agenda for action analytics National
Symposium on Action Analytics, St Paul, MN Retrieved May 12, 2015 from
Ochoa, X., Suthers, D., Verbert, K., & Duval, E (2014) Analysis and reflections on the third
Learning Analytics and Knowledge Conference (LAK 2013) Journal of Learning Analytics,
1(2), 5 22.‐
Pechenkina, E & Anderson, I (2011) Background paper on Indigenous Australian higher education: trends, initiatives and policy implications Retrieved May 12, 2015 from
www.innovation.gov.au/HigherEducation/IndigenousHigherEducation/ReviewOfIndigenousHigherEducation/Pages/Research.aspx
Trang 10Raca, M., Tormey, R., & Dillenbourg, P (2014) Sleeper’s lag: A study on motion and
attention Proceedings of the 4th International Conference on Learning Analytics and
Knowledge (LAK ‘14), Indianapolis, IN, USA doi:10.1145/2567574.2567581
Rivera, J., and Rice, M (2002) A comparison of student outcomes & satisfaction between
traditional & web based course offerings Online Journal of Distance Learning
Administration, 5(3).
Romero, C., & Ventura, S (2010) Educational data mining: A review of the state-of-the-art
IEEE Transaction on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 40(6),
601-618
Siemens G (2012) Learning analytics: Envisioning a research discipline and a domain of
practice, Proceedings of the 2nd International Conference on Learning Analytics and
Knowledge (LAK ’12), Vancouver, British Columbia, Canada
http://learninganalytics.net/LAK_12_keynote_Siemens.pdf
Siemens, G., Dawson, S., & Lynch, G (2013) Improving the productivity of the higher
education sector: policy and strategy for systems-level deployment of learning analytics
Society for Learning Analytics Research/Australian Government Office for Learning and Teaching Retrieved 14 April, 2014 from
http://www.itl.usyd.edu.au/projects/SoLAR_Report_2014.pdf
Siemens, G & Long, P (2011) Penetrating the Fog: Analytics in learning and education
EDUCAUSE Review, 46(4) July/August Retrieved 20 May, 2013 from
http://www.educause.edu/ero/article/penetrating-fog-analytics-learning-and-education
Suthers, D., & Verbert, K (2013) Learning analytics as a “middle space.” Proceedings of the
3 rd International Conference on Learning Analytics and Knowledge (LAK ’13), Leuven,
Belgium doi:10.1145/2460296.2460298
Thomas, L (2002).Widening participation in post compulsory education.‐ Education &
Training, 44(4/5), 241 – 242 doi:10.1108/et.2002.44.4_5.241.2
Tinto, V (2009) Taking student retention seriously: rethinking the first year of university
ALTC FYE Curriculum Design Symposium, Queensland University of Technology, Brisbane,
Australia Retrieved May 8, 2015 from
http://www.fyecd2009.qut.edu.au/resources/SPE_VincentTinto_5Feb09.pdf
Tsui, J., Lau, J., & Shieh, L (2014) Septris and SICKO: Implementing and using learning
analytics and gamification in medical education Educause Learning Initiative Retrieved May
10, 2015 from https://net.educause.edu/ir/library/pdf/ELIB1401.pdf
Universities Australia (2013) A smarter Australia: An agenda for Australian higher education 2013-2016 Canberra, ACT: Universities Australia Retrieved April 21, 2015 from
Trang 11https://www.universitiesaustralia.edu.au/news/policy-papers/Universities-Australia-Policy-van Barneveld, A., Arnold, K., & Campbell, J (2012) Analytics in higher education:
Establishing a common language Educause Learning Initiative Retrieved May 10, 2015 from
http://net.educause.edu/ir/library/pdf/eli3026.pdf
van Harmelen, M., & Workman, D (2012) Analytics for learning and teaching JISC CETIS
Analytics Series, Analytics for Learning and Teaching, 1(3) Retrieved May 12, 2015 from
Teaching-Vol1-No3.pdf
http://publications.cetis.ac.uk/wp-content/uploads/2012/11/Analytics-for-Learning-and-Verbert, K., Govaerts, S., Duval, E., Santos, J., Assche, F., Parra, G., & Klerkx, J (2013)
Learning dashboards: an overview and future research opportunities Personal and
Ubiquitous Computing, 18(6), 1499 – 1514.
West, D., Lizzio, A Miles, Toohey, D., C Huijser, H., Bronniman, J & Searle, B (2013)
Learning Analytics: How it can assist Universities with Student Retention OLT Strategic
Commissioned Project Application
Willcoxson, L., Manning, M., Hibbins, R., Joy, S., Thomas, J., Girardi, A., Leask, B., Sidoryn, T.,
Cotter, J., Kavanagh, M., Troedson, D., & Lynch, B (2011) The whole of university experience:
Retention, attrition, learning and personal support interventions during undergraduate business studies Surrey Hills, NSW: Australian Learning and Teaching Council Retrieved May
10, 2015 from http://eprints.usq.edu.au/20138/
Wolff, A., Zdrahal, Z., Nikolov, A., & Pantucek, M (2013) Improving retention: Predicting
at-risk students by analysing clicking behaviour in a virtual learning environment Proceedings
of the 3 rd International Conference on Learning Analytics and Knowledge (LAK ’13), Leuven,
Belgium doi:10.1145/2460296.2460324
Zạane, O (2001) Web usage mining for a better web-based learning environment
Proceedings 4th IASTED International Conference on Advanced Technology for Education (CATE ‘01), Banff, Canada Retrieved 12 May, 2015 from
http://webdocs.cs.ualberta.ca/~zaiane/postscript/CATE2001.pdf
Trang 12Appendix C – Demographic Frequency Data of
Academic Level Survey Participants
Frequency Frequency Relative
Length of employment in Higher
Trang 13Appendix D - Relevant OLT Projects
The following is a list of relevant OLT projects which have been considered during the projectand, which are linked to in the broader project literature review
Project title Lead
institution
Summary
Enabling connected
learning via open source
analytics in the wild:
learning analytics beyond
the LMS (2014)
Queensland University ofTechnology
This project extends the field of Learning Analytics (LA) by developing an open source toolkit for performing sophisticated analysis of learners' engagement in connected learning environments
Innovative perspectives
and approaches for
enhancing the student
experience (2014)
University ofMelbourne
This project builds capacity of higher education institutions by developing new perspectives and approaches for enhancing the student
The project engages postgraduate students and higher education personnel to contribute their experiences, insights and strategies to enhance the 21st century student experience, with an enquiring lens on the growing postgraduate coursework experience
Shaping the 21st century
student experience at
regional universities (2014)
University ofthe
Sunshine Coast
This project seeks to understand the 21st centuryexperiences of the diverse undergraduate student populations of regional universities to identify how equitable outcomes for these students can be achieved
Open for learning: using
open data tools and
techniques to support
student learning (2013)
Monash University
This project explored the extent to which providing open access to data through digital technology allows students to re-configure and re-use data in order to address real-world problems relating to their learning behaviours and learning decisions
Developing a culturally
appropriate data quality
framework for Aboriginal
and Torres Strait Islander
higher education statistics
(2013)
University ofNotre Dame
This project addressed the persistent and problematic nature of data and statistics pertaining to Aboriginal and Torres Strait Islander peoples, in particular in relation to their
participation in higher education
Trang 14Project title Lead
This project aimed to demonstrate the benefits
of an evidence-based approach to the design of inclusive technology enhanced learning (TEL) environments
Data mining of learning
This project aimed to develop innovative and workable data mining technology for an in-depth understanding of what makes good academic sentiment and performance and how poor-performing students can receive early intervention in a customized way in order to advance to high-performing status
Student retention and
This project aimed to undertake a review of learning analytics across Australian universities within an international context The project focuses on how learning analytics are informing teaching practice, personalised learning, and applications for improving retention and identification of students at-risk
Completing the loop:
returning meaningful
learning analytic data to
teachers (2013)
University ofMelbourne
The project has developed a web-based analyticstool that will support teachers to more easily interpret learning analytics to help them improveteaching and learning practices
Improving educational
opportunities for Aboriginal
education workers through
technology-based
pedagogy (2013)
Murdoch University
Design-based research (DBR) informed by Indigenous research theories were used to analyse the potential educational roles for AEWs enabled by E-Learning and new technologies
Exploring the role of
This project examined not only the impact of specific programs designed to enhance student belonging, but moreover how institution-wide change in learning technologies and policies affects practice