Designing Online Information Systems for Portfolio-Based Assessment: Design Criteria and Heuristics
ARTICLE
Terence Love, Curtin University, Australia ; Trudi Cooper, Edith Cowan University, Australia
JITE-Research Volume 3, Number 1, ISSN 1539-3585 Publisher: Informing Science Institute
Abstract
This paper outlines the main findings of research about online portfolio information systems. This research focused on the educational integrity of these educational systems and the maximisation of value across all stakeholders, in particular the value gained from the automation and interaction potential of the online environment. The findings and analyses were based on a review of current practices in online portfolios along with secondary analysis of the existing literature on portfolios and online portfolios. The research focused on the ways stakeholder value is created through different approaches to design composition. From this perspective, the paper explores issues relating to: the automation of administrative functions; matching context, discipline and technology; information storage; interface issues; quality assurance; equity issues; security, fraud and plagiarism detection; and the ability to realise curriculum innovations, such as providing and assessing evidence of professional skills and graduate attributes. The authors propose these are the central functional issues in designing of online portfolio assessment system and as such takes precedence over decision making about the technical means by which online portfolio systems are instantiated and implemented. The findings of this critical review of contemporary practice in designing online portfolio systems indicated a widespread neglect of those factors necessary to achieving educational integrity and maximising value across all stakeholders. Typically, design processes were marked by an overemphasis on technical issues about facilitating implementation rather than addressing the primary educational goals. In conclusion, the research suggests that most online portfolio systems fall significantly short of their potential, and, in many cases, are inferior to conventional portfolio assessment and traditional assessment approaches. The analyses suggest the design of online portfolio assessment systems should, like any other educational process, be grounded in achieving educational integrity, and, to gain the benefits of the online environment, focus on those factors that maximise value across all stakeholders. In particular, the research draws attention to the most significant, and most commonly underrealised, benefit offered by online environments: the ability to efficiently automate many of the time consuming routine administrative tasks associated with education and assessment without loss of teaching and learning benefits.
Citation
Love, T. & Cooper, T. (2004). Designing Online Information Systems for Portfolio-Based Assessment: Design Criteria and Heuristics. Journal of Information Technology Education: Research, 3(1), 65-81. Informing Science Institute. Retrieved March 28, 2024 from https://www.learntechlib.org/p/111441/.
Keywords
References
View References & Citations Map- American Association for Higher Education. (2001). Electronic Portfolios: Emerging Practices for Students, Faculty and Institutions. Retrieved from http://aahe.ital.utexas.edu/electronicportfolios/index.htmlAustralianComputerSociety.(2001).AccreditedTertiaryCourses.RetrievedJune,2001,fromhttp://www.acs.org.au/national/accreditation/intro.htm
- Australian Nursing Council Inc. (2000). National Competency Standards for the Registered Nurse. Adelaide: Australian Nursing Council Inc.
- Australian Quality Council. (2000). Business Excellence: An Overview. Canberra: Australian Quality Council. Barrett, H.C. (2000a). Collaborative Planning for Electronic Portfolios: Asking Strategic Questions. Retrieved May, 2001, from http://transition.alaska.edu/www/portfolios/planning.htmlBarrett,H.C.(2000b).CreateYourOwnElectronicPortfolio.RetrievedMay,2001,fromhttp://transition.alaska.edu/www/portfolios/iste2k.html
- Biggs, J., & Tang, C. (1997). Assessment by portfolio: Constructing learning and designing teaching. Research and Development in Higher Education, 79-87.
- Bowie, C., Taylor, P., Zimitat, C., & Young, B. (2000). Electronic Course portfolio in a new on-line Graduate certificate in Flexible Learning. Higher Education Research and Development Society of Australia News (April).
- Bradley, D. (2000). Distance education: An Open Question? Retrieved July, 2001, from http://www.com.unisa.edu.au/cccc/papers/keynote_address.htm
- Brooks, B.A., & Madda, M. (1999). How to organize a professional portfolio for staff and career development. Jounal for Nurses in Staff Development, 15 (1), 5-10.
- Cooper, T. (1997). Portfolio assessment: a guide for students. Perth: Praxis Education.
- Cooper, T. (1999). Portfolio assessment: A guide for lecturers teachers and course designers. Perth: Praxis Education.
- Cooper, T., & Emden, C. (2000). Portfolio Assessment: A Guide for Nurses and Midwives. Perth, WA: Praxis Education.
- Cooper, T., & Love, T. (2000). Portfolios in university-based design education. In C. Swann & E. Young (Eds.), Re-inventing Design Education in the University (pp. 159-166). Perth: School of Design, Curtin
- Curriculum Council. (1998). Curriculum Framework for Kindergarten to Year 12 Education in Western Australia. Perth, WA: Curriculum Council.
- Department of Education Training and Youth Affairs. (1999). The Quality of Australia Higher Education: An Overview. Retrieved March, 2000, from http://www.detya.gov.au/archive/highered/pubs/quality/overview.htmEducationDepartmentofWesternAustralia.(2000a,March).Assessment-Portfolios.RetrievedMay,2001,fromhttp://www.eddept.wa.edu.au/centoff/outcomes/focus/fc429.htm
- Engineering Council. (1997). Standards and Routes to Registration (SARTOR). Retrieved May 2001, from http://www.soe.org.uk/soe.org/soe/engcoun.htm
- Herrington, A., & Bunker, A. (2002). Quality Teaching Online: Putting Pedagogy First. In A. Goody, J. Herrington& M. Northcote (Eds.), Research and Development in Higher Education. Annual International HERDSA Conference 7-10 July 2002 [CD-ROM] (Vol. 25). Perth: Higher Education Research and Development Society of Australia.
- Hutchins, T., Sims, M., & Cooper, T. (1999). Developing a Portfolio which demonstrates Competencies. In M. Sims& T. Hutchins (Eds.), Learning materials: Certificate in Children’s Services; 0-6 years (bilingual support) (pp. 3-29). Perth: Ethnic Childcare Resource Inc. Western Australia.
- McCracken, W.M. (1997). Portfolio Assessment in Design Education. Atlanta, Ga: EduTech Institute and College of Computing, Georgia Institute of Technology.
- Oliver, R., & Herrington, J. (2001). Teaching and Learning Online. Perth: Centre for Research in Information Technology and Communications, Edith Cowan University.
- Rudner, L.M. (2001). Computer grading using Bayesian Networks– Overview. Retrieved from http://ericae.net/betsy/bayesian_ov.htmSewell,M.,Marczac,M.,&Horn,M.(N.D.).TheUseofPortfolioAssessmentinEvaluation.RetrievedAug,2001,fromhttp://ag.arizona.edu/fcr/fs/cyfar/Portfo~3.htm
- Technology and Industry Advisory Council. (2000). Export of Western Australian Education& Training: Constraints& Opportunities. Retrieved June, 2001, from http://www.wa.gov.au/tiac/exportedu/index.html
- Thompson, R., & Farrow, T. (1999). The Workbook Portfolio: Facilitating undergraduate student learning in the mental health clinical area. Nursing Praxis in New Zealand, 14(2), 21-30.
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to ReferencesCited By
View References & Citations Map-
Using ePortfolio's to Assess Undergraduate Paramedic Students: A Proof of Concept Evaluation
Rod Mason & Brett Williams
International Journal of Higher Education Vol. 5, No. 3 (2016) pp. 146–154
-
Best Practices in e-Assessment
Nicole A. Buzzetto-More & Ayodele Julius Alade, University of Maryland Eastern Shore, United States
Journal of Information Technology Education: Research Vol. 5, No. 1 (Jan 01, 2006) pp. 251–269
These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact info@learntechlib.org.