Showing posts with label higher education. Show all posts
Showing posts with label higher education. Show all posts

Monday, 16 September 2013

Abridged eMM Evaluation


For this post I am looking at two eMM processes. The areas that they are based within are Development and Support. I am using the eMM 2.3 Core Assessment Workbook. This is not presented in the same manner as the eMM practices used in last week's analysis. It sorts the practices backwards into the dimensions of  optimisation, management, definition, planning and delivery. This confused me to start with when I began to analyse the relative strengths of the process capability dimensions.
The organisation that I have selected to consider for this task is a tertiary institution in the South Island of New Zealand. The programme being informally evaluated is representative of an undergraduate programme of study. The institution has a blended approach to teaching.



Process D7: e-learning resources are designed and managed to maximise reuse.
This is a significant process for the organisation, as it has only been developing such resources for around 3 years and establishing a base benchmark now will allow development to be monitored over the next stages of resource creation and reuse.
Overall, the institution is extremely variable on this with responses ranging from fully adequate through to not adequate. After comparison, it seems to be stronger in the Delivery area, with Planning second. Though intentions are good, more robust formal monitoring and documented policy is absent. Most of the documentary evidence for this particular process was not available to the public. In this process I also found one example where the practice in the institution has gone backwards.(incentives provided to teaching staff who create resuable e-learning resources).



Process S2: Students have access to a range of library resources and services when engaging in e-learning.
Coming from a library background, I regard the practices in this area as extremely significant when supporting the operational management of e-learning delivery. These areas are a more mature part of the organisation, but even so, there is scope for improvement. Definition was the area of most weakness followed by Optimisation.
One issue I have is around the assumption that the benchmark as established is actually best practice. In the past 6 years, I believe that practice has moved on, and the assumption that is made that a library will sit separately from the learning and teaching support aspects of the institution it supports is no longer fully valid. Some of these benchmarks also seem designed for very large libraries. Also, the assumption that best practice is to assign a designated library staff member whose contact information is made available is not, in my opinion, the fairest and most consistent approach to take for students. The institution evaluated here provides other means of contact that ensure students get an apt and timely response from the most appropriate staff.

Materials used to define the characteristic practices:
  • the website of both the institution and its library,
  • the website of the students' association
  • the course outlines and graduate profiles from the programme,
  • internally available material related to a recently developed project around digital objects.


Overall, I think the major point that this exercise makes clear is that mentioned in our course material: "The key point to note is that more e-mature organisations have evolved ecologies that ease the use and adoption of digital technologies. " (Davis, N. and Mackintosh, W., 2013,s.8). This organisation is not yet e-mature, though there are clear signs that it is proceeding in that direction based on the two processes selected for this exercise. The model permits a clearer vision on the areas where easing that use and adoption could be better achieved.

This assessment was conducted as a personal learning exercise to gain understanding of the eMM and my assessments were for the most part restricted to publically available information and limited to the two e-learning processes described.

Images:
The two images reproduced here are from the Openclipart  website. Images from this site are able to be freely reused.

References:
Davis, N. and Mackintosh, W. (2013). Section eight: The organisation. [Available from University of Canterbury Learn EDEM 630 web site].

Marshall, S.  (2007). eMM-Core self-assessment workbook. [draft report]. Retrieved from: http://www.utdc.vuw.ac.nz/research/emm/documents/versiontwothree/20070620eMMCoreWorkbook.pdf

Thursday, 12 September 2013

eMM Mindmap and mini-evaluation


This week, we are still thinking about the e-learning Maturity Model as described in the last post here.
This mind map is to identify the structural components of eMM and how they relate to each other. It can be viewed in more detail by clicking on the link in the caption.

Mind map constructed using  Mind Meister. (https://mm.tt/324710821?t=8QjvmyHl8P)



So what do I think is the value of the eMM for assessing organisational maturity of e-Learning in my personal context?

Strengths
Exploring the capability of the organisation is very important in the current tertiary environment. With many demands and strategies, the temptation could be to bite off more than can be chewed. By using a model, the organisation can assess where it wants to direct scarce resources.
The model has a comprehensive set of dimensions, fully based on past scholarly research and practice thus reducing the need to establish an assessment model for any one institution. Staff can spend the time conducting the assessment, not producing the assessment tools.
The model provides an ideal method of benchmarking performance amongst like institutions. The New Zealand Universities Academic Audit Unit ( now Academic Quality Agency for New Zealand Universities (AQA), Te Pokapū Kounga Mātauranga mō ngā Whare Wānanga o Aotearoa) have encouraged the universities to undertake relevant benchmarking activities, and this is extremely relevant to the quality assurance processes that might be expected in the cycle 5 academic activity themes.
The organisation can progress and grow through the levels provided. This is an active, not a static model, aiming to produce a more effective organisation. I like that it assesses normal practice not the high or low ends of evidence.

Weaknesses
This is a very long benchmark, and requires the appropriate amount of time to be set aside to complete it thoroughly.
So far, from a quick look at citations on Google, there do not seem to have been many published reviews of its use, other than by the original developers. This may simply be that institutions do not have time to write up what they are doing, but could be because not many places have adopted it in its entirety yet.
I think there could be a tendency for parts of an organisation to see more value in particular process dimensions. This is acknowledged in the notes on relationships between the dimensions.
I find it a little confusing that sometimes the practices swap between talking about a course to talking about the programme of which the course is a part. For institutions where courses are part of a number of different programmes, this could be a drawback.


Recommendation decision on whether you would consider using eMM as a for a more detailed assessment of e-Learning at an organisation of your choice later in the course.
 Yes, I would certainly be interested in doing this, however, the organisation of my choice currently adopts a blended approach to teaching, so there are few courses or programmes that are fully in an e-learning mode. Therefore, there might be times when I would need to make comments alongside the rankings. Also, I am a little worried about how much time it might take to do this later in the course. This activity was only supposed to take one hour and has taken me at least 4 hours. Sometimes a task that sounds initially straightforward to undertake is not actually so in practice. Having been introduced to the model here, I intend to use it anyway next year to conduct some analysis.

References:
 Academic Quality Agency for New Zealand Universities. (2013). Cycle 5 academic audit framework. Retrieved from: http://www.aqa.ac.nz/sites/all/files/AQA%20Cycle%205%20Framework%20Jan2013.pdf

 Marshall, S. (2006, November 9). So what is the eMM anyway? [Blog post]. Retrieved from e-Literate website: http://mfeldstein.com/so_what_is_the_emm_anyway/

Marshall, S. (2007). E-Learning Maturity Model: Process descriptions [draft report]. Retrieved from http://www.utdc.vuw.ac.nz/research/emm/documents/versiontwothree/20070620ProcessDescriptions.pdf

Music listened to while preparing this blog post: I am still on easy listening this week. As Kevin mentioned, not to everyone's taste, but when I struggle with mind maps I need to be soothed - this week it has been The Seekers, particularly the album The Seekers Seen in Green.

Thursday, 8 August 2013

Trends and Drivers of Change - Synchronous timing


At work, we are approaching our annual Planning Day, so surveying trends and change drivers for that and for scenario planning on this course have converged in my mind with possibly confused and confusing results.Probably have spent too long on this as, like Sandra, I'm a day behind now. Will have to catch up in the weekend.
However, this has been a fun task, particularly as I love the Horizon reports and already referenced one of them in a tweet on this course last week. There is definitely a convergence of drivers and trends the more you read. Each author addresses or approaches them slightly differently, but they distill down to very similar points. I would ntoe that the Horizon reports are specifically about technologies, and we do need to remember that technologies are only one aspect of trends in learning and teaching - as we all know from the TPACK model (Mishra and Koehler).

From the 2013 Horizon report for Higher Education, this is my first key issue: Need for faculty training in what the report calls Digital Media Literacy.
"Faculty training still does not acknowledge the fact that digital media literacy continues its rise in importance as a key skill in every discipline and profession. Despite the widespread agreement on the importance of digital media literacy, training in the supporting skills and techniques is rare in teacher education and non-existent in the preparation of faculty... This challenge is exacerbated by the fact that digital literacy is less about tools and more about thinking, and thus skills and standards based on tools and platforms have proven to be somewhat ephemeral".
I selected this trend because, especially with an aging lecturer population, and the demands of PBRF; in my institution not everyone perceives the need to change and the driver is not particularly clear to them. It is part of my job to clarify this driver.

Trend Two is Australian, from an investigation of public univiersities by Ernst &Young : Integration With Industry. This is defined as "Scale and depth of industry-based learning, Research partnerships and commercialisation, Industry as competitors in the certification and delivery of content." It is selected in my context because we already have issues around the perceived equality of service provision between universities and ITOs, and already a strong request for more industry and iwi partnerships and relationships, both formal and informal. Much current pattern of provision needs to change for this trend to be fully supported and sustained.
http://www.ey.com/Publication/vwLUAssets/University_of_the_future/$FILE/University_of_the_future_2012.pdf
Ernst & Young's report  University of the future: A thousand year old industry on the cusp of profound change.
Note that Ernst & Young also identified my third trend (headed up Democratisation of knowledge and access in their list)

From a blog post about drivers for change, I selected this final one:
The Abundance of Quality Content. Here Morrison talks about the fact that students have access to many more sources of quality information now, and this changes the relationship between student and teacher onto a more equal footing. 
This is significant in my context because the team in which I work is responsible for empowering students and staff to locate, evaluate and use appropriate information sources, and also to promote innovative and successful ways of teaching and learning. Teaching staff often find that students are locating resources that they did not know about themselves, but, also, finding resources for the LMS that will engage students is a much faster task now, allowing more time to be spent on other aspects of teaching.

http://www.ala.org/acrl/sites/ala.org.acrl/files/content/publications/whitepapers/EnvironmentalScan13.pdf

This one is a 2013 scan from the USA Association of College and Research Libraries - (" the document is a scan of the environment and is not intended to be an exhaustive examination of every aspect of librarianship. It identifies current and emerging factors that impact academic libraries; describes the broader context in which these libraries operate; and outlines related implications for library resources, services, and  personnel. It is intended to support the planning and positioning of academic libraries for the future".)
 I have added this resource because it is full of relevant points that back up all the other readings. Each of my three trends appear in it, though under slightly different headings.

Music listened to while preparing this blog post: Actually, I had Tales of Old Dartmoor by the Goons playing quietly in the background. Note sure what message that sends...





 

Sunday, 4 August 2013

I Learn the Meaning of a New Word - My Decision-Making Simulation Activity

  So, here we are at the end of week one of our open education experience. There has been a lot of reading and absorption of new ideas and methodology. I feel like I have come a long way, but, as Tony C. posted on the wikieducator feed, it is taking quite a lot of time - glad I haven't had much on...

 Anyway, here is the new word - Zeitgeist: The defining spirit or mood of a particular period of history as shown by the ideas and beliefs of the time. (definition generated by asking Google 'What is zeitgeist?')

This term came up in one of the readings under Futures Thinking for Academic Libraries and I think it is useful for the whole area of scenario planning. We can be so influenced by the defining mood that it is very hard to rise above that to look at alternative futures that may possibly be characterised by a whole different set of ideas and beliefs. Or, as a senior colleague has said - 'if that is where you want to go, you shouldn't be starting from here'.

A useful site I found was http://cals.arizona.edu/dean/planning/H-E-scenarios.html where the University of Arizona College of Agriculture and Life Sciences collected a number of scenarios for higher ed, published for different parts of the world, under the title Higher Education Scenarios.

Decision-making Context: I am taking the position of a team leader within the Library, Teaching and Learning Group of a university. (This is an actual role that I hold). The university is characterised as a land-based institution, drawing national and international enrollment (levels 2 -10) from those interested in areas related to the land - from valuation and property studies through landscape architecture, agricultural science, tourism, the rural value chain etc. The research base is internationally recognised and world-leading scientists research and teach there. The university has recently moved to an "open unless" policy, and is moving towards a blended teaching approach. It has two main campuses and a number of joint projects and programmes with other higher education institutions.

 

Scenario Overview: For this exercise I have chosen the Four Future Scenarios for Higher Education from the OECD. I have selected Scenario Two - Serving Local Communities. For the purposes of this scenario, most higher educational institutions are focused on local and national needs and imperatives. Most institutions are researching in humanities and social sciences, with much science subject to national security. Teaching is a major objective, funding is good and recreational courses are encouraged. The scenario notes related issues around migration, anti-globalisation, and in increased role for higher education in fostering social cohesion. All the scenarios in this set really made me think about directions, but this one seemed to have the most distinct challenges and opportunities for my setting.
Strategic Decisions: My brainstorm list turned out rather long (really enjoyed that part) and getting it down to two areas was actually annoying as I had to sacrifice some that I was rather fond of. The 'how' decisions are those that I rated highest.
  • How would we provide services to a 'split' organisation? In this scenario, because of the university's particular focus, we would be teaching in our wider subject areas, but would be researching and also doing some teaching in the nationally strategic areas. There would be differences in how the teaching was supported and delivered because some areas would be commercially sensitive and the courses might be restricted. We might teach those students using a less collaborative approach. For the local and regional delivery, we would be funded and supported on an entirely different model to the governmental expectations. I wonder if it would be a bit like health service models where funding must be allocated according to those areas. We would probably have to disaggregate some current services and be transparently accountable in showing the distribution and the return on investment. We might not be able to source so much international information content and end up holding and distributing more printed resources  scanned via our LMS.  The learning services would be delivered both face to face on our campuses and at other regional hubs, and also via online programmes set up in collaboration with industry partners. We would need to intensify the support for teaching and evaluation of teaching to demonstrate to ourselves and others that what was taught and the teaching methods were appropriate in an atmosphere of lifelong learning.
  • How would we encourage appropriate agreements and partnerships? We would be enhancing our regional partnerships as this would be demanded by regional interest groups. Because of the emphasis on response to our communities, we would need to deepen current relationships with the Canterbury Tertiary Alliance and with Core Education, those with Ngai Tahu via Te Tapuae o Rehua  etc. and build more community alliances equivalent to that with the Te Waihora Ellesmere Trust or Banks Peninsula Conservation Trust, Rod Donald Trust etc. Building new relationships with industries that would allow us to have more staff to work on resources for our learning websites and who would provide shared resources for students to access would be important due to the expected collaborative attitude. We would have to build a learning environment that drew on retired staff to assist in the recreational courses, either in person or via class forum or video-conferencing. This would all have to be done within the wider university context, which I think would be more relaxed due to the adequacy of funding available in this model.
 Use of Decisions: Decision One could not be used in Scenario One, Three or Four, as the models do not demand a decision to split the learning, teaching and research approach, nor would the funding require that particular kind of split approach. In the other models, a much more joined up service could be provided by Library, Teaching and Learning. Scenario Two puts us in a particularly difficult position due to the current ways in which we utilise and benefit from international collaboration on a daily basis.
Decision Two would work across all the scenarios, as all models would require careful consideration of appropriate agreements and partnerships, though the decisions made on their nature would be quite different. Some partnerships would not be formed or would be dissolved under particular scenarios.
All scenarios permit a strategic decision to move further forward in directions of a blended approach to teaching, increased use of technology and appropriate distance delivery. All scenarios seem to permit univeristies retention of research-led teaching, though Scenario Two is the bleakest in this respect. All scenarios permit respect of students' learning and support for that learning and the skills that are required for retention and synthesis of discipline knowledge. 


Music listened to while preparing this blog post: Have you seen her by MC Hammer. I put this on repeat and it is great to aid concentration.