I found this stimulating discussion started by @BenPatrickWill on the weekend. “If you (hypothetically) had 15 mins to address your university senior managers about the future of edtech, and it was your best chance to bring in some critical perspectives, what would you highlight?” If you’re a leader, and you ever wondered… (Or if you ever wondered what you’d say if you were trapped in a lift with them)
Class discussions can be a lottery – one day everyone is excited and engaged and the next, you struggle to extract one-word responses. Jay Howard shares some invaluable practical advice in this piece that draws on 30 years of research. Some top tips – put the work back onto the learners, ask more complex questions that support creativity, encourage students to call out great ideas from their peers.
The fact that I thought twice about sharing this piece, which is fairly inoffensive in itself, says something about the politics around this in Higher Education. Institutions do, of course, offer a range of services and specialists that provide support to academics in teaching and ed tech – this is part of the work that I do and this is my community. This article asks the questions that I’ve been hearing a lot recently – are we doing enough and where do we go next?
One of the areas where pedagogy/andragogy and technology enhanced learning veers dramatically away from K-12 learning is when it comes to large classes. The PHELC21 symposium was held in June and the full proceedings are now available. This collection of papers includes work on engagement, course redesign, problem-based learning at scale and drawing classes.
Something that I’ve noticed recently in online conferences is an increased use of pre-recorded presentations. My initial response to this was a sense of feeling somewhat ripped off, but in better sessions I have realised how well this can work. Presenters are freed up to engage in simultaneous chat as the video plays, answering questions and following the audience down new discussion paths that would not be possible in a synchronous session. Emily Nordmann (University of Glasgow) is one of the leading lights in scholarship of lecture capture. This paper with her colleague Carolina Kuepper-Tetzel describes their recent use of this innovative approach with lecture “watch parties” with students. Once lecturers get past the strangeness of watching themselves, they and the students report real benefits from this mode of teaching.
I’ll preface this with a large caveat that I am wary of anyone who describes themselves as “the most influential person in the world for learning systems” and whose evaluation criteria include being signed up to their own business’s “Customer Excellence Pledge”. That said, this list of 30 Learning Management Systems (LMS) recommended by Weiss offers a handy resource for anyone exploring options in the LMS space and it covers a range of organisational contexts. I recognised just one name on this list, D2L.
It’s no secret that Facebook has an oversized grasp on the world’s psyche but this report from the MIT Technology Review still manages to chill in terms of how effectively this is misused. In 2020, 19 of the top 20 “American” Christian pages in terms of views were based in troll farms in Eastern Europe with suspected ties to Russian Intelligence. These aren’t even pages that people have signed up to, simply those that Facebook presents as ‘related content’. More than anything, stories like this highlight the urgency of embedding digital and media literacy and critical thinking in every level of the education system.
12 ideas to refresh your teaching in less than 10 minutes from The Educationalist Alexandra Mihai draws on a range of resources in cognitive psychology and faculty development to provide 12 brief activities (and wider practices) to bolster student learning in classes. Ranging from keeping the lesson plan visible for signposting/contextualisation to retrieval practices and activating prior knowledge, these are all things that can be picked up with minimal preparation.
Research this week has mainly involved a continuation of working on the concise paper relating to TEL edvisor (though we’re not using this term because, well, we kind of made it up) roles and meanings connected to practices.
After chatting to Peter, a few extra ideas have emerged – not really for the paper as much as things that I just want to file away to think about later.
A big one is that the roles of TEL edvisors (academic developers, learning designers, ed technologists etc etc) are generally named and advertised by senior people in institutions who may or may not have a full understanding of what the position entails or what they actually need from it. The point was also made that the dearth of ‘thought leaders’ (it really is a terrible term) in the higher levels of institutions with a rich understanding of TEL is a big problem and it’s perhaps why we get stuck with the ‘MOOC panic’ and ‘the infectious spread of flipped classrooms’ in the absence of strategic leadership. (Both of these approaches clearly have their place but they do seem to be latched on to as some kind of silver bullet far too often, when a more nuanced appreciation of the full range of TEL options would be preferable)
I’ve also been thinking again that I prefer TELT to TEL because it’s important to recognise that Teaching involves a very different set of practices and meanings than Learning does. Learning is clearly the desired outcome but there must be a Venn diagram somewhere that shows that there are clear parts of the act of teaching that are removed from learning. The thing is though, that our warm and gooey feels are all meant to to revolve around students and learning and so there is an inherent bias in the common language to focus only on this. TEL flows off the tongue a little easier as well, which probably has an effect on a subliminal level. In my day to day though, I work with teachers and I know that this is where my attentions lie. Teaching should be designed to create the right conditions for learning but it is not learning in itself.
One other thing – we’ve been looking at the practices that might be specifically attributed to (and which define?) TEL edvisors and came up with a list of seven (more on this another time) based on unpacking the meaning of duty statements. One practice that I think we haven’t covered but which TEL edvisors do a lot is advocate/innovate (maybe these are different). We are often in a position to try to move an individual teacher or the entire institution forward towards things that haven’t really been tried before. Making this happen requires advocacy. Arguably this could be bundled in with research but research rarely seems to be about actually enacting things, more about noting them. No idea what I want to do with this particular thought at this time but I suspect I’ll be coming back to it.
This is a big post because it is about a journal article that covers some of the core issues of my thesis in progress. I’ve spent far longer looking over, dissecting and running off on a dozen tangents with it than I had expected. My highlights and scrawled notes are testament to that.
In a nutshell, King and Boyatt attribute the success (or otherwise) of adoption of e-learning in their university to three key factors. Institutional infrastructure, teacher attitudes and knowledge and perceived student expectations. This seems like a reasonable argument to make and they back it up with some fairly compelling arguments that I’ll expand on and provide my own responses to shortly.
They use this to generate a proposed action plan which includes a coherent and detailed university level e-learning strategy – which includes adequate resourcing for technological and pedagogical support, academic development training, leadership, guidance, flexibility and local autonomy. Everything that they propose seems reasonable and sane yet (sadly) quite optimistic and ambitious. From their bios, I think that the authors aren’t teachers themselves but education advisors like myself but the perspective put forward in the article is very clearly from an academic’s perspective. (Well, 48 academics from a range of discplines, ages and years of teaching experience.) All the same, there were more than a few occasions when I read the paper and thought – “well it’s fine to suggest communities of practice (or whatever) but even when we do set them up, nobody comes more than once or twice”.
I guess the main difference between this paper and my line of thinking in my research is that I want to know what gets in the way, and I didn’t get enough of that here. I also found myself thinking a few times that this kind of research needs to avoid falling into the trap of forgetting that teaching is only one (often de-prioritised, depending on the uni culture) part of an academic’s practice and we need to factor in the impact that their research and service obligations have on their ability to find time to do this extra training. To be completely fair though, the authors did recognise and note this later in the paper, as well as the fact that the section on perceived student expectations was only that – perceptions – and not necessarily a true representation of what students think or want. So they propose extending the study to include students and the university leadership, which seems pretty solid to me and helps to strengthen my personal view that this is probably a thing I’ll need to do when I start my own research. (I’m still in proposal/literature review/exploration swampland for now). To this I would probably add the affordances of the technology itself and also the Education Advisor/Support staff that can and would help drive much of this.
This paper sparked a number of ideas for me but perhaps the most striking was the question of what are the real or main reasons for implementing e-learning and TELT? Is it simply because it can offer the students a richer and more flexible learning experience or is it because it makes a teacher’s life easier or brings some prestige to a university (e.g. MOOCs) or (in the worst and wrongest case) is perceived as a cost-saving measure. There is no reason that it can’t be all of these things (and more) and that makes a lot of sense but some of the quotes from teachers in the article do indicate that they are more motivated to adopt new tools and teaching approaches if they can see an immediate, basically cost-free benefit to themselves. Again, I’m not unsympathetic to this – everyone is busy and if you’re under pressure to output research above all else, it’s perfectly human to do this. But it speaks volumes firstly about the larger cultural questions that we must factor in to explorations of this nature and secondly about the strategic approaches that we might want to take in achieving the best buy in.
From here, I’ll include the notes that I took that go into more specifics and also include some quotes. They’re a little dot pointy but I think still valuable. This is most definitely a paper worth checking out though and I have found it incredibly useful, even if I was occasionally frustrated by the lack of practical detail about successfully implementing the strategies.
“In addition, the results suggest that underpinning staff motivation to adopt e-learning is their broader interest in teaching and learning. This implies a bigger challenge for the institution, balancing the priorities of research and teaching, which may require much more detailed exploration” (p.1278)
Glad to see this acknowledged.
This paper focuses on Adoption. What are the other two phases in the Ako paper?
Initiation (a.k.a adoption), Implementation and Institutionalisation
Getting people to start using something is a good start but without a long term plan and support structure, it’s easy for a project to collapse. The more projects collapse, the more dubious people will be when a new one comes along.
Feel like there are significant contradictions in this paper – need for central direction/strategy as well as academic autonomy. Providing people with a menu of options is good and makes sense but that makes for huge and disparate strategy.
The three core influencing factors identified. (How well are they defined?)
Institutional infrastructure
Definition:
Includes: institutional strategy, sufficient resources (to do what?), guidance for effective implementation.
Question of academic development training is framed with limited understanding of the practicalities of implementation. Assumption that more resources can simply be found and allocated with no reciprocal responsibilities to participate.
Support needs identified:
Exploration of available tools and the development of the skills to use them
Creating resources/activities and piloting them
Developing student skills in using the tools
Engaging with students in synchronous and asynchronous activities
Monitoring and updating resources
Unclear over what time frame this support is envisioned. Presumably it should be ongoing, which would necessitate a reconsideration of current support practices.
“Participants suggested the need for a more coordinated approach. A starting point for this would be consideration of how available technologies might be effectively integrated with existing pedagogic practices and systems” (p.1275)
Issues basically boil down to leadership and time/resourcing. Teachers seem to want a lot in this space – “participants in this study reported the lack of a coherent institutional-wide approach offering the guidance, resources and recognition necessary to encourage and support staff.” At the same time, they expect “ongoing consultation and collaboration with staff to ensure a more coherent approach to meet institutional needs” (both p.1277).
If you want leadership but you also want to drive the process, what do you see leadership as providing? I do sympathise, this largely looks more like a reaction to not feeling adequately consulted with however my experience with many consultation attempts in this space is that very few people actually contribute or engage. (This could possibly be a good question to ask – phrased gently – what actions have you taken to participate in existing consultation and collaboration processes in ed tech)
“A further barrier to institutional adoption was the piecemeal approach to availability of technologies across the institution. Participants reported the need for a more coordinated approach to provision of technologies and their integration with existing systems and practices” (p.1277)
Probably right, clashes with their other requests for an approach that reflects the different disciplinary needs in the uni. How do we marry the two? How much flexibility is reasonable to ask of teachers?
Staff attitudes and skills
Definition:
Is this where “culture” lives?
Includes:
“including their skills and confidence in using the technology” (p.1275)
“A key step for broadening engagement is supporting staff to recognise the affordances of technology and how it might help them to maintain a high-quality learning experience for their students.
[teacher quote] There’s a lot of resistance to technology but if you can demonstrate something that’s going to reduce amount of time or genuinely going to make life easier then fine” (p.1275)
Want to know more about the tech can do – a question here is, for who. Making teaching easier or making learning better? Quote suggests the former.
What about their knowledge of ePedagogy? (I need to see what is in the Goodyear paper about competencies for teachers using eLearning. Be interesting to compare that to the Training Packages relating to eLearning too)
A big question I have, particularly when considering attitudes relating to insecurity and not knowing things – which some people will be reluctant to admit and instead find other excuses/reasons for avoiding Ed Tech (”it’s clunky” etc) – is how we can get past these and uncover peoples’ real reasons. It seems like a lot of this research is content to take what teachers say at face value and I suspect that this means that the genuine underlying issues are seldom addressed or resolved. There are also times when the attitudes can lead to poor behaviour – rudeness or abruptly dropping out of a discussion. (Most teachers are fine but it is a question of professionalism and entitlement, which can come back to culture)
In terms of addressing staff confidence, scaffolded academic dev training, with clear indicators of progress, might be valuable here. (Smart evidence – STELLAR eportfolios – Core competencies for e-teaching and some elective/specialisation units? This is basically rebuilding academic development at the ANU from the ground up)
“The findings highlighted the importance of a pedagogic-driven approach to implementation that supports staff in recognising the potential of technology to add value to students’ learning experiences. While staff recognised that support was available centrally, they suggested that it needed to be more closely tailored to the specific needs of staff and extended to include online guidance at point of need and communities of practice that facilitated sharing between colleagues” (p.1278)
These seems to strengthen the case for college/school level teams. I am well aware that teachers tend not to engage with academic development activities and resources outside their discipline area – which I think is partially tribal because the Bennett literature suggests that there are actually few differences in teaching design approaches from discipline to discipline. This seems like a good area for further investigation. What kind of research has been conducted into effectiveness (or desire for) centralised Academic Dev units vs those at a college level?
Perceived student expectations
Definition: Students expect their online learning world to match the rest of their online experiences.
“One student expectation reported was the availability of digital resources accessible anytime and anywhere: participants suggested that students expected to access all course materials online including resources used as part of face-to-face sessions and supplementary resources necessary to complete assignments.” (p.1276)
Seems like there are a lot of (admittedly informed) assumptions be made of what students actually want by the teachers in this section. Maybe it is reasonable to say that everyone wants everything to be easier. But when does it become too much easier? When they don’t need to learn how to research?
Student need to learn how to e-Learn
“These findings suggest that for successful implementation of e-learning, students need to be supported to develop realistic expectations, an understanding of the implications of learning with technology and skills for engaging in these new ways of learning and make the most out of the opportunities that they present” (p.1277)
Interestingly phrased outcome – DO students need to learn more about the challenges of teaching and/or the mechanisms behind it? Is this just about teachers avoiding responsibilities? It sounds a bit like being expected to study physics or road-building before going for a drive.
“However students confidence with online tools and resources was perceived to vary and the finding suggest that students need to be supported to develop skills to engage effectively with the opportunities that e-learning affords…
It is not clear whether this is an accurate portrayal of student views or whether staff attributed their own views to the students. It would be valuable to ascertain whether this perception is a true representation by repeating the study with students.” (p.1278)
Again, nice work by the authors in catching the difference between student perspectives and teacher assumptions. I guess the important part is that whether the students hold the views or not, the teachers believe they do and this motivates them to use the technology.
Students don’t want to lose F2F experiences and they don’t want eLearning forced upon them when it seems like a cost-cutting measure. They do want (and expect) resources to be available online.
Outcomes
Proposed elearning strategy
“Reflecting on the factors that influenced the adoption of e-learning, participants suggested the need for an institutional strategy that :
Defines e-learning
Provides a rationale for its use
Sets clear expectations for staff and students
Models the use of innovative teaching methods
Provides frameworks for implementation that recognise different disciplinary contexts
Demonstrates institutional investment for the development of e-learning
Offers staff appropriate support to develop their skills and understanding” (p.1277)
I’d add an additional item – Offers staff appropriate support to develop and deliver resources and learning activities in TELT systems.
I have a lot of questions about this strategy – what kinds of expectations are we talking about? Is this about the practical realities of implementing and supporting tools/systems which recognises limits to their affordances? Modelling the use of innovative teaching practices – just because something is new doesn’t mean that it is good. I’d avoid this term in favour of best practice and/or emerging. Is modelling really a valid part of a strategy or would it be more about including modelling/showcasing as one of the activities that will achieve the goals. The goals, incidentally, aren’t even referred to. (Other than the rationale but I suspect that isn’t the intent of that item)
Overall I think this strategy is an ok start but I would prefer a more holistic model that also factors in other areas of the academics responsibilities in research and service. The use of “e-learning” here is problematic and largely undefined. There’s just an assumption that everyone knows what it is and takes a common view. (Which is why TELT is perhaps a better term – though I still need to spend some time explaining what I – and the literature – see TELT as)
Support:
Face to face support complemented by online guidance (in what form?)
Facilitated CoPs to support academics sharing their experiences. (Can we anonymise these?? – visible only to teachers (not even exec). If one of our problems is that people don’t like to admit that they don’t know something, let them do it without people knowing. )
Wider marketing of support services in this space to academics. (I don’t buy this – I think that teachers get over marketed to now by all sections of the university and I’ve sent out a lot of info about training and support opportunities that get no response at all)
Faculty or departmental e-learning champion (Is that me or does it need to be an academic? Should we put the entire focus onto one person or have a community. Maybe a community with identifiable (and searchable) areas of expertise
Big question – how many people use the support that is currently available and why/why not?
My questions and ideas about the paper:
Demographics of the sample reasonably well spread – even genders, every faculty, wide distribution of age and teaching experience as well as use of TELT. No mention of whether any of the participants are casual staff members, which seems an important factor.
It’s fine to look at teaching practices but teaching doesn’t exist in a vacuum for academics. They also have research and service responsibilities and I think it would be valuable to factor the importance of these things in the research. The fact that nobody mentions them – or time constraints – suggests that they weren’t part of the focus group or interview discussions.
My overall take on this – the authors expand on previous work by Hardaker and Singh 2011 by adding student expectations to the mix. I’d think there is also a need to consider the affordances of existing technology (and pedagogy?) and perhaps also a more holistic view of the other pressure factors impacting teachers and the university.
“The findings highlighted the importance of a pedagogic-driven approach to implementation that supports staff in recognising the potential of technology to add value to students’ learning experiences.” (p.1278)
There are a lot of reasons that TELT is actually implemented in unis and while this might be the claim as the highest priority, I would be surprised if it made the top 5. Making life easier for the uni and for teachers, compliance, cost-cutting, prestige/keeping-up-with-the-Joneses and canny vendors all seem quite influential in this space as well. Understanding how the decisions driving TELT implementations are made seems really important.
King, E., & Boyatt, R. (2015). Exploring factors that influence adoption of e-learning within higher education: Factors that influence adoption of e-learning. British Journal of Educational Technology, 46(6), 1272–1280. https://doi.org/10.1111/bjet.12195
I was recently invited by @UQKelly – Kelly Matthews of the University of Queensland – to attend the National Students as Partners Roundtable on a glorious Brisbane Spring day. (For which I am grateful almost as much for the chance to escape a particularly bleak Canberra day as for the exposure to some interesting ideas and wonderful people working in this space). This isn’t an area that I’ve had much to do with and I was invited to bring a critical friend/outsider perspective to proceedings as much as anything.
Students as Partners (which I’ll shorten to SaP because I’ll be saying it a lot) more than anything represents a philosophical shift in our approach to Higher Education, it doesn’t seem like too great a stretch to suggest that it almost has political undertones. These aren’t overt or necessarily conventional Left vs Right politics but more of a push-back against a consumerist approach to education that sees students as passive recipients in favour of the development of a wider community of scholarship that sees students as active co-constructors of their learning.
It involves having genuine input from students in a range of aspects of university life, from assessment design to course and programme design and even aspects of university governance and policy. SaP is described as more of a process than a product – which is probably the first place that it bumps up against the more managerialist model. How do you attach a KPI to SaP engagement? What are the measurable outcomes in a change of culture?
The event itself walked the walk. Attendance was an even mixture of professional education advisor staff and academics and I’d say around 40% students. Students also featured prominently as speakers though academics did still tend to take more of the time as they had perhaps more to say in terms of underlying theory and describing implementations. I’m not positive but I think that this event was academic initiated and I’m curious what a student initiated and owned event might have looked like. None of this is to downplay the valuable contributions of the students, it’s more of an observation perhaps about the unavoidable power dynamics in a situation such as this.
From what I can see, while these projects are about breaking down barriers, they often tend to be initiated by academics – presumably because students might struggle to get traction in implementing change of this kind without their support and students might not feel that they have the right to ask. Clearly many students feel comfortable raising complaints with their lecturers about specific issues in their courses but suggesting a formalised process for change and enhancements is much bigger step to take.
The benefits of an SaP approach are many and varied. It can help students to better understand what they are doing and what they should be doing in Higher Education. It can give them new insights into how H.E. works (be careful what you wish for) and help to humanise both the institution and the teachers. SaP offers contribution over participation and can lead to greater engagement and the design of better assessment. After all, students will generally have more of a whole of program/degree perspective than most of their lecturers and a greater understanding of what they want to get out of their studies. (The question of whether this is the same as what they need to get out of their studies is not one to ignore however and I’ll come back to this). For the students that are less engaged in this process, at the very least the extra time spent discussing their assessments will help them to understand the assessments better. A final benefit of actively participating in the SaP process for students is the extra skills that they might develop. Mick Healey developed this map of different facets of teaching and learning that it enables students to engage with. A suggestion was made that this could be mapped to more tangible general workplace skills, which I think has some merit.
As with all things, there are also risks in SaP that should be considered. How do we know that the students that participate in the process are representative? Several of the students present came from student politics, which doesn’t diminish their interest or contribution but I’d say that it’s reasonable to note that they are probably more self-motivated and also driven by a range of factors than some of their peers. When advocating for a particular approach in the classroom or assessment, will they unconsciously lean towards something that works best for them? (Which everyone does at some level in life). Will their expectations or timelines be practical? Another big question is what happens when students engage in the process but then have their contributions rejected – might this contribute to disillusionment and disengagement? (Presumably not if the process is managed well but people are complicated and there are many sensitivities in Higher Ed)
To return to my earlier point, while students might know what they want in teaching and learning, is it always what they need? Higher Ed can be a significant change from secondary education, with new freedoms and responsibility and new approaches to scholarship. Many students (and some academics) aren’t trained in pedagogy and don’t always know why some teaching approaches are valuable or what options are on the table. From a teaching perspective, questions of resistance from the university and extra time and effort being spent for unknown and unknowable outcomes should also be considered. None of these issues are insurmountable but need to be considered in planning to implement this approach.
Implementation was perhaps my biggest question when I came along to the Roundtable. How does this work in practice and what are the pitfalls to look out for. Fortunately there was a lot of experience in the room and some rich discussion about a range of projects that have been run at UQ, UTS, Deakin, UoW and other universities. At UoW, all education development grants must now include a SaP component. In terms of getting started, it can be worth looking at the practices that are already in place and what the next phase might be. Most if not all universities have some form of student evaluation survey. (This survey is, interestingly, an important part of the student/teacher power dynamic, with teachers giving students impactful marks on assessments and students reciprocating with course evaluations, which are taken very seriously by universities, particularly when they are bad).
A range of suggestions and observations for SaP implementations were offered, including:
Trust is vital, keep your promises
Different attitudes towards students as emerging professionals exist in different disciplines – implementing SaP in Law was challenging because content is more prescribed
Try to avoid discussing SaP in ‘teacher-speak’ too much – use accessible, jargon-free language
Uni policies will mean that some things are non negotiable
Starting a discussion by focusing on what is working well and why is a good way to build trust that makes discussion of problems easier
Ask the question of your students – what are you doing to maximise your learning
These images showcase a few more tips and a process for negotiated assessment.
There was a lot of energy and good will in the room as we discussed ideas and issues with SaP. The room was set up with a dozen large round tables holding 8-10 people each and there were frequent breaks for table discussions during the morning and then a series of ‘world cafe’ style discussions at tables in the afternoon. On a few occasions I was mindful that some teachers at the tables got slightly carried away in discussing what students want when there were actual, real students sitting relatively quietly at the same table, so I did what I could to ask the students themselves to share their thoughts on the matters. On the whole I felt a small degree of scepticism from some of the students present about the reality vs the ideology of the movement. Catching a taxi to the airport with a group of students afterwards was enlightening – they were in favour of SaP overall but wondered how supportive university executives truly were and how far they would let it go. One quote that stayed with me during the day as Eimear Enright shared her experiences was a cheeky comment she’d had from one of her students – “Miss, what are you going to be doing while we’re doing your job”
On the whole, I think that a Students as Partners approach to education has a lot to offer and it certainly aligns with my own views on transparency and inclusion in Higher Ed. I think there are still quite a few questions to be answered in terms of whether it is adequately representative and how much weighting the views of students (who are not trained either in the discipline or in education) should have. Clearly a reasonable amount but students study because they don’t know things and, particularly with undergraduate students, they don’t necessarily want to know what’s behind the curtain. The only way to resolve these questions is by putting things into practice and the work that is being done in this space is being done particularly well.
For a few extra resources, you might find these interesting.
Writing about work by your supervisor feels a little strange but, as adults and scholars, it really shouldn’t. Obviously there is a power dynamic and a question for me of what to do if I disagree with him. Putting aside the matter that Peter Goodyear has worked and researched in this field forever and is highly regarded internationally while I am essentially a neophyte, I’m almost certain that his worst reaction would be the slightest brow-crinkling and a kindly, interested “ok, so tell me why”. He even made the point that the research may now be dated but it could be worth following the citation trail. Fortunately none of this is an issue because, as you’d hope from your supervisor, it’s pretty great and there is much to draw from it.
In summary, this chapter focuses on understanding what and how teachers think when they are teaching online. Sadly perhaps, little has changed in the nature of online teaching in the 14 years since this was written – the online teaching activities described are largely related to students reading papers and participating in discussions on forums. This gives the chapter a degree of currency in terms of the technology (although a few questions emerged for me in terms of the impact of social media) and I imagine that little has changed in teacher thought processes in this time related to assessing and trying to engage students online.
In some ways it’s the methodology used in the study that is the most exciting part of this – it steers away from the sometimes problematic reliance on transcript analysis used often (at the time?) in research on online learning and makes more use of the opportunities for observation. Observing a teacher reading, processing and replying to discussion forum posts offers opportunities for insight into their thoughts that a far richer than one might get in observing face to face teaching. By using a combination of concurrent and retrospective verbalisation and interview, a rich picture emerges.
Concurrent verbalisation involves getting the tutor to keep up a kind of stream of consciousness dialogue as they work on the discussion posts, with the researcher prompting them if they fall silent for more than 10 seconds. This can prove difficult for the teacher at times as they need to stop speaking at times to concentrate on the replies that they write but a balance is generally found. The session is also videotaped and the researcher and teacher watch it back together, (‘stimulated recall’), which gives the teacher the opportunity to discuss what they were thinking in the quiet moments as well as enabling them to expand on their recorded comments. In terms of understanding the things that are important to teachers and how they work with the students, I find this method really exciting. I’m not at all sure how or if it will align with my own research when I come to it but this rich insight seems invaluable.
The author opens the chapter by thoroughly going through the motivations for researching teaching – ranging from an abstracted interest in it as a good area for study to a more action research oriented focus on improving specific aspects of teaching practice. He explores the existing literature in the field – particularly in relation to online learning and finds that (at the time) there were a number of significant gaps in research relating to practice and he proceeds to set out six high level research questions relating to online teaching. It seems worthwhile sharing them here
What are the essential characteristics of online teaching? What tasks are met? What actions need to be taken? Are there distinct task genres that further differentiate the space of online teaching?
How do these practices and task genres vary across different educational settings (e.g between disciplines, or in undergraduate vs postgraduate teaching, or in campus based vs distance learning) and across individuals?
For each significant kind of online teaching, what knowledge resources are drawn upon by effective teachers? How can we understand and represent the cognitive and other resources and processes implicated in their teaching?
How do novice online teachers differ from expert and experienced online teachers? How do they make the transition? How does their thinking change? How does the knowledge on which they draw change? How closely does this resemble ‘the knowledge growth in teaching’ about which we know from studies of teaching in other, more conventional, areas?…
What do teachers say about their experiences of online learning? How do they account for their intentions and actions? How do their accounts situation action in relation to hierarchies of belief about teaching and learning (generally) and about teaching and learning online?
How do learners’ activities and learning outcomes interact with teaching actions? (p.86)
Skipping forward, Goodyear conducted the research with a number of teachers working online and identified several key factors that shape what and how teachers teach online. The focus of their attention – is it on the student, the content, how well the subject is going, whether students are learning, the technology, how students will respond to their feedback etc – can vary wildly from moment to moment. Their knowledge of their students – particularly when they might never meet them in person – can shape the nuance and personalisation of their communications. This also ties to “presentation of self” – also known as presence – which is equally important in forming effective online relationships. Understanding of online pedagogy and attitudes towards it are unsurprisingly a big factor in success in teaching online and this also impacts on their ability to manage communication and conflict in an online space, where normal behaviours can change due to perceived distance.
There were a lot of other noteworthy ideas in this chapter that are worth including here and it also sparked a few of my own ideas that went off on something of a tangent.
Those who foresee an easy substitution of teaching methods too frequently misunderstand the function or underestimate the complexity of that which they would see replaced (p.80)
Teaching is not an undifferentiated activity. What is involved in giving a lecture to 500 students is different from what is involved in a one-to-one, face-to-face, tutorial. Also, interactive, face-to-face, or what might be called ‘live’ teaching is different from (say) planning a course, giving feedback on an essay, designing some learning materials, or reflecting on end-of-course student evaluation reports. (James Calderhead structures his 1996 review of teachers’ cognitions in terms of ‘pre-active’, ‘interactive’ and ‘post-active reflection’ phases to help distinguish the cognitive demands of ‘live’ teaching from its prior preparation and from reflection after the event) (p.82)
The affordances of the user interface are an important factor in understand how online tutors do what they do. This is not simply because online tutors need to understand the (relatively simple) technical procedures involved in searching, reading and writing contributions. Rather the interface helps structure the tutors’ tasks and also takes some of the cognitive load off the tutor (P.87)
Studies of ‘live’ classroom teaching in schools have tended towards the conclusion that conscious decision-making is relatively rare – much of what happens is through the following of well-tested routines (Calderhead, 1984). While swift routine action can be found in online tutoring, its curiously asynchronous nature does allow more considered problem solving to take place (p.97)
Many of these ideas crystallise thoughts that I’ve come to over recent years and which I’ve shared with Peter in our supervision meetings. I’m going to choose to believe that his inner voice is saying at these points, ‘good, you’re on track’ rather than ‘well, obviously and I wrote about this a decade and a half ago’. This is why we go with this apprenticeship model I guess.
As for the other random thought that emerged from reading this paper was that as we get more comfortable with using video and asking/allowing students to submit videos as assessments, we’ll need new ways to ‘read’ videos. Clearly these will already exist in the scholarhood but they may not be as widely known as we need.
Calderhead, J. (1996). Teachers: Beliefs and knowledge. In D. C. Berliner & R. C. Calfee (Eds.), Handbook of educational psychology (pp. 709–725). Prentice Hall International.
I shared some thoughts and summarised some of the discussions tied to the issues we face in supporting and driving institutional change, working with organisational culture and our role as professional staff experts in education design and technology.
There’s still much to talk about. Technology and what we need it to do, practical solutions both in place and under consideration / on the wishlist, further questions and a few stray ideas that were generated along the way.
Technology:
Unsurprisingly, technology was a significant part of our conversation about what we can do in the education support/design/tech realm to help shape the future of our institutions. The core ideas that came up included what we are using it for and how we sell and instill confidence in it in our clients – teachers, students and the executive.
The ubiquity and variety of educational technologies means that they can be employed in all areas of the teaching and learning experience. It’s not just being able to watch a recording of the lecture you missed or to take a formative online quiz; it’s signing up for a course, finding your way to class, joining a Spanish conversation group, checking for plagiarism, sharing notes, keeping an eye on at-risk students and so much more.
It’s a fine distinction but Ed Tech is bigger than just “teaching and learning” – it’s also about supporting the job of being a teacher or a learner. I pointed out that the recent “What works and why?” report from the OLT here in Australia gives a strong indication that the tools most highly valued by students are the ones that they can use to organise their studies.
Amber Thomas highlighted that “…better pedagogy isn’t the only quality driver. Students expect convenience and flexibility from their courses” and went on to state that “We need to use digital approaches to support extra-curricular opportunities and richer personal tracking. Our “TEL” tools can enable faster feedback loops and personalised notifications”
Even this is just the tip of the iceberg – it’s not just tools for replicating or improving analog practices – the technology that we support and the work we do offers opportunities for new practices. In some ways this links back closely to the other themes that have emerged – how we can shape the culture of the organisation and how we ensure that we are part of the conversation. A shift in pedagogical approaches and philosophies is a much larger thing that determining the best LMS to use. (But at its best, a shift to a new tool can be a great foot in the door to discussing new pedagogical approaches)
“It is reimagining the pedagogy and understanding the ‘new’ possibilities digital technologies offer to the learning experience where the core issue is” (Caroline Kuhn)
Lesley Gourlay made a compelling argument for us to not throw out the baby with the bathwater when it comes to technology by automatically assuming that tech is good and “analogue” practices are bad. (I’d like to assume that any decent Ed Designer/Tech knows this but it bears repeating and I’m sure we’ve all encountered “thought leaders” with this take on things).
“we can find ourselves collapsing into a form of ‘digital dualism’ which assumes a clear binary between digital and analogue / print-based practices (?)…I would argue there are two problems with this. First, that it suggests educational and social practice can be unproblematically categorised as one or the other of these, where from a sociomaterial perspective I would contend that the material / embodied, the print-based / verbal and the digital are in constant and complex interplay. Secondly, there perhaps is a related risk of falling into a ‘digital = student-centred, inherently better for all purposes’, versus ‘non-digital = retrograde, teacher-centred, indicative of resistance, in need of remediation’.” (Lesley Gourlay)
Another very common theme in the technology realm was the absolute importance of having reliable technology (as well as the right technology.)
“Make technology not failing* a priority. All technology fails sometime, but it fails too often in HE institutions. Cash registers in supermarkets almost never fail, because that would be way too much of a risk.” (Sonia Grussendorf)
When it comes to how technology is selected for the institution, a number of people picked up on the the tension between having it selected centrally vs by lecturers.
“Decentralize – allow staff to make their own technology (software and hardware) choices” (Peter Bryant)
Infrastructure is also important in supporting technologies (Alex Chapman)
Personally I think that there must be a happy medium. There are a lot of practical reasons that major tools and systems need to be selected, implemented, managed and supported centrally – integration with other systems, economies of scale, security, user experience, accessibility etc. At the same time we also have to ensure that we are best meeting the needs of students and academics in a host of different disciplines. and are able to support innovation and agility. (When it comes to the selection of any tool I think that there still needs to be a process in place to ensure that the tool meets the needs identified – including those of various institutional stakeholders – and can be implemented and supported properly.)
Finally, Andrew Dixon framed his VC elevator pitch in terms of a list of clear goals describing the student experience with technology which I found to be an effective way of crafting a compelling narrative (or set of narratives) for a busy VC. Here are the first few:
They will never lose wifi signal on campus – their wifi will roam seemlessly with them
They will have digital access to lecture notes before the lectures, so that they can annotate them during the lecture.
They will also write down the time at which difficult sub-topics are explained in the lecture so that they can listen again to the captured lecture and compare it with their notes. (Andrew Dixon)
Some practical solutions
Scattered liberally amongst the discussions were descriptions of practical measures that people and institutions are putting in place. I’ll largely let what people said stand on its own – in some cases I’ve added my thoughts in italics afterwards. (Some of the solutions I think were a little more tongue in cheek – part of the fun of the discussion – but I’ll leave it to you to determine which)
Culture / organisation
Our legal team is developing a risk matrix for IT/compliance issues (me)
(We should identify our work) “not just as teaching enhancement but as core digital service delivery” (Amber Thomas)
“we should pitch ‘exposure therapy’ – come up with a whole programme that immerses teaching staff in educational technology, deny them the choice of “I want to do it the old fashioned way” so that they will realise the potential that technologies can have…” (Sonja Grussendorf)
“Lets look at recommendations from all “strategy development” consultations, do a map of the recommendations and see which ones always surface and are never tackled properly.” (Sheila MacNeill)
“Could this vision be something like this: a serendipitous hub of local, participatory, and interdisciplinary teaching and learning, a place of on-going, life-long engagement, where teaching and learning is tailored and curated according to the needs of users, local AND global, actual AND virtual, all underscored by data and analytics?” (Rainer Usselman)
“…build digital spaces to expand our reach and change the physical set up of our learning spaces to empower use of technology…enable more collaborative activities between disciplines” (Silke Lange)
“we need a centralised unit to support the transition and the evolution and persistence of the digital practice – putting the frontliners into forefront of the decision making. This unit requires champions throughout the institutions so that this is truly a peer-led initiative, and a flow of new blood through secondments. A unit that is actively engaging with practitioners and the strategic level of the university” (Peter Bryant)
In terms of metrics – “shift the focus from measuring contact time to more diverse evaluations of student engagement and student experience” (Silke Lange)
“Is there a metric that measures teaching excellence?… Should it be designed in such a way as to minimise gaming? … should we design metrics that are helpful and allow tools to be developed that support teaching quality enhancement?” (David Kernohan) How do we define or measure teaching excellence?
“the other thing that we need to emphasise about learning analytics is that if it produces actionable insights then the point is to act on the insights” (Amber Thomas) – this needs to be built into the plan for collecting and dealing with the data.
Talking about the NSS (National student survey) – “One approach is to build feel-good factor and explain use of NSS to students. Students need to be supported in order to provide qualitative feedback” (David Kernohan) (I’d suggest that feedback from students can be helpful but it needs to be weighted – I’ve seen FB posts from students discussing spite ratings)
“We should use the same metrics that the NSS will use at a more granular levels at the university to allow a more agile intervention to address any issues and learn from best practices. We need to allow flexibility for people to make changes during the year based on previous NSS” (Peter Bryant)
“Institutional structures need to be agile enough to facilitate action in real time on insights gained from data” (Rainer Usselmann) – in real time? What kind of action? What kind of insights? Seems optimistic
“Institutions need at the very least pockets of innovation /labs / discursive skunk works that have licence to fail, where it is safe to fail” (Rainer Usselmann)
“Teachers need more space to innovate their pedagogy and fail in safety” (Silke Lange)
“Is it unfair (or even unethical) to not give students the best possible learning experience that we can?…even if it was a matter of a control group receiving business-as-usual teaching while a test group got the new-and-improved model, aren’t we underserving the control group?” (me)
“I can share two examples from my own experiences
An institution who wanted to shift all their UG programmes from 3 year to 4 year degrees and to deliver an American style degree experience (UniMelb in the mid 2000s)
An institution who wanted to ensure that all degree programmes delivered employability outcomes and graduate attributes at a teaching, learning and assessment level
So those resulted in;
a) curriculum change
b) teaching practice change
c) assessment change
d) marketing change ” (Peter Bryant)
“One practical option that I’m thinking about is adjusting the types of research that academics can be permitted to do in their career path to include research into their own teaching practices. Action research.” (Me) I flagged this with our Associate Dean Education yesterday and was very happy to hear that she is currently working on a paper for an education focussed journal in her discipline and sees great value in supporting this activity in the college.
“I think policy is but one of the pillars that can reinforce organisational behaviour” (Peter Bryant)- yes, part of a carrot/stick approach, and sometimes we do need the stick. Peter also mentions budgets and strategies, I’d wonder if they don’t change behaviour but more support change already embarked upon.
Technology
“let’s court rich people and get some endowments. We can name the service accordingly: “kingmoneybags.universityhandle.ac.uk”. We do it with buildings, why not with services?” (Sonia Grussendorf) – selling naming rights for TELT systems just like buildings – intriguing
We need solid processes for evaluating and implementing Ed Tech and new practices (me)
Pedagogical
“Could creating more ‘tailored’ learning experiences, which better fit the specific needs and learning styles of each individual learner be part of the new pedagogic paradigm?” (Rainer Usselman) (big question though around how this might be supported in terms of workload
“At Coventry, we may be piloting designing your own degree” (Sylvester Arnab)
“The challenge comes in designing the modules so as to minimise prerequisites, or make them explicit in certain recommended pathways” (Christopher Fryer)
I went on to suggest that digital badges and tools such as MyCourseMap might help to support this model. Sylvester noted that he is aware that “these learning experiences, paths, patterns, plans have to be validated somehow” Learner convenience over pedagogy – or is it part of pedagogy in line with adult learning principles of self-efficacy and motivation. In a design your own degree course, how do we ensure that learners don’t just choose the easiest subjects – how do we avoid the trap of having learners think they know enough to choose wisely?
“digital might be able to help with time-shifting slots to increase flexibility with more distributed collaboration, flipped teaching, online assessment” (George Roberts)
“At UCL we are in the midst of an institution-wide pedagogic redesign through the Connected Curriculum. This is our framework for research-based education which will see every student engaging in research and enquiry from the very start of their programme until they graduate (and beyond). More at http://www.ucl.ac.uk/teaching-learning/connected-curriculum
The connected bit involves students making connections with each other, with researchers, beyond modules and programmes, across years of study, across different disciplines, with alumni, employers, and showcase their work to the wider world…
There is strong top-down support, but also a middle-out approach with faculties having CC fellows on part time secondments to plan how introduce and embed the CC in their discipline.
From a TEL perspective we need to provide a digital infrastructure to support all of this connectivity – big project just getting going. Requirements gathering has been challenging… And we’re also running workshops to help programme and module teams to design curricula that support research-based and connected learning.” (Fiona Strawbridge) – liking this a lot, embedding practice. What relationship do these fellows have with lecturers?
“I am imagining that my research, personal learning environment would fit perfect with this approach as I am thinking the PLE as a toolbox to do research. There is also a potential there to engage student in open practice, etc.” Caroline Kuhn
“There may be a “metapedagogy” around the use of the VLE as a proxy for knowledge management systems in some broad fields of employment: consultancy, financial services, engineering…” (George Roberts) (which I’d tie to employability)
“We need to challenge the traditional model of teaching, namely didactic delivery of knowledge. The ways in which our learning spaces are currently designed -neat rows, whiteboard at front, affords specific behaviours in staff and students. At the moment virtual learning spaces replicate existing practices, rather than enabling a transformative learning experience. The way forward is to encourage a curricula founded on enquiry-based learning that utilise the digital space as professional practitioners would be expected to” (Silke Lange) – maybe but none of this describes where or how lecturers learn these new teaching skills. Do we need to figure out an evolutionary timeline to get to this place, where every year or semester, lecturers have to take one further step, add one new practice?
“Do not impose a pedagogy. Get rid of the curricula. Empower students to explore and to interact with one another. The role of the teacher is as expert, navigator, orienteer, editor, curator and contextualisor of the subject. Use heuristic, problem-based learning that is open and collaborative. Teach students why they need to learn” (Christopher Fryer)
This is but a cherry-picked selection of the ideas and actions that people raised in this hack but I think it gives a sense of some of the common themes that emerged and of the passion that people feel for our work in supporting innovation and good practices in our institutions. I jotted down a number of stray ideas for further action in my own workplace as well as broader areas to investigate in the pursuit of my own research.
As always, the biggest question for me is that of how we move the ideas from the screen into practice.
Further questions
How are we defining pedagogical improvements – is it just strictly about teaching and learning principles (i.e. cognition, transfer etc) or is it broader – is the act of being a learner/teacher a part of this (and thus the “job” of being these people which includes a broader suite of tools) (me)
What if we can show how learning design/UX principles lead to better written papers by academics? – more value to them (secondary benefits) (me)
“how much extra resource is required to make really good use of technology, and where do we expect that resource to come from?” (Andrew Dixon)
Where will I put external factors like the TEF / NSS into my research? Is it still part of the organisation/institution? Because there are factors outside the institution like this that need to be considered – govt initiatives / laws / ???
Are MOOCs for recruitment? Marketing? (MOOCeting?)
“How do we demonstrate what we do will position the organisation more effectively? How do we make sure we stay in the conversation and not be relegated to simply providing services aligned with other people’s strategies” (arguably the latter is part of our job)
“How do we embed technology and innovative pedagogical practices within the strategic plans and processes at our institutions?” (Peter Bryant)
Further research
Psychology of academia and relationships between academic and professional staff. (Executive tends to come from academia)
“A useful way to categorise IT is according to benefits realisation. For each service offered, a benefits map should articulate why we are providing the service and how it benefits the university.” (See https://en.wikipedia.org/wiki/Benefits_realisation_management ) (Andrew Dixon)
Leadership and getting things done / implementing change, organisational change
How is organisational (particularly university) culture defined, formed and shaped?
Actor-network theory
Design research
Some ideas this generated for me
Instead of tech tool based workshops – or in addition at least – perhaps some learning theme based seminars/debates (with mini-presentations). Assessment / Deeper learning / Activities / Reflection
Innovation – can be an off-putting / scary term for academics with little faith in their own skills but it’s the buzzword of the day for leadership. How can we address this conflict? How can we even define innovation within the college?
What if we bring academics into a teaching and learning / Ed tech/design support team?
Telling the story of what we need by describing what it looks like and how students/academics use it in scenario / case study format offers a more engaging narrative
What is the role of professional bodies (E.g. unions like the NTEU) in these discussions?
Are well-off, “prestigious” universities the best places to try to innovate? Is there less of a driving urge, no pressing threat to survival? Perhaps this isn’t the best way to frame it – a better question to ask might be – if we’re so great, what should other universities be learning from us to improve their own practices? (And then, would we want to share that knowledge with our competitors)
“I was thinking about the power that could lie behind a social bookmarking tool when doing a dissertation, not only to be able to store and clasify a resource but also to share it with a group of likeminded researcher and also to see what other have found about the same topic.” (Caroline Kuhn) – kind of like sharing annotated bibliographies?
Bigger push for constructive alignment
I need to talk more about teaching and learning concepts in the college to be seen as the person that knows about it
In conclusion
I’d really like to thank the organisers of the Digital is not the future Hack for their efforts in bringing this all together and all of the people that participated and shared so many wonderful and varied perspectives and ideas. Conversation is still happening over there from what I can see and it’s well worth taking a look.
This is me, today, Tuesday the 1st of March 2016. This is the day that I officially start my PhD studies (is it studies or research?) with the Faculty of Education and Social Work at the University of Sydney.
Surprisingly enough, the exact topic is a work in progress but broadly I will be looking into Technology Enhanced Learning and Teaching (TELT) Practices in Higher Education, the factors that influence it and ways to better support it. My supervisor is Peter Goodyear and my associate supervisor is Lina Markauskaite, both decent seeming people that have done a lot of respected work in this and related areas.
So why am I doing it?
This is the make-or-break question I suspect. The thing that will ultimately determine whether or not I finish. Happily I think my reasons are solid.
I want to know more about this field and I want to be better at my job as a learning technologist. (I used to mock the pretension of that title but it’s grown on me). I don’t necessarily aspire to a job in academia but I do think that this will help me professionally whichever path I do end up taking.
I see the questions that I have around this field as a puzzle and one which deserves to be solved. I think that technology can be better employed in adult education to create deeper and more meaningful learning experiences for students and it disappoints me that I don’t see this happening more regularly. I’d like to better understand what factors shape TELT practices in higher education and see what can be done to better support it.
I’m grateful for the opportunity that I’ve been given in being taken on as a student. I haven’t followed the more conventional academic path to get here in terms of research based study and there is certainly some catching up to do but this just makes me more determined to succeed.
The word “scholar” was mentioned a few times last week when I attended the HDR (Higher Degree by Research) induction session and while for some reason it evokes images of 12th Century monks painstakingly writing on parchment by candlelight in a dim cell, it feels special to be a (tiny) part of this history.
I should probably go read something now. (Though surely I’ve earned a break – see, proud scholar already)
I’ve been using Moodle for 3-4 years now but as a big part of my job is to train our teachers in it, it seemed wise to sign up for the new Teaching with Moodle MOOC being offered by Moodle.
It’s run by Mary Cooch (@moodlefairy) and her deep knowledge of the tool and the pedagogical approaches that work with it are on display from the get go.
This MOOC is aimed at beginner users but I have to admit I still picked up some handy tips – the ability to show one topic/section per page – and there is already a rich bank of posts and questions on the discussion board about user experiences around the world.
Teaching with Moodle only started on Sunday this week so there is plenty of time to get up to speed. I was able to whip through the activities and resources for the week in a bit over an hour. As with all MOOCs, it does suffer from the overwhelming weight of numbers in some of the discussions (1500+ introduction posts) but this is a minor quibble.
Life got quite busy in the last few weeks, so screenface had to go on the back-burner for a little while. I think it’s worth taking a look at what happened with the DDLR & DDeLR (Design & Develop Learning/eLearning Resources) subjects and what I might do with them next time.
What happened?
The majority of teachers taking the DDLR subjects have a reasonable expectation that this is a class where they will be able to develop some rich skills in using our eLearning platform to make new things for their students.
The units and elements of competency however are heavily focused on a design and development process for learning resources. The assessments for the teachers (who are the students in this case) hinge on providing evidence that they have considered the characteristics of their cohorts and mapped out a plan for whatever resource they are building. (This should include documenting necessary materials, sources of support and risk planning possible contingencies that may arise). They then need to create the resource, test it with peers or students and make refinements to it before final implementation.
All in all, sensible practice and (I assume) something that most teachers already do as a matter of course in their teaching practice. (Whether or not they formally name the steps in the process is another matter)
What the units and elements of competency don’t particularly care about is what the teachers learn about in terms of usability, readability, general design principles and, of course, the use of a range of new technological tools to get it all done. (Which is what they are most interested in addressing)
So we already have tensions built into the subject in the conflict between what the teachers want and need and what they have to demonstrate and be assessed on.
While we started with a full house of 14 people on the first day, numbers quickly dwindled to a dedicated core of 6 – 7. (A number of factors came to play here including personal issues for a couple of the cohort and running this subject at the very end of semester, when these teachers are themselves inundated with their own grading and teaching responsibilities)
For those that remained, we were able to provide what I hope was an engaging range of activities and training in design principles for usability, copyright and the use of our eLearning platform. (I was well supported by a member of my team – Jo – who also kindly filled in for me when I was away).
Assessment items have been slow to come in – possibly due to the onerous nature of evidence requirements for the subjects. Learners are required to provide 4 draft learning resources (with accompanying design documents and student group profiles) of which 2 are then tested and refined into final learning resources.
I tried to streamline this process in the first week by having the class work on a draft learning resource in the first week – a checklist that might be used to test the quality of their other learning resources. There has been a fair amount of confusion about this and I need to consider whether it is worth trying again and also how I go about explaining the concept.
The idea was to get the class thinking about important qualities in their learning resources and also to get some more buy-in in their own assessments, by effectively designing part of their grading tool. (This is not a graded subject but my intention was that by having them use their learning resource checker on their other resources, they would be more mindful of issues relating to pedagogy, content and technology.
What have I learned?
I need to lower my expectations of what can be achieved in the first lesson. We were beset with technical and enrollment questions that disrupted my carefully planned series of tasks and activities.
I had also put too much faith in the technical skills of the cohort and their ability to effectively use our LMS. I tried to do too many clever things – setting up conditional release on activities so that the learners could only access certain activities or resources after completing others.
I didn’t provide sufficient information about how the class might submit assessment items which were from their own development courses in our LMS. The assessments were set up as an assignment dropbox to receive files. I ended up telling people to create a word document with some screenshots and a link to the resources that they had created but this should have been explicitly stated in the assessment instructions.
I am happy that I was able to be flexible enough with the course to ask the learners what tools they were most interested in learning about and reshaping the course to accommodate this. A core principle of adult learning is that adults need to see the value in what they are being taught and this was an easy way to achieve this.
I’ve been able to speak to the previous teacher of this subject and she also struggled with a number of these issues – hopefully input from a wider group of colleagues might offer some solutions.
