NCI’s “Irish Survey of Student Engagement (ISSE) 2017 – report”

ISSE

Advertisements

Earlier this calendar year, first and final year undergraduate, as well as postgraduate taught, students were asked to provide feedback as part of the Irish Survey of Student Engagement (ISSE). Over the last number of weeks, we have been examining our own institution’s data and reporting upon it internally, but the time has now come to start making this analysis more widely available.

Our Irish Survey of Student Engagement (ISSE) 2017 – report is based on the qualitative and quantitative feedback received from 663 NCI students last spring. An overarching national report drawing on the data received from students attending Higher Education Institutions from all across the country is expected to be published later this month or early next.

NCI will of course be looking to capture learner feedback through the next iteration of this survey in spring 2018 but, in the meantime, we are working with staff and students in interpreting what our learners are telling us, taking it on board, and responding to it constructively.

This is all part of the ‘virtuous circle’ regarding learner feedback (i.e. promotion, completion, evaluation and action supported by ongoing communication) identified in the Feedback from students project work undertaken at the start of academic year 2015-16. It is also a fundamental part of the ‘feedback and feedback loop’ identified by the Working Group on Student Engagement in Irish Higher Education.

As the NCI’s ISSE 2017 data analysed PPT presentation given late last month to a group of colleagues illustrates, this work continues in earnest!

“Architects of their experience”

TSEP publication

The Student Engagement Partnership (TSEP) works in conjunction with the National Union of Students (NUS), as well as other stakeholders involved in Higher Education in England, to champion and develop student engagement knowledge and practice. Through its work, TSEP seeks “to equip student engagement professionals, practitioners and decision-makers across the sector with the knowledge and skills they need to make a success of student engagement in their context” (see http://tsep.org.uk/ for more details).

With this purpose it mind, it should be noted that the recent TSEP publication on student academic representation – see Abbi Flint, Hannah Goddard & Ellie Russell, “Architects of their experience: the role, value and impact of student academic representation systems in Higher Education in England” (London: TSEP, 2017), for the main report – offers up an engaging analysis, as well as a useful set of resources including a benchmarking tool, a literature review, and a summary poster.

The focus of these materials is student representation, in particular the student voice within the context of student academic engagement (i.e. engagement in and with learning). It is not necessarily an easy task to provide a summary regarding the rich resources on offer here; frankly, these documents deserve exploration on their own merits as they will have different meanings for Higher Education institutions depending on how and where they operate. This being said, even the most cursory of readings reveals that they could readily be employed to support thinking, review and action in a range of scenarios and contexts.

Of the report’s ten recommendations, the one that leaps out reads as follows:

“Reflect on and consider how to address power differentials which may inhibit effective representation. In some cases, this may include visible signs of where power lies, such as: who chairs meetings; who acts on issues brought through representation; who sets the agenda for meetings; and, when and how different parties are enabled to speak.”

Without wishing to do a disservice to the breadth or depth of a report that examines a whole host of student academic representation matters, any attempt to consider or review how effectively class representative meetings are operating could do worse than to start with such basic considerations as group composition, dynamics and purpose.

In turn, while many participants in these meetings may perceive them as being “focused mainly on feeding back on current experiences”, often with an unfortunate focus on the negative rather than also accentuating the positive, the more ambitious hold “aspirations to have a more proactive, feeding forward role, particularly in curriculum and course development: to enable students to be ‘architects of their experience'”.

Indeed, when done well, the value of effective student academic representation to the wide range of institutional stakeholders are, according to this TSEP research, obvious:

TO PROVIDERS

  • Alternative perspectives
  • Current and relevant information to inform improvement
  • Culture and community
  • Reputation

TO INDIVIDUAL STUDENT REPRESENTATIVES

  • Emotional
  • Personal development
  • Professional development

TO THE STUDENTS’ UNION

  • Reputation and credibility
  • Political
  • Culture and community
  • Currency and relevance
  • Informing improvement

TO THE WIDER STUDENT BODY

  • Being listened to
  • Valuing their voice
  • Changes secured on their behalf

And, once the easier to reach learner groups are on board – typically undergraduate, full time, near campus, etc. – every effort must be made to involve other, often less represented, groups be they students who are carers, international, mature, off-campus, part-time, postgraduate, etc.

At the same time, staff themselves, particularly but not necessarily only academic staff, must be at the forefront of effectively functioning student academic representation (SAR). The fact is that “staff engagement is important in supporting the operation of SAR at the local level, and how staff perceive, and are open to listening to, student contributions” will help to determine their utility and impact.

Ultimately, the impact of student academic representation can be profound, especially when effective practices are employed, such as appreciating how and when to communicate back to students, thereby closing the feedback loop. The fact is that, for everyone who is a member of a self-respecting learning community, most – if not all – of the points noted above should apply when it comes to the role, value and impact of effective representation in particular and the place of learner feedback more generally. These TSEP resources, which clearly resonate with NUS campaigning on this issue of student academic representation, deserve wide dissemination.

NCISU class rep training, 13 October 2017

The annual invitation for QA@NCI to meet and speak with the new NCISU class representatives, to answer their questions and to establish a point of contact with them, was no less welcome this year than it has been in the past. Indeed, this opportunity to get directly involved, to listen to what our student volunteers are telling us, and to consider what we might want to do next is one of the highlights of the academic calendar, so sincere thanks to Stephen Cleary (NCISU president) and his team for inviting us back again this year.

As 2017-18 unfolds, we were asked to speak with NCISU class reps on the topic of NStEP and NCI’s role within it, which was very timely given the potential that this national programme is now realising across the sector, as well as locally at institutions like our own.

The training and development of class reps is an NStEP priority; the fact that it aligns so closely with NCISU’s own imperatives means that progress is now being made in our understanding of a number of student engagement principles including ‘transparency’, ‘collegiality and parity of esteem’, and ‘feedback and feedback loop’ (see Taking Next StEPs for more details).

NCI and NCISU have been asked to lead on the NStEP project entitled “the role and recruitment of class representatives”, more of which in due course. But, if it the outcomes of the national project are anything like the openness on display today at this training event, as demonstrated in the willingness of our class reps to get involved, and their developing awareness of the possibilities inherent in learner representation, then it should prove to be a success.

NStEP and NCI's role within it
NStEP and NCI’s role within it

QA network #2: re-engaging

QA network

Sometimes, a good idea proves to be just that. So, particular thanks to Hugh for continuing to drive this network forward and, even more usefully, to himself and Ruth for the opportunity to touch base, to look at a specific issue in a bit more depth, as well as the chance to place it within its wider context, and, of course, to drink coffee at 8:30am in a nice city centre hotel.

Our previous meeting – see QA network #1 for details – had proven to be so successful that it felt like (i.e. in the sense that it actually was!) a meeting with trusted sectoral colleagues where there are opportunities to give and to take, to learn and to impart, to share and to develop.

This time around, the subject was Re-engagement with QQI, and it was immediately striking how our experiences thus far are leading to increasing levels of resource sharing, informed interaction across and within our institutions, and an awareness that we are actually part of a wider learning community rather than just being employees of different HEIs.

Ideally, our little group will expand to involve other HE colleagues working within the QA space, but we are determined to meet again, next time to talk about learner feedback systems and experiences, in particular feedback from students. That third QA network meeting is expected to take place in six weeks’ time or thereabouts in one of our three locations; if you’d like to get involved, you’d be very welcome, just get in touch.

QA fuel
QA fuel

“Connecting, Listening, and Enhancing”

UCC learner feedback review

Earlier this year, colleagues at University College Cork (UCC) conducted a review of learner feedback processes, particularly in terms of how and why student surveys are undertaken at their institution compared to other universities. They recently published their findings in an eminently accessible report with transferrable findings entitled Connecting, Listening, and Enhancing: Placing Student Perceptions of their Educational Experience at the Heart of Decision Making at UCC.

Apart from advocating that QA@NCI blog readers should themselves have a look through the report, this posting wishes to highlight one or two of the many takeaways from this important piece of work. For example, without proper oversight, there are dangers inherent in over-surveying our students, leading to survey fatigue and/or low (and by definition less representative) response rates. In turn, there can be real frustrations involved in showing evidence that the feedback loop is being closed effectively, particularly if there is an intertwined culture of disengagement or disinterest. Referring to the challenges facing learner survey activity at UCC, the review’s statement on ‘closing the loop’ resonates particularly loudly:

There is limited evidence that the analysis of data arising from some student surveys is being fed back to relevant stakeholders. Although data may be analysed, action may not be taken to make relevant changes, and the findings may not be disseminated appropriately.

This UCC review is also proving to be a useful means for us to consider our own practice and to help in determining whether it is effective or not. For instance, it highlights the role now being played nationwide by the Irish Survey of Student Engagement (ISSE) noting that, up to this point, analysis at UCC has centred on the quantitative – but not necessarily on the qualitative – data. Clearly, there is some real potential in considering the ‘words’ our students are offering through ISSE, as well as the ‘numbers’, which is why an “Irish Survey of Student Engagement (ISSE) 2017 – report” using NCI’s own quantitative and qualitative data is currently being put together; indeed, it will appear here on the QA@NCI blog in due course.

It is clear that Higher Education institutions – both their staff and learners – up and down the country are starting to recognise the power of, as well as the richness in, the student voice. The transparency exemplified through this UCC review is a very welcome addition to our body of knowledge and to its advocacy of due process. With any luck, but more likely through ongoing efforts to persuade, convince and cajole, it should help to prompt ever more effective practices to be enshrined when it comes to learner feedback in particular, and student engagement more generally. If we connect and listen, then we can also enhance.

Further details and resources related to the UCC ‘Review of student feedback’ are available here.

 

QA network #1: contact initiated!

QA network

It’s always good to receive an invitation for cake and coffee a meeting with QA colleagues drawn from other institutions, so sincere thanks to Hugh Sullivan (Quality Assurance Officer) from Hibernia College Dublin for taking this initiative and also for the opportunity to connect and meet with Ruth Ni Bheoláin (Quality Assurance and Enhancement Officer), our Griffith College counterpart, earlier this week.

Just as academic staff will interact with colleagues from their own subject area from other institutions or when our sabbatical officers connect with their peers to learn and to share, this chance to meet up informally with QA colleagues was just too good an opportunity to miss.

Although not all aspects of the Chatham House Rule will necessarily apply to these meetings, indeed all participants are happy for this blog posting to go ahead, it is only fair to limit this post to say that the conversation was broad, open and constructive, exactly what was intended. This dimension – i.e. the chance to touch base with colleagues working in analogous areas in other institutions – will doubtlessly prove to be the most useful element for all involved long into the future. It certainly is good to talk, to listen and to learn! Next time we meet, we’re going to go into a bit more depth about Re-engagement with QQI, a very timely opportunity to build upon the briefings held earlier this spring (see QQI briefing regarding the new Validation Policy and Criteria and the pilot process for Re-Engagement for example for more details).

In sum, this QA network should offer us the chance to consider a wide range of topics as they emerge in the weeks and months ahead. If you’re working in the QA space and interested in joining us next time, feel free to let us know.

Faculty Induction Day, 18 August 2017

Staff

Faculty Induction Day presents the opportunity to orientate new/recently arrived academic staff, to introduce them to colleagues from within their own location and from across NCI, and to draw their attention to established practices and systems. But, induction should never be seen as a one-off event, done well it is always an ongoing and iterative process which takes time and effort. Indeed, the rewards can be profound for the individuals directly concerned, as well as their colleagues and, in turn, their students.

The Quality Assurance presentation, typically delivered in a one-hour slot after lunch, not only gives us the chance to discuss what we do in our area of expertise with these new colleagues, how we support them in their work, etc. It also offers us in QA the opportunity to reflect upon what it is that we think we are doing, to consider more deeply how we might best offer the backing required, etc. But, most importantly of all, it is about creating a connection.

Quality Assurance presentation, 18 August 2017

Just as the new colleagues had questions today and, even more significantly, will have more queries as they crop up individually/collectively long into the future, the same applies to our students. Thus, a key role in induction is not just addressing immediate entreaties, it is about equipping and supporting people to provide/look for/find the answers beyond induction day.

Knowing that those with (at least some of) the answers are accessible, supportive, and open to learning themselves is just one of the functions of those facilitating and helping to fulfil Faculty Induction Day. After all, we were each that new colleague on our first day too.

Faculty Induction Day
Faculty Induction Day, 18 August 2017