Report

Download the Findings PDF
Download button

Section 7: The RIPPLES survey results and discussion

Survey design

The survey was designed and administered by Dr Daniel Surry, University of South Alabama. He was particularly interested in testing out the usefulness of the RIPPLES model in the Australian VET context. There were 46 questions. Twenty-nine questions addressed each of the seven components of the RIPPLES model, eight questions collected demographic data, and four questions addressed perceptions of personal and organisational innovativeness. Four open ended questions invited respondents to identify the two biggest enablers and barriers to using innovative e-learning and suggestions for fostering the use of innovative practices in e-learning. Respondents also were invited to leave their email addresses if they were happy to answer follow-up questions. The survey questions are included in Appendix 1.

Survey distribution and response profile

The RIPPLES survey was distributed through VET networks including the Flexible Learning Leaders listserv, state and territory LearnScope managers, state and territory Framework Coordinators, state and territory Australian Council of Private Education and Training (ACPET) contacts and state and territory Toolbox Champions. The survey was also distributed to project managers of previous and current New Practices in Flexible Learning projects, the State and Territory Framework Coordinator, through individual contacts in institutes and to those who had expressed an interest in the project including those who had registered on the research wiki. Many recipients forwarded the survey to their own networks.

The survey was conducted between 15 October and 1 November 2006, with a total of 321 respondents. From that, there were approximately 260 usable surveys. 0

Survey results

Descriptive statistics

The following is a summary of the demographic profile of the sample population including provider type, primary role, gender, age, state/territory and primary work location. The number of responses to the open-ended questions is also listed.

Respondents by provider type

Provider Total Percentage (%)
TAFE 220 83.0
Private registered training organisation (RTO) 14 5.1
ACE 4 1.4
Schools 3 1.1
Other 26 9.4

Respondents by primary role

Role Total Percentage (%)
Executive Manager 19 6.9
Manager 46 16.6
Practitioner 124 44.8
Support 35 12.6
Developer 18 6.5
Other 35 12.6

Respondents by gender

Gender Total Percentage (%)
Female 174 63
Male 102 37

Respondents by age

Age Total Percentage (%)
Less than 25 10 3.7
25–34 25 9.3
35–44 61 22.7
45–54 113 42.0
55–64 55 20.4
65 or more 5 1.9

Respondents by State/Territory

Provider Total Percentage (%)
ACT 7 2.6
NSW 71 26.2
NT 9 3.3
QLD 31 11.4
SA 30 11.1
TAS 13 4.8
VIC 84 31.0
WA 26 9.6

Respondents by primary work location

Location Total Percentage (%)
Metropolitan 177 64.8
Rural / Regional 96 35.2

Respondents by Aboriginal and/or Torres Strait Islander origin

Total Percentage (%)
Neither Aboriginal nor Torres Strait Islander 272 98.9
Aboriginal 3 1.1
Torres Strait Islander 0 0.0
Both Aboriginal and Torres Strait Islander 0 0.0

Respondents by field of VET teaching

Field Total Percentage (%)
Support role — e-learning facilitator, developer, coordinator 50 19.2
Agriculture, animal and primary industries 5 1.9
Architecture, building and planning 2 0.8
Art, design, music and entertainment 16 6.2
Business, administration and sales 40 15.4
Chemicals, plastics, rubber, etc. 0 0.0
Computing and information services 18 6.9
Education 57 21.9
Engineering and technical 11 4.2
Food processing 2 0.8
Furniture and wood products 4 1.5
Health and community services 26 10.0
Hospitality and tourism 10 3.8
Law, security, and defence 5 1.9
Literature and social sciences 4 1.5
Metal, electrical and automotive 6 2.3
Natural sciences and mathematics 1 0.4
Printing and paper 1 0.4
Textiles, clothing and footwear 1 0.4
Transport and storage 1 0.4

Qualitative data

Respondents were also asked four open-ended questions:

  1. In your opinion, what are the two biggest enablers that make it easier for people to use innovative practices in e-learning? (225 responses)
  2. In your opinion, what were the two biggest barriers that prevent people from using innovative practices in e-learning? (229 responses)
  3. If you were in charge of fostering the use of innovative practices in e-learning and you had unlimited resources, how would you do it? (211 responses)
  4. Is there anything else you would like to tell us? (110 responses)

The responses to these open-ended questions were analysed using the RIPPLES framework. Themes were identified and synthesised and transferred into the appropriate components of the model. Responses that did not fit within the RIPPLES model were analysed and reported separately.

Inferential statistics

Analysis of variance was conducted on the following:

  1. The extent to which individual courses employ innovative practices.
  2. Provider type.
  3. Role types.
  4. Perceived level of personal innovativeness.
  5. Perceived level of organisational innovativeness.
  6. The seven components of the Ripples model.

The results of each analysis are listed below.

1. The extent to which individual courses employ innovative practices

Question 39. Thinking specifically about the e-learning courses you are responsible for, to what extent do you think those courses use innovative practices and techniques?

An analysis of variance was conducted to determine if there were differences between respondents who felt their e-learning courses used innovative practices and respondents who felt their e-learning courses did not use innovative practices. The results showed that there were significant differences based on the seven components of the RIPPLES model, perceptions of personal innovativeness and perceptions of organisational innovativeness.

More specifically, respondents were more likely to report they used innovative practices in their e-learning courses if their organisations:

  • had a strong infrastructure for e-learning
  • took into account peoples’ ideas, beliefs and experiences when making decisions
  • engaged in shared decision making
  • had appropriate e-learning policies
  • had strong evaluation programs
  • had strong support systems
  • had strong pedagogical support.

In addition:

  • The more innovative a respondent reported themselves as being, the more likely they reported use of innovative practices in their e-learning.
  • The more innovative a respondent reported their organisation as being, the more likely they reported uses of innovative practices in their e-learning.
  • The more their organisation used innovative practices and techniques in e learning, the more likely they reported uses of innovative practices in their e-learning.

Note: State or territory, location (metro/rural), provider type, gender, and ethnicity were also found to be statistically significant variables but subsequent analysis determined that those factors were either not practically significant or were the result of statistical anomalies. As a result, they are excluded from the discussion. Additional research is needed to determine the effect of these variables on the use of innovative practices in e-learning.

Summary: The results indicate that the extent to which e-learning courses use innovative practices is the result of a number of interrelated factors including the technology infrastructure, communication, shared decision making, policies, evaluation, organisational and personal support and perceived personal and organisational innovativeness. There were three significant differences related to the RIPPLES components of People and Support and one each to Policy, Infrastructure and Evaluation. The RIPPLES components of Learning and Resources were not significant factors in this analysis.

2. Provider type

There were a number of statistically significant differences found between respondents based on their provider type (ie, TAFE, ACE). It should be noted, however, that the large majority of respondents to the survey (83%) were affiliated with TAFE. Therefore, it was determined that comparisons between provider types would not be valid. Further research comparing different provider types is recommended.

3. Role types

An analysis of variance was conducted to determine if there were differences between groups. The results showed that there were statistically significant differences between executive managers (6.9% of respondents) and other respondents in 10 key areas.

Compared to other respondents, executive managers:

  • felt resources were allocated less appropriately in their organisation
  • felt opinions, idea, beliefs and experiences were considered to a greater extent
  • rated the amount of shared decision making in their organisation higher
  • felt the culture of their organisation acted more as an enabler
  • felt the policies of their organisation acted more as an enabler
  • rated the commitment of their organisation to provide high quality e-learning experiences higher
  • felt the commitment to learning outcomes of their organisation acted more as an enabler
  • rated the quality and quantity of evaluations related to e-learning in their organisation higher
  • felt the quality and quantity of evaluations in their organisation acted more as an enabler
  • rated the quality of pedagogical support in their organisation higher.

Summary: Executive managers felt that communication, shared decision making, culture, commitment of their organisation to high quality e-learning experiences, evaluations and pedagogical support were more enabling than respondents with other roles. Conversely, executive managers believed financial resources were less appropriately allocated than other respondent types.

4. Perceived level of personal innovativeness

Personal innovativeness related to Question 38. Innovativeness is defined as being open to change and willing to adopt innovative tools and practices. In general, would you say you are more innovative or less innovative then the average person?

There were significant differences between respondents who viewed themselves as more or less innovative based on:

  • the level to which they believed the RIPPLES components: People, Policies, Learning, Evaluation and Support were important
  • their organisation’s infrastructure for e-learning
  • the level of shared decision making in their organisation
  • the degree to which they believed their organisation’s policies were rigid and difficult to change
  • the appropriateness of their organisation’s policies related to e-learning
  • the degree to which their organisation emphasised learning outcomes in e learning courses
  • the degree to which their organisation was committed to providing a quality e-learning experience
  • the quality and quantity of evaluations in their organisation
  • the quality and quantity of evaluations in their organisation related to e learning
  • the support system of their organisation
  • the quality of training in their organisation
  • the quality of technical support in their organisation
  • the quality of pedagogical support in their organisation
  • the extent to which they used innovative practices and techniques in their own e-learning courses
  • the degree to which they felt their organisation was innovative.

Note: The majority of respondents to this survey identified themselves as either much more innovative (38.3%) or somewhat more innovative (47.7%) than the average person. This question calls for a self-reported level of innovativeness and, therefore, represents a person’s perception of their own innovativeness, not an independent measure of innovativeness. While additional research could be conducted to include an independent measure of innovativeness, the discussion for this research has focused on types of ‘innovativeness’.

Summary: Perceptions of personal innovativeness are significantly related to the extent respondents believed the RIPPLES components: People, Policies, Learning, Evaluation and Support were important. Other significant factors include the infrastructure for e-learning, shared decision making, policies related to e-learning, commitment to quality e-learning provision, the quantity of evaluations related to e-learning and in general, the quality of pedagogical and technical and training, the use of innovative practices in their own e-learning delivery and the degree they thought their organisation was innovative. Eighty-six percent of respondents rated themselves as being much more or somewhat more innovative than the average person.

5. Perceived level of organisational innovativeness

A comparison of respondents based on the extent to which they felt their organisation as a whole uses innovative practices in e-learning, and the extent to which they believed each of the RIPPLES components serves as a barrier or an enabler showed significant differences on all seven components.

From a practical standpoint, this means that respondents who felt their organisation used innovative practices in e-learning tended to view each of the RIPPLES components as an enabler rather than a barrier in their organisation. Conversely, it means that respondents who felt their organisation did not use innovative practices in e-learning viewed each of the RIPPLES components as a barrier rather than an enabler in their organisation. This finding suggests that the RIPPLES components are a valid framework for determining barriers or enablers to the use of innovative practices in e-learning.

Of the 53.1% of respondents to this survey, 10.1% identified their organisation as being extremely innovative and 43% as somewhat innovative.

Summary: Organisational innovativeness was significantly related to the seven components of the RIPPLES model and so are considered enablers of innovative e-learning practices; 53.1% of respondents believed their organisations in general were extremely or somewhat innovative.

Summary of perceived personal and organisational innovativeness

Perceptions of personal innovativeness are significantly related to the extent respondents believed the RIPPLES components: People, Policies, Learning, Evaluation and Support were important. Other significant factors include the infrastructure for e-learning, shared decision making, policies related to e-learning, commitment to quality e-learning provision, the quantity of evaluations related to e-learning and in general, the quality of pedagogical and technical training, the use of innovative practices in their own e-learning delivery and the degree they thought their organisation was innovative. Organisational innovativeness was significantly related to the seven components of the RIPPLES model so they are considered enablers of innovative e-learning practices.

While 86% of respondents rated themselves as being much more or somewhat more innovative than the average person, 44.7 % indicated they were using innovative e-learning practices and techniques to a very high or high extent in their delivery. Of the 53.1% who believed their organisation in general was extremely or somewhat innovative, only 25.7% believed their organisation was using innovative practices to a very high or high extent. Individual respondents perceived themselves to be more innovative than the organisation they worked in and using more innovative practices than their organisation as a whole.

6. The seven components of the RIPPLES model

Table 6 shows the mean for each RIPPLES component on a seven point scale with ‘1’ being a major barrier and ‘7’ being a major enabler. The component Infrastructure showed the lowest mean score (3.42). This suggests that the technological infrastructure of the organisation was viewed as the biggest barrier to the use of innovative teaching practices in e-learning by respondents in this sample. The component Learning showed the highest mean score. This suggests that an emphasis on learning outcomes by the organisation was viewed as the biggest enabler to the use of innovative teaching practices in e-learning by respondents in this sample.

It should also be noted that Learning was the only RIPPLES component to score above a ‘4’ — the mean point on the ‘7’ point scale. This suggests that Learning was the only net enabler for this sample while the other six components were all net barriers — although all six appear to be relatively weak net barriers.

Table 6: Barrier or enabler — mean for each RIPPLES component

  N Minimum Maximum Mean Std. Deviation
Resources 255 1 7 3.59 1.660
Infrastructure 273 1 7 3.42 1.616
People 271 1 7 3.63 1.706
Policies 259 1 7 3.66 1.491
Learning 274 1 7 4.14 1.615
Evaluation 257 1 7 3.62 1.384
Support 272 1 7 3.64 1.730
** 1 = major barrier, 7 = major enabler

Barriers and enablers for each component of the RIPPLES model

This section is a collation of survey responses related to the barriers and enablers specifically aligned to the seven components of the RIPPLES model. This includes survey questions specifically addressing enablers and barriers, and the importance of each component for successful use of an e-learning innovation. A synthesis of the responses to the two open-ended questions specifically related to enablers and barriers have been aligned to the appropriate component.

Resources

Question 3. Do you think the financial resources of your organisation and the way those resources are allocated act as a barrier or an enabler to the use of innovative practices in e-learning? (A barrier makes innovative practices in e-learning harder, an enabler makes innovative practices in e-learning easier) 1 = Major Barrier, 7 = Major Enabler

Alternative text
Percentage of responses related to Question 3

Figure 5:Percentage of responses related to Question 3

Importance of financial resources (money) for the successful use of an innovation

Extremely important 6 5 Moderately important 3 2 Not important
36.9 23.4 18.9 17 3.2 0 0.6

Summary of responses related to Resources

Responses related to Resources tended to be short like ‘no funds’ or ‘no money’. Key words like ‘funding’, ‘money’, ‘funds’, ‘finances’ ‘dollars’, ‘financial’ and ‘cost’ appeared 16 times in the responses. The word ‘resources’ also referred to learning resources, so ‘financial resources’ were differentiated. Responses that included a reference to funding tended to come as a bundle of factors, most commonly; time, money, infrastructure, management decisions about resource allocation and management support.

Sample quotes

Management due to financial restriction are not able to invest in the development of innovative delivery.

Although technical support is excellent, the lack of resources is extremely short sighted! The organisation needs ‘to put its money where its mouth is’ so to speak.

Supportive management that encourages innovations and have the resources to fund it.

It is always sufficient $$$’s as this provides — when managed effectively and in an encouraging environment — the opportunity to develop staff, learning materials and logistical processes that will capitalise on an invigorated staff eager and able to relate to ‘industry education and training’ needs and deliver.

Private RTOs (registered training organisations) have no funding to do this and the infrastructure is very expensive.

Too many casual staff do not have the technology skills.

Enablers Barriers
SOURCES OF FUNDING
Hard money
  • Organisation commitment to resource e-learning innovations, resources and encourages risk-taking
  • Insufficient resource allocation
  • Petitioning for funds
Soft money
  • LearnScope — to motivate, learn, meet, explore, practice
  • Reframing the Future
  • Heavy reliance on Framework funding with no sustainability plan beyond the ‘project’
Enablers Barriers
SOURCES OF FUNDING
COSTS
Initial costs
  • Funding to establish and maintain support units
  • Private RTOs have no funding for expensive infrastructure
  • Costs to small RTOs (particularly for small owner/operator RTOs) who often lack sufficient funds for the necessary ICT requirements
  • No funds for purchase of equipment, hardware and software
  • Inability to finance appropriate resources
  • Casual staff are not resourced beyond teaching time
Ongoing costs
  • Upgrades of hardware and software
  • Expecting that a percentage of funding agreements are targeted for innovations
  • Lack of funding to backfill teachers from their regular duties to explore innovations
  • Resources allocated to other priorities
  • No money for upgrades
  • Competing priorities due to financial restrictions
  • Short-term funding of one-off projects

Infrastructure

Question 7. Do you think the infrastructure of your organisation acts as a barrier or an enabler to the use of innovative practices in e-learning? (A barrier makes innovative practices in e-learning harder, an enabler makes innovative practices in e-learning easier) 1 = Major Barrier, 7 = Major Enabler.

Alternative text
Percentage of responses related to Question 7

Figure: 6 Percentage of responses related to Question 7

Importance of appropriate infrastructure for the successful use of an innovation

Extremely important 6 5 Moderately important 3 2 Not important
54.2 28.2 13.6 2.6 1.0 0.3 0

Summary of responses to Infrastructure

Note: Responses related to technical support are included under the Support component

Sample quotes

People get frustrated when things don’t work and won’t try again.

Managers (I am one) do not have enough understanding of these things to champion them.

Lack of adequate technical support (in fact the presence of technical tyranny in the form of firewalls).

Enablers Barriers
Technology infrastructure
  • Robust baseline infrastructure
  • Fast, reliable and efficient
  • State of the art technology
  • Access to server space
  • Poor web connectivity
  • Servers that cannot support the technology
  • Low bandwidth
  • Slow
Hardware
  • Access to computer suites and technology in the classroom
  • All classrooms have computers, DVDS and internet access
  • State-of-the-art equipment
  • Technology that meets special needs
  • Low ratio of computers for teachers
  • Cheap technology added piecemeal
Software
  • Free software
  • Web 2.0 tools
  • Access to software
  • Red tape associated with access to new software and the internet
Access and use
  • No restrictions of the use of the computer network
  • Blocking access, especially to Web 2.0 tools is a significant barrier
  • Restrictions to the use of computer network
  • Firewalls

People

Question 11. Do you think that the culture of your organisation, specifically shared decision making and communication, acts as a barrier or an enabler to the use of innovative practices in e-learning? (A barrier makes innovative practices in e-learning harder, an enabler makes innovative practices in e-learning easier) 1 = Major Barrier, 7 = Major Enabler.

Alternative text
Percentage of responses related to Question 11

Figure: 7 Percentage of responses related to Question 11

Importance of appropriate shared decision making and participation for the successful use of an innovation

Extremely important 6 5 Moderately important 3 2 Not important
47.7 30.8 13.2 7.3 0.7 0.3 0

Summary of responses related to People

Sample quotes

Lack of engagement with us when designing or managing teaching tools. Very little real invitation to be involved in decision making and design.

Not having the social computing tools that would allow an appropriate level of collaboration to occur.

No consultation with educators before blocking decisions are made.

Lack of communication and understanding about ICT needs for education.

Appropriate support that isn’t driven by what the policy says must be so, but rather listens to the needs of the practitioner who is trying to find better ways to engage learners or manage programs.

Management shares their vision with staff about where they want the organisation to progress in relation to e-learning.

Enablers Barriers
Shared decision making
  • Practitioners involved in technology decisions
  • Lack of engagement in design or management
  • No shared decision making
  • No consultation
Communication
  • Communicating the vision
  • Listening to needs and responding
  • No social computing tools for communication
  • Lack of communication with educators about ICT needs
  • No interest in education use of technology

Policies

Question 16. Do you think that the policies of your organisation act as a barrier or an enabler to the use of innovative practices in e-learning? (A barrier makes innovative practices in e-learning harder, an enabler makes innovative practices in e-learning easier) 1 = Major Barrier, 7 = Major Enabler.

Alternative text
Percentage of responses related to Question 16

Figure 8: Percentage of responses related to Question 16

Importance of appropriate policies for the successful use of an innovation

Extremely important 6 5 Moderately important 3 2 Not important
37.8 26.1 20.4 11 2.3 0.7 1.7

Summary of responses related to Policies

Sample quotes

1. technical support for front line practitioners — base level teacher PD is not enough 2. clear organisational goals and policies to guide front line practitioners and change attitudes which may include incentive arrangements.

The word policy fills me with dread around e-learning because it’s often about older less computer literate managers wanting to control and stop a possibility of a mistake.

There were four references to policies in the open-ended responses. One was identified as an enabler and the other three as barriers. This is reflected in the percentage of responses to this component of the RIPPLES model with 32.4% selecting a neutral response.

Enablers Barriers
  • Clear policies to guide practitioners
  • No professional development policies
  • Don't understand legal/policy implications of what they are doing
  • Policy associated with compliance

Learning

Question 20. Do you think that your organisation's commitment to learning outcomes acts as a barrier or an enabler to the use of innovative practices in e-learning? (A barrier makes innovative practices in e-learning harder, an enabler makes innovative practices in e-learning easier) 1 = Major Barrier, 7 = Major Enabler.

Alternative text
Percentage of responses related to Question 20

Figure 9: Percentage of responses related to Question 20

Importance of commitment to learning outcomes for the successful use of an innovation

Extremely important 6 5 Moderately important 3 2 Not important
51.9 23.5 11.9 10.9 0.3 0.7 0.7

Summary of responses related to Learning

Sample quotes

Web 2.0 presents new challenges. Developing e-learning resources eg podcasting, screencasting, wikis, mobile technologies — is extremely time consuming and for many people very difficult. Making podcasts and videos requires good equipment and an understanding of recording technology. And one person cannot hope to have in-depth expertise in all of the technologies.

Do customers want e-learning? If so which ones?

Many colleagues have strong views about student receptiveness to this type of learning, especially students who are not strongly motivated, and need personal contact with teachers and students and who need individual help.

The culture of the teacher as the font of all knowledge has to be challenged before a larger uptake of e-learning is to occur.

Greater understanding among consumers about how e-learning works and can be adopted.

Enablers Barriers
PEDAGOGICAL
Role of e-learning
  • Affirming the purpose of investing in e-learning
  • Putting learning and teaching above all else
  • Understanding that it is not the technology that is driving the learning process
  • Lack of understanding of e-learning pedagogy
  • Not understanding the potential benefits of employing innovative practices
Implementation
  • Seeing the potential value of ‘e’ to teaching and learning
  • Seeing what and how others use e-learning
  • Real life case studies, good practices and success stories
  • Demonstration of good working models of complete programs, not just demonstration of individual objects and tools
  • Difficulties in making transition from traditional to more innovative methods
  • The dominant culture of the teacher as the font of all knowledge
  • Letting go of old practices
  • No understanding of effective e-learning
  • No transition time to build a new practice
Hearing learner/client perspectives
  • Understanding what the client wants from the program
  • Evidence that e-learning is actually what learners are wanting
  • An understanding by clients about how e-learning works and can be applied
  • Learner enthusiasm for e-learning as a way of achieving qualifications
  • Students demanding e-learning innovation
  • Younger students’ familiarity with emerging technologies
  • Learner fear of technology
  • Unconvinced that customers want e-learning

Evaluation

Question 24. Do you think that the quality and quantity of evaluations in your organisation acts as a barrier or an enabler to the use of innovative practices in e learning? (A barrier makes innovative practices in e-learning harder, an enabler makes innovative practices in e-learning easier) 1 = Major Barrier, 7 = Major Enabler.

Alternative text
Percentage of responses related to Question 24

Figure: 10 Percentage of responses related to Question 24

Importance of evaluation for the successful use of an innovation

Extremely important 6 5 Moderately important 3 2 Not important
32.5 31.9 20.6 12.4 1.8 0 1.1

Summary of responses related to Evaluation

Sample quotes

Evaluation was only mentioned once in the open-ended question. In was in relation to enabling e-learning through a holistic approach

Easy access to e-learning, relevant and well set out content, concise and stringent evaluation, resources, training of staff and clients on how to implement e-learning and finally support from management and organisation and well set out infrastructure. Sorry all of the above need to be available to enable good practices in e-learning.

This is reflected in the percentage of responses to this component of the RIPPLES model with 47.7% selecting a neutral response, which was the highest in this category for the seven components. Yet evaluation was considered to be an important factor for using an innovation successfully.

Support

Question 28. Do you think that the overall support system of your organisation acts as a barrier or an enabler to the use of innovative practices in e-learning? (A barrier makes innovative practices in e-learning harder, an enabler makes innovative practices in e-learning easier) 1 = Major Barrier, 7 = Major Enabler.

Alternative text
Percentage of responses related to Question 28 Figure 11: Percentage of responses related to Question 28

Importance of support for the successful use of an innovation

Extremely important 6 5 Moderately important 3 2 Not important
64.3 23.2 7.1 4.3 1.1 0 0

Summary of responses related to Support

Most of the responses related to Support. The words ‘support’, ‘supportive’, ‘supporting’ were mentioned 124 times in the enabling responses. Supportive managers were most frequently mentioned followed by mentors, colleagues, team, attitude and culture. Support was described as localised, personalised, organisational, practical, for learning, easily available, just-in-time, networks, on-site, financial, and administrative. The type of support was technical and pedagogical. Support for innovation and innovators and the uptake of innovative practice being supported were all variations of support. The words ‘mentor’, ‘mentoring’ and ‘e mentor’ were mentioned 22 times.

Conversely, ‘Lack of’ was the most common term in the response to barriers being mentioned 120 times. In a breakdown of responses the most frequent ‘Lack of’ was time (110), for professional development, to develop resources, to commit to e-learning, to plan and to make the transition to new practices. The second was support (79) in relation to innovative teaching, administrative, encouragement, technical and from managers and peers. Others were funding (61) for time release and purchase or upgrade of technology. Fear was mentioned 27 times in relation to change, failure, technology jargon, and letting go of familiar practices. Mentioned more than five times were knowledge of what is available, of technology and experience, training in ICT skills for e-learning; understanding of innovation, good practice in e-learning technology, educator’s needs; leadership, interest and commitment from senior management. A range of personal factors like lack of motivation, experience, will, incentives, confidence and encouragement were also identified as barriers.

Sample quotes

Staff too busy with current practice and responsibilities to have time to learn or prepare for innovations.

Fear of the machine. Many older staff have not adapted well to the change to ICT and there has been totally inadequate training to reduce the fear.

Lecturers having to learn the technology and pedagogy skills to be effective. Most lecturers have basic computing skills and for many forms of e-learning need to have a high level of commitment to learn the technology, often outside of work hours.

The IT staff are both competent and helpful, but there are far too few of them.

Stimulating and supportive team culture, driven by leadership which is forward-looking and educationally focused.

Local support is required when and where people need it. Teachers need support in faculty land, not from a central unit.

A commitment by the organisation that e-learning is valued (presence of an e-learning champion in the management cadre) and the provision of adequate infrastructure for training and technical support.

Enablers Barriers
TRAINING
Time
  • Time to think about the possibilities, investigate, experiment, make mistakes, learn new things, develop understandings, develop quality e-learning resources, access training, share with colleagues

Lack of time for:

  • Research — explore, play, trial tools, contemplate, reflect, plan for integration
  • Training — learn skills and new practices
  • Application — to transition to new practices
  • Release — from day-to-day activities and administrative demands
The process
  • Mentoring from experienced e learning practitioners with a proven implementation record
  • Practical hands on experience with personalised just-in-time support on a regular basis
  • A training culture that is learning rather than ‘e’ learning focused
  • Lack of training and support — technology and programs are just thrust under our noses and no — or very little — follow up and support
  • People need support out in faculty land, not a central unit
Enablers Barriers
TRAINING
The process (continued)
  • A support network of willing, adventurous peers for collaborative learning
  • A safe and enabling environment
 
Support
  • Innovation and support centres within an organisation
  • Readily available support
  • Structured, progressive in-house training in use of e-technologies
  • Having access to mentoring and support with time to learn and experiment
  • Just-in-time, personalised and one-to-one support to implement real e-learning innovations in a local context
  • Don’t know what is out there
  • Poor dissemination of innovations attempted elsewhere
  • Lack of exposure and participation in innovation sharing
TECHNICAL SUPPORT
Customer service orientation
Technical support
  • Competent interested and friendly support
  • For specific software
  • Just-in-time and personalised
  • Provided by ICT staff and educators
  • Helpful, positive and knowledgeable technical support
  • Readily available and sound ICT support from either experienced educators or ‘techies’
  • Technical support to ensure there is no significant downtime
  • Good ICT backup
  • Easy access from home
  • Minimal administrative or technical barriers to using the innovation
  • Artificial barriers put in place by over zealous ICT managers
  • Very conservative ICT managers
  • Insufficient staff in ICT support
  • Lack understanding of ICT needs
  • No communication about ICT needs for educational purposes
PEDAGOGICAL
Personal qualities and attributes
  • Desire, willingness to participate, open mindedness and passion
  • Challenging and supportive colleagues ready to change mindset
  • Motivation of teachers to engage with e-learning
  • Space to dream and supportive people around who understand the risk is OK
  • Attitude and enthusiasm and initiative of staff (both individually and collectively)
  • Being around people who are excited about it
  • Committed to pedagogy rather than outcomes
  • Enthusiastic staff and staff prepared to put in many hours at night and on weekends
  • Persistence
  • Closed minds
  • Apathy towards e-learning
  • Not wanting to engage with e learning even though support is there
  • Gatekeepers who want to keep the status quo

Fear (mentioned 27 times)

  • Fear of failure and repercussions
  • Fear of the unknown
  • Fear of change and not knowing how to be innovative
  • Fear of the language of ‘technology speak’
  • Fear of letting go of customary way of doing things and familiar practices
  • Fear by older staff
Modelling by peers and mentors
  • Seeing others in same age range using practices
  • Teachers who are experienced and have expertise in delivering e learning successfully
  • Access to forward thinking staff
  • Enthusiastic champions for technology and e-learning.
  • Local expertise who transfer skills in local context
  • The commitment drive and resilience of the practitioners to be innovative
  • Negative attitude towards e-learning peers making initiatives difficult to progress
  • Negative attitude towards e-learning peers making initiatives difficult to progress
Sharing and collaboration
  • Networking opportunities, workshops, showcases, conferences
  • Learning and working together as part of daily work activities
 
Experimenting with new applying practices
  • Building on what is already in use
  • Trial lots of examples of online resources
  • Pilot trials where learning from failure is necessary
  • Time to investigate and become familiar with the innovative practices available
  • Different lots of support and encouragement
  • Support to apply in a real learning situation
 
ADMINISTRATIVE LEADERSHIP
Managers
  • Forward thinking and forward looking educationally focused
  • Committed and have drive and resilience
  • Enthusiastic and positive
  • Modelling and leading by example
  • Unqualified support and encouragement
  • Actively seeking funding
  • Allocating time
  • Lack of management commitment to the future
Champions at senior level
  • A senior advocate to drive the process and enable the innovation process

General comments about barriers and enablers

Enablers

RIPPLES is a model for implementation readiness. The open questions identified a suite of general factors that were associated with the background practices of organisations rather than specifically related to e-learning facilitation. These factors related to the culture of an organisation and were deemed an enabling pre-requisite for successful implementation.

These factors include:

  • a willingness to embrace innovation
  • open to risk taking but acknowledging that innovations sometimes fail
  • provision of rewards and incentives for innovative practice
  • valuing, committing to, encouraging and supporting innovation in the workplace
  • a commitment to expanding e-learning capability.

Indicators of these factors in action include:

  • appropriate vision, planning and resources to implement
  • an e-learning and/or innovation champion at a senior management level
  • evidence of active commitment to innovation beyond vision and planning by all levels of management.

Barriers

Conversely, a number of cultural factors were identified as being organisational barriers.

  • an organisation that is risk averse and blame prone
  • lack of organisational vision and commitment for innovation and/or e-learning by senior management
  • no strategic vision for e-learning and how it would function
  • lack of support beyond the immediate local context
  • little sense of connection to the organisation’s purpose and the role in contributing to that purpose.

The barriers can be summed up by this quote from a respondent:

The gap between the rhetoric and the grassroots reality. What is articulated and what is practiced in active support are worlds apart in my experience. There is rarely any discussion about what innovation is, emerging trends (like Web 2.0) and how to capitalise on that. Innovators are not understood, so we lose them at a fast rate — you can’t have innovation without innovators.

A failure to understand that it is not about the technology but about the capacity to inspire curiosity and a learning culture in the workplace.

Summary

The RIPPLES survey provides a comprehensive analysis of the barriers and enablers to the use of innovative e-learning practice in VET delivery. The survey highlights a complex mix of a number of interrelated factors influencing e-learning innovation implementation suggesting both personal and organisational factors are required to move an innovative practice forward.

The next section will combine this data with that from other sources to identify key themes and highlight key findings.

Section 8: Feedback to the Australian Flexible Learning Framework

Contributors interviewed for this research included participants in current and past New Practices in Flexible Learning projects, intermediaries like e-learning coordinators, institute managers, Framework Coordinators, LearnScope managers, and innovative e-learning adopters who had direct or indirect links with a New Practices in Flexible Learning project. As part of the interview process participants were given Figure 12 and asked to respond to the following question:

Given your experience, what could these stakeholder groups do in the future to more effectively enable innovative practice in e-learning to be embedded?

Alternative text
Stakeholders in embedding a new practice

Figure 12: Stakeholders in embedding a new practice

What follows is a synthesis of the responses of approximately 27 people.

The funding body

A significant professional development opportunity

There was unequivocal acknowledgement that participation in a New Practices in Flexible Learning project opportunity had contributed to personal growth and learning and provided a significant opportunity to explore e-learning innovations. However, there was a mixed view about the adequacy of the sponsoring organisation to enable transfer of those benefits beyond the local experience.

Have a consolidation year in 2007: In the final year of the current Framework strategy (2005-2007), have dual focuses on new practice development and new practice implementation.

  • New practices need continued exploration, but they also need support to be implemented as implementation was the first stage in an embedding process.
  • Develop a program to support innovation teams, early adopters, Framework Coordinators, champions and decision makers responsible for embedding an innovative practice which builds the knowledge and skills necessary to lead or influence an embedding process.
  • Fund innovative practices that have demonstrated progress towards embedding regardless of their source.

Clarify purpose: Clearly define what a New Practices in Flexible Learning Project is really about — research and development of emerging technology, new pedagogies, or an organisational change process. Clearly define embedding expectations — is it local, across disciplines, or a broader national focus. Currently the New Practices in Flexible Learning Project is a product development model rather than a social influencing model which is what is required for embedding. Once the focus is on implementation the model needs to change to support that process.

Clarify the contribution of the New Practices in Flexible Learning Project to innovative e-learning development: Innovative practice in e-learning is already part of the fabric of VET and many initiatives are occurring outside the ‘formal’ New Practices in Flexible Learning projects. New practices are not necessarily the biggest movers of e-learning innovations in VET. There needs to be greater clarity about its unique role and contribution. What is its niche?

Consider the nature of the innovation: If the aim for a new practice is to be embedded, consideration must be given to its ‘embed-ability’ from the outset, which could include:

  • a commitment to delivery integrated into the project requirements
  • the new practice being generic enough for wide appeal and application.

Expand to a three year cycle: It is unrealistic to have any substantial embedding with the current funding and project management model. A longer timeframe is needed for the maturation process that leads to embedding. To date, the emphasis has been on the front end (development) but the back end (implementation) needs equal attention and this must be done up front as part of the funding methodology. A planning process that explicitly gives attention to both ends at once is an important factor.

Rethink a ‘project’ framework: It encourages short-term investment and application. The ‘one off-ness’ encourages a start-stop mentality with finite beginnings and endings and no accountability for sustained use.

Leverage new practices that are already demonstrating viability: There are many new practices that already have implementation success. Fund those that have demonstrated a user interest. These could include trials that are occurring within different RTO sectors.

Establish closer links with research bodies: Greater alliances with research bodies from other sectors disciplines and countries. This creates awareness of the latest research and emerging trends/issues questions, so there is more coherence about the most effective targeting. Analyse trends and practices of early adopters and champions to be better informed about what will work in a VET context. Otherwise there could be danger of funding the un-embeddable.

Pay more attention to organisational development: Many Framework initiatives have been personally beneficial, but there needs to be more attention paid to building the systems and organisational capability to embrace the changes. There needs to be parallel development of new practices and organisations.

Balance themes and priorities: Have a balance between targeting projects and open-ended projects to allow for diversity of opportunity.

Encourage consortiums: Partnerships provide fresh perspectives, new challenges and sharing of diverse knowledge and skills which in itself can be an embedding strategy. However, this should not be a selection requirement. Forced partnerships are not always the most productive, and some innovators with great ideas may not always have suitable connections.

Link formally to LearnScope: It is an established structure that can facilitate the embedding of investments in innovation. If New Practices in Flexible Learning represent the trends for e-learning, then it makes sense to encourage RTOs to engage with these trends. New Practices in Flexible Learning could also identify some of the new practices emerging from LearnScope and then scope a New Practices in Flexible Learning project to embed in particular industry areas.

Encourage fresh blood: There is a perception that New Practices in Flexible Learning is a fairly closed community. Several groups have received repeated funding, so consider an application limit or for repeat applicants to provide evidence of successful embedding of previous project as a pre-requisite to further funding.

Have a maintenance plan: Several potentially embeddable New Practices in Flexible Learning projects are sound, but are not being embedded because the content is redundant. A good example of this is the game-based learning for AQTF professional development. As there is often a lag time between the release of a new practice and readiness to use it, a maintenance plan is important to keep the new practice viable and encourage embedding.

The New Practices in Flexible Learning National Management Team

Level of support: It is outstanding. What is appreciated is the time to talk through projects and the suggestions for scaling back proposals so they become more manageable.

New practice identity: The source of a new practice is only important to people involved in seeking the funding. Invest in embedding the practice not in marketing the project.

Reporting process: Redirect the energy required for reporting into developing an embedding strategy. Developing guidelines and a delivery system for using a new practice would be more productive and could become a form of reporting in itself.

Be more flexible in reporting requirements: At times it seems that the reporting requirements and project management are more of a focus than the project itself. It is difficult to define and commit to deliverables at the beginning of a project as New Practices in Flexible Learning is about discovery. Deliverables can only be best guesses and mostly change. This needs a rethink.

Match reporting requirements to the nature of the innovation: The current reporting framework is designed for managing product development. Many new practices are about processes, so the current management model is not a good fit for all projects. 1 AQTF — Australian Quality Training Framework <http://www.dest.gov.au/sectors/training_skills/policy_issues_reviews/key_issues/nts/aqtf/what.htm>

Set up an innovation network: So that project teams, adopters and other stakeholders can talk to each other, access resources, share expertise and experience with the common purpose of developing a strategy to influence the uptake of the new practices. It provides a forum for expert input that can continue beyond the life of the ‘project’. Aim for sustainability of support systems. In 2007, set up an innovation network or more actively contribute to existing networks.

Balance the emphasis on development and diffusion: Currently the embedding component is an add-on and not well thought through. A dissemination workshop is not enough as all it can do is raise awareness. Think about more comprehensive embedding strategies such as:

  • a project brief that includes an implementation strategy
  • showcases by local champions who can contextual use to local needs
  • an annual innovation conference
  • regular publications on case studies and updates in a range of forums
  • implementation guidelines and presentation pack developed as part of the project so change agents have something practical to work with once the project is released.

Take a business approach to New Practice in Flexible Learning development: There are different variations of a business model. All three 2006 projects have a business approach to the New Practices in Flexible Learning Project, but with a different emphasis.

  • GippsTAFE is a business model focused on delivery, especially on tools and strategies for online communication. They use a consortium approach. The team is based within the Innovation and Organisational Development Unit.
  • Holmesglen is a business model focused on product development and using a project management model to service external contracts (on time, on budget etc). Development is primarily done in-house as a project. The team is based within the Training and Development Unit.
  • AMES is an adult and community learning model based on embedding better ways of providing access and skills for learners. They have a consortium and the project manager is within the Research and Learning Innovation Unit.

Consolidate the projects on the Framework website: The projects currently have minimal presence as they are archived under ‘projects’ in their year of funding or are part of the Resource Centre and are difficult to find.

Presentation of the outcomes: Dissemination must be more than a CD-ROM as this is a means to an end and not an end in itself. A CD-ROM is a dead product as it can’t be changed. Consider a dynamic website or wiki that people can access and contribute to and which can be maintained. The New Practices in Flexible Learning Project must model what it is espousing. The dissemination model needs to change if embedding is a priority.

Have a maintenance plan: Many New Practices in Flexible Learning Projects are now redundant because there is no maintenance plan. A good example is the e-games for AQTF professional development.

Support successful projects: Successful projects can be set up to fail if they are not funded to share their outcomes or to meet the demands of the interest shown. If an embedding dimension is added to project requirements then a process to enable this must also be considered.

Half way usability testing: Test out the new practice products in different contexts to ascertain viability before they are complete. It is important to find out what works and what needs changing before the project is complete. This could be treated like an applied research process which informs the next step — go or no go.

Tracking: Currently, there is no way of knowing who has picked up the New Practices in Flexible Learning, so the degree of embedding is unknown. Some tracking mechanism may help this.

Develop a comprehensive embedding strategy

If the responsibility of a New Practices in Flexible Learning Project team is to embed a new practice beyond the local context, requires a consultancy model, as there is no funding beyond the initial project.

So change the requirements of participation in a New Practices in Flexible Learning Project to fund parallel phases:

  • require successful applicants to commit to utilising the innovation themselves (in their context) as part of the contract
  • develop an implementation program with some flow-on funding to cover their external promotion role (so they can build a market as fee-for-service consultants in this area)
  • in a three year cycle, evaluate/monitor the uptake and impact (results), not the products or the processes
  • link to other framework strategies and embed it within those strategies
  • RTOs are used to getting things for free so may be unwilling to pay for a fee-for-service activity
  • consider local champions so there is profile and presence.

The organisation participating in New Practices in Flexible Learning Projects

The funded organisation must drive a new practice as a business case

  • Having a clear vision of where the new practice will take you and how it will live beyond the project is essential.
  • The driver for considering a new practice must be the organisation and its business goals. Always think about the business case and the connection with clients/industry/students.
  • You need to ask: ‘Where does this new practices opportunity fit into our business plan and how can we shape it to meet our needs’?
  • Focus on the point of delivery and ask: ‘How can this new practice change teaching practice?’

Recognise the different types of ‘innovation’ roles: Adventurers, explorers, translators, brokers, experimenters, doers. A diverse team is needed to embed a new practice.

Ensure enabling systems are in place: Take an organisational development perspective. With any innovation, it is the system sitting behind it that will enable it to be embedded. A new practice, no matter how big or how small is an organisational issue. Embedding an innovation is an active process that must be prepared for and supported.

Management support is critical: Senior management needs to be committed. Senior champions and middle level operational managers need to be excited and actively involved.

Assess the educational value of a new practice: This needs an educational analysis of what the technology can do and where it fits in the design of an educational program. Move from a focus on technology tools to implementation models.

Build new practice leadership: Those who have an eye on what is happening, can see the benefits for their organisation, bring it back and ground it. Consider a local identity like a New Practices in Flexible Learning Champion.

Take an interest in research: It can really give you the edge!

The New Practices in Flexible Learning Project Teams

1. The new practice

Ask key questions about the value of adopting a new practice

  • What would this new practice allow us to do or to do better than we couldn’t do before?
  • Will this be better for our learners?
  • How will it fit into a larger delivery system?
  • Is that system prepared to change its work practices to accommodate the innovation?
  • Can we keep it going after the funding stops?
  • Is this worth investing our time and money in?

In other words, how significant is it educationally and/or organisationally?

A new practice is not about the technology: The technology itself can be simple to learn. Embedding is about professional development and organisational commitment. If momentum can’t be sustained until there is a critical mass, the new practice will stop. It requires a longer term plan that is supported.

A new practice may be a better practice with new technology The practice is not necessarily ‘new’. The pedagogy is often already good, but is limited by an older technology. The new practice is to integrate a new technology to enable the delivery of good practice to be cheaper, automated and/or portable (online casting is a good example of this). The most important consideration is that as a result, the teaching and learning is ‘better’. For example, with online voice technologies, learners have better access to spoken texts, lectures, and models.

2. The Innovation Team process

Work in consortiums: This enables cross fertilisation, fresh perspectives, learning conversations and sharing of expertise beyond a local context. A consortium is an embedding enabler.

Be aware of the different drivers for investment in a new practice: For the innovation team it is the excitement of exploration and discovery. For the adopting practitioner, they are ‘up to their ears’ in the AQTF, compliance and daily work processes. Consider how a new practice will fit into their world.

New Practices in Flexible Learning is one of many funding sources A new practice is not an event or even a project, but an opportunity to improve the business. The funding is a culmination point — a time of readiness where everything comes together and the New Practices in Flexible Learning funding helps to accelerate the opportunity. A new practice is more likely to succeed if the New Practices in Flexible Learning Project is not the sole funding source, as the investment from other sources is a sign of long-term commitment which needs to be identified by other projects and incorporated into their plan or a completely new concept around what New Practices in Flexible Learning is about. Tap into a number of funding sources as part of a wider business plan and continue to do so.

Collectively and cumulatively this could include:

  • Framework; repeat funding from New Practices in Flexible Learning, Toolboxes, LearnScope, Industry Engagement
  • Reframing the Future
  • state/territory funding
  • institute funding
  • commercial activities.

The intermediaries

Works in pairs or groups: Never have one person responsible for embedding as perceptions can be different and the task too hard.

Link more closely to other Framework roles: Framework Coordinators, LearnScope managers, Toolbox Champions and engage them more strategically in the embedding process. Embedding is the common focus for everyone.

Think more creatively about how to embed Start with user interest rather than the new practice. For example, a LearnScope Start Up is made up of a group of total strangers with a shared interest that has bought them together. They register their interest and in an organic way they decide what to focus on. They organise themselves and it all falls out. They are across disciplines and have different work roles and even from different organisations. At the right point, they see a need and it fires them.

Recognise the importance of the bridging role: Identify and support the ‘Captains of the Starship’ — who see the potential of a new practice and how it can fit into an educational framework. This can turn a research and development opportunity into a business proposition.

Demand implementation guidelines: Guidelines for how to introduce the new practice in a local context and how to support its growth. A brokerage role may be useful to filter information and opportunities to suit the readiness and interest of different groups.

The innovators

Be mindful of the purpose: There is a perception that some Web 2.0 innovators are operating at a professional development level. They have active networks but there is little evidence of their efforts ‘dribbling down’ to influence intentional learning. Align with early adopters who can translate new practices into educational benefits at the local level.

The Adopters

What matters at the coalface is relevancy: The key questions that adopters should always be asked about a new technology are:

  • Does it meet business requirements and do we want it?
  • Gee whiz technology — is it useful to the real teacher in the real world?
  • Is it relevant and how will it make a difference to our learners?

Organisational technology infrastructure: Is the technology infrastructure robust enough to enable the utilisation of a new practice in the context of use?

Things to consider include:

  • student literacy skills
  • computer access for students
  • clarify who is responsible for resourcing ICT upgrade requirements,if there is doubt then often nothing gets resolved and the problem persists.

Consider the attributes of the new practice Is it a manageable chunk that can be learned quickly, that you can see the relevance for, have some control over and can apply readily?

Summary

The insights, experience and expertise of participants in New Practices in Flexible Learning projects and the intermediaries who are charged with promoting, championing, supporting and implementing those new practices, reinforce the main themes emerging from this research. Embedding new practices in e-learning is a dynamic, multidimensional, complex interconnected process that is the responsibility of a range of stakeholders who may have direct or indirect influence on the process and the outcomes. It reinforces the idea of a complex adaptive system dancing between the edge of chaos and the edge of stability as outlined in Section 5.

Section 9: Key findings

To be honest with you, most people are too busy. Increasingly, a teacher’s life is fuller and fuller of expectations that haven’t often got a lot to do with teaching. More and more, it takes away your capacity to deal with industry and with relationships outside. The compliance issues and issues of administration have just become so complex and so demanding, a lot of people are just saying ‘I am struggling to do my job’, much less, let’s be honest, doing what we are talking about. It takes time and effort above and beyond what you are doing, and unless you have got people who are determined and understand that and who are committed you have to say ‘What are they committed to? TAFE campus manager

This section draws on the broad pool of knowledge collected during this research, including results of the RIPPLES survey, the three case studies, interviews with New Practices in Flexible Learning project teams, the activities in the research wiki, the guidance of research advisors and critical friends and conversations emerging from presentations in a range of forums as well as the literature review.

The underlying tenor of the general research findings is not about resistance to or disinterest in e-learning innovations. In fact, there are healthy signs of progress towards embedding innovative e-learning and a willingess to move forward. For example, in the survey, 86% of respondents considered they were much more or somewhat more innovative than average, and 44.7% believed they were delivering innovative e-learning practices and techniques to a very high or high extent. While 53.1% believed their organisation was extremely or somewhat innovative, as a whole they believed that their organisation was using only 25.7% of e-learning innovations to a high or very high extent. The high percentage of self-rated innovativeness in this sample where respondents perceived themselves to be more innovative than the organisation they worked in and using higher level innovative practices than their organisation as a whole, suggests that this survey has attracted responses from innovators and early adopters.

This is not an unreasonable assumption, since the distribution of the survey was primarily through Framework networks so it would have reached those who had participated in e-learning professional development or research initiatives. If that assumption can be made, then the research findings represent the story of what has enabled or created barriers for this sample of VET practitioners, managers and support professionals as they move to the task of embedding e-learning in their local contexts and everyday practices.

If this is primarily the story of innovators and early adopters, then the challenge is how to utilise what has emerged from this research and shape it to reach the ‘other 85%’ that Geoghegan (1995) so aptly recognises. These mainstream adopters are the critical mass who must be targeted and convinced if there is to be significant movement along the adoption, diffusion, implementation and embedding route.

What can we learn from the experiences and insights of the contributors to this research so the Framework and other stakeholders can be informed about the appropriate paths to take to support the embedding process? The story starts with logistics.

It’s time and priorities

Key finding 1: Available time and competing priorities are limiting factors for engaging with e-learning innovations

Increasingly the VET working environment is becoming a crowded landscape with competing priorities and individuals are deciding whether e-learning is one of those priorities. The criteria for making a decision includes a mix of several interrelated factors: a work culture that embraces and supports innovation; a robust technology infrastructure; technology tools that are appropriate for teaching and learning purposes; a senior champion to drive the process; a willingness to consult and share; and supportive managers, peers and support professionals. This cluster of enablers that includes individual and organisational commitment provides a signal that e learning is a desired and valued component of a teaching and learning repertoire and worth the time and effort.

The beginning quote for this Section is from an interview with a TAFE campus manager about the challenges of embedding e-learning innovations and sums up the reality of the working life for many VET practitioners. A significant barrier to engaging with anything new is time. Of the 229 responses to the question on barriers, time was mentioned 110 times. It is a clear message. Increasingly the work environment is becoming a crowded landscape with many agendas and priorities competing for that time. This reality was consistently recognised by managers and practitioners alike, as this manager of a regional campus observed:

I think that busyness is just incredible across the Institute at the moment where nobody has the time to do much other than what they perceive as core business.

To introduce something new is a time based process. It is a long haul commitment and individuals make choices and decisions about prioritising their time, including whether e-learning innovation is a worthwhile investment. For some it is, for some it is not and others need a tipping point to be convinced either way. While some invest their own time, others want it provided as part of their working day.

Many practitioners who contributed to this research and who were identified by their peers as innovators articulated their willingness to invest both the time and effort because e-learning innovations motivated them.

Definitely, play time. It takes time to come up with, and try out, new ideas. What many people don't realise is that innovators make just as many, possibly more, mistakes as anyone else. We just try things out a *lot* more, we experiment, we tweak, we fix, and some things we simply discard. We may be guided by technical expertise or clarity of vision, but often we simply compact a *lot* of experimentation into a short amount of time to maintain our edge in the field. Other times, we need time to just think — to draw sketches of ideas, to muse, to bounce ideas off colleagues, peers and mentors, or to sort things out in our head.

It was the excitement of the chase that often sustained them.

A lot of the time we progress, fuelled by half a sandwich and a big idea and not much more.

They are propelled along if the conditions are right.

I thrive in my workplace because of supportive managers, who allow me to be relatively self-directed in my investigation and application of new ideas. They see the value in letting me pursue the avenues I feel have the most potential for enhancing teaching and learning in my institute and elsewhere. I also have a very understanding work team who are themselves exceptionally talented, and don't laugh at me too much when I get into a creative mood and come up with all sorts of new ideas for doing things better (well, "differently"); sometimes they even agree with some of them!!! :)

Some struggle if the conditions are not.

The greatest problems I face are from short-sighted dogmatic, bureaucratic technical or financial managers, who can only see the little impediments, and not the big possibilities. They talk about security and money, and not about teaching and learning; they understand a business case for systems that support accounting or managing of staff, but not for systems that can give our students freedom, opportunity, and new horizons. They often don't understand education, but somehow manage an educational institution.

Most are aware of the reality of what enables an innovation.

It is fine to come up with an innovation but if the overall corporate view is to not support its implementation then the opportunity is lost and a division is created between those who may have tried it and those who did not get the chance.

There is recognition of the critical role of an internal champion.

I think we have all had to overcome some amazing barriers to innovation in order to take steps forward and we will continue to do so — I had a very supportive director who left and the acting person was the opposite; I never realised quite how many barriers a single person could throw up in such a short space of time!

The message is clearly articulated about the reality of the crowded landscape.

...all the time you're competing with people who are trying to just stay afloat, and manage the everyday burdens that swamp them constantly. You're competing with a whole range of other things that need to be done. Unless innovation is seen as a basic and primary objective for an organisation that needs to be relevant .. there's no time for this 'extra' luxury.

Other contributors to this research, though not averse to effort or to innovative e-learning, had different criteria for making a decision. These criteria are reflected in the survey analysis which indicated that the extent to which e-learning courses use innovative practices is the result of a number of interrelated factors including the technology infrastructure, communication, shared decision making, policies, evaluation, organisational and personal support, personal innovativeness and organisational innovativeness.

This was also reflected in the responses to the open-ended survey questions. In other words, criteria for engagement include: a work culture that embraces and supports innovation and demonstrates that commitment by providing time to engage and learn; a robust technology infrastructure; technology tools that are appropriate for teaching and learning purposes, a senior champion to drive the process; a willingness to consult and share and supportive managers, peers and support professionals. This cluster of enablers that includes individual and organisational commitment provides a signal that e-learning is a desired and valued component of a teaching and learning repertoire.

These findings have mirrored what other researchers have found in other countries and in other education and training sectors and were highlighted in the literature review. While the reflection is not quite the same, it is not much different either. Embedding innovative practice in e-learning is perceived by contributors as a holistic process comprising a rich and complex mix of several interrelated factors, and a decision to engage is influenced by time and whether e-learning was perceived as a priority by the organisation.

It’s learning not technology

Key finding 2: There is a shift away from the ‘e’ and back to ‘learning’.

Enablers of innovative e-learning practice emphasised a move away from technology tools to a need to better understand e-learning pedagogy, client perspectives and for demonstration of good working models in local contexts. E-learning innovations tend to complement existing teaching practices indicating embedding efforts to date have been incremental. This signals a need to be clear about what we are trying to embed — new technologies (‘e’) or new pedagogies (‘learning’). They may not be one and the same.

The survey results revealed that for this sample, the most enabling component is Learning, and the biggest barrier is Infrastructure. This gets to the heart-of-the-matter of issues currently being debated both in the literature and more informally in the conversations across the practitioner networks within VET, namely

... the issue of the hype of technology and e-learning, ie the over expectation of what is possible with technology, rather than what actually is achievable and worthwhile with technology (Price et al., 2005, p. 65).

It is not surprising that the RIPPLES component of Learning is identified as the major enabler as this is VET’s core business. As a component of the RIPPLES model, Learning is described in the survey as ‘...the learning outcomes of a training or educational program. This also refers to a focus on the learner's overall experience within a training or educational program’. Responses to the open-ended questions about enablers of learning focused around an emphasis on pedagogy, client perspectives and demonstration of good working models for integrating technology into learning delivery. This highlights that pedagogy is replacing the focus on technology.

Barriers such as lack of understanding of e-learning pedagogy, the benefits of innovative practices and the difficulties of letting go of old practices suggest that the role of the ‘e’ is being reviewed. The following posting in a Framework wiki is a sample of the current perspectives being offered:

It is extremely important that when moving into a flexible delivery mode that involves e-learning that the basic principles of good teaching and learning are kept at the forefront. I know we often get caught up with what the technology can do but lose sight of what would be best for learners.

I know I am talking to the converted but I believe that until we remove the ‘e’ and just focus on learning, irrespective of whatever method we use, we will not have reached a stage where 'e' is a part of all learning.

(LC. wiki post, November, 2006)

Considering whether the ‘e’ is still required or is becoming a distractor signals a change in thinking by VET practitioners about the role and status of the ‘e’ in learning. The question that may need to be asked is what new practice are we aiming to embed — new technologies (e), or new pedagogies (learning)? It is an important question as new technologies do not necessarily mean new practices.

Currently, technologies are often used where they support existing teaching practice, rather than creating experiences or activities that change the practice itself and create new ways of teaching and learning (Price et al., 2005, p. 65).

This stance is supported by Collis and Moonen’s (2001) ‘18 lessons’ derived from their experiences with ICT over a number of years. ‘Lesson 5 After the core, choose more’ emphasises that a core technology — the dominant teaching method — requires ‘pervasive contextual pressure’ to change and therefore technology usually complements that core. In other words, the dominant practice remains. If this is the case, then the nature of the innovation rather than the technology becomes the focal point. What innovation are we seeking? Is it improvement to existing practices (incremental innovation), is it the transformation of those practices (radical innovation), or is it both? Indications from this research suggest that the major efforts to date have been on improvements to existing practice — incremental innovation.

An executive manager commented that with all the attention on e-learning and innovation, it was important not to lose sight of the most critical embedding issue.

It’s not the new practice we want to embed, it’s the results we want to embed. We must not forget it has to serve the needs of the students to be effective.

In other words, while new practices are about processes, the outcome is what is important — results.

It’s a readiness chasm

Key finding 3: There is an organisational readiness chasm

Innovative practitioners are outpacing the readiness of organisational systems and services to provide the infrastructure required to support those practices. While individuals have benefited from professional development opportunities, what has fallen short and is now becoming evident is the lack of equal and parallel attention to stakeholders, like educational and IT managers, whose ‘buy in’ is required to support implementation. The results of this research indicate that embedding an innovative practice requires the right innovation, innovative practitioners, innovative managers, innovation business systems, innovative workplaces and a commitment to a common vision for e-learning. It requires strategic alignment and interconnectedness between all the seven components identified in the RIPPLES model. If one component is out of alignment it creates barriers to progress suggesting interdependence between those components akin to the concept of a complex adaptive system. Consequently, the focus on embedding — the use of an innovation by the critical mass as a routine practice — may be ambitious and premature until the systems are more fully aligned.

While the role of ‘e’ is being challenged, what was challenging for many respondents were technology Infrastructure barriers. With the advent of Web 2.0 the e-learning landscape is changing and many tools now invite, facilitate and even demand a change in practice. But practitioners indicate significant barriers to the use of and access to these tools.

While 51.7% of respondents identified technology infrastructure as a barrier, 20.1% percent were neutral and 28.2% considered it an enabler. Enablers identified in the open-ended responses included a robust baseline infrastructure, state-of-the-art equipment in training rooms and classrooms, access to software and networks, and competent, interested and friendly technical support professionals. For example, one enabler was described as:

The kindness and enthusiasm of individual teachers and technicians. In TAFE, if you keep trying to get something new going, someone, somewhere will help you if you are persistent.

Barriers focused more on access issues, lack of consultation in decision making and a conservative approach by IT managers. Red tape and blocking access without consultation with teachers were significant barriers as reflected by this respondent:

Security rules every decision.

This is a significant barrier as 98.7% of respondents believed an appropriate technology infrastructure was important to successful use on an e-learning innovation.

This appears to be a common issue in other countries and sectors, as other studies have highlighted technology infrastructure as a major barrier to the progress of e learning innovations (Burkman 1987; Ely 1999; Surry and Ely 2001; Farquhar and Surry 2001; Grunwald 2002; Seufert and Euler 2003; Elgort 2005; White 2006).

As highlighted in the literature review in Section 4, several chasms have been identified that create barriers to the progress of e-learning implementation. Moore (1999) identified a chasm between early and mainstream adopters. Geoghegan (1994) identified a chasm between the support structures required for early and mainstream adopters which he labelled as ‘the other 85%’. Elgort (2005) identified a chasm between innovative technology and innovative teaching practice.

This research proposes another chasm — a readiness chasm.

Alternative text
The readiness chasm Figure 13: The readiness chasm

It suggests that innovative practitioners are outpacing the readiness of organisational systems and services to provide the infrastructure required to support those practices. The investment by the Framework and other initiatives over several years has made a significant contribution to capability development of practitioners and this is widely recognised.

Everything that I now use in practice I have learned in the past 4–5 years of LearnScope/Reframing the Future funding.

Participants in New Practices in Flexible Learning projects particularly highlight the personal benefits of this opportunity.

It is an outstanding opportunity that no-one else gives you. You learn a lot from it and that’s what New Practices is all about.

However, while individuals have benefited from this investment, barriers around issues of infrastructure, resources and the other five components of the RIPPLES model, indicate a lack of parallel attention to organisational development. This has been a barrier to the embedding process, a perspective reinforced by a senior organisational development manager with e-learning implementation responsibilities.

Names on the labels [of different models] don’t matter. The point is that a model assumes/asserts that you have to get all the areas more or less in alignment to get sustainable change and innovation. I’m convinced the unit of sustainable/embedded change is the training organisation, not the practitioner. At the moment it is too PD-and-technology driven, as if innovation is a variation of self-development of educators.

In other words, innovative e-learning initiatives have been managed more as a professional development activity rather than as an organisational development strategy. This is reflected in the interviews with VET managers and practitioners with responsibilities for e-learning innovation. While the baseline infrastructure was sound and catered well for established practices, the capacity and readiness to respond to innovative practices was where the challenge lay. For example, a senior manager commented that:

It [the technology infrastructure] has never been better I’d say. For us we take for granted the fantastic ICT service and infrastructure that we have got.

However, this same manager acknowledged that innovative practice challenged the system.

[Innovator] will no doubt tell you the experiences he has had in the last couple of years of fighting our bureaucracy and our approach to security in some of his online activities like the use of the chat room. He was shut out of that considerably in the early stages of the evolution into our ICT work. I think he still has got some limitations on that.

For the practitioner working with a new practice, this can be a frustrating and unrewarding experience.

You can’t get a voice board, you can’t hear it, or you can hear it, but you can’t record on it or you can’t see this because it is too big. Or you can’t get students to send you stuff because it is in a file that won’t get through the walls.

The impact on ‘the other 85%’ is obvious.

There are departments in our institute who need specialised software for their students to use and the IT department will not support it. They are not allowed to be installed and if someone brings it in and something happens, they will not do anything about it. ... and [the teachers] think ‘Bugger it, it is too hard.’ You can only push people so far.

These scenarios are not unfamiliar. As one set of issues gets resolved another set surfaces. Some practitioners used New Practices in Flexible Learning projects as a leverage to force change.

... you told people that we either did it or gave the money back! I mean really, it was really that much cut and dried.

Many practitioners are caught in bureaucratic red tape resulting in.

Corporate lockdowns that make it a hassle for anyone to try anything new on their workplace computers.

There is little doubt that to unlock this ‘lockdown’ warrants greater clarity and communication between different stakeholders about the role and benefits of innovative e-learning and how it contributes to an organisation’s mandate.

While the new practices now testing the system have been fostered at a practitioner level, what has fallen short and is now evident, is the lack of equal and parallel attention to stakeholders whose ‘buy in’ is required to support the implementation of those practices. These include executive and operational managers and professional support services staff. As a senior manager responsible for such efforts noted:

As far as change is concerned, one excited manager is better than a gaggle of excited practitioners.

One executive manager expanded on the importance of explicitly targeting decision makers if real progress was to be made.

Snapshot from the field Executive manager Teaching and learning portfolio There has been a high level of good solid professional development for practitioners in recent years, and this has been really effective in supporting their capacity to innovate. There is almost an equal need for decision makers to be professionally developed so that they have the knowledge and understanding to support and guide innovation within their organisations. This applies, I suppose, to reluctant bureaucrats such as myself who need to ensure that innovation is corporately and philosophically aligned, and also to the IT managers and similar within organisations, who are faced with the responsibility of ensuring the integrity and security of systems and data, and have not been well-supported in terms of exploring how innovation can sit comfortably with those demands. From that perspective maybe it’s time for us to move away from focusing on more new practices, and instead to move our attention to the art of embedding — to stabilise before we diversify further.

The survey results revealed significant differences between executive managers and other respondents in 10 key areas. Nineteen executive managers responded to the survey, and had a significantly more positive view about the degree in which opinions were considered, decisions were shared, their organisation had an enabling culture, their policies were enabling, commitment to a high quality e-learning experience and learning outcomes, the quality and quantity of evaluations, and the quality of pedagogical support. However, the executive managers also believed the resources for e-learning were allocated less appropriately than did other respondents. This profile was put to an executive manager who was invited to offer a response. What follows it that response.

Snapshot from the field Executive manager Teaching and learning portfolio You asked me how I responded to the significant differences between executive managers and other respondents in 10 key areas. My response was to cringe — to cringe because I know it’s probably true. Executive managers, indeed leaders of any kind, run a real risk of becoming isolated from the real action in their organisations, or of seeing what's going on from their own sometimes rose-coloured perspectives, or of being fed what they want to hear — a filtered version of reality which won't place them in any discomfort. For me the data confirmed that I have to consciously work against this, particularly if my vision is for my organisation to become and remain an innovative, responsive, agile business. So to ensure I don't become isolated from the real world of innovation and practice I have to be out in that real world talking to people, interacting and seeking to understand. This will also ‘untint’ my rose-colored glasses, as will my sense of integrity and accountability for the people I lead and the outcomes we achieve. And I suppose I can avoid being fed filtered information by building real relationships with my people based on mutual trust and respect. All stuff I should be doing as a leader anyway!

This frank response, while the voice of one executive manager reinforces what other stakeholders are saying — that in order to support the embedding of e-learning innovations senior decision makers may need a more realistic picture about the challenges faced by practitioners at the coalface.

The results of this research clearly indicate that embedding an innovative e-learning practice requires more than a focus on the practice and the practitioners. Practitioners themselves acknowledged that it took more than their enthusiasm and effort to make a difference and indicated that point of difference was often management support.

If it is not important to my manager, it is not important to my organisation, so it is not important to me.

Some veteran Framework participants had a hard-line view based on many years experience with the outcomes of professional development initiatives.

Most of the projects are initiated by the practitioner. If it all falls over, they are doing what they are doing anyway. ‘Right oh! That’s the end of the project, let’s get back to the classroom.’

As one observed:

You can’t fit new practices into an old environment.

But there was also recognition of another reality:

Managers — how they influence is how they get support themselves.

It has been a challenge to represent the diverse range of responses emerging from contributors to this research. Needless to say, it is a complex and multidimensional picture. Embedding innovative practice requires innovative practitioners, the right innovation, innovative managers, innovative business systems, innovative workplaces and a commitment to a common vision. It requires strategic alignment of all the components identified in the RIPPLES model.

Strategic alignment means deliberately arranging all parts of an enterprise, including its IT function and investments in its IT capability, to be consistent with the enterprise's overall business purpose and priorities (mission, vision, measurable goals, strategies, etc.) as a whole (Interoperability Clearinghouse 2003) 2 <http://www.ichnet.org/glossary.htm> .

The GippsTAFE case study provides a good example of working towards this alignment.

Case Study 1: An organisation — getting down to business

The GippsTAFE case study identifies the factors that are creating an alignment in their context. The core is a clear vision — to be the best provider of flexible learning in Australia. The CEO articulates and drives the vision, an innovation manager at senior level champions the vision, a dedicated Innovation and Organisational Development Team grounds the vision, senior managers understand and support the vision and practitioners implement the vision. The results are evident. While there is not a perfect alignment there is progress as the innovation manager and champion reflects:

Your case study tells me that they [the survey contributors] understand the value of flexible learning. It also tells me that they feel there is a good return on investment. And most of all I feel that the biggest fight is over. They understand the vision, they understand what we are doing and they want to do more. The cultural attitude has changed, even if the cultural practice still needs work. (Feedback on case study, used with permission)

Snapshot from the field

A senior manager with e-learning responsibilities who was a critical reader of this research, made the point that the success factors identified in the GippsTAFE case study could be transferred to embedding other innovations. While there was no doubt that vision was a central driver, that vision may not always include e-learning as a central focus. In other words, this is a good model for embedding any type of innovation that was considered a priority for a VET organisation.

A synthesis of the enablers identified by the RIPPLES survey (See Appendix 2), reinforces the need for alignment and interconnectedness between all the seven components. If one component is out of alignment, it creates barriers to progress suggesting an interdependence akin to the concept of a complex adaptive system as highlighted in Section 5. While organisational readiness to implement innovative practice is a mixed picture, ranging along the continuum from awareness, adoption, diffusion, implementation and embedding, the level of readiness favours the early phases in the adoption process. Consequently, the focus on embedding — the use of an innovation by the critical mass as a routine practice — may be ambitious and premature until the systems are more fully aligned.

It may be timely to reinforce another perspective as to why this alignment is worthwhile and indeed an imperative. That perspective is context.

It’s context — the knowledge society

Key Finding 4: Purposeful use of technology is a core competency in a knowledge society

Productive functioning in the knowledge society requires a mix of individual and social competence and purposeful use of technology (Collis and Moonen, 2005). Social software are ‘core tools’ for participating and contributing in a knowledge society and are integral to expressing, sharing, collaborating, communicating and co-constructing. E-learning innovations that support the new competencies for lifelong learning and living, learning and working in a knowledge society need to be supported as legitimate and credible innovations.

Context is the circumstances or the environment in which something is placed. What is the role of innovative e-learning in the current VET context? While response to local, state/territory and national priorities are emphasised as key drivers for innovative e-learning, there is also a wider context to be considered — the knowledge era.

The knowledge era is gaining momentum as a focus of attention in VET. Recent research by Staron et al. (2006) on developing capability for working and learning in the knowledge era has started to influence how some TAFE institutes are re-conceptualising their organisational development strategies. For example, the proposed model of life-based learning which incorporates a strength-based approach to capability development is being used for innovation and organisational development planning at Sydney Institute, TAFE NSW.

Julie Collareda, Manager of Learning and Innovation explains this orientation.

Snapshot from the field

Sydney Institute, TAFE NSW
Julie Collareda, Manager, Learning and Innovation
During the last six months the Learning and Innovation team have been reviewing our professional development model. The review has highlighted that the current model is grounded in a deficit-based approach. This model does not meet the needs of the VET pr