THE ROYAL AUSTRALASIAN COLLEGE OF MEDICAL ADMINISTRATORS
REPORT OF THE 2007 SURVEY OF CONTINUING EDUCATION

In June 2007 the College conducted a survey of all RACMA Fellows and Members to seek feedback about aspects of the College's Continuing Education Program (CEP), This is a summary report on the findings of the Survey. The CEP Committee has considered the feedback and reported to Council on these findings. Council has been very pleased to receive the Survey report and supports the wide communication of these results to members of the College.

There was a very good response rate to the on-line survey and the College is thankful to all those who participated. There is no shortage of survey data now available and with more in-depth analysis of participation patterns, it will be used in strategic development of the professional development program. The process of evaluation will also reflect priorities within the College's Strategic Plan 2006-2009 and the Council's endorsement, through the 2007/2008 budget, for resources to develop the CEP program.

1. Survey Findings

177 responses were received from the approximately 450 Fellows and Members surveyed (i.e. a 40% response rate). Tables 1-4 provide a profile of those who participated in the survey.

85% of those who participated in the Survey said they were aware they had given a commitment to participate in CEP and 63% indicated they completed the requirements. 81% of respondents said they planned to participate in 2007/2008. Of those who said that they did not meet the RACMA participation requirements (69 responses) the reasons most commonly cited included:

• CEP was undertaken with a college other than RACMA
• CEP activities were not easily accessible in more remote locations
• uncertainty about how to participate in the RACMA program, and
• it was felt that RACMA CEP was no longer relevant to them because they were retired or worked in another medical field.

Those who indicated they did not plan to participate in CEP in 2007/2008 also identified the same range of reasons as above.

In relation to reporting and certification, 53% of members say they do not report their CEP for RACMA to RACMA. 52% of respondents believe reporting arrangements are adequate, while 46% believe reporting arrangements need improvement.

There were 110 responses to the invitation to comment on how the present system of reporting CEP might be improved. The comments and suggestions ranged from the provision of better access to activities including knowledge about activities, access to an on-line or electronic means for recording CEP, personal contact with CEP Coordinators and the College.

When participants were asked to comment on how best the College could assist to improve skills, competence and confidence as a medical manager, there were suggestions and comparisons with other colleges. Some observations include:

• There was an arrangement for shared membership with ACHSE. "I was a member of both RACMA and ACHSE but was told I would retain access to the ACHSE activities through RACMA so dropped that subscription - I stopped receiving notification of their activities not long after which was very disappointing".
• Another liked the journal from the ACPE
• Provision of electronic access to journals
• Development of a Medical Administrator's Toolkit
• Provision of annual online problem-based learning tasks (eg vignettes, followed by multiple choice questions, then text to explain the answers).

Consistent with these themes was the 73% positive response to the suggestion that the College be more active in the provision of CEP related activities i.e. conduct more CEP related activities. Participants suggested numerous activities and subjects such as leadership, credentialing, governance, refresher management courses, rural medical management, links with CPD of other colleges, how to survive during organisational change, revision/disempowerment of the Director of Medical Services role and status, educational sessions/forums related to significant inquiries (e.g. Bundaberg and Cairns), and lessons for medical managers from these.

The data in Table 7 and the comments that accompanied it, suggest that while the position RACMA takes in relation to level of prescription is satisfactory, some seek flexibility in choice of CEP activities and recognition of professional development undertaken with other colleges, RACMA could articulate its requirements more clearly (e.g. topics, hours, work experiences vis-à-vis additional experiences).

In relation to access to CEP activities, 43% respondents (see Table 8) reported inadequate access, and suggestions for improvement included electronic means of delivery.

The survey highlighted the level of conjoint membership (ie membership of more than one College) and the findings are supported by  other data from the annual subscription process. 65% (111) of respondents said they were fellows of other colleges where continuing professional development was also an expectation. (see Tables 9 -11).

Survey respondents identified membership of the following other colleges: ACHSE (largest group), RACP, RACGP, RANZCP, ACEM, AFPHM, ACEM, RCPA, ACRRM, RANCR, RACS, AICD,AIM, RANZCOG.

There were numerous responses to the question about experiences most useful for professional development. They included lecturing, ACHS surveys, RACMA CEP meetings, media training, LAMP, attendance at various conferences in Australia and overseas, including RACMA conferences, teaching, undertaking online CPD, delivering papers, board participation and leadership, peer reviews, university study, preceptorship, learning sets, study tours, AMC accreditation, coaching and mentoring; a number of people mentioned LAMP and the AICD courses. 156 respondents listed conferences they had attended over the last three years.

(Note: in some cases, survey returns were accompanied by emails requesting information about the certification process for activities undertaken. These emails have been collected and will be responded to by the CEP Program through its routine certification processes.)

In relation to performance management, 67% of respondents also said they participated in workplace performance reviews and views about the value of these were varied. 74% of respondents reported they have access to professional development through their workplace.

56% of respondents said remuneration for professional development participation was encouraged through their workplace agreement.

2. Themes Arising from the Survey

A thematic analysis of the key information and findings of the Survey demonstrate:

• There is reasonable level of awareness of the commitment to undertake CEP for RACMA
• Reinforcement that a significant group participates but do not report.
• A high level of conjoint fellowships among RACMA members, and this may be impacting on participation and reporting.
• A general desire to have simplicity in structure of documentation and
  certification, but resistance to any increase in prescription.
• The desire for an electronic system to simplify recording and reporting.
• Increased visibility of local CEP Coordinators
• Increased RACMA promotion and provision of CEP activities.
• Requirement for clarity of how overseas fellow and members meet their RACMA CEP requirements.

3.  Next Steps     
    
This is an overview summary, and further more detailed analysis will be undertaken once the new Secretariat staff member commences on 6 August 2007. Nonetheless, this overview provides a satisfactory and valuable source of feedback to be used in informing current CEP initiatives.

The survey responses also point to some policy review and practice actions. These include:

• Implementation of a CEP electronic recording environment (in discussion)
• Development of a procedures and structures (as appropriate) to recognise professional development undertaken in another college by conjoint Fellows/Members, and those members overseas.
• Reorganisation of the College web site to make information about CEP more accessible (commenced)
• Implementation of a process to communicate information about CEP activities recognised by RACMA and promoted through the web site.
• Delivery of RACMA courses and workshops, online training materials (for example, a RACMA-auspiced Media Awareness workshop has been developed and will run in Sydney and Melbourne later this year)

In relation to the survey tool itself, the findings in relation to the employment sector of Fellows and Members showed a large proportion of responses in the ‘Other' category. It is planned to revise the standard RACMA categories before further surveys. The new categories may include:

• Area Health Service/District Health Board
• Public Sector - community health/public health
• Retired
• General Practice
  Professional Association Management/Medical Education (eg Medical Board/College)
• Private Sector Health Management

Some of the existing categories, where only small responses were received, could be relocated to the "Other" category e.g. Tissue/Blood, Pharmaceutical, Finance.

It has also been agreed that a summary of the findings of the Survey will be sent to survey participants, a number of whom expressed interest in the results and the College's proposed follow up. A copy will also be placed on the CEP Section of the Website.

4. Conclusion

There is no doubt that RACMA Fellows and Members are actively engaged in a wide spectrum of continuing professional development activity, and are very keen to provide comments and feedback to the College.

The College is grateful to all those who have participated in this CEP Survey. A wealth of information has been provided that will be very useful as the College works to strengthen its CEP program and its support to members.

Dr Karen Owen
Chief Executive

Dr Kim Hill
National Director
Continuing Education/Recertification