Position details

Login and apply


Job titleLead Psychometrician
DepartmentTheory and Standards
Close date15/08/2022
LocationLondon & home based
Vacancy notes- Interview date: TBC
-Deadline for applications is 23:59pm on the closing date
- All contracts offered on a 6-month probation
- Please complete the application in full
- 35 hours per week, full time, Permanent

Job description

Job descriptionThe Theory & Standards team oversee standards in paediatric education and training by quality assuring our examinations and assessments. The psychometric sub-team undertakes standard setting and analysis for the exams and assessments, as well as carrying out and publishing wide-ranging research supporting the work of the Education and Training division.

You will play a critical role in successfully designing, developing, implementing and delivering processes and procedures associated with creating, validating and maintaining new and existing examination and assessment tools. You will be required to make strategic decisions associated with exam and assessment delivery and audit. You will generate evidence to ensure that the highest standards are attained in the quality assurance of these processes.

You will guide and advise the Psychometric Team in all aspects of output and analysis, leading them in working collaboratively with College Offices, fellows, members and College staff in developing and analysing assessment tools offered by the RCPCH. You will be responsible for undertaking and managing the quality assurance and audit processes for these assessment tools to ensure that the highest standards are attained.
Responsibilities1. To identify areas for change and development within examination and assessment processes (eg, improving efficiency, validity, reliability, acceptability, legal defensibility, attainment, modifying processes in line with best practice)
2. Provide specialist psychometric advice and recommendations on aspects of exam transformation
3. Take responsibility for making critical decisions with regards to various of aspects of exam and assessment redesign and redevelopment
4. To be aware of and use current literature and best practices to inform future development of RCPCH examination and assessments, in line with key stakeholder and regulatory bodies
5. To advise and produce proposals, often in conjunction with RCPCH Officers and senior staff
6. To plan and manage the work of the Psychometric Team, to include reviewing and developing existing and new processes
7. To devise and deliver training in areas related to assessment i.e. assessment principles, item writing, standard setting and best practise for relevant stakeholders
8. Contribute to producing College documents and responses to requests from the GMC relating to policies, rules, procedures, supporting evidence, data sharing agreements and processes governing RCPCH examination and assessment activities
9. To provide leadership and drive forward Equality, Diversity and Inclusion (EDI) policies, practices, reporting and differential attainment analysis
10. To respond to data and information requests from members of the RCPCH, various College Committees and Board meetings; providing statistical data and narrative reports
11. To manage external data requests and collaborate with others undertaking research and ensuring the College’s data sharing policy is followed
Essential skillsEssential
• Undergraduate degree with further relevant professional experience and advanced knowledge of statistical analysis
• Experience of the application of the principles of assessment
• Ability to apply techniques and theories used in undertaking psychometric analysis
• Experience of IT software SPSS (or a relevant other programme: R, FlexIRT, Winsteps, Stata, Facets, IRTPRO)
• Experience with exam form assembly, item analysis and results analysis
• Excellent analytical and problem-solving skills demonstrating the ability to understand and resolve complex issues
• Excellent stakeholder management skills and experience of working at a senior level with a broad range of stakeholders to take forward programmes of work
• Excellent communication skills, with the ability to set out and discuss complex issues clearly for a wide audience
• Experience of undertaking quantitative and qualitative analysis
• Ability to exercise discretion in dealing with confidential issues
• Ability to work with minimal supervision, manage and take responsibility for own workload
Desirable skillsDesirable
• Experience with differential attainment analysis and validation frameworks
• Knowledge or an interest in medical education and familiarity with its terminology
• Experience of managing an administrative function to articulate to senior positions/ management teams the work involved
• Master’s degree with further relevant professional experience
Educational requirements• Undergraduate degree with further relevant professional experience and in-depth knowledge of statistical analysis

Employment & compensation

Base salaryGBP 43,000.00
Employment statusPermanent
Employment typeFull time
Contractual hours35.00
Compensation notes•Annual leave allowance 25 days plus College closure between Christmas and New Year.
•Employee Discount Scheme
•Employer pension contribution up to 10%
•35 hours week
•Comprehensive learning and development
• Interest free travel loans.

Powered by