Examination Scoring and Results
Examination Scores
Part I (MCQ)
Each question is worth one mark. Despite our best efforts to ensure that each new exam has the same level of difficulty, it is inevitable that some exams will prove to be slightly easier and some slightly more difficult. The specific number of questions that must be answered correctly in order to pass changes according to the difficulty of the exam. The standard setting process (see below) accounts for variations in difficulty from one exam to the next, so that pass-fail standards will be fair and comparable from exam to exam.
Part II (OSCE)
Stations are marked by assessors, who record each candidate’s performance in a specific station on a station-specific checklist and rate the candidate’s performance in:
- Communications
- Outcome
- Overall Performance
The interactive stations include all three ratings; non-interactive stations include only Outcome and Performance ratings. Assessors are trained to follow standardized criteria specific to the station task in providing these ratings.
Communications ratings for all interactive stations are based on standard criteria, for each of the following four factors:
- attending and responding to client’s needs, feelings and concerns, with a professional manner that treats clients respectfully (including greeting the client, eliciting the client’s questions and views, responding to the client’s concerns and inviting the client’s input and demonstrating respect for the client’s views, feelings and needs)
- using an organized, logical yet flexible approach that focuses the interaction (including logical ordering and appropriate use of open and closed-ended questions to elicit relevant information and respond appropriately, listening and responding to the client’s input rather than following a rigid checklist)
- using non-verbal communication that engages the client and enhances dialogue (including appropriate body posture and facial expression, appropriate eye contact)
- using language and verbal expression that can be clearly understood by the client (including clarity of speech, accurate use of language, appropriate terminology)
Outcome ratings are based on the station objectives and competencies assessed and follow station-specific outcome rating guidelines, including:
- adequacy and relevance of information gathered and provided
- identification of the primary drug therapy problem(s) and/or patient’s needs
- safety and effectiveness of recommendations and actions taken
Please refer to the Sample Stations for examples of station-specific Outcome ratings.
Overall Performance ratings (used for all stations) are based on standard criteria, including:
- the degree to which the problem is solved or tasks performed accurately and in accordance with best practices
- the quality of communications
- the accuracy of documentation, when required
- the accuracy and thoroughness of information gathered and provided
- the likelihood of an effective outcome for the patient
- whether or not the performance would result in any risk to the patient
- the extent of services provided as outlined in the relevant competencies shown in the Qualifying Examination Blueprint
Your Total Score is the sum of your Communication, Outcome and Overall Performance ratings in all twelve scored stations (excluding the pretest station). The passing score (see below) and all candidate scores are transformed to a standardized score scale to account for changes in difficulty from exam to exam. This ensures that scores and pass-fail standards will be comparable from exam to exam.
-
Part I (MCQ)
Each question is worth one mark. Despite our best efforts to ensure that each new exam has the same level of difficulty, it is inevitable that some exams will prove to be slightly easier and some slightly more difficult. The specific number of questions that must be answered correctly in order to pass changes according to the difficulty of the exam. The standard setting process (see below) accounts for variations in difficulty from one exam to the next, so that pass-fail standards will be fair and comparable from exam to exam.
-
Part II (OSCE)
Stations are marked by assessors, who record each candidate’s performance in a specific station on a station-specific checklist and rate the candidate’s performance in:
- Communications
- Outcome
- Overall Performance
The interactive stations include all three ratings; non-interactive stations include only Outcome and Performance ratings. Assessors are trained to follow standardized criteria specific to the station task in providing these ratings.
Communications ratings for all interactive stations are based on standard criteria, for each of the following four factors:
- attending and responding to client’s needs, feelings and concerns, with a professional manner that treats clients respectfully (including greeting the client, eliciting the client’s questions and views, responding to the client’s concerns and inviting the client’s input and demonstrating respect for the client’s views, feelings and needs)
- using an organized, logical yet flexible approach that focuses the interaction (including logical ordering and appropriate use of open and closed-ended questions to elicit relevant information and respond appropriately, listening and responding to the client’s input rather than following a rigid checklist)
- using non-verbal communication that engages the client and enhances dialogue (including appropriate body posture and facial expression, appropriate eye contact)
- using language and verbal expression that can be clearly understood by the client (including clarity of speech, accurate use of language, appropriate terminology)
Outcome ratings are based on the station objectives and competencies assessed and follow station-specific outcome rating guidelines, including:
- adequacy and relevance of information gathered and provided
- identification of the primary drug therapy problem(s) and/or patient’s needs
- safety and effectiveness of recommendations and actions taken
Please refer to the Sample Stations for examples of station-specific Outcome ratings.
Overall Performance ratings (used for all stations) are based on standard criteria, including:
- the degree to which the problem is solved or tasks performed accurately and in accordance with best practices
- the quality of communications
- the accuracy of documentation, when required
- the accuracy and thoroughness of information gathered and provided
- the likelihood of an effective outcome for the patient
- whether or not the performance would result in any risk to the patient
- the extent of services provided as outlined in the relevant competencies shown in the Qualifying Examination Blueprint
Your Total Score is the sum of your Communication, Outcome and Overall Performance ratings in all twelve scored stations (excluding the pretest station). The passing score (see below) and all candidate scores are transformed to a standardized score scale to account for changes in difficulty from exam to exam. This ensures that scores and pass-fail standards will be comparable from exam to exam.
Passing Score
A criterion-referenced pass/fail standard is established for each Part of the PEBC Qualifying Examination. This standard is performance-based and represents the level of performance appropriate to enter practice, as determined by a panel of practitioner experts.
This approach to making pass/fail decisions ensures that the same ability or performance standard is applied for each exam and it ensures that only candidates who meet or exceed this standard pass the exam. It is a candidate’s level of ability or performance compared to this standard that determines whether the candidate passes or fails, not a comparison of how other candidates performed on the exam. There is no built-in passing or failure rate with a criterion-referenced pass/fail standard.
Standard Setting for Part I (MCQ)
A representative group of practitioner experts conducted a thorough review of the content of the exam in June 2016. They determined the minimum number of questions that must be answered correctly on that exam in order to pass. The ability level that corresponded to that minimum passing score has been adopted as the pass/fail standard for the Qualifying Examination – Part I (MCQ).
In order to maintain the same pass/fail standard from one exam to the next, taking into account the difficulty of the exam, an equating process has been implemented. The equating process is a statistical procedure that determines the minimum number of questions that must be answered correctly on a new exam in order to meet the pass/fail standard that has been established. Although the specific number of questions that must be answered correctly in order to pass varies with the difficulty of the exam, the underlying estimate of ability that represents the pass/fail standard remains the same each time.
Standard Setting for Part II (OSCE)
Based on a thorough review of the exam, station by station, a panel of practitioner experts familiar with the exam format follows a thorough and standard process, led by an exam consultant, to determine the minimum rating for each scale in each station. The sum of these ratings across all 12 scored stations in the exam becomes the passing score for that exam. This process is repeated for each exam and takes into account the variations in difficulty that may occur from one exam to the next.
-
Standard Setting for Part I (MCQ)
A representative group of practitioner experts conducted a thorough review of the content of the exam in June 2016. They determined the minimum number of questions that must be answered correctly on that exam in order to pass. The ability level that corresponded to that minimum passing score has been adopted as the pass/fail standard for the Qualifying Examination – Part I (MCQ).
In order to maintain the same pass/fail standard from one exam to the next, taking into account the difficulty of the exam, an equating process has been implemented. The equating process is a statistical procedure that determines the minimum number of questions that must be answered correctly on a new exam in order to meet the pass/fail standard that has been established. Although the specific number of questions that must be answered correctly in order to pass varies with the difficulty of the exam, the underlying estimate of ability that represents the pass/fail standard remains the same each time.
-
Standard Setting for Part II (OSCE)
Based on a thorough review of the exam, station by station, a panel of practitioner experts familiar with the exam format follows a thorough and standard process, led by an exam consultant, to determine the minimum rating for each scale in each station. The sum of these ratings across all 12 scored stations in the exam becomes the passing score for that exam. This process is repeated for each exam and takes into account the variations in difficulty that may occur from one exam to the next.
Performance Trends on the Pharmacist Qualifying Examination
The Pharmacist Qualifying Examination is the two Part, entry-to-practice exam taken by all pharmacist candidates seeking PEBC certification. Candidates may elect to take both Parts in the same sitting or at separate sittings. The subgroups of candidates are defined below.
Reference: graduates of Canadian-accredited pharmacy programs taking the exam for the first time in the year of graduation
International First-Time Test Takers: graduates of international (non-U.S., non-accredited) pharmacy programs taking the exam for the first time
International Repeat Test Takers: graduates of international (non-U.S., non-accredited) pharmacy programs taking the exam who were previously unsuccessful
The data is divided based on candidate population for each Part of the exam based on five administrations between Spring 2021 and the Fall 2023:
Pharmacist Qualifying Examination |
Part I (MCQ) | Part II (OSCE) | ||
# Candidates | Pass Rate | # Candidates |
Pass Rate |
|
Reference |
2632 |
86.5% | 2630 |
93.7% |
International First-Time Test Takers |
2070 |
43.3% | 1884 |
59.8% |
International Repeat Test Takers |
1638 |
50.4% | 959 |
63.6% |
Quality Assurance Processes for the Examination
The Pharmacist Qualifying Examination questions and stations have been developed, reviewed, and pretested by several independent groups of practising pharmacists. They are then refined and reviewed again to ensure that they function as required for assessing competence.
Each form of the Qualifying Examination, Parts I and II, has been prepared according to the examination blueprint. It is then reviewed and approved for administration. PEBC exam staff perform and document quality assurance checks on each exam administration and scoring, ensuring that all procedures have been followed, that all data is complete and that scoring is accurate.
After each Part II (OSCE) administration a Quality Assurance Panel meets to review all exam data, candidate’s written feedback and exam centre reports, to ensure that each candidate’s result is based on a fair and accurate assessment of performance in the OSCE. If an incident occurred that could have affected a candidate’s performance, the Quality Assurance Panel reviews all written information provided by the exam centre and by the candidate on the feedback questionnaire, supplemented by any additional information provided in writing by the candidate within 7 calendar days of the exam, to ensure that the candidate’s final result is fair based on the candidate’s performance in all other stations.
Detailed analyses are conducted of the scoring and standard-setting results to confirm the reliability and validity of the results. Measurement experts review all documentation and analyses to confirm the reliability of the scores and validity of candidates’ final standing.
Distribution of Results
Results are posted to the PEBC website within six weeks of the exam. The results list contains the following information:
- The PEBC ID numbers of candidates who passed either, or both parts of the exam
- The PEBC Registration Number, if a candidate passed both parts of the Qualifying Exam
No other information appears on the results list. The list will appear in the Pharmacist Qualifying Exam section of the website.
Note:
To expedite the provincial registration of candidates whose licensure is waiting for PEBC certification, a list of successful registrants is forwarded to the provincial regulatory authorities at the same time as the release of individual results.
Results letters are then added to the Digital Wallet of each candidate within one week of the results list posting. Results will not be released by phone, so please do not call PEBC to ask for them. If your results letter is not added to your Digital Wallet within one week of the results list posting please email pebcinfo@pebc.ca.
Scores are not reported, since score differences on a certification exam are not meaningful for the purpose of determining whether you were successful. Results are given on a pass/fail basis only. Either you have qualified or have not yet qualified for certification. Board policy does not permit the release of overall exam scores, passing scores, or question/station content, including correct/incorrect responses.
Feedback Reports for Unsuccessful Candidates
Unsuccessful candidates will receive a feedback report with information about their performance on the exam. These reports will be added to the Digital Wallet of each candidate within approximately eight weeks following the release of exam results. Feedback reports are not available for candidates who have passed the exam. Please contact pebcinfo@pebc.ca if your feedback report is not added to your Digital Wallet within eight weeks following the release of the exam results.
The Pharmacy Examining Board of Canada provides candidates with Pharmacist Qualifying Examination – Feedback Reports for either Part I (MCQ) and/or Part II (OSCE). These reports for unsuccessful candidates provide relative feedback on a candidate’s performance according to the competency areas tested in the exam. This information is intended to help candidates identify their areas of greatest weakness so they can focus further study and remediation accordingly. It is important for candidates to review their feedback keeping in mind the relative blueprint weighting for each competency area in the exam (see Qualifying Examination Blueprint). Any requests for clarification of feedback reports must be submitted in writing.
Certifying and licensing exams are of a summative and confirmatory nature; they are used to certify competence to practise the profession at an entry-level, in the interest of the protection of the public. The exam is not intended to be educational or diagnostic. With respect to more detailed feedback on a candidate’s weaknesses, the Pharmacy Examining Board of Canada is unable to provide additional feedback or recommendations regarding individual performance or remediation.
Re-Scoring of the Examination for Unsuccessful Candidates
If you made an unsuccessful attempt, you can request one final hand scoring of the exam. To make your request, mail or courier the following to PEBC. These items must be received by PEBC within 75 days of the release of exam results:
1. A hardcopy letter that includes:
-
- your PEBC ID number
- the name of the exam you wish to have rescored
- the statement “I wish to have my exam rescored”
2. The required fee – Please review the offline fee instructions to ensure your fee is submitted correctly.
Note:
The content, methodology, standards, or assessment criteria of the Pharmacist Qualifying Examination are not subject to review or appeal by unsuccessful candidates or their agents. (Refer to: Quality Assurance Processes for the Examination).
This hand-scoring is only to confirm correct data entry and tabulation of scores; it is not a re-assessment of your performance in Part II (OSCE).
Attempts at the Pharmacist Qualifying Examination
Candidates are permitted a maximum of four attempts for each Part of the Pharmacist Qualifying Examination.
After three unsuccessful attempts, if you can present evidence, acceptable to the Board, of successful completion of remediation according to Board specifications (as outlined in your results letter), the Board is prepared to consider your petition for a fourth, final attempt. Remediation is only accepted if started after the date on your results letter and completed within one year of your fourth, final attempt. Documentation confirming completion of remediation must be received by PEBC, by email, at least three weeks before the date of the exam. You can find more information HERE.
It is important to assess your exam preparedness carefully and not simply make another attempt at the next scheduled exam date without adequate remediation and improvement in the needed competency areas.
Importance of Meeting Application Deadline:
It is important to ensure that application form(s) for either part of the Pharmacist Qualifying Examination are received by the deadline dates, even if your eligibility to take either part of the Qualifying Examination is conditional upon receipt of required remediation. Please do not wait for PEBC to acknowledge receipt of the above documentation, prior to sending your application(s).
Applications received after the deadline will not be processed even if the pending documentation has been received prior to the exam dates.
If you fail your fourth, final attempt at either part of the Qualifying Examination, you will not be permitted to retake the Qualifying Examination and therefore cannot proceed further toward Board certification. You are not permitted to attempt the PEBC certification process more than once. In other words, you cannot retake the Evaluating Examination and proceed again to retake either Part I (MCQ) or Part II (OSCE) of the Qualifying Examination.
If you withdraw before the start of an exam, it does not count as one of your attempts at the exam. Once you have begun an exam sitting, it does count as one of your attempts, even if you must leave the exam early – unless you are granted a “no standing” status based on a sudden event (see below).
Candidates are strongly encouraged not to attempt the exam and to make an appropriate withdrawal if, prior to the exam, they are ill or have extraordinary circumstances, including bereavement, that may affect their performance on the exam.
If you pass one part of the Qualifying Examination and fail the other, you may retake the part you failed at a future scheduled exam session. You must submit a new application and fee for the required part. (Please note that Part II is offered in a limited number of centres in some sittings)
Both Part I and Part II of the Qualifying Examination must be completed within a three year period of passing one Part of the Qualifying Examination. Candidates who do not successfully complete both Parts of the exam within three years will be required to retake and pass the Part that has already been completed. |
“No Standing” Status
If you must leave the exam early due to sudden illness or another sudden emergency situation and are unable to complete the exam, you may be granted a “no standing” status. The decision will be based on your written request and explanation, and this must be accompanied by valid documentation acceptable to the Registrar-Treasurer. In such circumstances, the sitting may be waived and not counted as an attempt.
Candidates are strongly encouraged not to attempt the exam and to make an appropriate withdrawal if, prior to the exam, they are ill or have extraordinary circumstances, including bereavement, that may affect their performance on the exam.
Note:
Petitions for special consideration received more than seven calendar days after the exam (e.g., upon receipt of a notice of an unsuccessful exam result) will NOT be considered.
Candidate requests for a “no standing” status on the basis of medical conditions or compassionate grounds (such as bereavement) will NOT be considered, unless received by the Registrar-Treasurer within seven calendar days after the close of the exam. In order for the request to be considered, the appropriate official documentation must be provided. A causal link must be made between the serious medical condition or compassionate circumstances and the effect on the candidate’s performance on the exam.
Registration
Once you pass both parts of the Pharmacist Qualifying Examination, your name will be entered into the Register of The Pharmacy Examining Board of Canada and you will receive a Certificate of Qualification printed in either official language. Until your Certificate is prepared, your letter of exam results can serve as official confirmation of your Board registration.
You should notify the PEBC office in writing of any address changes so that your Certificate will not get lost.
Due to the current COVID-19 situation, PEBC continues to experience delays in issuing and mailing Certificates of Registration for candidates. Delays are ongoing until PEBC resumes normal operations. PEBC thanks candidates for their patience.
Reprinting of Certificates of Qualification
Candidates who require a reprinting of their Certificate of Qualification, must submit a written request to PEBC, providing a statutory declaration explaining the reason for a reprint, together with the administrative fee.
Entitlement
Once you are registered with the Board, you are entitled to use the approved official designation:
- in English, “RPEBC” (i.e., “Registrant of The Pharmacy Examining Board of Canada”)
- in French, “IBEPC” (i.e., “Inscrit au Bureau des examinateurs en pharmacie du Canada”).