In this entry, we’ll outline how each of the various PSM sections of the Scorecard are scored which will explain how the individual section percentages add up to the overall score listed at the top of the page.
Each of the 12 main sections have an equal value of 8.3% towards the overall score. These sections are listed below:
- Implementation Schedule*
- Employee Participation
- Process Safety Information (PSI)
- Process Hazard Analysis (PHA)
- Standard Operating Procedures (SOPs)
- Training
- Contractors
- Pre-Startup Safety Review (PSSR)
- Mechanical Integrity (MI)
- Management of Change (MOC)
- Incident Investigation (II)
- Compliance Audits
*The Implementation Schedule can be removed from the scorecard following implementation, so if you don’t see it on your plant or company page that may be why. If you do see it, but would like to remove it, please send a request to support@wbbmportal.com. In the event the Implementation Schedule is removed from your plant scorecard, the remaining 11 sections carry an equal weight of 9.1%
In general terms, the default score for each section is based on the number of overdue tasks or items against those that are open. As an example, if a plant has 10 tasks that are open for a particular section and 5 are overdue, that results in a 50% score for that portion. If a plant has 1 open task, and that task is overdue, that results in a 0% score for that portion. If a plant has 10 tasks that are open but none are overdue, that results in a 100% score for that portion. However, there are a few sections that include more than just that simple calculation and in the section below the details for grading will be displayed.
Implementation Schedule
This score is based on the completion status of the Implementation Schedule. By default, the Implementation Schedule includes 82 open items or actions that should be addressed during implementation. As you complete the various checklist items, the percentage of completed items against the number of open items changes the score displayed in this element, essentially giving you a real time percentage of implementation.
Employee Participation
This section is made up of two parts, both equaling 50% of the overall EP score.
- % of monthly meetings in the year (i.e. facility should have 10 documented meetings during the 10th month of the year or 5 meetings during the 5th month of the year*). This score will be displayed at the top of the page as a fraction, indicating the number of meetings the facility has had against the number of months in the current year followed by a percentage relating to that fraction.
- % of overdue meeting agenda tasks against the number of overall tasks.
*This frequency (monthly, quarterly, etc.) is default at monthly, but can be changed based on your company policy.
Process Safety Information (PSI)
The PSI score is calculated from two parts:
- % of overdue PSI related tasks (driven by MOC) against the total number of open tasks
- Number of items in PSI library that are ‘missing’. In this case, the score is dropped down to 0% if there are any PSI items missing from the PSI library.
Process Hazard Analysis (PHA)
The score for the PHA section is calculated by the % of overdue PHA recommendations against the number of open recommendations. This does include data from multiple studies and multiple formats so if there are 6 different PHA studies all with open and/or overdue recommendations, the score is a composite of all the PHA studies (open/overdue). For example, if there are a total of 100 open PHA recommendations coming from 5 different PHAs, and there are 40 of those recommendations that are overdue, the score would be 60%.
Standard Operating Procedures (SOP)
The SOP score is also calculated from two parts:
- % of overdue SOP related tasks (driven by MOCs) against the total number of open tasks. For example, if there are 10 SOP tasks and 5 are overdue, the score for this part of the calculation would be 50%.
- % of uncertified SOPs (system entire and equipment specific) against the total number of SOPs available. For example, if your process/system has 100 SOPs and 10 are overdue, the score for this portion would be 90%.
In the case of the SOP score, the number of ‘open’ items represents the number of active SOPs at your facility rather than a typical ‘open’ action item. This simply means that even if all of the SOPs are currently certified at your facility, the scorecard will still show a number of open items – which represents the total number of active SOPs in your system.
Training
The training score is compiled from various parts:
- % of overdue training related tasks (driven by MOCs) against the total number of open tasks.
- % of open or uncompleted Safety Training (training modules) for the plant. These open or uncompleted training events are based on the configuration settings in the Training Administration area and can be viewed by the group settings that are set up.
- % of open or overdue SOP Training (based on training configurations in the SOP Training area).
In the case of the training score, the number of ‘open’ items represents the number of active training topics or events rather than a typical ‘open’ action item. This simply means that even if all of the training is current at your facility, the scorecard will still show a number of open items – which represents the total number of active training events per your configuration.
Contractors
The score for the contractor section consists of the percentage of overdue contractor related tasks (driven by MOCs) against the total number of open contractor tasks.
Pre-Startup Safety Review (PSSR)
The PSSR section score drops in the event there are any open or incomplete PSSR reports. As an example, if there are PSSR reports that have not been closed out the score drops to 0. This means that the PSSR section typically has a score of either 100% or 0%.
Mechanical Integrity
The Mechanical Integrity section is comprised of two parts:
- % of overdue MI tasks (inspections, work orders, etc.) against the total number of open MI tasks.
- % of overdue MI audit items (recommendations from MI audits, etc.) against the total number of open tasks.
Management of Change
The MOC score is also comprised of two parts:
- % of overdue MOCs. As an example, the due date for the overall MOC is what drives his score. So, if a plant has 5 open MOCs, and the due date entered in the request comes and goes, that MOC becomes overdue, and starts to affect the score (against the total number of open MOCs). If there are 5 open MOCs, and 1 is overdue, the portion of this score would be 80%.
- % of overdue tasks assigned from the MOCs. These are the individual tasks assigned out through the MOC process and is the total number of overdue tasks against the total number of open tasks. For example, if a facility has 10 MOCs, and 5 task assignments from each of those MOCs (for a total of 50 open tasks), and 10 of those tasks are overdue, the score for this portion would be 80%.
Incident Investigation
The Incident Investigation score is calculated using the % of overdue incident recommendations against the total number of open tasks stemming from the Incident Investigations themselves. As an example, if there are 2 open incidents, and 2 tasks from each report (for a total of 4 open tasks) and 1 of them is overdue, the score would be 75%.
This section also indicates the number of of open (noncertified) Incident Investigations reports, but an open incident investigation does not decrease the II score.
Compliance Audits
The Compliance Audit score is made up from two parts:
- % of uncertified audits (audits that have not been ‘certified’). This simply means that an audit has been created, completed, and documented, but that the actual ‘certification’ approval has not taken place.
- % of % of overdue audit recommendations against the total number of open audit recommendations. For example, if an audit has 10 recommendations and 8 are overdue, the score would be 20%. Also, similar to the PHA area, This does include data from multiple studies and so if there are 2 different audit studies all with open and/or overdue recommendations, the score is a composite of all the audit studies (open/overdue).
The data and counts of these various items are listed in the individual pages of each element
