eCampusOntario Open Competency Toolkit

Dennis Green and Carolyn Levy

eCampusOntario Open Competency Toolkit by Dennis Green and Carolyn Levy is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License, except where otherwise noted.

Contents

- Introduction

- About the toolkit

- How to use this resource

- Acknowledgements

- Part I. Defining Competence

- 1. What do we mean by competence?

- 2. How does competence change over time?

- 3. Why is competence important?

- 4. What are competencies?

- 5. How to construct a competency

- Part II. Competency Frameworks

- 6. What are competency frameworks?

- 7. Uses for competency frameworks

- 8. Competency framework structure

- 9. Grouping and clustering competencies

- Part III. Using Competencies

- 10. Use cases

- 11. Workforce development

- 12. Training and Learning

- 13. Assessment

- 14. Credentialing

- 15. Other use cases

- Part IV. Developer’s Guide

- 16. Where to start

- 17. Adapting an existing framework

- 18. Creating a new framework

- 19. Sample competencies

- 20. Sample competency framework structures

- 21. Putting it all together

- Templates

- Glossary

- Links

1

Introduction

Why did we develop the toolkit?

There is a lot of activity and growing interest internationally around micro-learning opportunities, which includes both micro-credentials and digital badges among others. eCampusOntario has been working to support micro-learning opportunities over the last several years, and this toolkit is part of  an initiative to support the development of common, open competency frameworks for in-demand sectors of the labour market. These competency frameworks will support the development of micro-learning opportunities in alignment with the eCampusOntario Micro-Credential Principles and Framework and form a key cornerstone for future workforce development activity.

The COVID-19 pandemic and the resulting economic disruption has magnified the increased need for cross-occupational mobility, as some sectors are facing a lengthy recovery, while others are seeing sudden and unanticipated increased demand for workers with the right skills. While the development of common competency frameworks is not intended as a direct response to post-COVID workforce recovery and realignment, having such frameworks in place will provide for both horizontal (cross-sectoral and cross-occupational) and vertical (within occupations and sectors) skill progression, certification, and career pathways for Canadians from all walks of life.

Other jurisdictions, such as Europe, Australia and New Zealand have well defined nationally validated competency and qualification frameworks but such a formalized system is lacking in Canada at the moment. The US, although it lacks a formal national competency and qualification framework, has amassed a large amount of data within its O*Net system that tracks occupational requirements across a number of domains, from abilities, interests, knowledge and skills, to work environments, context and values. There are also a number of international initiatives underway to look at better ways of aligning competency definitions, terminology, and micro-learning opportunities across the globe, all of which will lead to more consistent and responsive ways to react to the rapid pace of change in the workforce.

2

About the toolkit

Through this toolkit, eCampusOntario is developing the foundation, structure and tools to support the iterative development of open competency frameworks. If this is done well, it will pave the way for much more consistent and efficient work in this area for years to come. The result? Increased efficiency in both time and cost for others building common competency frameworks across in-demand industry sectors.

A major challenge that comes with developing competency frameworks across multiple industry sectors is ensuring that a common language and tools exist for the development of complementary competency libraries that are open, shared, and scalable. The language that is used in different sectors to describe the same skills or similar work activities varies, and industry sectors or occupational groups (such as professional associations) often develop their competency frameworks in silos. Duplication of effort and lack of transferability become stumbling blocks.

Compounding this are issues that persist with many sets of existing competency frameworks and occupational standards. These include lagging content development and revision cycles, misalignment between standards and assessment tools, and reliance on very small groups of people during input and validation processes. Often this stems from a combination of factors, but it is something that can be addressed by a well thought out and methodical approach to developing competency definitions and frameworks. This toolkit is intended to help address these issues.

In addition to supporting well-constructed competency frameworks, this toolkit is also intended to increase the openness of competency frameworks. By open, we mean that resources, tools and practices are free of legal, financial, and technical barriers and can be fully used, shared and adapted in the digital environment.

This toolkit was developed using a design and validation process that includes contact with both industry and education, in order to develop relationships that will support the socialization of the resources upon completion.

The toolkit is licensed under a Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) license [1], and is intended to be shared and revised. As we will explore within the various sections of the toolkit, competency frameworks and the tools that are used to develop them need to be fluid, living, and breathing documents that can adapt to change and evolve over time.

1. https://creativecommons.org/licenses/by-sa/4.0/ ↵

3

How to use this resource

This toolkit has two main purposes. The first is to foster the development of open competency frameworks that can be shared across industry sectors and for different end users. From this perspective, the toolkit may be used in different ways by different people. Some examples include:

- Using the toolkit and its templates to develop new competency frameworks.

- Making revisions to existing competency frameworks, to look at ways to align language and structure.

- Informing the design of competency-based training and assessment in both educational settings and the world of work and learning.

- Supporting the development of new and alternative credentials and micro-learning opportunities that relate to competency frameworks.

The second purpose is  to provide guidelines and good practices for people developing competency frameworks. There are sections of the toolkit dedicated to developing and writing competency descriptions as well as ways of grouping and clustering competencies to build frameworks.

We recommend that you begin with the Chapter on “Defining Competence.” This chapter outlines key terminology used in this toolkit and provides definitions for the terms “competent” and “competencies.” Even if you are experienced in developing competency frameworks, it’s important to grasp how these terms are being applied within the toolkit. Given the lack of agreed use of the terminology across sectors, it’s important to establish a shared understanding for the purpose of developing open competency frameworks. Once you are familiar with the terms, feel free to access the chapters as you need. If you are new to competency frameworks, it’s probably best to work through each chapter sequentially.

4

Acknowledgements

This toolkit would not have been possible without the support of eCampusOntario and a team of people representing a wide range of perspectives. We also want to thank the many people who participated in the review and validation of this toolkit who are not listed specifically.

These include:

Project Team

Dennis Green

Carolyn Levy

Our Working Group Members

Vivian Forssman

Lyne Marcil

Fiona McArthur

Judene Pretti

Evan Tapper

eCampusOntario Staff

Emma Gooch

Lena Patterson

Cindy Ly (Cover design)

Graphics

Caroline Mayhew

eCampusOntario is a not-for-profit organization funded by the Government of Ontario that supports Ontario’s colleges, universities, and Indigenous institutes. We build systems that are open, collaborative, and responsive to shifts and opportunities in the educational landscape to connect our campuses to the future of learning.

I

Defining Competence

In this section we will look at the basis for competency frameworks, both broadly and more specifically within the context of this toolkit.

In this section:

What do we mean by competence?

How does competence change over time?

Why is competence important?

What is a competency?

How to construct a competency

1

What do we mean by competence?

Defining competence is no easy task. There is wide variation regarding the use of the term and oftentimes this causes confusion when trying to develop a competency framework. Given the lack of shared understanding, it is necessary to define it for use in this toolkit. According to the Oxford English Dictionary , Competence (noun) “is the ability to perform to a specified standard.”[1] Competence involves successful performance in the world of work and learning. Effective performance requires both the skills to function effectively and the knowledge and attributes (attitudes and values) to apply those skills in routine and non-routine situations.

The term ‘competent’ (adjective) is used to describe individuals or groups (such as a competent person or a competent organization) and can be used in both broad and narrow contexts.

Being competent means being able to perform a task or an activity consistently over time and in different situations. To determine consistent performance it’s important to consider the following: [2]:

- Completing tasks and activities-

- Being able to apply specific knowledge and skills to complete work or school tasks and activities

- Understanding why an activity or task should be done that way

- Managing tasks –

- Being able to handle multiple tasks and activities and still get things done on time

- Knowing how to do a job, task, or activity and being able to do the things required to meet expectations of work quality

- Handling contingencies –

- Unexpected circumstances

- Changes in scope

- What to do when things go wrong

- Working within a role –

- Working with others as a part of a team, often with defined expectations and responsibilities

- Doing a job safely and following policies and procedures

- Working within the work or school environment –

- Doing tasks and activities within the physical environment and working conditions

- “Fitting in or contributing to” the organization’s culture and values

- Being able to adapt to similar but different situations related to the work

These situational factors are important when developing competency frameworks. It’s also important to note that competence changes over time; for example, if a situation changes the level of competence required to perform to the agreed standard may change. Competence is fluid in nature and should be considered at all stages of competency framework development.

1. Source: Oxford Dictionary, retrieved from https://www.lexico.com/definition/competence ↵

2. Variations of this model are well established and used in competency-based education and training systems, particularly in Australian tertiary education ↵

2

How does competence change over time?

If there is one thing to keep in mind, it’s that competence itself is fluid and occurs as we learn to do things. There are many different descriptions of what that the journey towards competence looks like, but there are a few common themes on the continuum from beginner to expert (a proficiency scale).

- Competence happens on the journey between not being able to do something at all to being an expert.

- Learning and practice are required in order to develop from one end of the proficiency scale to another.

- Without continued practice, or if something dramatically changes with the activity or the context around the activity (such as changes in technology) there may be a need to learn and practice again to remain competent.

- Time is the biggest variable. Some things take years to learn and become proficient in, others are easier to master. In addition, everyone learns and develops their skills differently. For example, having related skills and knowledge to draw on can dramatically impact how long an individual takes to become proficient in something new.

Most models of skill acquisition look at proficiency scales as being linear, but in actuality,  the journey can be more circular or branching, depending on a number of variables, such as complexity, pace of change, and the frequency that the activity is put into practice.

For example, let’s take a common activity that a large number of adults can do competently – driving a car – and see how this model of skill progression applies.

1. First, you have to learn the rules of the road and the basic operation of the vehicle.

2. Then you need to practice (usually in a supervised environment, with additional coaching) in order to develop the skills necessary to pass your driver’s test.

3. If you drive regularly, you will develop those skills further, and learn to adjust for different road conditions, until the act of driving becomes extremely comfortable and almost routine.

4. If you don’t drive for a long time, you will likely feel less comfortable, but are still able to drive safely.

5. If something dramatic changes, such as you move to a different country where the rules of the road are dramatically different (such as driving on the other side of the road), you will need to do some additional learning and/or practice to be able to drive as competently in that environment. Or sometimes as we become more and more comfortable driving we become lax and require refreshing our knowledge and skills.

6. Physical changes associated with aging may require you to take a driving test and possibly refresher training to maintain your license.

Keep this journey in mind (e.g. beginner to expert) as we look at how to develop a competency framework.

3

Why is competence important?

There may be situations where some competencies are critical to performing a work activity, in which case having confidence in the individual’s ability becomes a significant factor. For these situations, how often and in what manner the competency is being measured is important. Descriptions of competent performance are necessary so that the expected performance can be measured. Assessment is not always directly built into a competency framework, but the structure of how competencies are written needs to make assessment possible. Without this, there are too many variables, and the link between measuring competent performance and an individual’s demonstrated actions may be broken.

Another reason why competence is important is that different job roles may have different requirements in terms of the level of proficiency required in the same area. For example, many jobs have an expectation that everyone has a basic level of proficiency in using common office applications like word processing, spreadsheets, and presentation software. Certain roles may require different levels of competence, as those in marketing and communications might require expert proficiency in using presentation software, and finance roles may require expert proficiency in using spreadsheets. Moving between roles often requires some additional learning and practice in order to meet those expectations.

The need to identify the level of proficiency and to construct competencies that allow for assessment are reasons for having well-defined competency statements and descriptions.

4

What are competencies?

A competency describes the ability to use a set of related knowledge, skills, and attributes required to successfully perform activities and tasks  in a defined setting. This might seem straightforward but there is no agreed upon definition of competency. As the workplace and educational sectors debate the use of the term, we are going to propose some definitions that will help you build a competency framework.

For the purposes of this toolkit and for clarity, we differentiate between:

- competency frameworks, which include hierarchical groups or clusters of competencies ( competency groupings), and

- individual, well defined competencies.

When using this toolkit, we will refer to individual competencies (or a competency) as consisting of:

- a defined competency statement and

- its supporting information, or description.

While this interpretation is far from universal, it lays the groundwork for using competencies as a foundational piece of a competency framework.

Components of Competencies

Competencies are comprised of some key components:

1. A competency statement which outlines the context and criteria/standards for the expected performance.

2. Performance criteriawhich are measurable outcomes required to demonstrate proficiency of the competency.

3. Supporting  information which includes the required supporting knowledge and skills to be able to achieve the competency.

4. Key terms that are open to interpretation.

Take a moment to review the sample competency below which includes examples for each of the structural components.

Show/Hide alternative (text) version of the competency example in the image above

Competency Statement:

Handle hazardous materials according to Occupational Health and Safety (OHS) regulations and workplace requirements.

Performance Criteria:

- Participate in required training for handling hazardous materials (e.g WHMIS training) according to OHS regulations and workplace requirements

- Select hazardous materials according to OHS regulations and workplace requirements

- Use hazardous materials according to OHS regulations and workplace requirements

- Store and dispose of hazardous materials according to OHS regulations and workplace requirements

Supporting Knowledge and Skills:

Knowledge:

- Correct identification and handling of hazardous materials (e.g. WHMIS training and symbols)

- OHS regulations, particularly related to using hazardous materials

- Location of Safety Data Sheets and how to read them

- Workplace policies and procedures related to using hazardous materials

- Types of personal protective equipment (PPE) and their uses when handling hazardous materials

Skills:

- Ability to accurately measure quantities and concentrations of hazardous materials

Key Terms and Definitions for this Competency:

hazardous materials

Substances that can cause harm. Hazardous materials designed for commercial use are labelled according to WHMIS standards; those designed for home use carry consumer protection labels

occupational health and safety (OHS) regulations

Legal requirements for working safely, which may include required training and certification, maintaining workplace documentation, and reporting of any incidents or near misses to appropriate regulatory bodies

WHMIS

Workplace Hazardous Materials Information System; a Canadian system of site specific information about hazardous materials that are present in workplaces and how to use and handle them safely. WHMIS is aligned with the international Globally Harmonized System (GHS) standard for hazardous materials.

workplace requirements

Standard policies, operating procedures, and other requirements specific to a workplace as determined by the workplace and/or management

5

How to construct a competency

When it comes to creating or revising a competency framework, it’s important to consider the components of each competency. To ensure that you capture the necessary information to build your competency framework, we propose the following components, which align with the templates we provide in the toolkit.

Title (or Name) – A short name that identifies the competency and is useful in distinguishing it in the framework. Taking the action verb and context from the competency statement is a good place to start.

- Example: Handle Hazardous Materials

Competency Statement – A descriptive statement that states what a competent individual is doing, and in what context.

Show/Hide alternative (text) version of the competency statement illustrated above

- Format: Begins with a concrete action verb (e.g. does X in order to Y) and contains both context and criteria/standards

- Example: Handlehazardous materialsaccording to Occupational Health and Safety (OHS) regulations and workplace requirements

Defining Terms:

Concrete Action Verb = a measurable verb that states actions which can be observed and measured when used in the context of an activity or task.

Context = What the nature of the action is (i.e. the object of the verb)

Criteria/Standards = specify the criteria for expected performance (e.g. to what level, to which standard, scope etc.)

Performance Criteria – A list of measurable outcomes required to demonstrate proficiency in the competency.

Note: Expected performance criteria can look very similar to a competency statement. So, what’s the difference? Expected performance criteria are all the observable behaviours or sets of activities that a person must be able to do to demonstrate the competency. In order to achieve the competency listed above in the competency statement, the performance criteria list what a competent individual can do. In particular “handling” would include selecting, using, storing, and disposing of hazardous materials.

- A stem (such as “a competent individual can:”) may precede the list or be implied

- The performance criteria are the basis for both informal and formal assessment

Show/Hide alternative (text) version of performance criteria illustrated above

For example, a competent individual can:

- Selecthazardous materialsaccording to OHS regulations and workplace requirements(e.g. WHMIS)

- Usehazardous materialsaccording to OHS regulations and workplace requirements

- Store and dispose ofhazardous materials according to OHS regulations and workplace requirements

- Format: Always begins with a concrete action verb and identifies a specific standard (e.g. does X according to Y), in the same basic structure as a Competency Statement:

- Action  > Context > Criteria/Standards

- Performance criteria may also include scope and conditions or attributes (attitudes and values) depending on the nature of the competency. These will be important to the performance and assessment of the competency.

- In this example, noting a particular scope (e.g. WHMIS) may be important to clarify that we are not talking about all OHS regulations, while a competency on workplace communication may include performance criteria that specifically state the importance of being respectful and using culturally appropriate language while communicating.

Supporting Knowledge and Skills – What do you need to know, and be able to do in order to achieve the competency? These inform training requirements and learning outcomes.

- Examples:

- Must know and understand the correct identification and handling of hazardous materials (e.g. there may be a requirement to complete WHMIS training in procedures, symbols, etc.).

- Must be able to read and interpret product labels and instructions.

Key Terms and Definitions – A list of key terms and definitions required to provide clarity about the descriptors used in the competency and/or performance criteria statements. Such terms are often bolded in the statements or compiled in a central glossary. Definitions can limit scope or identify variations in scope.

- Examples:

- Hazardous materials: Substances that can cause harm and that require specific handling to use safely. Most hazardous materials found in the workplace fall under WHMIS requirements for handling and use.

- Occupational health and safety (OHS) regulations: Legal requirements for working safely, which may include required training and certification, maintaining workplace documentation, and reporting of any incidents or near misses.

- WHMIS: Workplace Hazardous Materials Information System; a system of site specific information about hazardous materials that are present and how to use and handle them safely.

- Workplace requirements: As determined by the workplace and management; requirements specific to a particular workplace and/or job role.

The crucial information you need to have for developing a competency framework is:

- the competency statement,

- the performance criteria,

- the supporting knowledge and skills, and

- the key terms and definitions.

What you include in your framework beyond these key components depends on the purpose of the framework and who is using it. The next section goes into more depth on the purpose of frameworks, which will help guide the development of your framework, and the additional components below are included in the templates and examples we provide in the toolkit.

Context and Examples – These are not always included in the description of individual competencies but are important to a framework. The templates found in the appendix includes places to capture this information.

- How is this competency relevant to a job role, organization, or industry sector?

- How might it be demonstrated in different contexts and environments?

- These add tangible examples of how the competency is applied

- Additional examples can be added unique to different users

- Examples:

- Workers may use hazardous materials for tasks such as cleaning and sanitizing, and must do so safely. This may include mixing or diluting concentrated chemicals according to the instructions provided by the supplier

- Supervisors and managers are also responsible for ensuring that everyone has the proper training and knows where to find specific information on the safe use of each hazardous material found in the workplace.

Learning Content / Links

- Learning content should connect with the supporting skills and knowledge as well as the performance criteria

- Is there specific learning content related to this competency or a group of competencies?

- Is there a formal training requirement?

- Examples:

- Links to WHMIS Training (formal training course)

- Links to OHS regulation (supporting knowledge related to this competency for review)

- Links to workplace-specific OHS policies and procedures

Assessments

- Which competencies and behaviours are being measured, and how?

- Are multiple competencies being assessed at the same time?

- Formal assessments often require a rubric or specification tied to a proficiency scale

- These are developed separately to allow flexibility in how the competency and expected behaviours are measured in different contexts.

- Examples:

- WHMIS test/Certification (knowledge component; possibly regulatory requirement)

- Observation of individual handling hazardous materials while doing related tasks (practical component)

Connections to (or within) a Competency Framework – Categories and other links

- How does this competency tie into groupings or categories within a framework?

- How does this competency relate to other competencies (e.g. as a pre-requisite or requiring one)

- Linkages to occupations and how they apply (e.g. criticality, frequency, complexity)

- Examples:

- Categories – Workplace safety, Common core (ie everyone needs this)

- Unique Identifier or Code – this allows the organization of competencies in a logical manner and makes them machine-readable

II

Competency Frameworks

Next, we’ll look at competency frameworks, their uses, and their key components.

In this section:

What are competency frameworks?

Uses for competency frameworks

Competency framework structure

Grouping and clustering competencies

6

What are competency frameworks?

Competency frameworks are simply a combination of competencies that have been organized in some fashion, and usually consist of a minimum of three components:

- competencies,

- structures and hierarchies that organize competencies into groupings and/or categories, and

- connections between competencies, learning resources and assessments.

A competency framework may also include additional information, depending on its use case and intended audience. These could include information on specific occupations or sectors, link to training and/or certification requirements, or may identify skill or competency areas that overlap with other frameworks, etc.

Competency frameworks can be big or small, and evolve over time. The simplest and smallest example of a competency framework might be a job description. It outlines the skills, knowledge, and attributes required for a single position, but likely will include some common, shared competencies that relate to other positions, and some functional or technical competencies specific to the role.

Although a competency framework that includes a single job description is unlikely, an organization may well have a small framework that includes all the competencies required across multiple job roles within each department and across the whole organization.

At the opposite end of the spectrum, a competency framework that covers an entire continent, like the European Skills/Competences, qualifications and Occupations framework (ESCO) consists of over 13,000 competencies tied to thousands of occupations and qualifications, and is extremely complex in the number of hierarchies and layers of information (taxonomies) that it contains.

Later on in the toolkit we’ll look specifically at ways to use competencies and groups of competencies within a framework.

7

Uses for competency frameworks

Competency frameworks define the competencies needed to identify, evaluate, and recognize effective performance, typically in the workplace as attached to a job role or occupation. While the range of uses for competency frameworks is wide (some lists include over 100 end uses), there are a few common reasons why a competency framework may be developed, all of which may be applied in either a workplace or an educational context. The language used in each of those settings may vary, but there are four main contexts and primary uses.

Context

Use

Training and Learning

Developing individuals and teams through teaching and learning activities

Assessment

Evaluating individual and team performance in formal and informal ways

Credentialing

Recognizing achievements and issuing records of achievement

Workforce Development

Identifying individual, organizational and sectoral needs, career planning, and managing talent

Well-designed competency frameworks support training and learning, assessment, credentialing, and workforce development in different ways. All of these uses are also interrelated, as credentialing and workforce development include some form of training or learning and assessment.

Uses Related to Occupations and Job Roles

Most competency frameworks are connected to occupations and/or job roles in some way. Among frameworks that are built around occupations and job roles, the focus, structure, and use varies greatly, primarily driven by the type of organizations and stakeholders developing and using the framework.

Sector and Professional Organizations

Many competency frameworks are built around an occupation or group of related occupations in an industry sector. They define expected behaviours and performance associated with occupations, as well as outlining career progression between occupations and competencies that are common to many or all of the occupations within the framework. These may form the basis for licensing, continued professional development, specialization, or may link directly to courses and/or certifications issued by the same body that developed and manages the framework. Users of such a framework may include people working in the sector and/or specific occupations; people who are involved in delivering training and certification; and people looking to enter a career in one of the related occupations.

Private Sector Organizations

Larger organizations may have their own competency frameworks, which have been developed specifically for the purposes of workforce planning, performance management, and career progression. These frameworks typically focus less on formal certifications and tie directly into performance review cycles and professional development. Company-wide values or desired attributes often will be defined as core competencies within a framework of this nature. Users of this type of framework would include people in HR, employees and management within the organization, those designing or delivering training for the organization, and job seekers.

Governments and Public Sector

Governments and government organizations use competency frameworks for a range of uses, mostly linked to workforce planning on a macro scale. These frameworks are often broken down by sectors or occupational groups that are national in scope and sometimes tie into national and even international qualification frameworks. These frameworks are used for strategic decision making for things like the education system, career planning by those entering the workforce, and may form the basis for the evaluation of an individual’s skills for the purposes of immigration, skill recognition, or transferability between occupations.

Education

Increasingly, the education system (both in the K-12 and post-secondary contexts) is using competencies and competency frameworks to link educational pathways and outcomes with workforce demands and career paths. Generally speaking, this has been most widely used in connecting existing external competency frameworks to formal learning, rather than developing new competency frameworks. This trend is certainly on the rise in North America and well-established in other jurisdictions that have strong national systems that connect competencies and qualifications.

Other Uses

Educational institutions and/or government bodies (such as Ministries of Education) are also developing high level overarching competencies that are not directly connected to a field of study. These frameworks tend to focus on broad and transferrable competencies that they are looking to develop in all students that will ultimately serve them well long after graduation, regardless of their career path.

The Importance of “Open”

This wide range of uses strengthens the case for competency frameworks to be open and accessible. Competencies span job roles, occupations and sectors, and development cycles for competency frameworks have different drivers. By collaborating and sharing our insights, we make the development and revision of competencies over time easier for everyone and give people the freedom  to revisit and revise similar competencies to meet their specific needs and use cases.

8

Competency framework structure

Let’s preface this by saying that there are many different reasons and uses for competency frameworks, as outlined in the previous chapter, and there are multiple ways to build a framework depending on its ultimate purpose. At a minimum, if you have a number of competencies and some form of organization or structure, you have a competency framework but each component within the framework has a specific purpose. These components include, but are not limited to:

- competencies,

- structures and hierarchies, and

- connections between competencies, learning resources, and assessments.

Competencies and Competency Descriptions

These are the fundamental building blocks of any competency framework. We talked earlier about the importance of defining competencies and what the different parts of a competency description do. Competencies themselves form the basis for evaluation and inform learning and training needs; however, without a defined structure and organization competencies are limited in how effectively they can be used. Imagine a pile of building materials without any plans, and you have an analogy for competencies without structures.

Structures and Hierarchies or Taxonomies

In order to make individual competencies particularly useful to the end user, they need to be organized in a logical fashion. We’ll talk more about grouping and clustering competencies in the next chapter, but structures and hierarchies may include:

- Framework levels / layers of information that are well-defined. Flatter structures are easier for the end user to understand, and the sequence and format of how information is presented needs to make sense as well. Levels and layers may include a convention for combining competencies into larger and larger groupings, or a system that allows for the tagging or tracking of competencies across multiple groupings.

- Competency groupings that are logical and not duplicative. The same competency may belong to multiple groupings in different contexts, but no two competencies should be the same. If the scope or complexity is different for different job roles or individuals, then those should be written as separate competencies.

- A naming/coding convention that is defined and not limiting for scalability. Again, competencies need to be unique, but a naming or coding convention that limits scalability can be problematic. For example, many occupational frameworks will use a convention that includes letters and numbers (A1, A2, A3, etc.). When revising the framework at a later date, there is often a desire to re-organize information, causing a shift and re-coding of all of the competencies (e.g. a new competency is added between A1 and A2, so everything downstream needs to shift). While this problem will never fully go away, thinking it through early can help.

- Terminology, definitions, and use of language are consistent throughout the framework. Often people use words interchangeably to mean the same thing. A glossary and then diligence in using the same words consistently are exceptionally helpful. Even if there is disagreement on the definition, having a definition itself provides clarity.

- Here’s an example: While developing a culinary framework – the use of “cooking method” and “cooking technique” were often used interchangeably; however, when experts were asked to create competencies they often used the terms differently in particular contexts. The lack of shared understanding created challenges when designing the competency framework. The team ultimately decided that unique definitions were required for the terms.

Connections

In addition to structures and hierarchies, connections between competencies, assessments and training/learning are important in creating holistic assessment and determining learning/training requirements. Connections between similar competencies either in the same framework or in a different framework create pathways for career progression and transferability. As an example, a competency about working safely in one industry sector or occupation could be linked to a similar competency in a different occupation or sector, and include information about any gap training or up-skilling required due to difference in scope or application.

9

Grouping and clustering competencies

The grouping and clustering of competencies can take a variety of forms, and often this is done according to an occupation or a job role. That is not to say that there is only one way to cluster groups of competencies, and creating structures that allow for competencies to be applied across different industries, occupations, and roles is important when designing a common competency framework. Competencies and groups of competencies can also be used for the purposes of designing training and credentialing, which may or may not align directly with the needs of a specific workplace, occupation, or sector.

Some different approaches that are commonly used include:

- Competencies grouped by theme. This might include categorizing competencies into main competency areas, such as Interpersonal Skills, Workplace Safety, Computer Skills, Project Management, etc.

- Competencies grouped by workplace and/or job role. Often this will include common cross-functional competencies (ones that all people within an organization need) and technical or functional competencies that apply to specific work activities and job roles.

- Competencies grouped by occupation. This is common when frameworks have been developed for the purposes of certification or licensing. This may also include sub-groupings by theme or job role in occupations where there is a lot of specialization.

- Competencies grouped by industry or sector. This approach is similar to the way competencies are grouped for a workplace or for job roles, but on a much larger scale. These frameworks often have common shared groupings of competencies that apply across occupations but also specific groupings of competencies that apply to an occupation or occupations within a sector.

There is no universal approach to grouping competencies, and most large frameworks will have competencies categorized in multiple ways. For example, a framework for an occupation may also break down the competencies used in that occupation according to themes or groupings of related competencies. Large competency frameworks often rely on the use of metadata such as keywords and tags to cross-reference information, but also rely on technology such as a web-based interface connected to a database or library of competencies. What becomes increasingly important, especially the larger a framework, is that the information can be tracked and managed effectively, and that individual competencies are viewed as building blocks for larger structures.

To understand how competencies act as a building blocks, think of the difference between a jigsaw puzzle and a Lego® set. Both are comprised of pieces that are designed to fit together to form a larger whole, but a jigsaw puzzle only has one possible combination. A Lego® set, even if purchased to assemble a specific project, has pieces that can be disassembled and rearranged in an infinite number of ways to form new structures.

Here is an example of related competencies, and how they can be viewed as a group covering one topic; a larger group with subdivisions for multiple topics; as a group split into two separate competency units aligned with different roles and levels of responsibility; or as an individual competency. This group of competencies, arranged by theme, might apply to multiple job roles or to an occupation or sector as well.

Example 1: As a group of related competencies

This example shows all of the workplace safety competencies within a framework.

Example 2: Competency groupings rolled up  into larger themes or categories

This example shows how the Workplace Safety competencies might be a part of a larger category or theme within a framework, such as common core competencies that all workers must have, regardless of job role or occupation.

Example 3: As a smaller grouping (units) related to different job roles

This example separates out the workplace safety competencies that apply to all workers, and those that may only apply to managers and others responsible for the workplace’s safety system.

Example 4: One Competency in detail

Here’s an example of one competency from the previous list in detail, including the expected behaviours (performance criteria), supporting knowledge and skills, and some key terms and definitions.

Adding Context and Examples:

Descriptions of context with accompanying examples may appear in a framework as additional information about a group of competencies or a specific competency, depending on the structure and intended use of the framework. This can be helpful in highlighting how the competencies are applied in the real world, identify any new and emerging trends, or to help those in designing realistic ways to assess the competency or group of competencies. For example, safety competencies are often evaluated in conjunction with other activities, as they are used regularly and for a number of different tasks.

Examples:

(This applies to the whole group of workplace safety competencies.)

- Working safely is critical to all workplaces. There are different requirements and regulations in place for employees and employers, but everyone has a responsibility to contribute to a safe workplace environment.

(These apply specifically to using hazardous materials.)

- Workers may use hazardous materials for task such as cleaning and sanitizing, and must do so safely. This may include mixing or diluting concentrated chemicals according to the instructions provided by the supplier.

- Supervisors and managers are also responsible for ensuring that everyone has the proper training and knows where to find specific information on the safe use of each hazardous material found in the workplace.

III

Using Competencies

In this section, we’ll look closer at how competencies are used within a framework. We’ll start with some specific use cases and examples, and then look at how these relate to the broad uses we discussed in the first section.

In this section:

Use cases

Workforce development: relating competencies to job roles, activities and tasks

Training and learning: relating competencies to formal and informal learning activities

Assessment: relating competencies to evaluation of performance

Credentials: relating competencies to formal credentials, micro-credentials, and professional designations

Other use cases

10

Use cases

There are many use cases for competency frameworks, which will determine how you go about creating or adapting your framework. We have identified some different use cases to give you an idea of how people use  competency frameworks.  We framed these use cases by asking the following questions:

Who will be using the toolkit?

What problem are they trying to solve?

What context will they be using it for?

How will this help?

The examples in the following pages illustrate how a competency framework can be used for a variety of applications. We will be relating them to the four major themes we identified earlier.

Context

Use

Training and Learning

Developing individuals and teams through teaching and learning activities

Assessment

Evaluating individual and team performance in formal and informal ways

Credentialing

Recognizing achievements and issuing records of achievement

Workforce Development

Identifying individual, organizational and sectoral needs, career planning, and managing talent

These of course, are interrelated, as competencies relate to job roles and work activities/tasks, training, and assessment.

11

Workforce development

Relating competencies to job roles, activities and tasks

High level context: Job roles are generally defined around assigned tasks and activities, and therefore, the competencies required to perform in the role. These may be used to recruit people with the competencies required for a certain role, to identify emerging skill needs, and to coordinate ongoing talent management such as career growth and succession planning.

Examples:

Who: Employer

What problem: The organization has grown and it’s difficult to describe and evaluate job roles and performance expectations across departments.

What context: I would like to develop a set of defined competencies that everyone in the organization needs to address all the tasks involved. Also, competencies specific to job roles and work activities are required.

This will help: By providing templates and resources to help us develop these competencies internally, using vetted and validated approaches

Who: Industry group in an emerging field

What problem: There is no consistent and validated information on the occupations in our emerging field, making it difficult to convey our workforce development needs

What context: I would like to develop a set of defined competencies and typical job roles/occupations in our field so that there is consistency across the industry

This will help: By providing a validated approach to developing competencies and competency frameworks, we will define our occupations in a way that has been developed and reviewed by national contributors

Both of these use cases focus on developing competencies in relation to activities and tasks in the workplace. To help you define the competencies required for an activity or task it’s important to understand the difference between the two.

Task and activities both require competencies to perform or complete them, but generally speaking:

- Activities are broader than tasks.

- Activities are comprised of tasks, (i.e. tasks are used to perform/complete activities).

- Tasks always have a beginning and an end, and may be sequential, but are not always so.

- Tasks may also have sub-tasks (i.e. things that must be done to complete a task).

This understanding of the relationship between competencies and activities and tasks is important when it comes to creating competencies. To determine the competencies required to perform an activity, you need to watch or speak with someone who knows how to complete the activity. Normally, the person(s) will show you (or outline) a set of tasks that are needed to complete the activity. At this point, you will be able to start identifying the competencies (e.g. knowledge, skills and attributes) that are required to successfully complete the activity.

You will probably find that many of the tasks that you identify will also help you to determine how to assess the performance and determine any training requirements. This helps to frame your competencies.

Example

Let’s look at an activity that  many of us do every day – prepare and serve a meal.

Preparing a meal is an activity, which may include several tasks:

- Find the recipe(s)

- Gather the ingredients

- Prepare the main dish(es)

- Prepare any accompaniments, such as side dishes or sauces

- Select any beverages

- Set the table

- Serve the food, either plated individually or served family-style

- Clear the table

- Clean up in the kitchen

What are the competencies we need in order to complete this activity? Preparing a meal is not a competency, but it does draw on certain competencies that apply to all cooking and/or baking activities:

- Use recipes to prepare food

- Use kitchen tools and equipment

- Use cooking and baking methods

- Follow safe work practices

- Follow safe food handling procedures

Process for creating competencies related to work activities::

1. Identify the main activities and tasks that are being performed.

2. Determine the underlying skills, knowledge and attributes required to perform each of those activities.

3. Look at how the same skills, knowledge and attributes are used across multiple tasks, and can be grouped together to form competencies.

4. Identify performance criteria for each of the competencies.

12

Training and Learning

Relating competencies to formal and informal learning activities

High level context: Competencies provide clear definitions of expected performance, and therefore can be used to inform the training and learning needs of individuals, teams, and organizations. Training and learning may be formal, such as structured courses and programs of study, or informal, such as a personal development plan in the workplace.

Examples:

Who: College or university teams (curriculum developers, teaching and learning centres, faculty, continuing education leaders, Deans)

What problem: We have heard that we need to incorporate competencies into our programming, but don’t know what that means.

What context: Hoping to build competencies into new programming, or approach existing programming with a competency lens to “uncover” latent competencies that may be eligible to turn into micro-learning opportunities.

This will help: By providing a baseline of information to understand how to identify and speak about a competency vs. a learning outcome.

Who: Employer (e.g. HR department, Managers, Executives)

What problem: We need to connect ongoing professional development to our organization’s needs and job roles.

What context: I would like to develop a professional development framework for all of our employees that can link the competencies we need with both internal and external training.

This will help: By providing a validated process to align competencies with formal learning and training needs.

Learning Outcomes and Competencies

If you are working in the training and learning sector, you might have been challenged with trying to explain the difference between a competency and learning outcome.  Learning outcomes relate closely to competencies and often sound very similar. However, there are two major distinctions.

1. Competencies describe what someone can do, but not how the competency was developed (i.e. A competent individual can…) Learning outcomes describe what someone can do as a result of a learning activity (i.e. Upon completion of this course, the learner will be able to…)

2. Competencies can be developed through formal learning or not. The purpose of a competency is to describe a desired level of performance/ability in relation to activities. Someone may be able to demonstrate the competency without a learning intervention, through self-directed learning and repetitive practice. Learning outcomes always include a learning intervention.

Learning outcomes may encompass one or many competencies in order to achieve the outcome and the competencies may be repeated in multiple contexts. For example, developing competence in problem-solving may be carried out over a number of courses associated with various learning outcomes.

Using competencies to inform learning

Process:

- Review competencies and supporting information

- Identify performance criteria and supporting skills and knowledge

- Will there be formal training required for the competency, or can it be developed over time through informal learning and coaching?

If no formal learning is required:

- Provide some context in how the competency can be developed through self-directed learning and repetitive practice

If formal learning is required:

- Determine scope of learning – will it cover some or all of the competency, or multiple competencies?

- Draft learning outcomes and determine relationships to competencies

- Determine learning objectives to support the learning outcomes

- Develop learning activities and lesson plans aligned with the learning objectives

A few questions to consider for formal learning:

- Does the learning outcome include both the context of an activity and a performance standard?

- Does assessment of the learning outcome include observing performance over a period of time and in real-world conditions?

- Is further practice required outside of (or following) the learning activity in order for someone to develop competence?

If the learning activities and outcomes are designed as a component of developing underlying skills and/or knowledge, but will not result in the ability to demonstrate all of the performance criteria for the competency, then any criteria that need to be developed externally should be identified.

The Learning Design Canvas in the Templates section is a helpful tool to get you started.

13

Assessment

Relating competencies to formal and informal evaluation of performance

High level context: Assessing competencies is critical when determining performance proficiency. It’s important to ensure that competencies are being measured in context with the activities and tasks that require them, and by the individuals and teams using them.

Examples:

Who: Professional association or licensing body

What problem: Skill and competency profiles from different jurisdictions vary in both scope and language, making it difficult to assess similar credentials at face value.

What context: We are developing a framework for evaluating the skills of trained professionals from different jurisdictions against a consistent standard for practice.

This will help: By providing a consistent strategy to assess competence against a defined industry standard.

Who: Employer (e.g. HR department, Managers, Executives)

What problem: We need to connect ongoing professional development to our organization’s needs and job roles.

What context: I would like to integrate assessing competencies required for different roles into our ongoing performance management process.

This will help: By providing a validated process to align competencies with formal learning and training needs.

Assessment and evaluation have different contexts and meanings, depending who you ask. For some, assessment is formal, and evaluation is a more casual, ongoing activity, and for others it’s the reverse. In either case, competencies include supporting information (e.g. performance criteria), which form the basis for assessment, whether through a formal testing process, or through a combination of observation, reflection, and feedback.

What is critical in determining assessment approaches are ensuring:

- Linkages between performance criteria and appropriate assessment methods.

- The importance of alignment – are you evaluating what is being asked for in the performance criteria? Are you drawing on the underlying skills and knowledge for scope?

- Scope – you must be assessing all of the performance criteria in one way or another. Using a holistic assessment approach, you may be able to assess multiple competencies at the same time.

Process:

- Review competencies and supporting information

- Identify performance criteria and supporting skills and knowledge

- Determine how each of the performance criteria could be assessed (e.g through direct observation, self-assessment, testing, etc.)

- Determine the assessment approach

- Will formal assessment be required for this competency?

- Are there other competencies that could also be assessed at the same time (e.g. tasks that require multiple competencies)?

- How will assessments be recorded and graded? Do you have a rubric or specification tied to a proficiency scale?

This toolkit is not intended to specifically provide guidance in the development of formal assessments, but since assessment may be an intended use of your competency framework it bears mentioning a bit about using proficiency scales and rubrics here.

Using proficiency scales and rubrics

Proficiency scales and rubrics are key to formal assessment of competencies. Because much of determining competence is related to observing real-world performance, it is important to do everything possible to remove subjectivity from the assessment process.

Proficiency scales set out the range of assessment. They can be very simple – such as a competent/not competent or pass/fail approach, or have multiple levels such as the typical “beginner to expert” scale illustrated earlier. Some assessment approaches will use a numerical scale (e.g. from 1-5 or 1-10, or a percentage), but in any case a rubric is necessary to set the criteria for those doing the assessment. The type of scale usually is linked to the nature of the competency – for example, the assessment of competencies related to safety and high-risk activities often have a binary pass/fail scale attached. You either work safely or you don’t, and there may be a specific threshold that needs to be met to ensure the safety of everyone.

Rubrics specify how to assign a rating to the proficiency scale. For a binary pass/fail they should be specific enough to identify and clarify what was or was not demonstrated during the assessment in order to achieve the result, and for a scale with multiple levels, detail the criteria specific to the attainment of each level. Rubrics are also helpful for people using competency frameworks for ongoing professional development or performance reviews, as they provide detailed information about what is expected.

14

Credentialing

Relating competencies to formal credentials, micro-credentials, and professional designations

High level context: Recognizing achievement of competencies is an integral piece of many occupational designations and ongoing professional development.

Examples:

Who: Professional association or licensing body

What problem: Skill and competency profiles from different jurisdictions vary in both scope and language, making it difficult to compare similar credentials.

What context: We need to ensure that those working in our profession have a consistent set of competencies in order to practice professionally.

This will help: By providing a validated approach and structure for developing a competency framework that is linked to both formal credentials and ongoing professional development needs.

Who: College or university teams (curriculum developers, teaching and learning centres, faculty, continuing education leaders, Deans)

What problem: We don’t know how to map our competencies together and how to categorize them in a way that will make sense to grant administrators.

What context: Preparing a grant application to develop multiple micro-credentials that ladder into regular programming.

This will help: By providing a structure to map existing competencies to and demonstrate relationships between them.

A common use for competency frameworks is in defining and relating competencies to licensing requirements and professional designations, which include both formal credentials (such as those issued by a college/university, or regulatory body) and required ongoing professional development (such as endorsements or micro-credentials).

Stucturally, this use of a competency framework is based on workplace and job roles, but the linkages to credentials may vary greatly. In some cases, there are prerequisite educational requirements or credentials that precede entry into an occupation, and these may not necessarily be captured in the competency framework. In other cases, entry to practice has no formal credential requirement, and competencies are developed through a combination of formal learning and on-the job experience.

How competencies are applied in both of these situations are similar, in that there are generally a set of common competencies that apply to a range of activities, or include behaviours expected across the occupation. There is also a work activity/task based structure that identifies the competencies used for different roles and areas of specialty, and in many cases there is a requirement for ongoing re-certification or licensing to ensure currency in the field is maintained.

Relating competencies to credentials

Process:

- Identify any pre-requisite training or certification requirements. These may or may not be linked directly to competencies within the framework.

- Identify the scope of the different credentialing pathways – are you looking to issue credentials based on the achievement of specific competencies, or are you looking to link external credentials to competencies within the framework?

- Are there requirements for re-certification and/or continued professional development?

- Are there endorsements or specialties that could be best defined by micro-credentials or digital badges?

- What is the relationship between the credentials and work activities – are credentials being based on the ability to perform specific activities, or a range of activities? If so, then what are the competencies required?

15

Other use cases

High level context: There may be other uses for competency frameworks including uses for policy makers and others that are indirectly related to one of the main categories we have already mentioned. This includes the use of competency frameworks as a valuable research tool.

Examples:

Who: Funding body or agency

What problem: There is no authoritative source to refer my grant applicants to ensure that the applications I get back have a consistent definition and application of competency.

What context: I am developing a funding call for micro-credentials and I want them to all be competency based.

This will help: By providing an authoritative and vetted source of information on competencies that has been developed and reviewed by national contributors.

Who: Student or job seeker

What problem: There is an overwhelming amount information being presented to me about career options and I don’t know where to get a real understanding of different careers.

What context: I would like to know which careers align best with my skills and interests

This will help: By providing clarity on how to interpret competency frameworks and other sets of occupational standards that have similar structure.

Competency frameworks contain valuable information about work activities, the required skills, knowledge and attributes, and educational requirements of different occupations and sectors. Competency frameworks can also be very confusing to interpret, and understanding how they are constructed can help to demystify them.

IV

Developer’s Guide

This section is dedicated to those who are tasked with creating competency frameworks. It includes some guidelines and best practices, as well as more detailed information on how to use and adapt the templates and samples provided to support your development (or evolution) of a competency framework.

In this section:

Where to start

Adapting an existing framework

Creating a new framework

Sample competencies

Sample competency framework structures

Putting it all together

16

Where to start

Whether you are planning the development of  a brand new competency framework or looking to use the toolkit to update or revise an existing one, there is a recommended process and considerations to ensure that you get the most out of your effort. We will look at these a little further from two points of view in the next chapters:

1. Revising an existing framework

2. Developing a new framework.

Whether you are creating or revising a competency framework, the process is much the same. However, for each stage there will be more or less emphasis on certain activities depending on your context.

Below is an outline for the overall process of developing a competency framework.

Process Steps and Considerations:

(Click on each process step heading to show/hide the details for that step)

Planning

Templates for this stage: Competency Framework Development Canvas

Included in this stage:

- Discovery – use case, scope, format, etc

- Background research

Important considerations at this stage:

- Determine the purpose from the onset – what problem(s) are you trying to solve by using the toolkit?

- What is the purpose or use of the competency framework?

- Who is the end user? What is their understanding of competencies?

- Do you need a simple framework, or can it be something more complex?

- Does anyone else have a framework/competencies that you could use?

- Has anyone else developed one you really like?

- It is often easier to repurpose and adapt something rather than create from scratch.

Development

Templates for this stage: Competency Authoring Template  and Competency Framework Development Workbook

Included in this stage:

- Task analysis

- Consultation with subject matter experts

- Determining structure and groupings within the framework

- Validation with stakeholders

Important considerations at this stage:

- Who do you need to talk to if there are no competencies developed for the role or context? Which experts do you need to call on?

- Ensure input from a broad group for validation, including those who participated initial development.

- Manage scope changes – some may be necessary but keep the objectives in view

- Goldilocks approach in defining competency and activity groupings (not too big, not too small)

- Input and validation need to capture a wide range of perspectives, and be checked for unconscious bias.

- Who is the framework for?

- How will they use it?

- Did we invite them to participate in developing it? If not, how do we ensure their input during validation?

Implementation

Included in this stage:

- Final editing

- Preparing for distribution (print, digital layouts)

- Publish framework

- Socializing/promoting to intended audiences

Important considerations at this stage:

- Which formats are your publishing your framework on?

- Flexibility and adaptability – these have to be “living documents”

- Does the framework need to allow for additions later on?

Evaluation

Included in this stage:

- Review and planned revision cycles

- Feedback on usability and any errors or omissions

- Monitoring for changes that may impact the competency framework (changes in technology, occupational scope, etc)

Important considerations at this stage:

- How rapid is the pace of change related to the framework?

- How easy is it to make edits and update the framework?

Sustainability

Included in this stage:

- Ongoing maintenance

- Funding model

Important considerations at this stage:

- Who owns it?

- Where does it live?

- How will it be maintained?

17

Adapting an existing framework

Adapting an existing framework with the toolkit

Perhaps your competency framework is due for revision, or you have had some feedback that your current format is not meeting the needs of some of your users. Whatever the case may be, you can use this toolkit and the templates as a resource to plan and revise an existing framework.

Process Steps and Considerations

(Click on each process step heading to show/hide the details for that step)

Planning

Templates for this stage: Competency Framework Development Canvas

Main activities at this stage:

- Discovery – review the toolkit and determine what sections apply to the competency framework for revision

- Identify any missing information (may be in related documents and/or resources) in the framework. For example, do the competencies contain performance criteria? Supporting information about skills, knowledge and context? Links to training, courses and/or learning resources? Are assessment methods identified?

- Background research – gather existing documentation and known missing information

Important considerations at this stage:

- Determine the purpose from the onset – what problem(s) are you trying to solve by using the toolkit?

- What is the purpose or use of the competency framework?

- Who is the end user? Has that changed over time?

- Is your current framework simple or complex? Does that need to change?

- Does anyone else have a framework/competencies that you could reference?

- Has anyone else developed one you really like?

- It is often easier to repurpose and adapt something rather than create from scratch

- Beware of development fatigue and a need for change management strategies.

- Is anyone resisting change to the framework?

- Are you continually going back to the same small group for input?

Development

Templates for this stage: Competency Authoring Template and Competency Framework Development Workbook

Main activities at this stage:

- Task analysis – what’s changed since last time?

- Map current competencies and categories to templates. Consider the following:

- Taxonomy levels – How many are there? Does the taxonomy make sense considering the purpose?

- Can you identify the competencies in the current framework? If not, what is considered a competency and how does it fit into the definitions in the toolkit?

- Language usage- what is defined as a competency in the current framework as compared to the toolkit? You might need to do some ‘translation’ to understand what’s missing.

- Work with stakeholders to populate missing sections; take opportunity to examine wording and structure for usability

- Consultation with subject matter experts – ensure there are some new faces and some involved in previous work

- Validated revised framework with broader stakeholder group

Important considerations at this stage:

- Ensure input from a broad group for validation, including those who participated initial development.

- Manage scope changes – some may be necessary but keep the purpose of the framework in view

- Use a “Goldilocks” approach in defining competency and activity groupings (not too big, not too small)

- Input and validation need to capture a wide range of perspectives, and be checked for unconscious bias.

- Who is the framework for?

- How will they use it?

- Did we invite them to participate in developing it? If not, how do we ensure their input during validation?

Implementation

Main activities at this stage:

- Final editing

- Preparing for distribution (print, digital)

- Publish revised framework

- Socializing/promoting to intended audiences

Important considerations at this stage:

- Which formats are you publishing your framework in? Are the same as before or are you using different channels after the revision?

- Flexibility and adaptability – these have to be “living documents”

- Does the framework need to allow for additions later on?

Evaluation

Main activities at this stage:

- Plan a revision cycle and frequency after publication – useful for both ensuring currency and engagement of stakeholders

- Gather feedback on usability and any errors or omissions. Did you accomplish the changes you set out to make?

- Monitor for changes that may impact the competency framework (changes in technology, occupational scope, etc)

Sustainability

- Ongoing maintenance – what have you learned from previous revisions that can be applied in the future?

- Funding model – do you have the resources to keep the framework current?

- Who owns the framework and is responsible for maintaining it?

18

Creating a new framework

Creating a new framework using the toolkit

If you are building a new competency framework, you are likely not creating everything from scratch. There may be some existing information to draw from, but the toolkit can help you work through the process and provide templates for different stages of the process.

Process Steps and Considerations

(Click on each process step heading to show/hide the details for that step)

Planning

Templates for this stage: Competency Framework Development Canvas

Main activities at this stage:

- Discovery – what can using the toolkit help you achieve?

- Define scope and context of framework – primary users, applications, and purpose/goals using the framework development canvas template

- Conduct literature review/environmental scan – research on what already exists. Are there frameworks out there that you can leverage?

- Review technical requirements if you are using a software application to create the competency framework

- Define clear guidelines and procedures for development

- Set up project structure and team (e.g. Do you need a project manager/lead? Who will be the subject matter experts that you call on? Do you need a writer? An instructional designer?)

Important considerations at this stage:

- Who do you need to talk to if there are no competencies developed for the role or context? Which experts do you need to call on?

- Determine the purpose from the onset – what problem(s) are you trying to solve by using the toolkit?

- What is the purpose or use of the competency framework?

- Who is the end user? What is their understanding of competencies?

- Do you need a simple framework, or can it be something more complex?

- Does anyone else have a framework/competencies that you could use?

- Has anyone else developed one you really like?

- It is often easier to repurpose and adapt something rather than create from scratch.

Development

Templates for this stage: Competency Authoring Template and Competency Framework Development Workbook

Main activities at this stage:

- Use a facilitated development process to define competencies and framework structure. Options may include:

- Job role and task analysis with Subject Matter Experts (SMEs)

- Broader research instruments – surveys, interviews, focus groups

- Confirm purpose of framework and targeted audience with SMEs

- Review technical requirements if using a software application to build the framework. Ensure that the competency framework fits the software’s purpose and capabilities rather than ‘fitting’ the framework to the software

- Start with a high level list of competencies and groupings and work to a more granular level

- Work with stakeholders/contractors to populate templates using iterative design process

- Manage scope changes – sometimes change may be warranted, but also can derail processes

- Ensure input from a broad group of stakeholders and SMEs. Be conscious of internal bias and adequate representation.

- Validate framework with broader stakeholder group

- Revise framework based on stakeholder feedback

Important considerations at this stage:

- Ensure input from a broad group for validation, including those who participated in initial development.

- Use a “Goldilocks” approach in defining competency and activity groupings (not too big, not too small)

- Input and validation need to capture a wide range of perspectives, and be checked for unconscious bias. Questions to ask:

- Who is the framework for?

- How will they use it?

- Did we invite them to participate in developing it? If not, how do we ensure their input during validation?

Implementation

Main activities at this stage:

- Final editing

- Preparing for distribution (print, digital)

- Publish revised framework

- Socializing/promoting to intended audiences

Important considerations at this stage:

- Which formats are your publishing your framework on?

- Flexibility and adaptability – these have to be “living documents”

- Does the framework need to allow for additions later on?

Evaluation

Main activities at this stage:

- Plan a revision cycle and frequency after publication – useful for both ensuring currency and engagement of stakeholders

- Gather feedback on usability and any errors or omissions

- Monitor for changes that may impact the competency framework (changes in technology, occupational scope, etc)

Sustainability

Important considerations at this stage:

- Ongoing maintenance – Who will be responsible? Who ‘owns’ the framework?

- Where does it live? How do people access the framework? Are they using it?

- How will it be maintained? Do you have the resources to keep the framework current?

19

Sample competencies

This section provides some sample competencies  that have been created using the templates in the toolkit. We have selected five categories of competencies to illustrate the following:

- The competency structure (e.g. statement, performance criteria, supporting skills and knowledge, etc.); and

- How the competencies can be applied to different contexts, occupations and job roles.

The sample competencies are listed under each of five categories (or specific areas of competency) listed below:

The sample competencies listed on this page may be downloaded for you to use and/or adapt for your specific purpose. Feel free to download each competency and adapt it to suit your purpose(s).

Click here to download all of the examples and templates in one folder. (Link opens in new tab)

Suggestions for editing/customizing the examples:

- Determine whether or not you have the ability to keep glossary definitions in one location and then hyperlink the text – you will see that many terms and definitions are used in multiple competencies.

- Review the context and examples section, and customize them for your specific use case. We have provided generic examples to suit this purpose.

- Customize the generic language, such as “according to workplace procedures” to more specific language if it makes sense to do so (e.g. according to Organization XYZ ‘s policies and procedures).

- Insert appropriate links to your specific training and learning resources.

- Amend the assessment methods to suit your needs.

Occupational Health and Safety (OHS) Competencies

Every workplace has requirements for health and safety. While the context and level of risk changes by work environment and job role, these competencies should be applicable in most workplaces. A list of sample competencies follows below and have been categorized based on common core and supervisory contexts. Click on the link to each competency for an example of how it has been defined using the competency template in this toolkit.

Common Core Competencies (apply to everyone)

- Follow Workplace Safety Procedures

- Use Personal Protective Equipment

- Handle Hazardous Materials

Supervisory Competencies (also for those in OHS-related roles)

- Develop OHS System

- Monitor OHS System

- Maintain OHS System

Competencies Related to Working Remotely

This set builds on many competencies that apply to many workplaces, but the recent pandemic and resulting changes in how we have worked have heightened certain competencies.

The COVID-19 pandemic has forced many people to change the way they work. For many, working remotely is now the norm resulting in the need to transfer skills to complete work tasks from afar. The sample competencies outlined in this section can be applied to any work context; however, they may be applied in a new way given the demands of working remotely. For example, the use of communication equipment and technology has dramatically increased for some people, as has the increased focus on accountability and adaptability. For leaders, managing a team remotely has meant developing new ways to approach work and to keep people engaged while remaining productive.

Common Core Competencies (apply to everyone)

- Work with Other Team Members

- Communicate Effectively with-Others

- Use Communication Equipment and-Technology

- Plan and Organize Own Work

- Demonstrate Accountability

- Demonstrate Adaptability

Supervisory Competencies

- Coordinate Remote Team

- Provide Guidance to Remote Team

- Monitor Remote Team

20

Sample competency framework structures

Competency framework structures can vary from the very simple to the extremely complex. There is no one way to create a competency framework structure; however, there are better structures than others depending on the intended use. When developing the framework structure, it’s important to consider the purpose and the users of the framework. Does the framework need to be simple in structure for people to use and/or understand? Or do you need to develop a more complex structure to fulfill all the requirements of the intended uses?

Information Hierarchies or Taxonomies

Managing information, especially a lot of complex information is critical to making a competency framework useful. Most frameworks will have a defining structure or taxonomy that organizes competencies (and other information as well) from broad groupings into more and more specific groupings. Depending on the framework  there may be multiple taxonomies, each with its own purpose. At a minimum, individual competencies should be grouped in a logical manner, and in a way that makes the information easy to find and organize.

Examples of Taxonomies:

Competencies sorted into categories using a structured taxonomy:

- General Area of Competency (GAC) – The broadest category of grouping within the framework. There should be a limited number of GACs within a framework. If there are more than 10, can any of them be grouped differently?

- Specific Areas of Competency (SAC) – Each GAC may have a smaller number of specific areas of competency within it.

- In a large framework there may also be small gradations (i.e. more specific areas of competency or “sets” of competencies).

- Competencies – Each SAC will have a limited number of competencies. Each competency will contain both a competency statement and supporting information, such as performance criteria

Specific Example (Culinary Arts Framework)

- Safety and Sanitation (GAC)

- OHS Competencies  (SAC)

- Workplace Safety (Set)

- Use Personal Protective Equipment (Competency)

Typically, each of the groupings should be logical and manageable. 3-5 competencies in a specific area of competency, and 3-5 SACs in a GAC are a good rule of thumb. If you only have 1 or 2 , then look at how these might be combined with other groupings. If you have 6 or more, consider how they might be divided.

Another way that taxonomies are found in a framework are those organized by work activity or job role/position. Similarly, these may have sub structures.

Taxonomy Example

Specific Example

By work activity

- Major work activity

- Specific work activity

- Task

- Sub-task

Carpentry

- Builds wood frame structures

- Framing

- Constructs wall systems

- Builds dimensional lumber wall system

By occupation

- Occupational group

- Occupation

- Occupational specialty

- Job role/level

Medical Occupations

- Medical practitioners

- Physicians

- Family Physician

- Resident (General Practice)

By organization

- Department

- Team

- Position

- Responsibilities

Large Organization

- Finance and Admin

- Accounting

- Junior Accountant

- Manage client accounts

Common Core Competencies

Many frameworks have a set of common core competencies (they might also be referred to as ‘foundational’ competencies) that might apply to a broad range of occupations, job roles, or activities. These often include things like Health and Safety or Interpersonal Skills and may be coupled with requirements for on-boarding or pre-employment training, or tie into well-defined sets of employability skills or essential skills.

Some common core competencies may not be tied to specific occupations or activities. These competencies typically describe attitudes and values that must be used when undertaking any activity. Some people refer to these competencies as social-behavioural; for example, competencies that require a person to conduct activities with a specified attitude. These would be considered overarching to the rest of the occupation-specific or activity-specific competencies.

Competency and Work Activity Matrices

For many frameworks, particularly those linked to occupational performance, there is a need to provide a distinction between the work activities being performed and the competencies that support them. For these, there tends to be a matrix approach where the activities (and tasks that are required to complete the activities) are cross-referenced to a set of competencies. Within this type of structure, the competencies may also have their own hierarchy and groupings. In a framework that contains such a structure, assessments and learning are often aligned with the activities, as opposed to the competencies. Mapping the competencies to the activities will help you identify logical groupings that will help build your competency framework.

Competency layers/scaffolding

Within a group of competencies, there may be relationships that structure some competencies as more advanced, or requiring other competencies as prerequisites. For example, many leadership or supervisory competencies build on foundational competencies or those required for a certain activity. In this example, one must have all of the workplace safety competencies in order to manage the OHS system for the workplace. There may even be additional more advance competencies that only relate to OHS specialists, such as auditing and developing training.

Sample Frameworks

Here are some examples of existing frameworks that use some or all of these structures.

ESDC Skills and Competencies Taxonomy

Essential Competencies for Midwifery Practice

Toronto Region Immigrant Employment Council’s Inclusive Workplace Competencies

IT Professionalism Europe’s e-CF Explorer

European Skills/Competences, qualifications, and Occupations (ESCO)

21

Putting it all together

Ok, so now that you have all of your competencies defined, how do you turn all of that into a completed framework? In order to make a framework usable it needs to contain all of the information necessary for the end users, and be presented in away that it is understood by them as well.

Introductory material

Most frameworks, particularly if there will be a print (or digital downloadable) version available will  have some introductory material. Web-based frameworks will generally have a landing page or pages with the same information.

This should include:

- Purpose of the framework, such as intended audience and how it is intended to be used

- User guide – i.e. how to read and/or interpret the information

- Visual representation of the framework structure and/or individual competencies and/or competency groupings

- Background information, such as why and how the framework was developed and who contributed to the development and validation.

Body

This is the main content of the framework.

This should include:

- Competencies, organized into categories and other groupings as appropriate

- Additional content, such as role and task descriptions linked to specific competencies or groupings, assessment criteria and rubrics, and additional information that support both the purpose and use of the competencies.

Depending on the complexity of the framework, you may decide to aggregate some common information from competency groupings, such as supporting knowledge and skills that apply to multiple competencies, or context in how a group of competencies is utilized. The goal is clarity and presenting the framework is a way that the end user can access and understand the information easily and for their intended purpose.

Appendices

Appendices are a good way to store aggregated information that applies to the framework as a whole.

This might include:

- Glossary of all of the key terms and/or acronyms used in the framework

- Links and references to additional resources

1

Templates

Click here to download all of the examples and templates in one folder. (Link opens in new tab)

Individual templates and their uses are identified below:

For use in the planning phase:

Competency Framework Development Canvas

What it is: This tool is useful for planning a competency framework, by capturing the intended audience, as well as information you need to develop and maintain your framework

Learning Design Canvas (with instructions)

What it is: A version of the development canvas tool can also be used to design learning, either to go with a competency framework or independently

For use in the development phase:

Competency Authoring Template (blank)

Competency Authoring Template (with instructions)

What it is: This template includes all the fields used for the sample competencies. The version with instructions has some annotations about what to put in each field, and the blank versions is there for you to populate. In practice, it’s easiest to use this template to detail specifics for each competency, and use the workbook below to provide a high level overview of the framework and look for overlap or duplication.

Open Competency Framework Development Workbook

What it is: These spreadsheets allow you to to capture the information about all of your competencies and your framework structure in one place.

2

Glossary

activity

Something that an individual or team undertakes effort to complete. Activities may be broad and ongoing, or may require a number of specific tasks, each of which may have its own beginning and end.

competence / competent

The ability to do something successfully or efficiently

competency (pl. competencies)

The specific and measurable combination of knowledge, skills and attributes that result in the performance of an activity or task to a defined level of expectation or performance standard.

competency frameworks

A combination of well-defined competencies and hierarchical information on how competencies are grouped and connected to work activities, job roles, assessments and more for various applications.

competency groupings

A set of more than one defined competencies that create a larger component within a competency framework or for a particular use. Competency groupings may be hierarchical and have several layers of sub-groupings, and a single competency may be included in many different groupings.

competency statement

A descriptive statement that states what a competent individual is doing, and in what context

concrete action verb

Concrete action verbs are also known as measurable verbs. They state actions which can be observed and measured when used in context with an activity.

digital badges

A digital badge is a digitally issued credential that contains structured information that is standardized for easier sharing and can be evaluated and authenticated via embedded links. This leads to trusted recognition for learners and makes their credentials more portable and meaningful.

expected behaviours

measurable and observable actions that demonstrate performance of the competency to the expected standard

learning activities

Learning activities are the things the learner engages in doing to achieve the learning objectives. Learning activities may be lessons, assignments, projects, etc. and may or may  not be graded or assessed.

learning objectives

Learning objectives are smaller and more focused than learning outcomes. They state the intended goals for smaller pieces of learning, such as for a single lesson or course module. (e.g. Each lesson in a course will have specific  learning objectives.) Objectives usually focus on knowledge acquisition or development of discrete skills; describe process rather than the intended result and are aligned with learning outcomes.

learning outcomes

Learning outcomes are broad statements of what someone will be able to do on completion of the learning intervention, usually at the end of a "course" or "program". The learning outcome expresses the integrated learning by a student and explains what the learner will achieve.

metadata

Metadata is data that describes or summarizes other data. It provides information about a certain item's content. This may include tags or key words that are attached to a descriptor and therefore can by searched, found easily and are machine readable.

micro-credentials

A micro-credential is a certification of assessed learning associated with a specific and relevant skill or competency. Micro-credentials enable rapid retraining and augment traditional education through pathways into regular postsecondary programming.

performance criteria

measurable outcomes required to demonstrate proficiency in the competency

proficiency scale

A system for measuring levels of proficiency. Proficiency scales may have a number of defined steps or stages or may be expressed in terms of a percentage compared to the highest level of performance. Proficiency scales are often used for formal assessment of practical tasks, when combined with defined performance criteria and rubrics.

rubric

Specifications for grading against a specific scale. Rubrics in the context of assessment of competence should identify specific specific performance that must be demonstrated in order to be granted a specific status or level of achievement in relation to the competency and/or proficiency scale.

supporting knowledge and skills

The underlying things you must know and be able to do in order to demonstrate the competency. Knowledge and skills alone are not enough to demonstrate competence; they must be applied together within the context of the activity being undertaken.

task

A specific activity that has a start and an end. Multiple tasks may be required to complete broader work activities, and tasks may in turn have smaller sub-tasks or steps that are required to complete them.

taxonomy (pl. taxonomies)

A classification into ordered categories. In competency frameworks, it usually refers to information categorized and arranged in several, increasingly specific levels.

world of work and learning

The world of work and learning encompasses activities and expectations that are found in both the workforce and higher education, as well as those that may be done on a volunteer basis but include clear roles, responsibilities, and performance expectations.

3

Links

Here is a summary of external links found in the toolkit and some that may be helpful for additional reference.

eCampusOntario Publications and Reference Material

eCampusOntario’s Micro-Credential Principles and Framework

Competency Framework Examples

Public Sector – Canada

ESDC Skills and Competencies Taxonomy

Public Sector – International

US Department of Labour’s O*Net Portal

European Skills/Competences, qualifications, and Occupations (ESCO)

Australian Training and Qualifications Framework

New Zealand Qualifications Framework

South African Qualifications Authority

Private Sector

Essential Competencies for Midwifery Practice

Toronto Region Immigrant Employment Council’s Inclusive Workplace Competencies

IT Professionalism Europe’s e-CF Explorer

T3 Innovation Network Learning and Employment Records (LER) Hub

Reference Documents

Canada’s Essential Skills (ESDC)

Ontario’s Essential Employability Skills