<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "http://jats.nlm.nih.gov/publishing/1.1d1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">SAJEMS</journal-id>
<journal-title-group>
<journal-title>South African Journal of Economic and Management Sciences</journal-title>
</journal-title-group>
<issn pub-type="ppub">1015-8812</issn>
<issn pub-type="epub">2222-3436</issn>
<publisher>
<publisher-name>AOSIS</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">SAJEMS-23-3049</article-id>
<article-id pub-id-type="doi">10.4102/sajems.v23i1.3049</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Research</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>A systematic literature review of the implementation and evaluation of the JOBS programme: A suggested framework for South Africa</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0002-3824-3038</contrib-id>
<name>
<surname>Paver</surname>
<given-names>Rach&#x00E9;le</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-6691-517X</contrib-id>
<name>
<surname>De Witte</surname>
<given-names>Hans</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0001-6065-4338</contrib-id>
<name>
<surname>Rothmann</surname>
<given-names>Sebastiaan</given-names>
</name>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0002-5896-9506</contrib-id>
<name>
<surname>Van den Broeck</surname>
<given-names>Anja</given-names>
</name>
<xref ref-type="aff" rid="AF0002">2</xref>
<xref ref-type="aff" rid="AF0003">3</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-8699-2511</contrib-id>
<name>
<surname>Blonk</surname>
<given-names>Roland</given-names>
</name>
<xref ref-type="aff" rid="AF0002">2</xref>
<xref ref-type="aff" rid="AF0004">4</xref>
<xref ref-type="aff" rid="AF0005">5</xref>
</contrib>
<aff id="AF0001"><label>1</label>Research Group Work, Organisational and Personnel Psychology, KU Leuven, Belgium</aff>
<aff id="AF0002"><label>2</label>Optentia Research Focus Area, North-West University, Vanderbijlpark, South Africa</aff>
<aff id="AF0003"><label>3</label>Work and Organization Studies, KU Leuven, Brussels, Belgium</aff>
<aff id="AF0004"><label>4</label>Healthy Living, Toegepast Natuurwetenschappelijk Onderzoek (TNO), Leiden, the Netherlands</aff>
<aff id="AF0005"><label>5</label>Department of Human Resource Studies, Tilburg University, Tilburg, the Netherlands</aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><bold>Corresponding author:</bold> Rach&#x00E9;le Paver, <email xlink:href="rachele.paver@nwu.ac.za">rachele.paver@nwu.ac.za</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>25</day><month>02</month><year>2020</year></pub-date>
<pub-date pub-type="collection"><year>2020</year></pub-date>
<volume>23</volume>
<issue>1</issue>
<elocation-id>3049</elocation-id>
<history>
<date date-type="received"><day>28</day><month>02</month><year>2019</year></date>
<date date-type="accepted"><day>06</day><month>11</month><year>2019</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2020. The Authors</copyright-statement>
<copyright-year>2020</copyright-year>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>Licensee: AOSIS. This work is licensed under the Creative Commons Attribution License.</license-p>
</license>
</permissions>
<abstract>
<sec id="st1">
<title>Background</title>
<p>South Africa is challenged with high levels of unemployment, comprising many people with low levels of education and also individuals who have never held a job before. Despite having many vulnerable participants, interventions aimed at the unemployed generally exclude psychosocial training and are methodologically weak.</p>
</sec>
<sec id="st2">
<title>Aim</title>
<p>The JOBS programme, a scientifically sound intervention, has been developed specifically to help people affected by unemployment to cope with the psychological effects. As a means of applying such a programme in South Africa, this study aimed to develop a framework based on the insights gained on the implementation and evaluation of the JOBS programme.</p>
</sec>
<sec id="st3">
<title>Methods</title>
<p>The study comprised a systematic review of literature regarding the JOBS intervention and its derivatives (<italic>n</italic> = 34).</p>
</sec>
<sec id="st4">
<title>Results</title>
<p>The results revealed that populations similar to the unemployed in South Africa had benefitted significantly regarding re-employment and mental health outcomes.</p>
</sec>
<sec id="st5">
<title>Conclusion</title>
<p>Suggestions derived from the literature included aiming the programme at the most vulnerable unemployed in South Africa: the youth and long-term unemployed. Furthermore, expanding the programme by adding an entrepreneurial component may yield positive results, considering the lack of employment opportunities in South Africa.</p>
</sec>
</abstract>
<kwd-group>
<kwd>JOBS programme</kwd>
<kwd>employment interventions</kwd>
<kwd>systematic literature review</kwd>
<kwd>unemployment</kwd>
<kwd>South Africa</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s0001">
<title>Introduction</title>
<p>South Africa is facing an unemployment crisis: currently 29.1&#x0025; of people in South Africa are jobless (Stats SA <xref ref-type="bibr" rid="CIT0036">2019</xref>). While statistics may indicate the magnitude of the problem at hand, they fail to depict the nature and severe impact of unemployment. Unemployment is not only associated with societal and economic ramifications; it also has serious psychological consequences for those who are unemployed (see Strandh et al. <xref ref-type="bibr" rid="CIT0037">2014</xref>; Wanberg <xref ref-type="bibr" rid="CIT0055">2012</xref>).</p>
<p>Numerous interventions have been implemented to alleviate unemployment (Independent Evaluation Group <xref ref-type="bibr" rid="CIT0013">2013</xref>; McCarthy <xref ref-type="bibr" rid="CIT0020">2008</xref>). Despite the benefits of evidence-based practices (see Heckman, Lalonde &#x0026; Smith <xref ref-type="bibr" rid="CIT0012">1999</xref>; Ravallion <xref ref-type="bibr" rid="CIT0030">2008</xref>), it is startling to see that most vocational interventions are consensus-based &#x2013; implying that the interventions are based on what the stakeholders <italic>think</italic> is necessary, without the supporting evidence to <italic>prove</italic> what is really needed (Marais &#x0026; Matebesi <xref ref-type="bibr" rid="CIT0019">2013</xref>). Considering the urgency of unemployment, the shortage of evidence-based practices in South Africa is a concern.</p>
<p>One profound example of a scientifically sound employment initiative is the JOBS programme (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>). The JOBS intervention seeks to enhance the employability of jobseekers by equipping them with the necessary job search, social and problem-solving skills to support them in their job search efforts. Several factors contribute to the achieved outcomes. Two of the strengths of the programme are its strong theoretical foundation and empirically tested evidence (Vinokur &#x0026; Price <xref ref-type="bibr" rid="CIT0041">2015</xref>). Likewise, the comprehensive protocol guiding the programme contributes significantly to successful dissemination undertakings (Curran, Wishart &#x0026; Gingrich <xref ref-type="bibr" rid="CIT0006">1999</xref>). Extensive evidence of the effectiveness of the JOBS programme has previously been reported (Price &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0029">2014</xref>).</p>
<p>Due to the encouraging results, several JOBS derivatives have been implemented in other countries. These programmes include the Ty&#x00F6;h&#x00F6;n Job Search Programme in Finland (Vuori et al. <xref ref-type="bibr" rid="CIT0053">2002</xref>), the Jobs in China programme (Price &#x0026; Fang <xref ref-type="bibr" rid="CIT0026">2002</xref>), the Job-Search programme in Israel (Shirom Vinokur &#x0026; Price <xref ref-type="bibr" rid="CIT0033">2008</xref>), the Winning New Jobs (WNJ) programme in Ireland (Barry et al. <xref ref-type="bibr" rid="CIT0001">2006</xref>) and the JOBS intervention in the Netherlands (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>). Although these programmes have proven to be reliable in different economic contexts (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>), they have been implemented mainly in developed countries, except for China. The lack of evidence-based practices in South Africa, together with the successful replication of the JOBS programme, creates an opportunity to explore whether such an intervention can be tailored to suit the South African context.</p>
<p>Much effort has been devoted to developing materials that explicitly explain the procedures and dynamics of the JOBS programme (Curran et al. <xref ref-type="bibr" rid="CIT0006">1999</xref>). Yet investigating literature pertaining to the execution and subsequent outcomes of the JOBS programme may assist further dissemination. A greater understanding of typical components of an intervention &#x2013; implementation and evaluation &#x2013; can be used to serve as guiding principles for application and assessment in the South African context. Based on the above statement of the research problem, the objectives of this research were:</p>
<list list-type="bullet">
<list-item><p>To review literature regarding the implementation (context and process aspects) and evaluation (promoting and impeding effects) of the JOBS programme and variations of it.</p></list-item>
<list-item><p>Based on the previous findings, to develop a framework to assist with the implementation and evaluation of the JOBS programme in South Africa.</p></list-item>
<list-item><p>To make recommendations for future research and practice.</p></list-item>
</list>
</sec>
<sec id="s0002">
<title>Research design</title>
<sec id="s20003">
<title>Research approach</title>
<p>A systematic literature review was done to achieve the objectives of this study. A systematic review identifies the main scientific contributions relevant to a specific topic by conducting extensive literature searches of published and unpublished studies (Tranfield, Denyer &#x0026; Smart <xref ref-type="bibr" rid="CIT0038">2003</xref>). This review aimed to identify literature containing information about the JOBS programme and variations of it. Transparent and reproducible procedures were used to enhance the quality and outcomes of the review process.</p>
</sec>
<sec id="s20004">
<title>Research method</title>
<sec id="s30005">
<title>Targeted body of literature</title>
<p>Before starting with the review, the founders of the JOBS programme and the web page of the Michigan Prevention Research Center (MPRC) were consulted to obtain information regarding the JOBS programme and its dissemination. Electronic searches were undertaken to allocate articles identified on the web page. Next, a search was conducted to ascertain whether possible articles were excluded. Databases such as Google Scholar and EBSCOhost (Academic Search Premier, Africa-Wide Information, American Doctoral Dissertations, PsycARTICLES and PsycINFO) were utilised to find the relevant articles.</p>
</sec>
<sec id="s30006">
<title>Search terms and selected criteria</title>
<p>It was anticipated that the articles worth including in the review would refer to the JOBS programme in the articles themselves. Therefore, numerous searches were conducted by including the authors involved (as obtained from the dissemination page) with the term Job Opportunities and Basic Skills programme (e.g. AUTHOR: Vuori; IN-TEXT: &#x2018;JOBS program&#x002A;&#x2019;). Because another programme, called the JOBS Program, yielded additional results when searching for &#x2018;Jobs Program&#x002A;&#x2019;, it was necessary to include the various authors. The search string consisted of two search concepts joined by the Boolean operator AND; the second string contained a list of authors joined by the Boolean operator OR. The following search string was entered in the databases: [1] IN-TEXT: &#x2018;jobs program&#x002A;&#x2019; [2] AUTHOR: &#x2018;Barry&#x2019;, &#x2018;Caplan&#x2019;; &#x2018;Choi&#x2019;; &#x2018;Kessler&#x2019; &#x2018;Price&#x2019;; &#x2018;Schul&#x2019;; &#x2018;Van Ryn&#x2019; &#x2018;Vinokur&#x2019; and &#x2018;Vuori&#x2019;.</p>
<p>To prevent the omission of essential articles, a complementary search was performed. Reference lists of the selected articles were reviewed for more relevant publications. During the process, it became evident that there were indeed articles that did not refer to the JOBS programme in their content. Therefore, an additional search was conducted using the authors involved from the different variations of the JOBS programme and each of the different JOBS variations (e.g. AUTHOR: &#x2018;Barry&#x2019;; IN-TEXT: &#x2018;Winning New Jobs&#x2019;). The second search string again consisted of two search concepts joined by the Boolean operator AND; the first string contained a list of names for variations of the JOBS programme and the second a list of authors, with both strings joined by the Boolean operator OR. The following search string was entered in the databases: (1) IN-TEXT: Jobs in China Project, Job-search Intervention, Ty&#x00F6;h&#x00F6;n Job Search Program, or Winning New Jobs (2) AUTHOR: &#x2018;Blonk&#x2019;, &#x2018;Brenninkmeijer&#x2019;, &#x2018;Choi&#x2019;, &#x2018;Donaldson&#x2019;, &#x2018;Fang&#x2019;, &#x2018;Friedland&#x2019;, &#x2018;Ling&#x2019;, &#x2018;Shirom&#x2019;, and &#x2018;Turner&#x2019;.</p>
<p>Criteria for including articles were as follows:</p>
<list list-type="bullet">
<list-item><p>Articles and chapters had to be peer-reviewed.</p></list-item>
<list-item><p>Articles and chapters had to be written in English.</p></list-item>
<list-item><p>Articles had to be about the JOBS programme or variations of it.</p></list-item>
<list-item><p>The study population had to be unemployed people.</p></list-item>
</list>
</sec>
<sec id="s30007">
<title>Gathering the data</title>
<p>Conference proceedings and papers to which access was limited or where no full-text papers were available were excluded. Price and Vinokur (<xref ref-type="bibr" rid="CIT0029">2014</xref>) mention that the JOBS programme has previously been executed in Sweden and South Korea; however, the literature seemed limited and unavailable. Furthermore, the JOBS programme has also been implemented in organisational and school contexts. Considering that the circumstances of the participants are not the same, these studies were omitted. The inclusion and exclusion criteria narrowed the scope of this review. Finally, 34 articles met all the inclusion criteria (<xref ref-type="fig" rid="F0001">Figure 1</xref>).</p>
<fig id="F0001">
<label>FIGURE 1</label>
<caption><p>Flow chart of study selection and inclusion.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="SAJEMS-23-3049-g001.tif"/>
</fig>
</sec>
</sec>
</sec>
<sec id="s0008">
<title>Analysis and presentation of the data</title>
<p>Implementation and evaluation aspects were studied to gain a better understanding of the JOBS programme and its derivatives.</p>
<p><italic>Implementation</italic> is described as the process of putting a plan into action to achieve objectives (Miller, Wilson &#x0026; Hickson <xref ref-type="bibr" rid="CIT0022">2004</xref>). To ensure sufficient programme fidelity and to effectively replicate the JOBS, it seemed necessary to study the various components involved in executing such a programme. <italic>Evaluation</italic> can be described as the determination of the merit, worth and significance of an area of interest using criteria directed by specific standards for purposes of decision-making (Richards &#x0026; Schmidt <xref ref-type="bibr" rid="CIT0032">2002</xref>). Evaluation practices are a crucial component in the success of evidence-based programmes (Jan&#x00E9;-Llopis et al. <xref ref-type="bibr" rid="CIT0014">2005</xref>). To develop a framework aimed at guiding the implementation and evaluation of the JOBS programme in South Africa, the following aspects of the papers included in the systematic literature review were studied (<xref ref-type="table" rid="T0001">Table 1</xref>).</p>
<table-wrap id="T0001">
<label>TABLE 1</label>
<caption><p>Reviewed implementation and evaluation aspects of the JOBS programme.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Implementation</th>
<th valign="top" align="left">Evaluation</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Context<break/>Participants:
<list list-type="bullet">
<list-item><p>Biographical characteristics:
<list list-type="simple">
<list-item><label>&#x25A0;</label><p>Gender</p></list-item>
<list-item><label>&#x25A0;</label><p>Age</p></list-item>
<list-item><label>&#x25A0;</label><p>Education</p></list-item>
<list-item><label>&#x25A0;</label><p>Duration of unemployment</p></list-item>
</list></p></list-item>
<list-item><p>Population, sample size and recruitment</p></list-item>
<list-item><p>Programme:</p></list-item>
<list-item><p>Delivery</p></list-item>
<list-item><p>Content</p></list-item>
<list-item><p>Incentives</p></list-item>
<list-item><p>Facilitators</p></list-item>
<list-item><p>Duration of programme</p></list-item>
<list-item><p>Group sizes</p></list-item>
<list-item><p>Venue of training</p></list-item>
<list-item><p>Stakeholders</p></list-item></list></td>
<td align="left">Methodology:
<list list-type="bullet">
<list-item><p>Data collection method</p></list-item>
<list-item><p>Research design and data collection intervals</p></list-item>
</list>Process evaluation:
<list list-type="bullet">
<list-item><p>Randomisation</p></list-item>
<list-item><p>Integrity manipulation checks</p></list-item>
</list>Impact evaluation:
<list list-type="bullet">
<list-item><p>Outcomes:
<list list-type="simple">
<list-item><label>&#x25A0;</label><p>Prevention of poor mental health Promotion of re-employment</p></list-item>
<list-item><label>&#x25A0;</label><p>Consequential outcomes</p></list-item></list></p></list-item></list></td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="s20009">
<title>Assessment of methodological quality</title>
<p>An additional reviewer &#x2013; a researcher involved in the broader project &#x2013; was consulted to ensure methodological quality. After the duplicates had been removed, both the researcher and reviewer were involved in selecting studies to remain in the systematic review based on their abstracts and full content.</p>
<sec id="s30010">
<title>Ethical considerations</title>
<p>Ethical clearance was obtained from the Humanities and Health Research Ethics Committee (HHREC), North-West University, with ethical clearance number: NWU-HS-2018-0006.</p>
</sec>
</sec>
</sec>
<sec id="s0011">
<title>Results</title>
<p>The literature review comprised 34 studies. The predetermined criteria, as per <xref ref-type="table" rid="T0001">Table 1</xref>, guided the systematic review. The main aspects regarding the implementation and evaluation of the JOBS programme and variations of it were tabulated. The summarised findings are reported below.</p>
</sec>
<sec id="s0012">
<title>Implementation</title>
<p>This section contains information about the context in which the various programmes were implemented as well as participant and programme specifics.</p>
<sec id="s20013">
<title>Context</title>
<p>The JOBS programme has been implemented in numerous states and countries, in all of which the context has differed to some degree (see <xref ref-type="app" rid="app001">Appendix 1</xref>). The unemployment rates, as reported in the studies included, varied from 4&#x0025; to 20&#x0025; (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Vuori et al. <xref ref-type="bibr" rid="CIT0053">2002</xref>). Additionally, the unemployed seemed to be supported by welfare benefits, also safeguarding them against severe financial hardship. Unemployment grants differed, depending on the social policies of the countries involved (Vinokur &#x0026; Price <xref ref-type="bibr" rid="CIT0041">2015</xref>).</p>
</sec>
<sec id="s20014">
<title>Participants</title>
<sec id="s30015">
<title>Biographical variables</title>
<p>According to Vinokur and Price (<xref ref-type="bibr" rid="CIT0041">2015</xref>), benefits of the JOBS programmes did not seem to be distributed equally to all the participants. Some findings are reported below; yet it should be noted that only a few of the studies included mentioned the impact of demographic variables on the intended outcomes. Findings regarding participants&#x2019; demographic variables were not always consistent and sufficient to substantiate these relationships. Compared to other demographic variables, education had the strongest impact on the outcomes of the job search interventions.</p>
<p><bold>Gender:</bold> Female participants seemed to suffer greater economic losses and experience more difficulties regaining employment (Vinokur et al. <xref ref-type="bibr" rid="CIT0048">2000</xref>). Yet women generally benefitted more from the programme than their male counterparts (MPRC 2003). They were more likely to (1) obtain employment six months after the intervention (Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>), (2) score higher on participant engagement (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>), (3) experience positive group participation (Vuori et al. <xref ref-type="bibr" rid="CIT0051">2005</xref>) and (4) participate voluntarily (Vuori et al. <xref ref-type="bibr" rid="CIT0053">2002</xref>).</p>
<p><bold>Age:</bold> Unemployed people between the ages of 16 and 65 were generally the targeted population. The mean age of participants in the studies included was 36 (Standard deviation [SD] = 9). Vuori et al. (<xref ref-type="bibr" rid="CIT0051">2005</xref>) state that younger participants were usually more positive and found employment more easily than older participants, but showed a higher tendency of non-participation (Van Ryn &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0040">1992</xref>; Vinokur et al. <xref ref-type="bibr" rid="CIT0048">2000</xref>; Vinokur, Price &#x0026; Caplan <xref ref-type="bibr" rid="CIT0042">1991a</xref>). The training programme seemed to also have a positive impact on older participants regarding improved job search skills and increased self-confidence (Price &#x0026; Choi <xref ref-type="bibr" rid="CIT0023">2001</xref>).</p>
<p><bold>Level of education:</bold> The majority of participants in the programmes involved had a secondary level of education (equivalent to 12 years of schooling; mean of all the studies: 40.65&#x0025;). Participants with higher levels of education more often gained in terms of obtaining re-employment (MPRC 2003), increases in job search self-efficacy (Choi, Price &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0004">2003</xref>), a lower likelihood of major depressive episode diagnosis (Vinokur et al. <xref ref-type="bibr" rid="CIT0048">2000</xref>) and non-participation (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>; Van Ryn &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0040">1992</xref>; Vinokur et al. <xref ref-type="bibr" rid="CIT0048">2000</xref>), and higher levels of voluntary participation (Vuori et al. <xref ref-type="bibr" rid="CIT0053">2002</xref>). Despite these positive findings, in some other studies, it was evident that the programme also clearly yielded mental health benefits and economic benefits for those less educated and most disadvantaged in terms of the job market (Price &#x0026; Choi <xref ref-type="bibr" rid="CIT0023">2001</xref>; Vinokur, Price &#x0026; Schul <xref ref-type="bibr" rid="CIT0045">1995b</xref>).</p>
<p><bold>Duration of unemployment:</bold> The JOBS programme was originally designed to prevent further deterioration in mental health among the unemployed and was not specifically intended to deal with potential problems associated with long-term unemployment (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>). Therefore, the majority of the initial studies included only those who had been unemployed for less than 13 weeks (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>; Price et al. <xref ref-type="bibr" rid="CIT0028">1992</xref>; Van Ryn &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0040">1992</xref>; Vinokur et al. <xref ref-type="bibr" rid="CIT0042">1991a</xref>, <xref ref-type="bibr" rid="CIT0050">1991b</xref>, <xref ref-type="bibr" rid="CIT0044">1995a</xref>, <xref ref-type="bibr" rid="CIT0048">2000</xref>; Vinokur, Price &#x0026; Caplan <xref ref-type="bibr" rid="CIT0043">1996</xref>; Vinokur &#x0026; Schul <xref ref-type="bibr" rid="CIT0046">1997</xref>). However, because the long-term unemployed were reported as the most vulnerable, more recent developments included participants who had been unemployed for longer periods (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Malmberg-Heimonen &#x0026; Vuori <xref ref-type="bibr" rid="CIT0018">2005</xref>; Price &#x0026; Choi <xref ref-type="bibr" rid="CIT0023">2001</xref>; Reynolds, Barry &#x0026; Gabhainn <xref ref-type="bibr" rid="CIT0031">2010</xref>; Vuori et al. <xref ref-type="bibr" rid="CIT0051">2005</xref>).</p>
</sec>
<sec id="s30016">
<title>Population, sample size and recruitment</title>
<p><bold>Population:</bold> Eligibility criteria required individuals to be aged between 16 and 65. Prospective screening questionnaires were used in some studies to determine participants&#x2019; risk score for poor mental health (Vinokur et al. <xref ref-type="bibr" rid="CIT0045">1995b</xref>). However, those who showed major signs of mental illness, serious psychosocial problems or behavioural problems or who scored extremely high on depression symptoms were omitted from the study (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>).</p>
<p><bold>Sample size:</bold> Most of the studies included were conducted as a part of large-scale field experiments, ranging from 1087 to 3402 participants. Smaller-scale studies ranged from 125 to 672 participants. Sample sizes did not seem to influence the results achieved or the sustainability of the programmes. It was rather the use (or lack) of effective methods that seemed to have an impact on the outcomes (Price &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0029">2014</xref>).</p>
<p><bold>Recruitment:</bold> The primary method used to recruit participants was through recruiters who approached individuals eligible for employment benefits while collecting grants at employment offices. In studies including an experimental and control group, participants were told about the two programmes on job-seeking methods. One programme was described as a workshop consisting of five half-day sessions (the experimental condition); the other was described as a self-guided programme, in which participants received a booklet with job search information (the control condition). To prevent biases, participants had to show no preference for a type of intervention (experimental or control condition; Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>; Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>).</p>
<p><bold>Voluntary or enforced participation:</bold> Participants from some programmes had to participate in the job search workshop to qualify for welfare benefits (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Lee &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0016">2007</xref>). When studying the impact of voluntary or enforced participation, a Finnish study showed that enforced participation did not increase re-employment; however, it impaired the positive mental health impacts of the programme. Further analysis demonstrated that enforced participation in job search training decreased re-employment among the longer-term unemployed workers (Malmberg-Heimonen &#x0026; Vuori <xref ref-type="bibr" rid="CIT0018">2005</xref>).</p>
<p><bold>Dropout rates:</bold> In the US programmes, on average, 59&#x0025; (varying by 5&#x0025;) of participants failed to show up for the intervention (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>; Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>). Consequently, dropout rates could be anticipated and, therefore, twice as many participants were recruited and allocated to intervention groups in the Israeli study (Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>). In the Malmberg-Heimonen and Vuori (<xref ref-type="bibr" rid="CIT0018">2005</xref>) study, it was surprising to find that response rates did not differ much among the enforced, voluntary and control groups (94&#x0025;, 92&#x0025;, and 91&#x0025;).</p>
</sec>
</sec>
<sec id="s20017">
<title>Programme</title>
<p>The information presented below was derived from the JOBS training manual (Curran et al. <xref ref-type="bibr" rid="CIT0006">1999</xref>).</p>
<sec id="s30018">
<title>Delivery</title>
<p>The JOBS programme entails two main processes. On the one hand, job search skills (the actual content of the programme) are taught to participants, while, on the other hand, empowerment of the participants, by applying the programme&#x2019;s underlying principles in the method of delivery, is the true underlying mission of the workshop. The following aspects guided the method of delivery used by the trainers:</p>
<p><bold>Referent power:</bold> Moderate self-disclosures shared by facilitators create an environment in which participants feel safe to reveal their concerns and experiences. These also contribute to creating an atmosphere of unconditional acceptance and to enhancing feelings of being normal and valued.</p>
<p><bold>Guiding behaviour:</bold> Specific positive feedback is given to participants to reinforce positive behaviour. Strategies used to generate positive feedback include active listening, observation and reflecting on what participants have shared as a means of showing participants that they are valued.</p>
<p><bold>Inoculation against setbacks:</bold> The group is encouraged to identify potential setbacks and difficulties in the job search process. Strategies are developed to overcome the identified challenges and, consequently, participants realise that their problems can be solved. Participants are asked to commit themselves to action by selecting and vowing to undertake a solution most appealing to them.</p>
<p><bold>Social support:</bold> Social support forms an integral part of the underlying processes, as exercises are specifically designed to create opportunities for facilitators and participants to support each other. An environment where participants are unconditionally accepted is created. Such a safe environment contributes to participants feeling comfortable to express their opinions and reveal their feelings.</p>
<p><bold>Active leaning:</bold> The learning process relies greatly on participants&#x2019; knowledge and skills. Participants acquire job search skills by using active learning methods, elicited using group discussions and brainstorming sessions.</p>
<p>In contrast to traditional top-down, trainer-focused training methods, the JOBS programme relies heavily on its individual-focused approach. The delivery principles mentioned above contribute to the strong individual-focused approach. Principles are continuously applied and integrated and form the basis on which the content is delivered.</p>
</sec>
<sec id="s30019">
<title>Content</title>
<p>The programme consists of five sessions. During the first session, participants discover their job skills; the second session focuses on dealing with obstacles related to employment; the third session is used to introduce participants to some job search techniques; the fourth session covers topics such as curriculum vitae writing and preparing participants for job interviews; during the fifth session participants rehearse skills acquired throughout the week. The workshop concludes with a certificate ceremony, during which facilitators boost participants&#x2019; confidence by highlighting their strengths and skills and providing each participant with a sincere and inspiring message.</p>
<p>The JOBS protocol describes the programme processes meticulously. Yet these processes are flexible and can be altered, depending on the needs of the groups, without losing the intended effects of the programme. The majority of the disseminated versions of the JOBS programme were implemented strictly according to the protocol. The content differed in terms of minor language, cultural, procedural and scheduling changes to suit different contexts. To maintain the standard of the JOBS programme, all materials were piloted and approved. It is worth mentioning that, when the protocol was somewhat neglected, it was reported that the programme was less successful in achieving the intended outcomes (Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>).</p>
</sec>
<sec id="s30020">
<title>Incentives</title>
<p>Participants were rewarded monetarily for participation or each returned questionnaire (varying between $5.00 and $15.00, depending on the currency of the country). In cases where questionnaires were not returned, an additional amount was issued on the completion of their questionnaires. This incentive was reported to result in a substantial increase in response rates (about 20&#x0025;; Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>). Participants in the JOBS programme and Netherlands JOBS programme also received a certificate of participation for completing the programme (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>).</p>
<p>Researchers obtained higher response rates when offering incentives: in cases with relatively high dropout rates, no mention of rewards or incentives was evident (Barry et al. <xref ref-type="bibr" rid="CIT0001">2006</xref>; Reynolds et al. <xref ref-type="bibr" rid="CIT0031">2010</xref>; Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>). The same finding was, however, not true in the WNJ California studies, which managed to retain approximately 70&#x0025; of their participants, seemingly without the use of incentives (Choi et al. <xref ref-type="bibr" rid="CIT0004">2003</xref>).</p>
</sec>
<sec id="s30021">
<title>Facilitators</title>
<p><bold>Pairing:</bold> Teams consisting of one male and one female trainer are prescribed by Curran et al. (<xref ref-type="bibr" rid="CIT0006">1999</xref>) to complement each other well. An untested assumption existed that a pair of trainers reduced deviation from the principles of the JOBS programme. However, the assumed benefits of having male&#x2013;female pair facilitators have not yet been tested. Benefit-cost research could determine whether the cost of using two trainers, rather than one, is outweighed by the benefits that are generated (Price et al. <xref ref-type="bibr" rid="CIT0027">1998</xref>).</p>
<p><bold>Prerequisites:</bold> Facilitators were generally social workers, labour advisors, educational counsellors or high school teachers. It was suggested that facilitators ought to be skillful in working with people (public speaking and communications backgrounds). Because trained individuals (that is, mental health professionals, such as counsellors or clinicians) might execute strongly embedded techniques not necessarily consistent with unemployment-related counselling methods, professional training was not a prerequisite (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>).</p>
<p><bold>Programme-related training:</bold> Facilitators had to undergo extensive formal training. The content of the training covered understanding of group processes, theoretical foundations of the programme and extensive rehearsal in the form of pilot studies. The duration of training varied from 6 to 30 days (48 h&#x2013;240 h). The reason for the extensive training was that facilitators were not only conveyors of information, but also experts in navigating the group processes, with the ability to connect emotionally with the participants and facilitate interactions in a group setting. To promote conformity, trainers&#x2019; performance was evaluated by trained supervisors.</p>
</sec>
<sec id="s30022">
<title>Duration of the programme</title>
<p>Some of the findings yielded by the original JOBS trial encouraged the revision of the programme, which consequently led to the development of the JOBS II intervention (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>). The first version (the JOBS I programme) spanned eight 3 h sessions, over a two-week period (four mornings per week; Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>). To increase programme efficiency and the attendance of participants, meeting hours were reduced by 30&#x0025;, delivered over five 4 h sessions in a one-week period in the JOBS II (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>). The majority of disseminated versions of the JOBS programme continued to apply the programme following the JOBS II protocol. In some groups, the Finnish programme was delivered over four days, as the first day was used to deal with recently laid-off workers&#x2019; negative emotions (Vuori et al. <xref ref-type="bibr" rid="CIT0053">2002</xref>) &#x2013; an illustration of how the programme can be altered to meet the needs of the group, without affecting the outcomes.</p>
</sec>
<sec id="s30023">
<title>Group sizes</title>
<p>Guidelines of the JOBS programme suggest groups consisting of 12&#x2013;20 participants (Curran et al. <xref ref-type="bibr" rid="CIT0006">1999</xref>). There were exceptions, where the groups ranged from three to 110 participants per group (median = 11; Malmberg-Heimonen &#x0026; Vuori <xref ref-type="bibr" rid="CIT0018">2005</xref>). Although only a few studies reported on the impact of group sizes, larger groups seemed to have more negative experiences than smaller groups (Vuori et al. <xref ref-type="bibr" rid="CIT0051">2005</xref>).</p>
</sec>
<sec id="s30024">
<title>Venue of training</title>
<p>Venues such as community centres, school classrooms, churches and union halls, easily accessible to participants, were mostly used. Venues had to be large enough to accommodate 25 people and furnished with movable chairs, arranged in a semicircular layout. Such a layout was reported to be most effective in delivering the group intervention (Curran et al. <xref ref-type="bibr" rid="CIT0006">1999</xref>).</p>
</sec>
<sec id="s30025">
<title>Stakeholder involvement</title>
<p>Crucial to the success of the WNJ programme in Ireland was that the developers of the original JOBS programme were involved from the outset and contributed to obtaining buy-in from strategic stakeholder agencies. Despite a substantial initial investment of resources for demonstration, neither the WNJ in California nor the JOBS in China project continued beyond their initial stages, as commitment of resources for continuation was not offered by the government or other stakeholders. Therefore, the success of programme dissemination depended considerably on the involvement of, and support received from, stakeholders (Vinokur &#x0026; Price <xref ref-type="bibr" rid="CIT0041">2015</xref>).</p>
</sec>
</sec>
</sec>
<sec id="s0026">
<title>Evaluation</title>
<p>This section is comprised of information regarding evaluation of the processes and the impact of the JOBS programme.</p>
<sec id="s20027">
<title>Methodology</title>
<sec id="s30028">
<title>Data collection method</title>
<p>Self-administered questionnaires were used to assess participants&#x2019; attitudes, intentions, various behavioural components and experience of the workshop (Van Ryn &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0040">1992</xref>). In cases of unreturned questionnaires or where participants failed to show up for the workshop, telephonic interviews were conducted (Barry et al. <xref ref-type="bibr" rid="CIT0001">2006</xref>).</p>
</sec>
<sec id="s30029">
<title>Research design and data collection intervals</title>
<p>Randomised field study designs were used to investigate the intervention effect between experimental and control conditions (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>; Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>; Vuori et al. <xref ref-type="bibr" rid="CIT0053">2002</xref>). Programmes that made use of a randomised field study design had three to four interval times, namely pre-intervention (two weeks before the programme), post-intervention (directly after the programme), post-post-intervention (between two and six months after the programme) and long-term follow-ups, varying from 12 to 32 months after the intervention (Barry et al. <xref ref-type="bibr" rid="CIT0001">2006</xref>; Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Vinokur et al. <xref ref-type="bibr" rid="CIT0042">1991a</xref>). Other programmes only tested pre-intervention and post-intervention to determine the impact of the programme (Lee &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0016">2007</xref>; Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>).</p>
</sec>
</sec>
<sec id="s20030">
<title>Process evaluation</title>
<p>To determine the internal validity and the strength and integrity of the JOBS programmes, two types of analysis were generally conducted. These process measures consisted of testing the integrity of randomisation and strength of the programme (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>).</p>
<sec id="s30031">
<title>Effectiveness of randomisation</title>
<p>The first check to determine the validity of the programme was to determine whether the statistical analyses were conducted on a randomised (true) experimental design. This was established by comparing the demographic and other tested variables of the experimental and control conditions at baseline to identify possible differences. In cases where differences were found, these variables were controlled for in further analyses (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>).</p>
</sec>
<sec id="s30032">
<title>Manipulation checks, integrity and strength of the intervention</title>
<p>The second test was to test the strength and integrity of the intervention through self-reported questionnaires at the end of each session. Participants were asked to evaluate their experience of facilitators and the programme. These evaluations were used to determine whether various intervention elements had been implemented and had operated as designed (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>). Participants who scored high on these measures also reported higher levels of internal control and job-seeking self-efficacy (Choi et al. <xref ref-type="bibr" rid="CIT0004">2003</xref>), decreases in depression and anger, and increases in self-esteem and quality of life (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>). Also, trainer skills (one of the evaluated variables) exhibited during group interactions contributed to increased re-employment, even at the 12-month follow-up (Reynolds et al. <xref ref-type="bibr" rid="CIT0031">2010</xref>).</p>
<p>Two additional methods were used to ensure the quality of the programme and a high level of trainer adherence to the protocol. Firstly, members of the research team frequently observed programme trainers: after each session, constructive feedback was given to trainers. Secondly, the facilitators met weekly to discuss skill-related topics they encountered during their sessions (Vinokur et al. <xref ref-type="bibr" rid="CIT0045">1995b</xref>).</p>
</sec>
</sec>
<sec id="s20033">
<title>Impact evaluation</title>
<sec id="s30034">
<title>Outcomes</title>
<p>The positive outcomes of the JOBS programme were documented amply. Below are some of the most prominent findings related to the two core objectives of the JOBS programmes: prevention of poor mental health and promotion of re-employment, and other post-hoc outcomes.</p>
<p><bold>Prevention of poor mental health:</bold> Participation in the intervention resulted in increased self-esteem, self-efficacy and social assertiveness among participants; consequently, participants also showed improved psychological and mental health and well-being (Lee &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0016">2007</xref>; Reynolds et al. <xref ref-type="bibr" rid="CIT0031">2010</xref>). Furthermore, long-term effects of the programme revealed that participants experienced lower symptoms of depression (Price et al. <xref ref-type="bibr" rid="CIT0028">1992</xref>; Vuori &#x0026; Silvonen <xref ref-type="bibr" rid="CIT0052">2005</xref>), improved self-esteem (Reynolds et al. <xref ref-type="bibr" rid="CIT0031">2010</xref>) and an enhanced ability to deal with setbacks. A noteworthy finding is that participants screened for showing higher risk for depression seemed to benefit the most in terms of mental health and re-employment outcomes (Vinokur et al. <xref ref-type="bibr" rid="CIT0045">1995b</xref>).</p>
<p><bold>Promotion of re-employment:</bold> Several programmes demonstrated increased rates of re-employment, with an average of 46&#x0025; after the intervention, compared to the control group, with an average of 18&#x0025; (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>; Donaldson <xref ref-type="bibr" rid="CIT0007">2012</xref>; Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>; Vuori et al. <xref ref-type="bibr" rid="CIT0051">2005</xref>). Programme participants also showed higher motivation to persist in job search efforts (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>), were employed in better jobs (in terms of earnings and job satisfaction) (Vinokur et al. <xref ref-type="bibr" rid="CIT0050">1991b</xref>), were employed faster, had less recurring episodes of unemployment (Vinokur &#x0026; Price <xref ref-type="bibr" rid="CIT0041">2015</xref>) and experienced reduced economic hardship after being employed (Barry et al. <xref ref-type="bibr" rid="CIT0001">2006</xref>). Results remained over time, as long-term effects of the programme revealed that participants, compared to their counterparts, experienced higher re-employment (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>). Another crucial finding is that both the Ty&#x00F6;h&#x00F6;n and the Netherland&#x2019;s JOBS programmes confirmed the effectiveness of the intervention to help even the more vulnerable long-term unemployed gain employment (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Vuori et al. <xref ref-type="bibr" rid="CIT0053">2002</xref>).</p>
<p><bold>Consequential outcomes:</bold> Finally, the JOBS programme demonstrated substantial cost-benefit effectiveness because the higher earnings led, on average, to higher tax revenues and decreased welfare grants for governments (Vinokur et al. <xref ref-type="bibr" rid="CIT0050">1991b</xref>).</p>
</sec>
</sec>
</sec>
<sec id="s0035">
<title>Discussion</title>
<p>The purpose of this study was to review literature regarding the JOBS programme and variations of it, with the intention of developing a framework that could guide the successful implementation and evaluation of the JOBS programme within the South African context. To gain a better understanding of the components related to the implementation of the JOBS programme, the contexts in which the programme have previously been implemented and the targeted population, as well as aspects regarding the programme, were studied. Based on the findings of the systematic review, as well as context-specific matters, a framework is proposed for the implementation and evaluation of the JOBS programme within the South African context (see <xref ref-type="app" rid="app002">Appendix 2</xref>).</p>
<p>In terms of contextual differences between developed countries (where the JOBS programme has previously been implemented), and developmental countries (e.g. South Africa), some differences are crucial to consider when implementing an employment programme, such as the JOBS intervention. While the unemployment rates of the involved developed countries averaged 12&#x0025;, more than 27&#x0025; (37.3&#x0025; when including those who have stopped looking for employment; Stats SA <xref ref-type="bibr" rid="CIT0035">2018</xref>) of South Africans are currently unemployed. Moreover, it has been reported that 69&#x0025; of these individuals have been unemployed for longer than a year (Stats SA <xref ref-type="bibr" rid="CIT0035">2018</xref>). In South Africa, unlike the other countries, unemployment grants safeguarding people from financial hardship are not available. Also, the unemployed are generally situated in rural areas isolated from major economic activity. With limited job opportunities, jobseekers feel discouraged, and deprived of a chance to compete in the labour market (Du Toit et al. <xref ref-type="bibr" rid="CIT0010">2018</xref>). Fortunately, the JOBS programme is specifically designed to deal with such conditions, yet it remains important to be cognisant of the impact of contextual factors on potential participants&#x2019; state of mind.</p>
<p>With regard to participant-related matters, the reviewed literature showed that young and old, educated and less educated participants had previously benefitted from the JOBS interventions. However, it is important to note that South Africa has a youth unemployment rate of 52&#x0025; (aged between 15 and 24; Stats SA <xref ref-type="bibr" rid="CIT0035">2018</xref>); 62&#x0025; of the unemployed population have never even held a job before (Stats SA <xref ref-type="bibr" rid="CIT0034">2017</xref>); and 57&#x0025; of South Africans have an education of less than matric (Grade 12). Therefore, although the unemployed in general could benefit from the programme, it is suggested to target vulnerable populations, such as younger, less educated and long-term unemployed individuals, as it may yield promising results.</p>
<p>Furthermore, participants from previous studies were reached at employment services offices. Because unemployment grants are not available in South Africa, participants cannot be reached on a large scale in a similar way. Therefore, different strategies of reaching the intended population should be considered. Suggestions include making use of newspaper and radio advertisements, and government agencies working with jobseekers, or working with youth and community leaders. One programme in particular tested the effectiveness of forced versus voluntary participation. Findings revealed that enforced participation did not increase re-employment and impaired the positive mental health impact of the programme (Malmberg-Heimonen &#x0026; Vuori <xref ref-type="bibr" rid="CIT0018">2005</xref>). Giving participants the autonomy to participate voluntarily in the programme seems to yield more positive benefits. This may be an important finding for policymakers, as a precondition for receiving unemployment grants is often enforced attendance of a job search programme. Yet responsibility also rests with workshop trainers to be particularly devoted in creating an environment to which participants <italic>choose</italic> to return.</p>
<p>Considering the possibility that participants showing a preference to partake in employment programmes may be somewhat more intrinsically motivated, at the same time, it is those who show a higher risk of depressive symptoms that may benefit more (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>). Thus, careful attention should be paid to recruitment measures, ensuring that both the motivated and those who may be at risk of depressive symptoms are reached through recruitment methods, as they are equally important in achieving intended programme outcomes. Similarly, some programmes made use of screening questionnaires to identify participants at risk of poor mental health (Vinokur et al. <xref ref-type="bibr" rid="CIT0045">1995b</xref>); those who scored exceptionally high on depression symptoms or showed major signs of mental illness were omitted from the programme (Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>). As previously mentioned, given that many of the unemployed in South Africa may be severely discouraged, it is recommended to refrain from screening participants to identify high-risk cases, as it may result in the exclusion of participants who may benefit from the programme.</p>
<p>The next implementation aspect investigated related to programme-related matters. In line with previous adaptations of the JOBS programme, it is suggested to tailor the content of the manuals and activities to better suit the context and to increase cultural acceptability (Barry et al. <xref ref-type="bibr" rid="CIT0001">2006</xref>; Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>). Due to slow economic growth and the lack of skills in specific disadvantaged populations, changes in conditions of obtaining a job may be difficult (Vinokur &#x0026; Price <xref ref-type="bibr" rid="CIT0041">2015</xref>). A solution that may fill both of these voids could be to consider fostering an entrepreneurial mindset among programme participants. People working in the informal sector often have a lower education level (although not lower wages) compared to those employed in the formal sector (Kim <xref ref-type="bibr" rid="CIT0015">2002</xref>), which may be a suitable solution within the South African context.</p>
<p>Furthermore, the ability to facilitate and understand group processes, build feelings of competence and create an environment of unconditional acceptance were essential requirements for facilitators. Yet education levels of the facilitators were not reported as particularly important. Due to the great demand for social work in South Africa, a shortfall of qualified social workers exists, which often results in employing people at social services offices who are less skilled and experienced (Collin <xref ref-type="bibr" rid="CIT0005">2017</xref>). Failure to grasp the importance of, and means of executing, the principal components of the programme may be problematic for the successful execution of the programme. Consequently, involving trainers knowledgeable and experienced in this area, while at the same time having the ability to relate to participants, should be considered. These may typically include individuals with higher degrees, coming from a similar background, who can also serve as role models for participants. Additionally, trainers should have the ability to adopt an individual-focused training approach, aimed at the enhancement of active learning among participants, instead of taking on the traditional role of teacher.</p>
<p>A noteworthy lesson was that the success of the programme lies greatly in the adherence to the designed protocols, as fewer of the anticipated outcomes were achieved when the protocol was neglected (Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>). The majority of workshops included between 12 and 18 participants per group, as it was effective and economical. Ideally, delivery was guided by two training facilitators, as two were more capable of monitoring the behaviour and reactions of participants (Vinokur &#x0026; Price <xref ref-type="bibr" rid="CIT0041">2015</xref>). Also, five half-day sessions, compared to longer two-week sessions, seemed to be more effective in keeping participants engaged. A vital lesson could be learned from the Finnish study that allowed for a debriefing day. During this session former appointed employees had an opportunity to deal with negative emotions caused by their dismissals (Vuori et al. <xref ref-type="bibr" rid="CIT0051">2005</xref>). Providing participants with such a venting opportunity may have made them more receptive to the programme.</p>
<p>Lastly, the founders of the JOBS programme strongly advised involving an effective champion, advocating for the programme at the policy level from the outset. It was also suggested that service delivery agencies be included that were open to applying innovative initiatives. Furthermore, a continuous flow of resources and funding seemed fundamental to the success and sustainability of large-scale programmes (Price &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0029">2014</xref>). In the South African context, economic development departments in local governments, supported by training providers, could act as champions of the JOBS programme.</p>
<p>This study also explored three elements (methodology, process and impact) related to the evaluation of the JOBS programme. The investigated studies were either conducted with a randomised field or quasi-experiment design as the chosen methodology, with self-reported questionnaires as the main data collection method. Considering the effectiveness of these designs in reporting the effectiveness and changes over time, it is suggested to use a similar approach. Furthermore, attrition was a pervasive problem experienced by most of the studies. However, offering incentives and recruiting more participants due to anticipated dropouts yielded higher attendance rates (Caplan et al. <xref ref-type="bibr" rid="CIT0003">1989</xref>; Shirom et al. <xref ref-type="bibr" rid="CIT0033">2008</xref>).</p>
<p>Aspects contributing to the process evaluation of the intervention included randomisation and manipulation checks of the studies included. To ensure internal validity, comparisons between the control and experimental groups&#x2019; demographic and other variables were tested for possible biases. Furthermore, the strength and integrity of the various interventions were assessed by means of self-reported questionnaires at the end of each workshop. Several benefits can be gained from delivering a programme that is valid and reliable. Firstly, as mentioned earlier, adhering to programme protocols is strongly recommended, as the intended outcomes are achieved through reliable practices. Secondly, ensuring that participants experience the programme positively has previously been shown to increase engagement and, consequently, has led to other outcomes, such as decreased depression and anger, increased internal control, job-seeking self-efficacy and self-esteem (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>; Vinokur &#x0026; Schul <xref ref-type="bibr" rid="CIT0046">1997</xref>).</p>
<p>With regard to the JOBS programme&#x2019;s impact, one of the most significant findings was the beneficial re-employment outcomes for those who had been unemployed for a moderate length of time (longer than a year; Brenninkmeijer &#x0026; Blonk <xref ref-type="bibr" rid="CIT0002">2011</xref>; Vuori et al. <xref ref-type="bibr" rid="CIT0053">2002</xref>). Likewise, findings from examined literature also showed beneficial mental health and re-employment outcomes, particularly for high-risk participants (Vinokur &#x0026; Schul <xref ref-type="bibr" rid="CIT0046">1997</xref>). These findings are valuable as it was found in a South African study that approximately 70&#x0025; of the unemployed population was categorised as desperate or discouraged (Van der Vaart et al. <xref ref-type="bibr" rid="CIT0039">2018</xref>). The unemployed in both clusters generally came from poor socio-economic backgrounds, had relatively low levels of education, had limited opportunities for odd jobs or temporary employment, and were quite pessimistic. Given the capability of the JOBS programme to produce significant outcomes for high-risk participants, it appears that it could hold valuable outcomes, also for those who have been unemployed for long periods and may be truly discouraged.</p>
<sec id="s20036">
<title>Limitations and recommendations</title>
<p>Some limitations of this study need to be considered. Firstly, only peer-reviewed articles and book chapters that were written in English were included in the current study. Since the JOBS programme has been implemented in the Netherlands, Israel, Finland and China, where other official languages occur, the possibility of excluding potential articles exists. Secondly, access to some articles (Jobs in China project and Ty&#x00F6;h&#x00F6;n trainers&#x2019; manual) was limited, or they could not be found, resulting in their omission from the review (i.e. Fang &#x0026; Ling <xref ref-type="bibr" rid="CIT0011">2001</xref>; M&#x00E4;kitalo, Tervahartiala &#x0026; Saarinen <xref ref-type="bibr" rid="CIT0017">1997</xref>; Price <xref ref-type="bibr" rid="CIT0023">2001</xref>). In the third place, due to the nature of intervention studies, it is possible that only studies yielding significant results were published. Although all versions of the JOBS programme known to the developers were reported, it is possible that there may be unpublished efforts. Consequently, meaningful lessons that could have been learnt from these papers were not available. However, much effort was invested in systematically searching for and including all possible studies. Lastly, the study did not include articles where the JOBS programme had been applied in work-to-school and organisational contexts. Although these programmes may have yielded valuable findings, these studies were omitted, as the aim of this study was to specifically focus on the most effective methods to assist the unemployed.</p>
</sec>
</sec>
<sec id="s0037">
<title>Conclusion</title>
<p>This study reviewed literature about the JOBS programme as a means of extending our knowledge of applying such a job search intervention in a South African context. Therefore, core aspects regarding the implementation and evaluation of the JOBS programme and variations of it were investigated. Specifically, implementation features such as contextual factors, participant characteristics and programme aspects were studied, while evaluation features included impact and process evaluation components.</p>
<p>Evidently, the success of the JOBS programme largely depended on following the protocol. Thus, studying the previously performed methods and outcomes of the JOBS programme, in various contexts, may serve as a valuable guideline to prescribe possible best practices. The integration of included literature and important aspects regarding the South African context produced a framework that could be valuable in the implementation and evaluation of the JOBS programme in South Africa.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>This work was supported by the Experiences of Unemployment Research Project funded by the Flemish Interuniversity Council &#x2013; University Development Cooperation (VLIR-UOS). We are truly grateful for this opportunity.</p>
<sec id="s20038" sec-type="COI-statement">
<title>Competing interests</title>
<p>The authors have declared that no competing interest exists.</p>
</sec>
<sec id="s20039">
<title>Authors&#x2019; contributions</title>
<p>This publication was based on the PhD thesis of R.P. H.D.W., S.R. and A.V.d.B. were co-authors as well as supervisors of the project. R.B. made conceptual contributions to the manuscript.</p>
</sec>
<sec id="s20040">
<title>Funding information</title>
<p>Flemish Interuniversity Council &#x2013; University Development Cooperation (VLIR-UOS), ZEIN2013PR397.</p>
</sec>
<sec id="s20041">
<title>Data availability statement</title>
<p>The main aspects regarding the implementation and evaluation of the JOBS programme and variations of it were tabulated. A summary table can be requested from the first author. The literature review comprised 34 studies; these articles can be requested from the first author.</p>
</sec>
<sec id="s20042">
<title>Disclaimer</title>
<p>The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any affiliated agency of the authors.</p>
</sec>
</ack>
<ref-list id="references">
<title>References</title>
<ref id="CIT0001"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Barry</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Reynolds</surname>, <given-names>C</given-names></string-name>., <string-name><surname>Sheridan</surname>, <given-names>A</given-names></string-name>. &#x0026; <string-name><surname>Egenton</surname>, <given-names>R</given-names></string-name>.</person-group>, <year>2006</year>, &#x2018;<article-title>Implementation of the JOBS programme in Ireland</article-title>&#x2019;, <source><italic>Journal of Public Mental Health</italic></source> <volume>5</volume>(<issue>4</issue>), <fpage>10</fpage>&#x2013;<lpage>25</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1108/17465729200600028">https://doi.org/10.1108/17465729200600028</ext-link></comment></mixed-citation></ref>
<ref id="CIT0002"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Brenninkmeijer</surname>, <given-names>V</given-names></string-name>. &#x0026; <string-name><surname>Blonk</surname>, <given-names>R.W</given-names></string-name>.</person-group>, <year>2011</year>, &#x2018;<article-title>The effectiveness of the JOBS program among the long-term unemployed: A randomized experiment in the Netherlands</article-title>&#x2019;, <source><italic>Health Promotion International</italic></source> <volume>27</volume>(<issue>2</issue>), <fpage>220</fpage>&#x2013;<lpage>229</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1069072716657534">https://doi.org/10.1177/1069072716657534</ext-link></comment></mixed-citation></ref>
<ref id="CIT0003"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Caplan</surname>, <given-names>R.D</given-names></string-name>., <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>., <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>. &#x0026; <string-name><surname>Van Ryn</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>1989</year>, &#x2018;<article-title>Job seeking, reemployment, and mental health: A randomized field experiment in coping with job loss</article-title>&#x2019;, <source><italic>The Journal of Applied Psychology</italic></source> <volume>74</volume>(<issue>5</issue>), <fpage>759</fpage>&#x2013;<lpage>769</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/0021-9010.74.5.759">https://doi.org/10.1037/0021-9010.74.5.759</ext-link></comment></mixed-citation></ref>
<ref id="CIT0004"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Choi</surname>, <given-names>J.N</given-names></string-name>., <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>. &#x0026; <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>.</person-group>, <year>2003</year>, &#x2018;<article-title>Self-efficacy changes in groups: Effects of diversity, leadership, and group climate</article-title>&#x2019;, <source><italic>Journal of Organizational Behavior</italic></source> <volume>24</volume>(<issue>4</issue>), <fpage>357</fpage>&#x2013;<lpage>372</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/job.195">https://doi.org/10.1002/job.195</ext-link></comment></mixed-citation></ref>
<ref id="CIT0005"><mixed-citation publication-type="web"><person-group person-group-type="author"><string-name><surname>Collin</surname>, <given-names>F</given-names></string-name>.</person-group>, <year>2017</year>, &#x2018;<article-title>NGOs trained to fill in for social workers</article-title>&#x2019;, <source><italic>Times Live</italic></source>, <comment>21 November, viewed 21 February 2019, from <ext-link ext-link-type="uri" xlink:href="https://www.timeslive.co.za/news/south-africa/2017-11-21-ngos-trained-to-fill-in-for-social-workers/">https://www.timeslive.co.za/news/south-africa/2017-11-21-ngos-trained-to-fill-in-for-social-workers/</ext-link></comment></mixed-citation></ref>
<ref id="CIT0006"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Curran</surname>, <given-names>J</given-names></string-name>., <string-name><surname>Wishart</surname>, <given-names>P</given-names></string-name>. &#x0026; <string-name><surname>Gingrich</surname>, <given-names>J</given-names></string-name>.</person-group>, <year>1999</year>, <source><italic>JOBS: A manual for teaching people successful job search strategies</italic></source>, <publisher-name>University of Michigan, Institute for Social Research, Michigan Prevention Research Center</publisher-name>, <publisher-loc>Ann Arbor, MI</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0007"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Donaldson</surname>, <given-names>S.I</given-names></string-name>.</person-group>, <year>2012</year>, &#x2018;<chapter-title>Evaluation of the winning new jobs program</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>S.I.</given-names> <surname>Donaldson</surname></string-name> (ed.)</person-group>, <source><italic>Program theory-driven evaluation science: Strategies and applications</italic></source>, pp. <fpage>93</fpage>&#x2013;<lpage>112</lpage>, <publisher-name>Routledge</publisher-name>, <publisher-loc>New York</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0008"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Donaldson</surname>, <given-names>S.I</given-names></string-name>., <string-name><surname>Gooler</surname>, <given-names>L.E</given-names></string-name>. &#x0026; <string-name><surname>Weiss</surname>, <given-names>R</given-names></string-name>.</person-group>, <year>1998</year>, &#x2018;<chapter-title>Promoting health and well-being through work: Science and practice</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>X.B.</given-names> <surname>Arriaga</surname></string-name> &#x0026; <string-name><given-names>S.</given-names> <surname>Oskamp</surname></string-name> (eds.)</person-group>, <source><italic>Addressing community problems: Psychological research and interventions</italic></source>, pp. <fpage>160</fpage>&#x2013;<lpage>194</lpage>, <publisher-name>Sage</publisher-name>, <publisher-loc>Thousand Oaks, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0009"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Donaldson</surname>, <given-names>S.I</given-names></string-name>. &#x0026; <string-name><surname>Gooler</surname>, <given-names>L.E</given-names></string-name>.</person-group>, <year>2002</year>, &#x2018;<article-title>Theory-driven evaluation of the Work and Health initiative: A focus on winning new jobs</article-title>&#x2019;, <source><italic>American Journal of Evaluation</italic></source>, <volume>23</volume>(<issue>3</issue>), <fpage>341</fpage>&#x2013;<lpage>346</lpage>.</mixed-citation></ref>
<ref id="CIT0010"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Du Toit</surname>, <given-names>M</given-names></string-name>., <string-name><surname>De Witte</surname>, <given-names>H</given-names></string-name>., <string-name><surname>Rothmann</surname>, <given-names>S</given-names></string-name>. &#x0026; <string-name><surname>Van den Broeck</surname>, <given-names>A</given-names></string-name>.</person-group>, <year>2018</year>, &#x2018;<article-title>Unemployment experiences in context: A phenomenological study in two townships in South Africa</article-title>&#x2019;, <source><italic>Journal of Psychology in Africa</italic></source> <volume>28</volume>(<issue>2</issue>), <fpage>122</fpage>&#x2013;<lpage>127</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/14330237.2018.1454575">https://doi.org/10.1080/14330237.2018.1454575</ext-link></comment></mixed-citation></ref>
<ref id="CIT0011"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Fang</surname>, <given-names>L</given-names></string-name>. &#x0026; <string-name><surname>Ling</surname>, <given-names>W</given-names></string-name>.</person-group>, <year>2001</year>, <source><italic>Jobs in China: A seven city project</italic></source>, <publisher-name>Institute of Psychology, National Academy of Sciences</publisher-name>, <publisher-loc>Beijing</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0012"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Heckman</surname>, <given-names>J.J</given-names></string-name>., <string-name><surname>LaLonde</surname>, <given-names>R.J</given-names></string-name>. &#x0026; <string-name><surname>Smith</surname>, <given-names>J.A</given-names></string-name>.</person-group>, <year>1999</year>, &#x2018;<chapter-title>The economics and econometrics of active labor market programs</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>O.</given-names> <surname>Ashenfelter</surname></string-name> &#x0026; <string-name><given-names>D.</given-names> <surname>Card</surname></string-name> (eds.)</person-group>, <source><italic>Handbook of labor economics</italic></source>, pp. <fpage>1865</fpage>&#x2013;<lpage>2097</lpage>, <publisher-name>Elsevier</publisher-name>, <publisher-loc>Amsterdam</publisher-loc>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/S1573-4463(99)03012-6">https://doi.org/10.1016/S1573-4463(99)03012-6</ext-link></comment></mixed-citation></ref>
<ref id="CIT0013"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Independent Evaluation Group</collab></person-group>, <year>2013</year>, <source><italic>Youth employment programs: An evaluation of World Bank and international finance corporation support</italic></source>, <publisher-name>World Bank Publications</publisher-name>, <publisher-loc>Washington, DC</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0014"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jan&#x00E9;-Llopis</surname>, <given-names>E</given-names></string-name>., <string-name><surname>Barry</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Hosman</surname>, <given-names>C</given-names></string-name>. &#x0026; <string-name><surname>Patel</surname>, <given-names>V</given-names></string-name>.</person-group>, <year>2005</year>, &#x2018;<article-title>Mental health promotion works: A review</article-title>&#x2019;, <source><italic>Promotion and Education</italic></source> <volume>12</volume>(<issue>2</issue>), <fpage>9</fpage>&#x2013;<lpage>25</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/10253823050120020103x">https://doi.org/10.1177/10253823050120020103x</ext-link></comment></mixed-citation></ref>
<ref id="CIT0015"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kim</surname>, <given-names>B.Y</given-names></string-name>.</person-group>, <year>2002</year>, &#x2018;<article-title>The participation of Russian households in the informal economy. Evidence from the VTsIOM data</article-title>&#x2019;, <source><italic>Economics of Transition</italic></source> <volume>10</volume>(<issue>3</issue>), <fpage>689</fpage>&#x2013;<lpage>717</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1111/1468-0351.t01-1-00130">https://doi.org/10.1111/1468-0351.t01-1-00130</ext-link></comment></mixed-citation></ref>
<ref id="CIT0016"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lee</surname>, <given-names>S.J</given-names></string-name>. &#x0026; <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>.</person-group>, <year>2007</year>, &#x2018;<article-title>Work barriers in the context of pathways to the employment of welfare-to-work clients</article-title>&#x2019;, <source><italic>American Journal of Community Psychology</italic></source> <volume>40</volume>(<issue>3&#x2013;4</issue>), <fpage>301</fpage>&#x2013;<lpage>312</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10464-007-9144-x">https://doi.org/10.1007/s10464-007-9144-x</ext-link></comment></mixed-citation></ref>
<ref id="CIT0017"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>M&#x00E4;kitalo</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Tervahartiala</surname>, <given-names>T</given-names></string-name>. &#x0026; <string-name><surname>Saarinen</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>1997</year>, <source><italic>Ty&#x00F6;h&#x00F6;n Ty&#x00F6;h&#x00F6;ohjelma Ohjaajan k&#x00E4;sikirja [Ty&#x00F6;h&#x00F6;n program trainers&#x2019; manual]</italic></source>, <publisher-name>Finnish Institute of Occupational Health</publisher-name>, <publisher-loc>Helsinki</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0018"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Malmberg-Heimonen</surname>, <given-names>I</given-names></string-name>. &#x0026; <string-name><surname>Vuori</surname>, <given-names>J</given-names></string-name>.</person-group>, <year>2005</year>, &#x2018;<article-title>Activation or discouragement: The effect of enforced participation on the success of job-search training</article-title>&#x2019;, <source><italic>European Journal of Social Work</italic></source> <volume>8</volume>(<issue>4</issue>), <fpage>451</fpage>&#x2013;<lpage>467</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/13691450500314178">https://doi.org/10.1080/13691450500314178</ext-link></comment></mixed-citation></ref>
<ref id="CIT0019"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Marais</surname>, <given-names>L</given-names></string-name>. &#x0026; <string-name><surname>Matebesi</surname>, <given-names>Z</given-names></string-name>.</person-group>, <year>2013</year>, &#x2018;<article-title>Evidence-based policy development in South Africa: The case of provincial growth and development strategies</article-title>&#x2019;, <source><italic>Urban Forum</italic></source> <volume>24</volume>(<issue>3</issue>), <fpage>357</fpage>&#x2013;<lpage>371</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s12132-012-9179-4">https://doi.org/10.1007/s12132-012-9179-4</ext-link></comment></mixed-citation></ref>
<ref id="CIT0020"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>McCarthy</surname>, <given-names>P</given-names></string-name>.</person-group>, <year>2008</year>, <source><italic>South Africa&#x2019;s &#x2018;door knockers&#x2019;: Young people and unemployment in metropolitan South Africa</italic></source>, <publisher-name>Centre for Development and Enterprise</publisher-name>, <publisher-loc>Johannesburg</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0021"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>Michigan Prevention Research Center (MPRC)</collab></person-group>, <year>2013</year>, <source><italic>The JOBS project for the unemployed: Update</italic></source>, <publisher-name>Michigan Prevention Research Center, Institute for Social Research, University of Michigan</publisher-name>, <publisher-loc>Ann Arbor, MI</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0022"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Miller</surname>, <given-names>S</given-names></string-name>., <string-name><surname>Wilson</surname>, <given-names>D</given-names></string-name>. &#x0026; <string-name><surname>Hickson</surname>, <given-names>D</given-names></string-name>.</person-group>, <year>2004</year>, &#x2018;<article-title>Beyond planning: Strategies for successfully implementing strategic decisions</article-title>&#x2019;, <source><italic>Long Range Planning</italic></source> <volume>37</volume>(<issue>3</issue>), <fpage>201</fpage>&#x2013;<lpage>218</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.lrp.2004.03.003">https://doi.org/10.1016/j.lrp.2004.03.003</ext-link></comment></mixed-citation></ref>
<ref id="CIT0023"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>.</person-group>, <year>2001</year>, &#x2018;<chapter-title>Winning new jobs in China. Preface</chapter-title>&#x2019; in <person-group person-group-type="editor"><string-name><given-names>L.</given-names> <surname>Fang</surname></string-name> &#x0026; <string-name><given-names>W.</given-names> <surname>Ling</surname></string-name> (eds.)</person-group>, <source><italic>Jobs in China: A seven city project</italic></source>, <publisher-name>Institute of Psychology, Chinese Academy of Sciences</publisher-name>, <publisher-loc>Beijing, Republic of China</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0024"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>., <string-name><surname>Choi</surname>, <given-names>J.N</given-names></string-name>., &#x0026; <string-name><surname>Lim</surname>, <given-names>S</given-names></string-name>.</person-group>, <year>2006</year>, &#x2018;<chapter-title>Beyond the iron rice bowl: Life stage and family dynamics in unemployed Chinese workers</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>M.</given-names> <surname>Warner</surname></string-name> &#x0026; <string-name><given-names>G.</given-names> <surname>Lee</surname></string-name> (eds.)</person-group>, <source><italic>Unemployment in China</italic></source>, pp.<fpage>123</fpage>&#x2013;<lpage>142</lpage>, <publisher-name>Routledge</publisher-name>, <publisher-loc>London, UK</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0025"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>., <string-name><surname>Choi</surname>, <given-names>J</given-names></string-name>. &#x0026; <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>.</person-group>, <year>2002</year>, &#x2018;<article-title>Links in the chain of adversity following job loss: How economic hardship and loss of personal control lead to depression, impaired functioning and poor health</article-title>&#x2019;, <source><italic>Journal Occupational Health Psychology</italic></source> <volume>7</volume>(<issue>4</issue>), <fpage>302</fpage>&#x2013;<lpage>312</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/1076-8998.7.4.302">https://doi.org/10.1037/1076-8998.7.4.302</ext-link></comment></mixed-citation></ref>
<ref id="CIT0026"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>. &#x0026; <string-name><surname>Fang</surname>, <given-names>L</given-names></string-name>.</person-group>, <year>2002</year>, &#x2018;<article-title>Unemployed Chinese workers: The survivors, the worried young and the discouraged old</article-title>&#x2019;, <source><italic>International Journal of Human Resource Management</italic></source> <volume>13</volume>(<issue>3</issue>), <fpage>416</fpage>&#x2013;<lpage>430</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09585190110111459">https://doi.org/10.1080/09585190110111459</ext-link></comment></mixed-citation></ref>
<ref id="CIT0027"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>., <string-name><surname>Friedland</surname>, <given-names>D.S</given-names></string-name>., <string-name><surname>Choi</surname>, <given-names>J</given-names></string-name>. &#x0026; <string-name><surname>Caplan</surname>, <given-names>R.D</given-names></string-name>.</person-group>, <year>1998</year>, &#x2018;<chapter-title>Job loss and work transitions in a time of global economic change</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>X.</given-names> <surname>Arriaga</surname></string-name> &#x0026; <string-name><given-names>S.</given-names> <surname>Oskamp</surname></string-name> (eds.)</person-group>, <source><italic>Addressing community problems</italic></source>, pp. <fpage>195</fpage>&#x2013;<lpage>222</lpage>, <publisher-name>Sage</publisher-name>, <publisher-loc>Thousand Oaks, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0028"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>., <string-name><surname>Van Ryn</surname>, <given-names>M</given-names></string-name>. &#x0026; <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>.</person-group>, <year>1992</year>, &#x2018;<article-title>Impact of preventive job search intervention on the likelihood of depression among the unemployed</article-title>&#x2019;, <source><italic>Journal of Health and Social Behavior</italic></source> <volume>33</volume>(<issue>2</issue>), <fpage>158</fpage>&#x2013;<lpage>167</lpage>.</mixed-citation></ref>
<ref id="CIT0029"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>. &#x0026; <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>.</person-group>, <year>2014</year>, &#x2018;<chapter-title>The JOBS program: Impact on job seeker motivation reemployment, and mental health</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>U.</given-names> <surname>Klehe</surname></string-name> &#x0026; <string-name><given-names>E.A.J.</given-names> <surname>van Hooft</surname></string-name> (eds.)</person-group>, <source><italic>Oxford handbook of job loss and job search</italic></source>, pp. <fpage>575</fpage>&#x2013;<lpage>590</lpage>, <publisher-name>Oxford University Press</publisher-name>, <publisher-loc>Oxford, UK</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0030"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Ravallion</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>2008</year>, <source><italic>Evaluation in the practice of development</italic></source>, <comment>Working paper No. 4547</comment>, <publisher-name>World Bank Publications</publisher-name>, <publisher-loc>Washington, DC</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0031"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Reynolds</surname>, <given-names>C</given-names></string-name>., <string-name><surname>Barry</surname>, <given-names>M.M</given-names></string-name>. &#x0026; <string-name><surname>Gabhainn</surname>, <given-names>S.N</given-names></string-name>.</person-group>, <year>2010</year>, &#x2018;<article-title>Evaluating the impact of the winning new jobs programme on the re-employment and mental health of a mixed profile of unemployed people</article-title>&#x2019;, <source><italic>The International Journal of Mental Health Promotion</italic></source> <volume>12</volume>(<issue>2</issue>), <fpage>32</fpage>&#x2013;<lpage>41</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/14623730.2010.9721812">https://doi.org/10.1080/14623730.2010.9721812</ext-link></comment></mixed-citation></ref>
<ref id="CIT0032"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Richards</surname>, <given-names>J.C</given-names></string-name>. &#x0026; <string-name><surname>Schmidt</surname>, <given-names>R</given-names></string-name>.</person-group>, <year>2002</year>, <source><italic>Longman dictionary of applied linguistics and language teaching</italic></source>, <publisher-name>Longman</publisher-name>, <publisher-loc>Harlow</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0033"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Shirom</surname>, <given-names>A</given-names></string-name>., <string-name><surname>Vinokur</surname>, <given-names>A</given-names></string-name>. &#x0026; <string-name><surname>Price</surname>, <given-names>R</given-names></string-name>.</person-group>, <year>2008</year>, &#x2018;<article-title>Self-efficacy as a moderator of the effects of job-search workshops on re-employment: A field experiment</article-title>&#x2019;, <source><italic>Journal of Applied Social Psychology</italic></source> <volume>38</volume>(<issue>7</issue>), <fpage>1778</fpage>&#x2013;<lpage>1804</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1111/j.1559-1816.2008.00369.x">https://doi.org/10.1111/j.1559-1816.2008.00369.x</ext-link></comment></mixed-citation></ref>
<ref id="CIT0034"><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>Statistics South Africa (Stats SA)</collab></person-group>, <year>2017</year>, <source><italic>Quarterly labour force survey: Quarter 1, 2017</italic></source>, <comment>viewed 21 January 2020, from <ext-link ext-link-type="uri" xlink:href="http://www.statssa.gov.za/publications/P0211/P02111stQuarter2017.pdf">www.statssa.gov.za/publications/P0211/P02111stQuarter2017.pdf</ext-link>.</comment></mixed-citation></ref>
<ref id="CIT0035"><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>Statistics South Africa (Stats SA)</collab></person-group>, <year>2018</year>, <source><italic>Quarterly labour force survey: Quarter 1, 2018</italic></source>, <comment>viewed 21 January 2020, from <ext-link ext-link-type="uri" xlink:href="http://www.statssa.gov.za/?p=11129">www.statssa.gov.za/?p=11129</ext-link>.</comment></mixed-citation></ref>
<ref id="CIT0036"><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>Statistics South Africa (Stats SA)</collab></person-group>, <year>2019</year>, <source><italic>Quarterly labour force survey: Quarter 3, 2019</italic></source>, <comment>viewed 21 January 2020, from <ext-link ext-link-type="uri" xlink:href="http://www.statssa.gov.za/?p=12689">www.statssa.gov.za/?p=12689</ext-link>.</comment></mixed-citation></ref>
<ref id="CIT0037"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Strandh</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Winefield</surname>, <given-names>A</given-names></string-name>., <string-name><surname>Nilsson</surname>, <given-names>K</given-names></string-name>. &#x0026; <string-name><surname>Hammarstr&#x00F6;m</surname>, <given-names>A</given-names></string-name>.</person-group>, <year>2014</year>, &#x2018;<article-title>Unemployment and mental health scarring during the life course</article-title>&#x2019;, <source><italic>The European Journal of Public Health</italic></source> <volume>24</volume>(<issue>3</issue>), <fpage>440</fpage>&#x2013;<lpage>445</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1093/eurpub/cku005">https://doi.org/10.1093/eurpub/cku005</ext-link></comment></mixed-citation></ref>
<ref id="CIT0038"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tranfield</surname>, <given-names>D</given-names></string-name>., <string-name><surname>Denyer</surname>, <given-names>D</given-names></string-name>. &#x0026; <string-name><surname>Smart</surname>, <given-names>P</given-names></string-name>.</person-group>, <year>2003</year>, &#x2018;<article-title>Towards a methodology for developing evidence-informed management knowledge by means of systematic review</article-title>&#x2019;, <source><italic>British Journal of Management</italic></source> <volume>14</volume>(<issue>3</issue>), <fpage>207</fpage>&#x2013;<lpage>222</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1111/1467-8551.00375">https://doi.org/10.1111/1467-8551.00375</ext-link></comment></mixed-citation></ref>
<ref id="CIT0039"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Van der Vaart</surname>, <given-names>L</given-names></string-name>., <string-name><surname>De Witte</surname>, <given-names>H</given-names></string-name>., <string-name><surname>Van den Broeck</surname>, <given-names>A</given-names></string-name>. &#x0026; <string-name><surname>Rothmann</surname>, <given-names>S</given-names></string-name>.</person-group>, <year>2018</year>, &#x2018;<article-title>A psychosocial typology of the unemployed in South Africa</article-title>&#x2019;, <source><italic>South African Journal of Psychology</italic></source> <volume>48</volume>(<issue>2</issue>), <fpage>179</fpage>&#x2013;<lpage>192</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/0081246317721600">https://doi.org/10.1177/0081246317721600</ext-link></comment></mixed-citation></ref>
<ref id="CIT0040"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Van Ryn</surname>, <given-names>M</given-names></string-name>. &#x0026; <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>.</person-group>, <year>1992</year>, &#x2018;<article-title>How did it work? An examination of the mechanisms through which an intervention for the unemployed promoted job-search behavior</article-title>&#x2019;, <source><italic>American Journal of Community Psychology</italic></source> <volume>20</volume>(<issue>5</issue>), <fpage>577</fpage>&#x2013;<lpage>597</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/BF00941773">https://doi.org/10.1007/BF00941773</ext-link></comment></mixed-citation></ref>
<ref id="CIT0041"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>. &#x0026; <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>.</person-group>, <year>2015</year>, &#x2018;<chapter-title>Promoting reemployment and mental health among the unemployed</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>J.</given-names> <surname>Vuori</surname></string-name>, <string-name><given-names>R.</given-names> <surname>Blonk</surname></string-name> &#x0026; <string-name><given-names>R.</given-names> <surname>Price</surname></string-name> (eds.)</person-group>, <source><italic>Sustainable working lives. Aligning perspectives on health, safety and well-being</italic></source>, pp. <fpage>171</fpage>&#x2013;<lpage>186</lpage>, <publisher-name>Springer</publisher-name>, <publisher-loc>Dordrecht</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0042"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>., <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>. &#x0026; <string-name><surname>Caplan</surname>, <given-names>R.D</given-names></string-name>.</person-group>, <year>1991a</year>, &#x2018;<article-title>From field experiments to program implementation: Assessing the potential outcomes of an experimental intervention program for unemployed persons</article-title>&#x2019;, <source><italic>American Journal of Community Psychology</italic></source> <volume>19</volume>(<issue>4</issue>), <fpage>543</fpage>&#x2013;<lpage>562</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/978-1-4615-0565-5_3">https://doi.org/10.1007/978-1-4615-0565-5_3</ext-link></comment></mixed-citation></ref>
<ref id="CIT0043"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>., <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>. &#x0026; <string-name><surname>Caplan</surname>, <given-names>R.D</given-names></string-name>.</person-group>, <year>1996</year>, &#x2018;<article-title>Hard times and hurtful partners: How financial strain affects depression and relationship satisfaction of unemployed persons and their spouses</article-title>&#x2019;, <source><italic>Journal of Personality and Social Psychology</italic></source> <volume>71</volume>(<issue>1</issue>), <fpage>166</fpage>&#x2013;<lpage>179</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/0022-3514.71.1.166">https://doi.org/10.1037/0022-3514.71.1.166</ext-link></comment></mixed-citation></ref>
<ref id="CIT0044"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>., <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>., <string-name><surname>Caplan</surname>, <given-names>R.D</given-names></string-name>., <string-name><surname>Van Ryn</surname>, <given-names>M</given-names></string-name>. &#x0026; <string-name><surname>Curran</surname>, <given-names>J</given-names></string-name>.</person-group>, <year>1995a</year>, &#x2018;<chapter-title>The jobs I preventive intervention for unemployed individuals: Short-and long-term effects on reemployment and mental health</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>L.R.</given-names> <surname>Murphy</surname></string-name>, <string-name><given-names>J.J.</given-names> <surname>Hurrell</surname> <suffix>Jr</suffix></string-name>, <string-name><given-names>S.L.</given-names> <surname>Sauter</surname></string-name> &#x0026; <string-name><given-names>G.P.</given-names> <surname>Keita</surname></string-name> (eds.)</person-group>, <source><italic>Job stress interventions</italic></source>, pp. <fpage>125</fpage>&#x2013;<lpage>138</lpage>, <publisher-name>American Psychological Association</publisher-name>, <publisher-loc>Washington, DC</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0045"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>., <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>. &#x0026; <string-name><surname>Schul</surname>, <given-names>Y</given-names></string-name>.</person-group>, <year>1995b</year>, &#x2018;<article-title>Impact of the JOBS intervention on unemployed workers varying in risk for depression</article-title>&#x2019;, <source><italic>American Journal of Community Psychology</italic></source> <volume>23</volume>(<issue>1</issue>), <fpage>39</fpage>&#x2013;<lpage>74</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/BF02506922">https://doi.org/10.1007/BF02506922</ext-link></comment></mixed-citation></ref>
<ref id="CIT0046"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>. &#x0026; <string-name><surname>Schul</surname>, <given-names>Y</given-names></string-name>.</person-group>, <year>1997</year>, &#x2018;<article-title>Mastery and inoculation against setbacks as active ingredients in the JOBS intervention for the unemployed</article-title>&#x2019;, <source><italic>Journal of Consulting and Clinical Psychology</italic></source> <volume>65</volume>(<issue>5</issue>), <fpage>867</fpage>&#x2013;<lpage>877</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/0022-006X.65.5.867">https://doi.org/10.1037/0022-006X.65.5.867</ext-link></comment></mixed-citation></ref>
<ref id="CIT0047"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>. &#x0026; <string-name><surname>Schul</surname>, <given-names>Y</given-names></string-name>.</person-group>, <year>2002</year>, &#x2018;<article-title>The web of coping resources and pathways to reemployment following a job loss</article-title>&#x2019;, <source><italic>Journal of Occupational Health Psychology</italic></source> <volume>7</volume>(<issue>1</issue>), <fpage>68</fpage>&#x2013;<lpage>83</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="http://doi.org/10.1037/1076-8998.7.1.68">http://doi.org/10.1037/1076-8998.7.1.68</ext-link></comment></mixed-citation></ref>
<ref id="CIT0048"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>., <string-name><surname>Schul</surname>, <given-names>Y</given-names></string-name>., <string-name><surname>Vuori</surname>, <given-names>J</given-names></string-name>. &#x0026; <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>.</person-group>, <year>2000</year>, &#x2018;<article-title>Two years after a job loss: Long term impact of the JOBS program on reemployment and mental health</article-title>&#x2019;, <source><italic>Journal of Occupational Health Psychology</italic></source> <volume>5</volume>(<issue>1</issue>), <fpage>32</fpage>&#x2013;<lpage>47</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/1076-8998.5.1.32">https://doi.org/10.1037/1076-8998.5.1.32</ext-link></comment></mixed-citation></ref>
<ref id="CIT0049"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>. &#x0026; <string-name><surname>Van Ryn</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>1993</year>, &#x2018;<article-title>Social support and undermining in close relationships: Their independent effects on the mental health of unemployed persons</article-title>&#x2019;, <source><italic>Journal of Personality and Social Psychology</italic></source> <volume>65</volume>(<issue>2</issue>), <fpage>350</fpage>&#x2013;<lpage>359</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/0022-3514.65.2.350">https://doi.org/10.1037/0022-3514.65.2.350</ext-link></comment></mixed-citation></ref>
<ref id="CIT0050"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>., <string-name><surname>Van Ryn</surname>, <given-names>M</given-names></string-name>., <string-name><surname>Gramlich</surname>, <given-names>E.M</given-names></string-name>. &#x0026; <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>.</person-group>, <year>1991b</year>, &#x2018;<article-title>Long-term follow-up and benefit-cost analysis of the jobs program: A preventive intervention for the unemployed</article-title>&#x2019;, <source><italic>Journal of Applied Psychology</italic></source> <volume>76</volume>(<issue>2</issue>), <fpage>213</fpage>&#x2013;<lpage>219</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/0021-9010.76.2.213">https://doi.org/10.1037/0021-9010.76.2.213</ext-link></comment></mixed-citation></ref>
<ref id="CIT0051"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vuori</surname>, <given-names>J</given-names></string-name>., <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>., <string-name><surname>Mutanen</surname>, <given-names>P</given-names></string-name>. &#x0026; <string-name><surname>Malmberg-Heimonen</surname>, <given-names>I</given-names></string-name>.</person-group>, <year>2005</year>, &#x2018;<article-title>Effective group training techniques in job-search training</article-title>&#x2019;, <source><italic>Journal of Occupational Health Psychology</italic></source> <volume>10</volume>(<issue>3</issue>), <fpage>261</fpage>&#x2013;<lpage>275</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/1076-8998.10.3.261">https://doi.org/10.1037/1076-8998.10.3.261</ext-link></comment></mixed-citation></ref>
<ref id="CIT0052"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vuori</surname>, <given-names>J</given-names></string-name>. &#x0026; <string-name><surname>Silvonen</surname>, <given-names>J</given-names></string-name>.</person-group>, <year>2005</year>, &#x2018;<article-title>The benefits of a preventive job search program on re-employment and mental health at 2-year follow-up</article-title>&#x2019;, <source><italic>Journal of Occupational and Organizational Psychology</italic></source> <volume>78</volume>(<issue>1</issue>), <fpage>43</fpage>&#x2013;<lpage>52</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1348/096317904X23790">https://doi.org/10.1348/096317904X23790</ext-link></comment></mixed-citation></ref>
<ref id="CIT0053"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vuori</surname>, <given-names>J</given-names></string-name>., <string-name><surname>Silvonen</surname>, <given-names>J</given-names></string-name>., <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>. &#x0026; <string-name><surname>Price</surname>, <given-names>R.H</given-names></string-name>.</person-group>, <year>2002</year>, &#x2018;<article-title>The Ty&#x00F6;h&#x00F6;n job search program in Finland: Benefits for the unemployed with risk of depression or discouragement</article-title>&#x2019;, <source><italic>Journal of Occupational Health Psychology</italic></source> <volume>7</volume>(<issue>1</issue>), <fpage>5</fpage>&#x2013;<lpage>19</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1037/1076-8998.7.1.5">https://doi.org/10.1037/1076-8998.7.1.5</ext-link></comment></mixed-citation></ref>
<ref id="CIT0054"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vuori</surname>, <given-names>J</given-names></string-name>. &#x0026; <string-name><surname>Vinokur</surname>, <given-names>A.D</given-names></string-name>.</person-group>, <year>2005</year>, &#x2018;<article-title>Job-search preparedness as a mediator of the effects of the Ty&#x00F6;h&#x00F6;n job search intervention on re-employment and mental health</article-title>&#x2019;, <source><italic>Journal of Organizational Behavior</italic></source> <volume>26</volume>(<issue>3</issue>), <fpage>275</fpage>&#x2013;<lpage>291</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1002/job.308">https://doi.org/10.1002/job.308</ext-link></comment></mixed-citation></ref>
<ref id="CIT0055"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wanberg</surname>, <given-names>C.R</given-names></string-name>.</person-group>, <year>2012</year>, &#x2018;<article-title>The individual experience of unemployment</article-title>&#x2019;, <source><italic>Annual Review of Psychology</italic></source> <volume>63</volume>, <fpage>369</fpage>&#x2013;<lpage>396</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1146/annurev-psych-120710-100500">https://doi.org/10.1146/annurev-psych-120710-100500</ext-link></comment></mixed-citation></ref>
</ref-list>
<app-group>
<app id="app001">
<title>Appendix 1</title>
<sec id="s0043">
<title></title>
<p>The context of the countries and states in which the JOBS programme have been implemented.</p>
<table-wrap id="T0002">
<label>TABLE 1-A1</label>
<caption><p>Summary of the context of the countries and states in which the JOBS programme have been implemented.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Programme name and country</th>
<th valign="top" align="left">Context</th>
<th valign="top" align="left">Related articles</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">JOBS programme, Michigan, US</td>
<td align="left">During the time JOBS I was implemented, the national US unemployment rate was between 4&#x0025; and 5&#x0025;, and rose to 8&#x0025;, with a long-term unemployment rate of 2.4&#x0025;, by the time JOBS II was implemented (Price &#x0026; Vinokur, <xref ref-type="bibr" rid="CIT0029">2014</xref>). Some regions of the country, such as the greater Detroit area (south-eastern Michigan) had consistently higher rates of unemployment, compared to the national unemployment rate (Vinokur et al. <xref ref-type="bibr" rid="CIT0050">1991b</xref>). Labour policies implemented at that time safeguarded unemployed workers from severe financial hardship by providing them with 65&#x0025; of their previous earnings for a maximum of six months. Such grants protected the unemployed while recovering to return to labour market; however, policies were relatively strict in terms of the duration. It was reported that labour market conditions deteriorated the year after the JOBS II intervention was implemented. Despite the more difficult conditions positive findings provided evidence of the generalisability of the programme in different economic conditions (Vinokur et al. <xref ref-type="bibr" rid="CIT0044">1995a</xref>).</td>
<td align="left">Caplan et al. (<xref ref-type="bibr" rid="CIT0003">1989</xref>), Vinokur et al. (<xref ref-type="bibr" rid="CIT0042">1991a</xref>), Vinokur et al. (<xref ref-type="bibr" rid="CIT0050">1991b</xref>), Price et al. (<xref ref-type="bibr" rid="CIT0028">1992</xref>), Van Ryn and Vinokur (<xref ref-type="bibr" rid="CIT0040">1992</xref>), Vinokur and Van Ryn (<xref ref-type="bibr" rid="CIT0049">1993</xref>), Vinokur et al. (<xref ref-type="bibr" rid="CIT0045">1995b</xref>), Vinokur et al. (<xref ref-type="bibr" rid="CIT0043">1996</xref>), Vinokur and Schul (<xref ref-type="bibr" rid="CIT0046">1997</xref>, <xref ref-type="bibr" rid="CIT0047">2002</xref>), Vinokur et al. (<xref ref-type="bibr" rid="CIT0048">2000</xref>)</td>
</tr>
<tr>
<td align="left">Winning New Jobs, California, US</td>
<td align="left">This initiative was funded by the California Wellness Foundation. The Michigan Prevention Research Center (MPRC), in collaboration with the Claremont Graduate School and the Manpower Demonstration Research Corporation, disseminated the JOBS programme to three diverse communities in California as a large-scale demonstration project. Information regarding grants and financial support for the unemployed was not described in the above-mentioned articles, and can therefore not be reported on.</td>
<td align="left">Choi et al. (<xref ref-type="bibr" rid="CIT0004">2003</xref>), Donaldson, Gooler and Weiss (<xref ref-type="bibr" rid="CIT0008">1998</xref>), Donaldson and Gooler (<xref ref-type="bibr" rid="CIT0009">2002</xref>), Price et al. (<xref ref-type="bibr" rid="CIT0027">1998</xref>)</td>
</tr>
<tr>
<td align="left">Winning New Jobs, Baltimore, State of Maryland, US</td>
<td align="left">The Maryland programme was implemented by the Department of Social Services of Baltimore Country, as a central part of the &#x2018;From the Ground Up&#x2019; programme. The programme was specifically aimed at helping welfare clients. Participants included in the Maryland study reportedly had greater needs than the general unemployed population (Price &#x0026; Vinokur, <xref ref-type="bibr" rid="CIT0029">2014</xref>). According to the study conducted by Lee and Vinokur (<xref ref-type="bibr" rid="CIT0016">2007</xref>) in 1996 a federal entitlement programme was replaced by welfare reform legislation that limited the receipt of welfare benefits to five years. Consequently, it was reported the dramatic decline in financial aid led to a great increase in employment among welfare recipients.</td>
<td align="left">Lee and Vinokur (<xref ref-type="bibr" rid="CIT0016">2007</xref>)</td>
</tr>
<tr>
<td align="left">Jobs in China project, China</td>
<td align="left">Before 1980 urban Chinese workers were employed by state-owned enterprises, where wages were guaranteed and benefits such as housing, pension and health insurance were included. While workers presumed that their employment was secure, these state-owned enterprises faced major budget constraints by 1997, which led to critical workforce reductions (Price &#x0026; Fang <xref ref-type="bibr" rid="CIT0026">2002</xref>). As a result, the MPRC and the National Academy of Sciences of the People&#x2019;s Republic of China collaborated to implement the JOBS in China programme. The programme was carried out in seven cities, namely Beijing, Guangzhou, Chongching, Shiyan, Yichang, Luoyang and Yantai. Information regarding neither the unemployment rate of in China, at the time of the programme, nor available unemployment grants were reported in either of these studies.</td>
<td align="left">Price and Fang (<xref ref-type="bibr" rid="CIT0026">2002</xref>); Price, Choi and Lim (<xref ref-type="bibr" rid="CIT0024">2006</xref>)</td>
</tr>
<tr>
<td align="left">Ty&#x00F6;h&#x00F6;n Job Search Programme, Finland</td>
<td align="left">In Finland, the unemployment rate was almost as high as 20&#x0025;. When considering the resources the unemployed in Finland were provided with it is evident that they generally have a prolonged period of unemployment economic security, while being jobless. Union members received allowances between 60&#x0025; and 70&#x0025; of their previous earnings for approximately 23 months. Whereas non-members (less than 20&#x0025; of the Finnish workforce) and those unemployed for more than 500 workdays, received flat-rate allowances. Consequently, it was reported that an increasing proportion of unemployed became passive in their job search and ultimately experienced difficulties in re-entering the workforce. The Ty&#x00F6;h&#x00F6;n Job Search Programme was implemented as a trial, as a possible solution to the unemployment challenge in Finland. It was initially implemented in the city of Turku. After its successful dissemination it was supported by Ministry of Labour, that funded the extension into a large-scale nationwide initiative (Price &#x0026; Vinokur <xref ref-type="bibr" rid="CIT0029">2014</xref>).</td>
<td align="left">Vuori et al. (<xref ref-type="bibr" rid="CIT0053">2002</xref>), Malmberg-Heimonen and Vuori (<xref ref-type="bibr" rid="CIT0018">2005</xref>), Vuori and Vinokur (<xref ref-type="bibr" rid="CIT0054">2005</xref>), Vuori and Silvonen (<xref ref-type="bibr" rid="CIT0052">2005</xref>)</td>
</tr>
<tr>
<td align="left">Winning New Jobs (WNJ), Ireland</td>
<td align="left">The programme was implemented in Donegal, Derry or Londonderry and in parts of Sligo and Leitrim. The unemployment rate in these regions varied from 8&#x0025; to 15.6&#x0025;, compared with the Northern Ireland average of 4.7&#x0025;. The WNJ programme was piloted as wider community-based initiative in rural communities. Government support provided to the unemployed was not mentioned in these articles, and can therefore not be elaborated on.</td>
<td align="left">Barry et al. (<xref ref-type="bibr" rid="CIT0001">2006</xref>), Reynolds et al. (<xref ref-type="bibr" rid="CIT0031">2010</xref>)</td>
</tr>
<tr>
<td align="left">JOBS programme, Israel</td>
<td align="left">The programme was offered in peripheral areas in Israel. These areas were specifically selected, as they exceeded a 10&#x0025; unemployment rate, at the time of the programme. As the study was implemented in the developmental areas of Israel, Shirom et al. (<xref ref-type="bibr" rid="CIT0033">2008</xref>) reported that re-employment outcomes were affected by the limitations of the labour market conditions. Other information regarding social benefits were not reported.</td>
<td align="left">Shirom et al. (<xref ref-type="bibr" rid="CIT0033">2008</xref>)</td>
</tr>
<tr>
<td align="left">JOBS programme, Netherlands</td>
<td align="left">In 2007 the unemployment rate in the Netherlands was 4.5&#x0025;, of which almost 42&#x0025; have been unemployed more than 12 months. The study was conducted in Lelystad, a suburban city in the centre of the Netherlands. The number of beneficiaries receiving unemployment grants or social welfare benefits in Lelystad is slightly higher (7&#x0025;) compared with the rest of the Netherlands.</td>
<td align="left">Brenninkmeijer and Blonk (<xref ref-type="bibr" rid="CIT0002">2011</xref>)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>Note: Please see the full reference list of the article, Paver, R., De Witte, H., Rothmann, S., Van den Broeck, A. &#x0026; Blonk, R., 2020, &#x2018;A systematic literature review of the implementation and evaluation of the JOBS programme: A suggested framework for South Africa&#x2019;, <italic>South African Journal of Economic and Management Sciences</italic> 23(1), a3049. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/sajems.v23i1.3049">https://doi.org/10.4102/sajems.v23i1.3049</ext-link>, for more information.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
</app>
<app id="app002">
<title>Appendix 2</title>
<sec id="s0044">
<title></title>
<p>The overall findings regarding the implementation and evaluation of the JOBS programme.</p>
<table-wrap id="T0003">
<label>TABLE 1-A2</label>
<caption><p>A summary of the results pertaining to the implementation and evaluation of the JOBS programme.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Programme components</th>
<th valign="top" align="left">Sub-components</th>
<th valign="top" align="left">Variable</th>
<th valign="top" align="left">Description</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left" rowspan="13">Implementation</td>
<td align="left">Context</td>
<td align="left">-</td>
<td align="left">Growing distance exists between the unemployed and the labour market in South Africa. Suggestions to overcome these matters include empowering people through the JOBS programme by providing them with the necessary job search, social and entrepreneurial skills to uplift not only themselves, but also their communities.</td>
</tr>
<tr>
<td align="left" rowspan="2">Participants</td>
<td align="left">Biographical characteristics</td>
<td align="left">Generally, younger, lower-educated and long-term unemployed benefitted the most from the programme. Thus, it seems that the youth (15&#x2013;35 years of age), with a minimum level of education of Grade 12, and the long-term unemployed will gain the most from the programme.</td>
</tr>
<tr>
<td align="left">Population, sample size and recruitment</td>
<td align="left">Recommended inclusion criteria are a minimum education level of Grade 12, being English-speaking, and being between 15 and 35 years of age. No suggestion regarding the sample size is made. Prospective screening questionnaires are not suggested, as it may lead to the exclusion of many vulnerable participants. Suggested recruitment methods are through newspaper and radio advertisements, and government agencies working with jobseekers, or working with youth and community leaders. Voluntary participation yielded more positive results; therefore, refraining from enforced participation is suggested. Because the number of dropout participants can be anticipated in advance, it is suggested that more participants be recruited.</td>
</tr>
<tr>
<td align="left">Programme delivery</td>
<td align="left">-</td>
<td align="left">The programme was generally delivered over five half-day sessions, implemented strictly according to the JOBS protocol.</td>
</tr>
<tr>
<td align="left">Content</td>
<td align="left">-</td>
<td align="left">Minor changes were made to suit different contexts. A suggestion is to include an entrepreneurial component to encourage self-employment.</td>
</tr>
<tr>
<td align="left">Incentives</td>
<td align="left">-</td>
<td align="left">The majority of programmes used monetary incentives. Although the incentives differed, what was evident was that the use of incentives significantly increased participation. Similar incentives are suggested.</td>
</tr>
<tr>
<td align="left" rowspan="3">Facilitators</td>
<td align="left">Pairing</td>
<td align="left">The majority of studies reported having used two trainers, generally male&#x2013;female pairs.</td>
</tr>
<tr>
<td align="left">Prerequisites</td>
<td align="left">Facilitators were generally social workers, labour advisors, educational counsellors and high school teachers, with well-developed social skills and emotional intelligence.</td>
</tr>
<tr>
<td align="left">Training</td>
<td align="left">The suggested duration of training is 48 h (two days). Regardless of the duration, emphasis was placed on ensuring that facilitators had the required skills and that they were comfortable with, and capable of, following the protocol.</td>
</tr>
<tr>
<td align="left">Duration of programme</td>
<td align="left">-</td>
<td align="left">Programmes were generally delivered over five 4 h sessions in a one-week period.</td>
</tr>
<tr>
<td align="left">Group sizes</td>
<td align="left">-</td>
<td align="left">Groups consisting of between 12 and 20 participants were reported as ideal to achieve the intended outcomes.</td>
</tr>
<tr>
<td align="left">Venue of training</td>
<td align="left">-</td>
<td align="left">Based on availability and convenience, venues located near participants and large enough to accommodate 25 people were generally used.</td>
</tr>
<tr>
<td align="left">Stakeholders</td>
<td align="left">-</td>
<td align="left">It was consistently shown that when government and other essential parties were involved to advocate for the programme, support and resources provided by such parties made it possible to expand and sustain the programme.</td>
</tr>
<tr>
<td align="left" rowspan="5">Process evaluation</td>
<td align="left" rowspan="3">Methodology</td>
<td align="left">Data collection method</td>
<td align="left">Data were generally collected using self-administered questionnaires.</td>
</tr>
<tr>
<td align="left">Research design and collection intervals</td>
<td align="left">Randomised field study designs were used most frequently. However, due to ethical reasons, both experimental and control groups should benefit equally from the study. Therefore, a quasi-experimental design is recommended. Data were collected at pre-, post- and post-post intervention intervals. Similar intervals seem suitable.</td>
</tr>
<tr>
<td align="left">Randomisation</td>
<td align="left">It is suggested that participants be randomly selected and assigned to either the control or intervention group.</td>
</tr>
<tr>
<td align="left">Integrity manipulation checks</td>
<td align="left">-</td>
<td align="left">A method that worked effectively seems to be participant evaluation surveys as well as the use of independent observers to assess the programme.</td>
</tr>
<tr>
<td align="left">Impact evaluation <italic>Outcomes</italic></td>
<td align="left">-</td>
<td align="left">The programme was the most beneficial for participants with a high risk for depression and the long-term unemployed.</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</app>
</app-group>
<fn-group>
<fn><p><bold>How to cite this article:</bold> Paver, R., De Witte, H., Rothmann, S., Van den Broeck, A. &#x0026; Blonk, R., 2020, &#x2018;A systematic literature review of the implementation and evaluation of the JOBS programme: A suggested framework for South Africa&#x2019;, <italic>South African Journal of Economic and Management Sciences</italic> 23(1), a3049. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/sajems.v23i1.3049">https://doi.org/10.4102/sajems.v23i1.3049</ext-link></p></fn>
</fn-group>
</back>
</article>