Co-production and innovation in public services’ assessment: The case of the Citizen Audit Project
DOI:
https://doi.org/10.5902/1983465963947Keywords:
internal audit, participatory audit, assessment of public services, co-production, innovation.Abstract
Purpose: This paper analyzes the Citizen Audit Project (PAC), in the light of public sector innovation theory, in order to identify challenges for introducing co-production in the evaluation process of public services by the internal audit of the Executive Power of the State of Santa Catarina, Brazil.
Design/methodology/approach: We carried out the study as a qualitative research, and collected data through a documentary search and interviews with 21 key agents of public control or with those who interacted with PAC in the chosen operations. We used content analysis to examine the collected data.
Findings: We analyze the main challenges inherent to co-production in the activity of public services’ assessment by internal audit. Results show an alignment between the identified dares and the theoretical basis of public innovation. These were barriers related to bureaucratic dysfunctions, openness of political agents and audit professionals to receive and consider proposals from society, time and resources needed, leadership style, citizens’ lack of motivation, and the evaluation model.
Originality/value/implications: The paper contributes to the literature on public audit, public sector innovation, and co-production, by conducting an original study that identified challenges related to the implementation of co-production in audit process and analyzed them from the perspective of public sector innovation. Evidence brought by this research contributes to fill literature gaps regarding empirical studies on the convergence between these three topics. Regarding practical implications, it provides base for PAC consolidation and for its replication by governments interested in implementing innovations through the process of participatory audit.
Downloads
References
Abrucio, F. L. (1997). O impacto do modelo gerencial na Administração Pública: Um breve estudo sobre a experiência internacional recente. Cadernos ENAP, n. 10. http://repositorio.enap.gov.br/handle/1/556
Affiliated Network for Social Accountability in East Asia and the Pacific [ANSA-EAP] (2018). CPA Learning Guidebook. Retrieved from http://www.ansa- eap.net/resources/thematic/cpa-learning-guidebooks/
Agranoff, R. (2014). Reconstructing bureaucracy for service: Innovation in the governance era. In: C. Ansell & J. Torfing (Eds.), Public Innovation through Collaboration and Design (ch. 3). New York: Routledge.
Amanatidou, E., Gritzas, G., & Kavoulakos, K. I. (2015). Time banks, co-production and foresight: Intertwined towards an alternative future. Foresight: the Journal of Futures Studies, Strategic Thinking and Policy, 17(4), 308–331. https://doi.org/10.1108/FS-05-2014-0035
Ansell, C. (2012). What is a 'Democratic Experiment'? Contemporary Pragmatism, 9(2), 159–180. https://doi.org/10.1163/18758185-90000235
Ansell, C., & Torfing, J. (Eds.) (2014). Public Innovation through Collaboration and Design. London: Routledge.
Arnstein, S. R. (1969). A ladder of citizen participation. Journal of the American Institute of Planners, 35(4), 216-224. https://doi.org/10.1080/01944366908977225
Barrutia, J. M., & Echebarria, C. (2019). Drivers of exploitative and explorative innovation in a collaborative public-sector context. Public Management Review, 21(3), 446–472. https://doi.org/10.1080/14719037.2018.1500630
Barzelay, M. (1997). Central audit institutions and performance auditing: A comparative analysis of organizational strategies in the OECD. Governance, 10(3), 235-260. https://doi.org/10.1111/0952-1895.411997041
Barzelay, M (2000a). Performance auditing and the new public management: Changing roles and strategies of central audit institutions. In T. Miyakawa (Ed.), The Science of Public Policy: Essential Readings in Policy Sciences II, vol. VII (pp. 52-90). London: Routledge.
Barzelay, M. (2000b). The new public management: A bibliographical essay for Latin American (and other) scholars. International Public Management Journal 3(2), 229 - 265. https://doi.org/10.1016/S1096-7494(00)00038-6
Behn, R. D. (1998). O novo paradigma da gestão pública e a busca da accountability democrática. Revista do Serviço Público, 49(4), 5-45. Retrieved from http://repositorio.enap.gov.br/handle/1/1560
Bovaird, T. (2007). Beyond engagement and participation: User and community coproduction of public services. Public Administration Review, 67(5), 846-860. https://doi.org/10.1111/j.1540-6210.2007.00773.x
Boyle, D., & Harris, M. (2009). The challenge of co-production: How equal partnerships between professionals and the public are crucial to improving public services [Discussion paper]. London: NESTA. Retrieved from http://b.3cdn.net/nefoundation/312ac8ce93a00d5973_3im6i6t0e.pdf.
Brandão, S. M., & Bruno-Faria, M. F. (2017). Barreiras à inovação em gestão em organizações públicas do governo federal brasileiro: Análise da percepção de dirigentes. In P. Cavalcante, M. Camões, B. Cunha, & W. Severo (Orgs.), Inovação no Setor Público: teoria, tendências e casos no Brasil (cap. 7). Brasília: IPEA. Retrieved from http://repositorio.ipea.gov.br/handle/11058/8795
Brandsen, T., Steen, T., & Verschuere, B. (2018). Co-production and co-creation. Engaging citizens in public services. New York: Routledge. http://library.oapen.org/handle/20.500.12657/25001
Cavalcante, P. L. C. (Org.) (2019). Inovação e políticas públicas: Superando o mito da ideia. Brasília: IPEA. http://repositorio.ipea.gov.br/handle/11058/9330
Cavalcante, P., Camões, M., Cunha, B., & Severo, W. (2017). Inovação no setor público: Teoria, tendências e casos no Brasil. Brasília: ENAP/IPEA. http://repositorio.enap.gov.br/handle/1/2989
Clark, B. Y. (2021). Co-assessment trough digital technologies. In E. Loeffler & T. Bovaird (Eds.). The Palgrave Handbook of Co-Production of Public Services and Outcomes (pp. 429-449). London, UK: Palgrave Mcmillan.
Crosby, B. C., Hart, P., & Torfing, J. (2017). Public value creation through collaborative innovation. Public Management Review, 19(5), 655-669. https://doi.org/10.1080/14719037.2016.1192165
Dell'Era, C., Magistretti, S., Cautela, C., Verganti, R., & Zurlo, F. (2020). Four kinds of design thinking: From ideating to making, engaging, and criticizing. Creativity and Innovation Management, 29(2), 324-344. https://doi.org/10.1111/caim.12353
Denhardt, R. B., & Denhardt, J. V. (2007). The new public service: Serving, not steering (Expanded edition). New York: ME Sharpe.
Denhardt, R. B., & Denhardt, J. V. (2015). The new public service revisited. Public Administration Review, 75(5), 664-672. https://doi.org/10.1111/puar.12347
Effective Institutions Platform [EIP] (2014). Supreme Audit Institutions and Stakeholder Engagement Practices: A Stocktaking Report. Retrieved from https://www.effectiveinstitutions.org/media/Stocktake_Report_on_Supreme_Audit_Institutions_and_Citizen_Engagement_.pdf
Evers A. Ewert, B. (2021). Unerstanding Co-Production as a Social Innovation. In E. Loeffler & T. Bovaird (Eds.). The Palgrave Handbook of Co-Production of Public Services and Outcomes (pp. 133-154). London, UK: Palgrave Mcmillan.
Fung, A. (2013). Infotopia: Unleashing the democratic power of transparency. Politics & Society, 41(2), 183-212. Retrieved from http://www.transparencypolicy.net/assets/FungInfotopia2013.pdf.
Gascó, M., & van Eijk, C. (2018). Unravelling the co-producers: Who era they and what motivations do they have? In T. Brandsen, T. Steen, & B. Verschuere (Eds.), Co-production and co-creation. Engaging citizens in public services (pp. 63-76). New York: Routledge.
Goetz, A. M., & Gaventa, J. (2001). Bringing citizen voice and client focus into service delivery [IDS Working Paper n. 138]. Brighton: Institute of Development Studies. Retrieved from https://opendocs.ids.ac.uk/opendocs/bitstream/handle/20.500.12413/3900/Wp138.pdf
Goetz, A. M., & Jenkins, R. (2001). Hybrid forms of accountability: citizen engagement in institutions of public-sector oversight in India. Public Management Review, 3(3), 363-383. https://doi.org/10.1080/14616670110051957
Goldstein, B. E. (2008). Skunkworks in the embers of the Cedar Fire: Enhancing resilience in the aftermath of disaster. Human Ecology, 36(1), 15–28. https://doi.org/10.1007/s10745-007-9133-6
Governo do Estado de Santa Catarina/Secretaria Estadual da Fazenda/Auditoria Geral [GESC/SEF/DIAG]. (2016a). Relatório de Inspeção Nº 0001/16 – Operação Merenda Escolar. Florianópolis: DIAG.
GESC/SEF/DIAG. (2016b). Relatório de Inspeção Nº 0002/16 – Operação Emergência. Florianópolis: DIAG.
GESC/SEF/DIAG. (2016c). Relatório de Inspeção Nº 0003/16 – Operação transferências. Florianópolis: DIAG.
GESC/SEF/DIAG. (2016d). Relatório de Inspeção Nº 0004/16 – Operação Meio Ambiente. Florianópolis: DIAG.
GESC/SEF/DIAG. (2016e). Relatório de Inspeção Nº 0036/16 – Operação APAE’s. Florianópolis: DIAG.
GESC/SEF (2017a). Balanço Geral do Estado, Exercício de 2016. Vol. II. Retrieved from http://www.sef.sc.gov.br/arquivos_portal/relatorios/8/Volume_II.pdf.
GESC/SEF/DIAG. (2017b). Relatório de Inspeção Nº 0004/17 – Operação Merenda Escolar - Norte. Florianópolis: DIAG.
GESC/SEF/DIAG. (2017c). Relatório de Inspeção Nº 0156/17 – Operação Uniedu. Florianópolis: DIAG.
GESC/SEF (2018). Balanço Geral do Estado, Exercício de 2017. Vol. II. Retrieved from http://www.sef.sc.gov.br/arquivos_portal/relatorios/8/Balanco_Geral_Volume_2.pdf.
Grandvoinnet, H., Aslam, G., & Raha, S. (2015). Opening the Black Box: The Contextual Drivers of Social Accountability (New Frontiers of Social Policy Collection). Washington, DC: World Bank. Retrieved from https://www.openknowledge.worldbank.org/handle/10986/21686.
Hood, C. (1995). The "new public management" in the 1980s: variations on a theme. Accounting, Organizations and Society, 20(2/3), 93-109. https://doi.org/10.1016/0361-3682(93)E0001-W
Hood, C., & Jackson, M. W. (1991). Administrative argument. London: Dartmouth Publishing Group.
Institute of Internal Auditors [IIA] (2016). International Professional Practices Framework - IPPF. Retrieved from https://na.theiia.org/standards-guidance/Pages/Standards-and-Guidance-IPPF.aspx.
International Organization of Supreme Audit Institutions [INTOSAI] (2004). GOV 9100 Guidelines for Internal Control Standards for the Public Sector. Retrieved from http://www.issai.org/en_us/site-issai/issai-framework/intosai-gov.htm
INTOSAI (2013a). Report on the 22nd UN/INTOSAI Symposium on Government Audit. Vienna. Retrieved from http://www.intosai.org/fileadmin/downloads/downloads/5_events/symposia/2013/EN_22_UN-INT_SympReport_Attachments.pdf.
INTOSAI (2013b). Communicating and Promoting the Value and Benefits of SAIs: An INTOSAI Guideline. Retrieved from http://iniciativatpa.org/2012/wp-content/uploads/2014/06/Communicating-and-promoting-the-value-and-benefits-of-SAIs-Guideline.pdf.
Kinder, T. (2013). Innovation in an inter-organizational context. In S. P. Osborne & L. Brown (Eds.), Handbook of Innovation in Public Services (ch. 21). Cheltenham, UK: Edward Elgar.
Kliksberg, B. (1999). Seis teses não-convencionais sobre participação. Revista de Administração Pública, 33(3), 7-37. Retrieved from http://bibliotecadigital.fgv.br/ojs/index.php/rap/article/view/7634/6168
Klumb, R., & Hoffmann, M. G. (2016). Inovação no setor público e evolução dos modelos de administração pública: O caso do TRE-SC. Cadernos Gestão Pública e Cidadania, 21(69), 86-103. https://doi.org/10.12660/cgpc.v21n69.53902
Koppenjan, J., Kars, M., & van der Voort, H. (2009). Vertical politics in horizontal policy networks: Framework setting as coupling arrangement. Policy Studies Journal, 37(4), 769–792. https://doi.org/10.1111/j.1541-0072.2009.00334.x
Kozuch, B., & Sienkiewicz-Malyjurek, K. (2016). Factors of effective inter-organizational collaboration: a framework for public management. Transylvanian Review of Administrative Sciences, 47, 97-115. Retrieved from http://rtsa.ro/tras/index.php/tras/article/view/474/463
Landry, J., & Angeles, L. (2011). Institutionalizing participation in municipal policy development: Preliminary lessons from a start-up process in Plateau-Mont-Royal. Canadian Journal of Urban Research, 20(1), 105–131. Retrieved from https://www.jstor.org/stable/26193857
Lopes, A. V., & Farias, J. S. (2020). How can governance support collaborative innovation in the public sector? A systematic review of the literature. International Review of Administrative Sciences, p. 1-17. https://doi.org/10.1177/0020852319893444
Mckenna, D. (2021). Co-assessment through citizens and service users in audit, inspection ad scrutinity. In E. Loeffler & T. Bovaird (Eds.). The Palgrave Handbook of Co-Production of Public Services and Outcomes (pp. 451-467). London, UK: Palgrave Mcmillan.
Merton, R. (1978). Estrutura burocrática e personalidade. In E. Campos (Org.) Sociologia da burocracia (4a ed.). Rio de Janeiro: Zahar.
Moore, M., & Hartley, J. (2010). Innovations in governance. In S. P. Osborne (Ed.), The new public Governance? Emerging perspectives on the theory and practice of public governance. London: Routledge.
Olivieri, C. (2011). Os controles políticos sobre a burocracia. Revista de Administração Pública, 45(5), 1395-1424. Retrieved from http://bibliotecadigital.fgv.br/ojs/index.php/rap/article/view/7041
Olivieri, C., Loureiro, M. R., Teixeira, M. A. C., & Abrucio, F. L. (2015). Control and public management performance in Brazil: Challenges for coordination. International Business Research; 8(8), 181-190. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.832.3466&rep=rep1&type=pdf
Osborne, S. P. (2006). The new public governance? Public Management Review, 8(3), 377–388. https://doi.org/10.1080/14719030600853022.
Osborne, S. P. (2010). Public governance and public services delivery: A research agenda for the future. In S. P. Osborne (Ed.), The new public governance? Emerging perspectives on the theory and practice of public governance. New York: Routledge.
Osborne, S. P. (2013). A service-influence approach to public service innovation? In S.P. Osborne, & L. Brown (Eds.), Handbook of Innovation in Public Services. Cheltenham, UK: Edward Elgar.
Osborne, D., & Gaebler, T. (1992). Reinventing government: How the entrepreneurial spirit is transforming the public sector. New York: Penguin Books.
Osborne, S. P., Radnor, Z., & Strokosch, K (2016). Co-production and the co-creation of value in public sector: a suitable case for treatment? Public Management Review, 18(5), 639-653. https://doi.org/10.1080/14719037.2015.1111927
Osborne, S. P., & Strokosch, K. (2013). It takes two to tango? Understanding the co-production of public services by integrating the services management and public administration perspectives. British Journal of Management, 24, S31-S47. https://doi.org/10.1111/1467-8551.12010
Padley, M. (2013). Delivering localism: The critical role of trust and collaboration. Social Policy & Society, 12(3), 343-354. Retrieved from http://journals.cambridge.org/abstract_S1474746413000134
Pestoff, V. (2011). Co-production, new public governance and third sector social services in Europe. Ciências Sociais Unisinos, 47(1), 15-24. https://doi.org/10.4013/csu.2011.47.1.02
Power, M. (1994). The audit explosion. London: Demos. Retrieved from https://www.demos.co.uk/files/theauditexplosion.pdf.
Power, M. (2000). The audit society - Second thoughts. International Journal of Auditing, 4(1), 111-119. https://doi.org/10.1111/1099-1123.00306
Rocha, A. C. (2007). Auditoria de Gestão – Uma forma eficaz de promoção da Accountability. In Anais do 31º Encontro Nacional da Associação Nacional de Pós-Graduação e Pesquisa em Administração, Rio de Janeiro. Rio de Janeiro: ANPAD
Rocha, A. C. (2011a). Accountability na Administração Pública: Modelos teóricos e abordagens. Contabilidade, Gestão e Governança, 14(2), 82-97. Retrieved from https://www.revistacgg.org/contabil/article/view/314
Rocha, A. C. (2011b). Realização do potencial de accountability dos pareceres prévios do Tribunal de Contas do Estado de Santa Catarina (PhD dissertation). Universidade Federal da Bahia, Salvador. Retrieved from http://www.adm.ufba.br/sites/default/files/publicacao/arquivo/Arlindo%20Rocha%20-%20Tese%20completa%20-%20Vers%C3%A3o%20final%20em%20PDF.pdf.
Rocha, A. C., & Quintiere, M. M. R (2011). Auditoria Governamental: Uma abordagem metodológica da Auditoria de Gestão. Curitiba: Juruá.
Rocha, A. C., Spaniol, E. L., Schommer, P. C., & e Souza, A. D. (2012). A coprodução do controle como bem público essencial à accountability. Anais do XXXVI Encontro Nacional da Associação de Pesquisa e Pós-Graduação em Administração, Rio de Janeiro. Rio de Janeiro: ANPAD.
Rocha, A. C. (2013). Accountability - Constituinte necessária das sociedades democráticas. ReFAE -Revista da Faculdade de Administração e Economia, 5(1), 81-100. Retrieved from http://bibliotecadigital.tse.jus.br/xmlui/handle/bdtse/2888
Salm, J. F., & Menegasso, M. E. (2009). Os modelos de Administração Pública como estratégias complementares para a coprodução do bem público. Revista de Ciências da Administração, 11(25), 97-120. https://doi.org/10.5007/2175-8077.2009v11n25p83
Schommer, P. C., Rocha, A. C., Spaniol, E. L., Dahmer, J., & Souza, A. D. (2015). Accountability and co-production of information and control: Social observatories and their relationship with government agencies. Revista de Administração Pública, 49(6), 1375-1400. http://dx.doi.org/10.1590/0034-7612115166
Schommer, P. C., & Tavares, A. O. (2017). Gestão Social e Coprodução de Serviços Públicos. Curso de Gestão Social (Fascículo 4). Fortaleza: Fundação Demócrito Rocha/UANE/BID/STDS-CE. Retrieved from https://drive.google.com/file/d/1qxsytR4SNCBW8mkdsny8EUT5RGf13ONE/view
Schuch, E. M., & Hoffmann, M. G. (2021). Co-criação e design thinking: uma experiência de inovação no serviço público em um município brasileiro. Teoria e Prática em Administração, Ahead of Print, 1-13.
Steen, T., & Tuurnas, S. (2018). The roles of the professional in co-production and co-creation processes. In T. Brandsen, T. Steen, & B. Verschuere (Eds.). Co-production and co-creation. Engaging citizens in public services (ch. 8). New York: Routledge.
Strokosch, K. (2013). Co-production and innovation in public services: Can co-production drive innovation? In S. P. Osborne, & L. Brown (Eds.). Handbook of Innovation in Public Services (pp. 375-389). Cheltenham, UK: Edward Elgar.
Struecker, D., & Hoffmann, M. G. (2017). Participação social nos serviços públicos: caracterização do estado da arte por meio da bibliometria e da revisão sistemática. REGE - Revista de Gestão, 24(4), 371 - 380. https://doi.org/10.1016/j.rege.2017.03.008
Torfing, J. (2013). Collaborative innovation in the public sector. In S. P. Osborne & L. Brown (Eds.). Handbook of Innovation in Public Services (pp. 301-316). Cheltenham, UK: Edward Elgar.
Torfing, J., Ferlie, E., Jukić, T. & Ongaro, E. (2021). A theoretical framework for studying the co-creation of innovative solutions and public value. Policy & Politics, 49 (2), 189-209. https://doi.org/10.1332/030557321X16108172803520
Torfing, J., Sorensen, E., & Roiseland, A. (2019). Transforming the public sector into an arena for co-creation: Barriers, drivers and ways forward. Administration and Society, 51(5), 795-825. https://doi.org/10.1177/0095399716680057
Torfing, J., & Triantafillou, P. (2016). Enhancing Public Innovation by Transforming Public Governance? New York: Cambridge University Press.
Trischler, J., & Scott, D. R. (2016). Designing public services. The usefulness of three service design methods for identifying user experience. Public Management Review, 18(5), 718-739. https://doi.org/10.1080/14719037.2015.1028017
United Nations [UN] (2005). Unlocking the human potential for public sector performance. World Public Sector Report 2005. New York: Department of Economic and Social Affairs. Retrieved from http://unpan1.un.org/intradoc/groups/public/documents/un/unpan021616.pdf.
United Nations (2007). Auditing for social change: A strategy for citizen engagement in public sector accountability. New York: Department of Economic and Social Affairs. Retrieved from https://digitallibrary.un.org/record/610334
United Nations (2011a). Engaging citizens to enhance public sector accountability and prevent corruption in the delivery of public services [Expert Group Meeting report]. Vienna: Department of Economic and Social Affairs. Retrieved from http://unpan1.un.org/intradoc/groups/public/documents/un/unpan047647.pdf
United Nations (2011b). A practical guide to social audit as a participatory tool to strengthen democratic governance, transparency, and accountability. New York: UNDP - Regional Bureau for Latin America and the Caribbean. Retrieved from http://www.undp-aciac.org/publications/ac/books/practicalguide-socialaudit-e.pdf.
United Nations Department of Economic and Social Affairs [UNDESA] (2013). Citizen engagement practices by supreme audit institutions: Compendium of innovative practices of citizen engagement by supreme audit institutions for public accountability. New York: United Nations. Retrieved from http://www.intosai.org/fileadmin/downloads/downloads/4_documents/publications/eng_publications/Compendium_UNPAN92198.pdf.
Verschuere, B., Brandsen, T., & Pestoff, V. (2012). Co-production: The state of the art in research and the future agenda. Voluntas: International Journal of Voluntary and Nonprofit Organizations, 23(4), 1083-1101. https:// doi.org/10.1007/s11266-012-9307-8
Voorberg, W, H., Bekkers, V. J. J. M., & Tummers, L. G. (2014). A systematic review of co-creation and co-production: Embarking on the social innovation journey. Public Management Review, 17(9), 1333–1357. https://doi.org/10.1080/14719037.2014.930505
Weber, M. (1978). Os fundamentos da organização burocrática: Uma construção do tipo ideal. In E. Campos (Org.), Sociologia da Burocracia (4a ed.). Rio de Janeiro: Zahar.
World Bank (2014). Strategic framework for mainstreaming citizen engagement in World Bank Group operations. Retrieved from http://documents.worldbank.org/curated/en/266371468124780089/pdf/929570WP0Box380ategicFrameworkforCE.pdf.
World Bank Group/Asociación Civil por la Igualdad y la Justicia [WBG/ACIJ] (2015). E-Guide on engaging citizens in the audit process. Retrieved from http://www.e-participatoryaudit.org/index.html.
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Revista de Administração da UFSM
This work is licensed under a Creative Commons Attribution 4.0 International License.
This journal remains the copyright holders of articles published. In order to be published, authors must sign the Copyrights Letter, which is sent to the authors by e-mail, thus granting rights, including on translation, to ReA/UFSM. The journal grants third parties the right to use, reproduce, and share the article according to the Creative Commons license agreement (CC-BY 4.0), as stated in the article’s PDF documents.
