You are here

FAU Collections » FAU Research Repository » FAU Theses and Dissertations

Performance measurement using trained observer ratings: The effect of environmental variables on comparative measures in local government

Download pdf | Full Screen View

Date Issued:
2003
Summary:
Comparative performance measurement is an anathema to most government officials. While internal comparison with national benchmarks or other similar agencies is an accepted management analysis tool, public comparisons are deemed too politically risky for all but a few governments, agencies, and non-profits. To avoid the unappealing prospect of being unfavorably ranked versus comparable agencies, governments cite two primary objections. First, performance measurement is considered an inexact science, subject to manipulation of input data and outcome scores that affects comparisons. Second, comparative measurement is considered unfair by governments because they maintain each operates in a unique environment of demographic and physical characteristics beyond their control which have significant effects on their ability to deliver quality services. This research addresses both of these objections to comparative performance measurement. It uses trained observer ratings, an accepted objective measurement system, and utilizes a scoring scheme that results in a ratio variable outcome score appropriate for comparisons and statistical analysis. The model was employed for external random testing of street appearance across 30 governments in Broward County, Florida, eliminating the possibility of manipulation by those being measured. In addition, the research evaluates the effects of twelve independent variables, which measure characteristics of each community's unique environment. The research question is whether the effects of the external environmental factors on the composite street rating scores are so significant as to make comparisons meaningless, as government officials contend. The findings of this research do indicate that white, educated, affluent residents tend to live in cities with better streets and that environment is an important element in street appearance. Further, the standard deviation scores indicate that the more diversity in the environment of a city, the more diversity in the quality of its streets. Nonetheless, the conclusion of the research is that although environment is significant, the methods and findings of the model can be employed to control for environmental effects in future comparative performance efforts to assuage the concerns of governments being compared.
Title: Performance measurement using trained observer ratings: The effect of environmental variables on comparative measures in local government.
478 views
30 downloads
Name(s): Giancoli, Donald Patrick
Florida Atlantic University, Degree Grantor
Thai, Khi V., Thesis Advisor
Type of Resource: text
Genre: Electronic Thesis Or Dissertation
Date Issued: 2003
Publisher: Florida Atlantic University
Place of Publication: Boca Raton, Fla.
Physical Form: application/pdf
Extent: 234 p.
Language(s): English
Summary: Comparative performance measurement is an anathema to most government officials. While internal comparison with national benchmarks or other similar agencies is an accepted management analysis tool, public comparisons are deemed too politically risky for all but a few governments, agencies, and non-profits. To avoid the unappealing prospect of being unfavorably ranked versus comparable agencies, governments cite two primary objections. First, performance measurement is considered an inexact science, subject to manipulation of input data and outcome scores that affects comparisons. Second, comparative measurement is considered unfair by governments because they maintain each operates in a unique environment of demographic and physical characteristics beyond their control which have significant effects on their ability to deliver quality services. This research addresses both of these objections to comparative performance measurement. It uses trained observer ratings, an accepted objective measurement system, and utilizes a scoring scheme that results in a ratio variable outcome score appropriate for comparisons and statistical analysis. The model was employed for external random testing of street appearance across 30 governments in Broward County, Florida, eliminating the possibility of manipulation by those being measured. In addition, the research evaluates the effects of twelve independent variables, which measure characteristics of each community's unique environment. The research question is whether the effects of the external environmental factors on the composite street rating scores are so significant as to make comparisons meaningless, as government officials contend. The findings of this research do indicate that white, educated, affluent residents tend to live in cities with better streets and that environment is an important element in street appearance. Further, the standard deviation scores indicate that the more diversity in the environment of a city, the more diversity in the quality of its streets. Nonetheless, the conclusion of the research is that although environment is significant, the methods and findings of the model can be employed to control for environmental effects in future comparative performance efforts to assuage the concerns of governments being compared.
Identifier: 9780496426522 (isbn), 12043 (digitool), FADT12043 (IID), fau:12590 (fedora)
Note(s): Thesis (Ph.D.)--Florida Atlantic University, 2003.
Subject(s): Local government--Labor productivity
Comparative government--Methodology
Municipal government--United States--Evaluation
Held by: Florida Atlantic University Libraries
Persistent Link to This Record: http://purl.flvc.org/fau/fd/FADT12043
Sublocation: Digital Library
Use and Reproduction: Copyright © is held by the author with permission granted to Florida Atlantic University to digitize, archive and distribute this item for non-profit research and educational purposes. Any reuse of this item in excess of fair use or other copyright exemptions requires permission of the copyright holder.
Use and Reproduction: http://rightsstatements.org/vocab/InC/1.0/
Host Institution: FAU
Is Part of Series: Florida Atlantic University Digital Library Collections.