Win ShihUniversity at Albany Libraries, State University of New York 2010.03*

Public Library AssessmentDecisions are based on facts, research, and analysis, and where services are planned and delivered in ways that maximize positive outcomes and impacts for customers and stakeholders.*

Why We Evaluate? A desire to expand services A desire to improve management & prioritize services , An interest in know the impact of services & programs Being responsive to a funding agency *

U.S. Institute of Museum and Library Services 2007

Measurement & Evaluation *

The Assessment Paradigm Resources > Capability > Utilization > Impact > > > Resources: input measures : Capability: processing measures : Utilization: output measures : Impact: outcome measures :

Measurement & Evaluation*

Input measures: resources allocated (annual budget, size of collection, number of staff) : (, , ) Process measures: transform resources into activities (quantify time or cost to perform specific task or activity such as ordering, receiving, cataloging) : (, , , )Measurement & Evaluation*

Output measures: how inputs and processes utilized (annual circulation, number of reference questions answered, number of users served: (, , )Measurement & Evaluation*

What can we evaluate??How much we do: statistics : How well we do: customer satisfaction, quality benchmarks & standard: , *

What we are worth: ROI, cost benefit : ,

Why we matter: outcomes measurement, assessment of impact : ,*What can we evaluate? ?

Tools Used for AssessmentThe Public Library Service: IFLA/UNESCO Guidelines for Development 2001: /*

The New Planning for Results by Sandra Nelson for the Public Library Association 2001

Tools Used for Assessment

*

Public Library Data Service Statistical Report www.pla.org/plds

Tools Used for Assessment*

U.S. State Standards each different -Standards for Illinois Public librariesTools Used for Assessment*

Staffing levels Tools Used for Assessment*

Hours of services by population Tools Used for Assessment*

Library collection levels Tools Used for Assessment*

Who uses the standards Guide for librarians, library staff, and board trustees during budget preparation and strategic planning ,, , Reveal library strengths and weaknesses

Tools Used for Assessment*

How are standards used? Review, reflect, and refine library s service philosophy and strategic planning , Director uses to share librarys progress as well as recommend changes to library boardTools Used for Assessment*

How are standards used? Library staff meetings focus on standards to enhance staffs understanding of librarys service philosophyTools Used for Assessment*

U.S. Institute of Museum and Library Services and National Center for Education Statisticshttp://harvester.census.gov/imls/compare/index.aspStatistics are collected from over 9,000 public libraries. Data are available for individual public libraries and are also aggregated to state and national levels9000. , Compare Public Libraries - Use site to create reports comparing one library of interest to other libraries

Tools Used for Assessment*

How Does Your Public Library Compare with Service Performance of Peer Groups Comparisons of service performance based on 5 input variable and 7 output variables.57

Tools Used for Assessment*

Tools Used for Assessment*

Hennens American Public Library Ratings (HAPLR) http://www.haplr-index.com

Public Library RatingsExpend. per capita Percent Budget to materialsMaterials Expend. Per capitaFTE staff per 1,000 popul ()Periodicals per 1000 residents ()Volumes per CapitaCost per circulation (low to high) Visits per capitaCollection turnoverCirculation per FTE Staff HourCirculation per CapitaReference per capitaCirculation per hourVisits per hour Circulation per visit *

*

(Americas Star Libraries):http://www.libraryjournal.com/article/CA6629180.htmlStarted in 2008 Library Journal 2008 (LJ)Measures (IMLS 2006): library visits circulation program attendance public Internet computer uses Total 256 listed as 3 star, 4 star, and 5 star libraries 256 ,Recommended model Americas Star Libraries *

Library Journal www.libraryjournal.comLibrary of the Year Movers & Shakers Carnegie/New York Times I Love My Librarian Award /-http://www.ilovelibraries.org/Local outlets newspapers, etc.

Special Awards *

Listening to Customers Surveys to measure customer expectationsFocus group interviews Mining the automated systems

Other ways *

Public libraries, outcomes and quality of lifehttp://www.iisd.org/measure/compendium/International Institute for Sustainable Development Sustainability Indicators-

Libraries Enrich Life*

Decision about which indicates to use to measure quality of life by state or community is result of neighbor meetings or visioning project to provide consensus about important variables that contribute to communitys definition of well beingLibraries Enrich Life*

Jacksonville, Florida Quality of Life Project library circulation is an indicator (http://www.jcci.org/)

Libraries Enrich Life*

The Quality of Life Progress Report includes over 100 indicators that reflect trends in nine external environments9100 education; economy; environment; social wellbeing; arts, culture, and recreation (library circulation per person); health; government; transportation; and safety.;, Libraries Enrich Life*

Libraries Enrich LifeFate of most public libraries in U.S. is entirely a local matter

*

Suggested readingsDemonstrating results: using outcome measurement in your library by Rhea Joyce Rubin, Public Library Association 2006 The New Planning for Results by Sandra NelsonPublic Library Association 2001

*

Thank You! !

Questions & Answers *

*-What need to be assessed? size size,cataloging, circulation) -Operating Revenue and Expenditures(headcount, use) User satisfaction Outcome of the library service value of library services

**Sections include: role and purpose, legal and financial framework, meetings the needs of users, collection development, human resources, management and marketingManagement tools discussed include: community needs analysis, monitoring and evaluation, performance measurementhttp://archive.ifla.org/VII/s8/proj/publ97.pdfThe Public Library Service: the IFLA/UNESCO Guidelines for Developmentby Ed. by Philip Gill In collab. with Section of Public LibrariesSeries: IFLA Publications Series 97 Publisher: Mnchen: K.G. Saur, 2001

*Previously standards since 1966 planning process that encouraged each library to develop its own goals to reflect community needsService response is what a library does for, or offers to, the public in an effort to meet a set of well-defined community needsWays libraries serve the public: basic literacy, business and career information, commons, community referral, consumer information, cultural awareness, current topics and titles, formal learning support, general information, government information, information literacy, lifelong learning, local history and genealogy.Provides example of needs addressed by service response, what library does and provides, possible components of basic service, target audience and service aspects, resource allocation issues, possible measures to consider when developing objectives, basic stories

*Designed to meet the needs of public library administrators and others, including media outlets, for timely and relevant library-specific data that supports a wide variety of management decisions.Published annually, the PLDS Statistical Report collects information from more than 800 public libraries across the United States and Canada on finances, library resources, annual use figures and technology.In addition, each annual PLDS report contains a special survey highlighting statistics on one service area or public library topic. 2009 includes a special survey on library facilities The current edition will help library managers identify top performing libraries, compare service levels and technology usage and provide documentation for funding requests. The Statistical Report 2009 is available for purchase in both print and database subscription

The Public Library Data Service (PLDS) Statistical Report, a project of the Public Library Association, is designed to meet the needs of public library administrators and others for timely and effective library-specific data that illuminates and supports a wide variety of management decisions. Since its beginning in 1988, PLDS reports have also been used extensively by the press to better understand public libraries. Published annually, the PLDS report presents exclusive, timely data from more than 800 public libraries across the United States and Canada on finances, library resources, annual use figures, and technology. In addition to these valuable topics, each year's edition contains a special survey highlighting statistics on one service area or topic. The 2008 report contains a special survey on public library finance.

*Data and statistics used with planning process to establish case of library support at local levelCategories for basic library statistical data at national levelReporting unit and target population, human resources, collection resources, infrastructure, finances, servicesServing our Public 2.0: Standards for Illinois Public Libraries

Basic essential standards: operate in compliance with Illinois library law, have organized collection of information, have written library policies approved by librarys governing body, have fixed location with posted regular hours of services, have trained paid staff to management the collection and provide access to it, be supported in part of in whole by public funds, have an identifiable library materials budget and 24 core standardsChapter topics: governance and administration, personnel, facilities, technology, access, collection management and resource sharing, public services including reference and readers advisory services, programming, marketing, promotion, collaboration*i.e. librarys jurisdiction population is 8,500, the library wishes to achieve the growing level, the library population is 5000-9999, and basic is 2 FTE, but to be growing, the library needs to the number of additional FTEs needed to reach the growing, is .5 per 1,000 population. Multiple by 8.5 x 1000 x .5 =4.25So, the library will need to have 2 + 4.25 =6.25 FTE. *Same concept, for library hours. The consideration should be given to the convenience of users in establishing hours of operation. Every library should have some evening hours past 5pm. And some weekend hours including a minimum of four hours on Saturday. *Book collection: Example: The Librarys jurisdictional population is 38,000The library wishes to achieve the established levelThe librarys population is in the 25000-49000 range. Therefore, the base for the library is 70000The established level for this range is 2.75 volumes per capitaMultiply 2.75 x 38000 =104500Add this 104500+70000=174500

May ask a question: What kind of measure this is? Resources: input measures Capability: processing measures Utilization: output measures Impact: outcome measures

**Nationwide descriptive statistics on public libraries are collected and disseminated annually through a voluntary census, the Public Libraries Survey. The survey is conducted by the U.S. Census Bureau for the Institute for Museums and Library Services (IMLS). Statistics are collected from over 9,000 public libraries. Data are available for individual public libraries and are also aggregated to state and national levels.Compare Public Libraries - Use site to create reports comparing one library of interest to other libraries*Input variables includes public service hours per year, total librarians, total ALA-MLS librarians, total number of subscriptions, total number of books and serials. Output variables included library visits per capita, childrens program attendance, circulation of childrens materials, interlibrary loans received per 1,000 population, interlibrary loans provided, total per capita reference transactions, and total per capita circulation

*Measurement Category HALPR Weight Expend. per capita 3 Percent Budget to materials 2 Materials Expend. Per capita 2 FTE staff per 1,000 popul 2 Periodicals per 1000 residents 1 Volumes per Capita 1 Cost per circulation (low to high) 3 Visits per capita 3 Collection turnover 2 Circulation per FTE Staff Hour 2 Circulation per Capita 2 Reference per capita 2 Circulation per hour 2 Visits per hour 1 Circulation per visit 1**The LJ Index rates U.S. public libraries with total expenditures of $10,000 or more that serve populations of at least 1000. Ratings are based on four per-capita service indicators: library visits circulation program attendance public Internet computer uses

*Movers & Shakers - 50 or more up-and-coming individuals from across the United States and Canada who are innovative, creative, and making a difference. From librarians to vendors to others who work in the library field, Movers & Shakers 2010 will celebrate the new professionals who are moving our libraries ahead.

Carnegie Corporation of New York awarded the American Library Association $489,000 to support the Award. Administered by the ALAs Public Information Office and Campaign for Americas Libraries, the award encourages library users to recognize the accomplishments of librarians for their efforts to improve the lives of people in their community. http://www.ilovelibraries.org/

Local outlets newspapers, etc*Listening to CustomersSurveys to measure customer expectationsFocus group interviewsMining the automated systemsPublic libraries, outcomes and quality of lifeInternational Institute for Sustainable Development Sustainability IndicatorsDecision about which indicates to use to measure quality of life by state or community is result of neighbor meetings or visioning project to provide consensus about important variables that contribute to communitys definition of well being http://www.iisd.org/measure/compendium/Jacksonville, Florida Quality of Life Project library circulation is an indicatorFate of most public libraries in U.S. is entirely a local matter*Jacksonville's Quality of Life Progress Report" is probably the most well-known community indicators project. In 1985, the Jacksonville Chamber of Commerce and JCCI came together to measure the quality of life in the community, expanding beyond economic indicators to measure the breadth of what was important to the Jacksonville community. 100 community volunteers developed indicators for measuring the quality of life and created what are now 119 indicators in the following nine categories: Achieving Educational Excellence, Growing a Vibrant Economy, Preserving the Natural Environment, Promoting Social Wellbeing and Harmony, Enjoying Arts, Culture, and Recreation, Sustaining a Healthy Community, Maintaining Responsive Government, Moving Around Efficiently, and Keeping the Community Safe. The indicators have been updated annually to monitor Jacksonville's progress on community improvement, and reviewed annually by a citizen's committee that assigns Gold Stars and Red Flags to community priorities as the trendlines move toward or away from the Targets for 2005 set in 2000. In 2002, the Quality of Life and JCCI's other regional human services indicator project, the Community Agenda, were brought together in one document.*Jacksonville's Quality of Life Progress Report" is probably the most well-known community indicators project. In 1985, the Jacksonville Chamber of Commerce and JCCI came together to measure the quality of life in the community, expanding beyond economic indicators to measure the breadth of what was important to the Jacksonville community. 100 community volunteers developed indicators for measuring the quality of life and created what are now 119 indicators in the following nine categories: Achieving Educational Excellence, Growing a Vibrant Economy, Preserving the Natural Environment, Promoting Social Wellbeing and Harmony, Enjoying Arts, Culture, and Recreation, Sustaining a Healthy Community, Maintaining Responsive Government, Moving Around Efficiently, and Keeping the Community Safe. The indicators have been updated annually to monitor Jacksonville's progress on community improvement, and reviewed annually by a citizen's committee that assigns Gold Stars and Red Flags to community priorities as the trendlines move toward or away from the Targets for 2005 set in 2000. In 2002, the Quality of Life and JCCI's other regional human services indicator project, the Community Agenda, were brought together in one document.**