LIBR 285-10
Research Methods in Library and Information Science
Summer 2007 Greensheet
Joe Matthews
E-mail
Phone: (760)930-9223
Office Hours:
Office hours are conducted virtually. You may reach the instructor anytime using email.
| Greensheet Links Textbooks and Readings Course Requirements |
Resources Blackboard Blackboard Tutorials SLIS e-Bookstore |
Students must self-enroll for this course on Blackboard. You will be required to use a password access code. The code will be provided to you via the MySJSU Messaging system.
Course Description
Evaluation is a practical and important tool for any manager although it is often dismissed by some who claim “It is not REAL research.” The purpose of this course is to provide the student with an understanding of evaluation, and the strengths and limitations of the models and methodologies used in evaluation.
You should be cognizant that this class will help you build a toolkit of practical tools that can be used to evaluate a library or a specific library service. You should plan on using your completed class assignments as a part of your e-portfolio.
Course Objectives
The objectives of the course are:
- To introduce students to the concepts and theories associated with evaluation
- To assist students in developing skills that will allow them to be better prepared in assisting their library in evaluating a particular service
- Prepare a literature review that will identify “best practices”
- Identify and position their library services within the broader information, education, and recreation markets
- To provide students with an opportunity to develop skills in analytical thinking.
LIBR 285 supports the following SLIS Core Competencies:
- understand the nature of research, research methods and research findings; retrieve, evaluate and synthesize scholarly and professional literature for informed decision-making by specific client groups.
In addition, this section supports the following SLIS Core Competencies:
- evaluate programs and services on specified criteria.
The SLIS Core Competencies are found at http://slisweb.sjsu.edu/slis/competencies.htm
Textbooks and Readings
Readings
Readings are assigned throughout the class.
Required Text
The required text is:
- Joseph R. Matthews. The Evaluation and Measurement of Library Services. To be published by Libraries Unlimited. Available from the author in manuscript form. Please mail a check for $40 to me and I will mail a copy to you.
5421 Kipling LN, Carlsbad, CA 92008
Wonderful Resources
- Andrew Booth and Anne Brice. Evidence-Based Practice for Information Professionals: A Handbook. London: Facet, 2004.
- Danny Wallace and Connie Van Fleet. 2nd Edition. The Measurement and Evaluation of Library Services. Westport, CN: Libraries Unlimited, 2001.
- Robert Taylor. Value-Added Processes in Information Systems. Ablex, 1986
- Cathy De Rosa et al. Perceptions of Libraries and Information Resources. Dublin, OH: OCLC, 2005.
- Stephen M. Kosslyn. Elements of Graph Design. New York: W.H. Freeman, 1994.
- Frederick Williams and Peter Monge. Reasoning with Statistics; How to Read Quantitative Research. 5th edition. Harcourt College Publishers, 2001.
- Joseph Matthews. Strategic Planning and Management for Library Managers. Westport, CN: Libraries Unlimited, 2005.
- Joseph Matthews. The Bottom Line: Determining and Communicating the Value of the Special Library. Westport, CN: Libraries Unlimited, 2002.
- Joseph Matthews. Measuring for Results: The Dimensions of Public Library Effectiveness. Westport, CN: Libraries Unlimited, 2004.
- Jane Bradford. What’s Coming Off the Shelves? A Reference Use Study Analyzing Print Reference Sources Used in a University Library. The Journal of Academic Librarianship, 31 (6), November 2005, 546-58.
- Paul Kantor. Objective Performance Measures for Academic and Research Libraries. Washington, DC: Association of Research Libraries, 1984;
- Daniel Gore. The Mischief in Measurement. Library Journal, May 1, 1978, 933-37.
- Michael Buckland. Concepts of Library Goodness. Canadian Library Journal. April 1982, 39 (2), 63-66. http://www.unesco.org/webworld/ramp/html/r8722e/r8722e1c.htm
- David W. Lewis. The Innovator’s Dilemma: Disruptive Change and Academic Libraries. Library Administration & Management, 18 (2), Spring 2004, 68-74.
- Peter Morville. Ambient Findability. Sebastopol, CA: O’Reilly, 2005.
- Jeffrey Katzer; Kenneth H. Cook, and Wayne W. Crouch. Evaluating Information: A Guide for Users of Social Science Research. 4th edition. Boston: McGraw- Hill, 1998.
- Ronald R. Powell and Lynn Silipigni Connaway. Basic Research Methods for Librarians. . Westport, CN: Libraries Unlimited, 2004.
Other Resources
- Mildred Patten. Understanding Research Methods: An Overview of Essentials. Pyrczak Publishing, 2000.
- Robert Donnelly. The Complete Idiots Guide to Statistics. New York: Alpha Books, 2004.
- Donald Wheeler. Understanding Variation: The Key to Understanding Chaos. Knoxville, TN: SPC Press, 2000.
- Joan Durance and Karen Fisher. How Libraries and Librarians Help: A Guide to Identifying User-Centered Outcomes. Chicago: American Library Association, 2005.
- Peter Scholtes. The Leader’s Handbook: A Guide to Inspiring Your People and Managing the Daily Workflow. New York: McGraw-Hill, 1998.
The Researching Librarian Website - http://www.researchinglibrarian.com/
The Research Methods web resources site listed through the Resources link on the SLAIS web page: http://www.slais.ubc.ca/resources/research_methods/index.htm. - Evidence-Based Webography http://www.shef.ac.uk/scharr/eblib/webography.html
- Several hundred surveys created by librarians are available at
http://www.nsls.info/services/fastfacts/category.aspx - Free and low-cost Web-based surveys can be constructed at Zoomerang.Com, SurveyMonkey.Com and several other sites.
Course Requirements
Class Meetings
This is an online class that will meet Thursday night from 7:00 pm to 8:30 pm, using Elluminate. You will need to purchase a microphone if you do not have one. Your attendance and active participation during the online session is an important part of your grade. The first class meeting is June 7th.
Attendance/Participation
Regular attendance is vital to success in this course because a number of cooperative learning/group activities will occur in class and a great deal of material will be covered during each class session. Participation in group projects, in online class meetings using Elluminate and in Blackboard discussion forums is crucial. Reading/viewing/listening to required materials will enhance your ability to participate in these discussions. Check Blackboard regularly for updates.
Coursework Completion
All course work to be completed by August 6, 2007.
General Expectations
All students must:
- have the minimal home computing environment as described at http://slisweb.sjsu.edu/ecommunication/homecomputing.htm
- Enroll in the course in Blackboard to receive communications from the instructor by the first day of the term.
- Submit all assignments electronically. The following scheme is required for the files: [Student’s Last Name]_[Assignment Number]. Example: If the students last name is Smith use Smith_assignment1.doc. Failure to utilize this format results in point deductions.
- Use a current virus protection program to scan all assignments before they are submitted electronically to Blackboard and to the instructor.
- Submit assignments by the midnight of the due date. All assignments submitted after the due date will be subjected to a grade penalty.
- Use a consistent format for bibliography citations.
- Type or key coursework using Microsoft Word, double-spaced and in 12 point font.
- Consecutively number pages of assignments with the student’s name and the name of the assignment in the footer of each page.
Other Requirements
Students must have e-mail accounts and access to the Internet, including the ability to view the World Wide Web with a graphical browser (e.g., Firefox, Netscape or Internet Explorer) and PDF files; and the ability to listen to RealOne Player lectures. Students may access Blackboard directly at http://tigris.sjsu.edu or from the SLIS Web site ( http://slisweb.sjsu.edu ) under the Computing pull-down menu.
Downloading Software Tools
If necessary, you may download Adobe Reader from Adobe's Web site at http://www.adobe.com/products/acrobat/readstep2.html
For instructions on downloading the RealPlayer, see http://slisweb.sjsu.edu/ecommunication/realplayer.htm
SLISADMIN
Students should also join the school’s electronic list, SLISADMIN, to get official or administrative messages from SLIS. Find directions at http://slisweb.sjsu.edu/ecommunication/electroniclists.htm or choose
Electronic Lists under the Computing pull-down menu on the SLIS Web site.
See Blackboard for other information about this class.
Assignments
All projects will be presented near the end of the class. Each presentation will last about ten minutes and should involve all team members. Project presentations can be presented to the instructor at any time prior for a review and feedback (this review will not be graded). A PowerPoint presentation is recommended.
Make sure that the type of library is clearly identified at the start of each presentation. Each presentation must include a literature review (a list of citations must be provided), an exploration of methods that could be used for the evaluation, why a particular method(s) was selected and the use of real data from a library, if at all possible, should be included in the analysis.
Each team will complete five projects from the “Evaluation of Services” section and one project from the “Evaluation of the Library” section. The projects will be selected using a process that prevents duplicates until all projects have been selected and then duplicates can be chosen. Each team will select one project, and then the next team will make a selection, and so forth (similar to the NBA draft).
Evaluation of Services
- Prepare a simply analysis of who you believe a library’s customers are without consulting any reports or statistics (if you don’t work in the library, interview two or more staff members for their perceptions). Now, using statistics and reports from the library’s automated system, prepare a presentation about the library’s customers. What segments of your potential customers do you currently serve? How often do they use the library? What proportion of your potential customers are actual customers, “lost customers,” and non-customers (marketplace penetration analysis)? Now compare your beliefs with what the data has to say.
- Now, knowing who and where your customers are located, how will you determine what they want? What quantitative research methods might you employ? What qualitative research methods might you employ? For a public library, demographic information about your community is optionally available at www.geolib.org.
- Prepare a presentation to determine if a library’s customers who use electronic resources are different in some way from those who physically visit the library? How would you determine what problems these customers have in using the electronic resources? Identify the costs of providing electronic resources. What trends exist with regard to the amount of use of electronic resources? What demand for desktop access to electronic resources is likely to exist in the future? What are the implications for a library in the next five to ten years?
- Using statistics and reports from a library’s automated library system, prepare a presentation about the library’s collection. What is the overall turnover rate? Percent of circulation and turnover rates by type of materials, fiction versus non-fiction, call number range and so forth. Compare this information to the library’s holdings – for example, if DVDs account for 2% of the total collection, what is the percent of circulation for DVDs?
- Prepare a workflow diagram for circulation or technical services as it exists today in a library and then prepare an alternative arrangement of furniture and equipment that will simplify things. How many steps in the process before and after the proposed changes? Now carefully examine each of the steps or tasks performed and determine whether some may be safely eliminated or combined with other tasks.
- Your boss read an article in USA Today that stated that reference librarians are right about 55% of the time. Your boss wants to know if that is the case in your library. What does the literature have to say about this? How do you resolve the conflicting views found in the literature? How would you prepare an evaluation in your library to ascertain how accurate your reference librarians are? What would be an acceptable level of accuracy (and why)?
- The library board/your boss have received complaints that the library’s collection is old and useless. Prepare an analysis and a set of recommendations.
- Your boss is concerned about the library’s continuing expenditures for reference books when “everything is available on the Internet.” Prepare an analysis of a library’s expenditures for reference materials and contrast it with expenditures for electronic resources. What trends are evident when looking at data for the last five years? What data would you need and how would you gather it to determine how much the reference collection is being used? Is the reference collection too large? Is your boss wrong?
- Prepare a presentation for the library board/your boss about the economic benefits of a library. What options are available to determine economic benefits? How would you prepare a cost-benefit analysis for your library?
- The state library has awarded your public library a grant to determine all possible outcomes associated with the library’s annual “summer reading program.” Identify likely input, output and outcome measures and how you would collect the data to assess the magnitude of these measures.
- Assess the current state of readiness of the technology in your library. If your library has a technology plan, what is the state of implementation? Is the library’s technology current or is it getting a “bit long in the tooth?” Should “open source software” be seriously considered?
- The library has been requested to make a presentation assessing the existing facilities. Do some facilities need to be expanded and modernized? Do some facilities need to be replaced or closed? Are new branch facilities needed? What criteria should be used for this assessment?
- You are concerned that the costs of processing new materials are too high and that it takes too long for materials to be processed. How will you determine what the existing costs are and the time it takes to process materials? How do your costs and processing times compare to “peer” libraries (best practice libraries?)? Prepare an analysis to determine whether the library should outsource the processing of its new materials or re-organize technical services.
- The number of complaints that items are not on the shelves has increased dramatically during this past year. How would you determine what the current availability rate is and where are the items if they are not on the shelf?
- Assess your library’s Web site. Examine the Web sites from at least 10 other “peer” libraries across the US. Give each site a score based on several criteria. Explain why you selected the criteria used for your analysis.
- Consider your library’s online catalog. If your system is more difficult to search and less effective than Amazon.com (and whose isn’t?), then you have work to do. How would you involve users in asking what they want? How would you identify what they actually do now? What new features would you really would like from your system’s vendor?
- You are concerned about the quality of customer service provided by your library staff members. How can you assess the customer service received by your customers? How would you assess customer satisfaction? What options are available to assess customer service? Prepare an analysis.
- A school or academic library wants to ensure that its students received instruction in the area of information literacy. In addition to discussing ways to deliver information literacy content, discuss ways to discover the impact of information literacy instruction in the lives of the students.
- Customers are complaining about the time it takes to get materials through interlibrary loan. What can be done to improve the service levels?
- The library’s online catalog reflects the fact that something has been ordered. However, complaints are being received that indicate that it takes months before items are received and placed on the shelves of the library. What are the current service levels and what can be done to make improvements?
- Customers and staff are complaining about the number of typos in the library’s online catalog. Prepare an analysis of the problem.
- Your public library is considering adopting merchandising. Your boss has asked you to prepare a presentation that identifies “best practices.”
- An evaluation of other services may be submitted by a team and approved by the instructor. Prepare an analysis and a presentation.
Evaluation of the Library
- How would you determine if your library is a “good” library? How do you select “peer libraries” so that you can compare and contrast your library with your peers? What are the issues surrounding selecting “peer libraries” from out-of-state?
- Prepare a presentation about a library of your choice using statistics from a national/state/province resource or directory. The audiences for this presentation are the funding decision makers for your library. You are trying to get these stakeholders to approve a more than 15% increase in your budget. What performance measures would you like to use that are not found in the directory?
- After reviewing Robert Taylor’s book, Value-Added Processes in Information Systems, prepare a presentation that discusses the ways in which a library adds value for its customers. What new ways could a library add value by changing existing services or introducing new services?
- Prepare an analysis of the library’s existing services and how much they are used. Identify the costs to provide each service. Identify the cost-effectiveness of all services and place them in rank order. Prepare a presentation of your analysis.
Each individual student will prepare a brief assessment of what you have learned as a result of this class. You should also reflect on each team member’s contributions and the willingness of each individual to work together as a team. A copy of the questions to be discussed will be posted on Blackboard.
Due: On or before August 6, 2006.
Course Calendar
Please see course outline each week and the assignments tab on the Blackboard Web page for specific assignment details, if any.
Date |
Assignment |
June 7 |
Read Evaluation & Measurement, Ch. 1-2 |
June 14 |
Read Evaluation & Measurement, Ch. 3 |
June 21 |
Read Evaluation & Measurement, Ch. 4 |
June 28 |
Read Evaluation & Measurement, Ch. 5 A. Bookstein. Questionnaire Research in a Library Setting. Journal of Academic Librarianship. 11, March 1985, 24-28. M. Cooper. Perspectives on Qualitative Research with Quantitative Implications: Studies in Information Management. Journal of Education for Library and Information Science. 31 (2), 1990, 105-112. B. Moran. Survey Research for Librarians. Southeastern Librarian. 35, 1985, 78-81. Paper for team project # 1 and 2 is due. |
July 12 |
Read Evaluation & Measurement, Ch. 6 Denise Troll Covey. Using Data to Persuade: State Your Case and Prove It. Library Administration & Management, 19 (2), Spring 2005, 82-89. H. Weiner. How to Display Data Badly. American Statistician, 38 (2) 1984, 137-147. Paper for team project # 3 and 4 is due. |
July 19 |
Read Evaluation & Measurement, Ch. 16 Robert H. Orr. Measuring the Goodness of Library Services: A General Framework for Considering Quantitative Measures. Journal of Documentation, 1973, 29 (3), 315-333. Rosemary Du Mont and Paul Du Mont. Measuring Library Effectiveness: A Review and an Assessment. Advances in Librarianship, 9, 1979, 103-41. G. Travis White. Quantitative Measures of Library Effectiveness. The Journal of Academic Librarianship, 3 (3), 1977, 128-36. Paper for team project # 3 and 4 is due. Team presentations will start. |
July 26 |
Team presentations. |
August 2 |
Team presentations. |
Grading Policy
Everyone begins the class with a grade of “B”, the standard grade for graduate level work. Students who complete the assignments, use Blackboard class site, and the face to face class meetings and participate in the Elluminate discussions will receive the B provided the quality of written work meets the standard of rigorous scholarly work for the University.
Each project requires the team to prepare a project report using MS Word and a PowerPoint presentation.
Grading Points
A point breakdown contributing toward your final grade is as follows:
Item |
Each |
Total Points |
| Projects, reports, presentations (6) | 50 |
300 |
| Class participation (using Blackboard, Elluminate and in person in San Jose) |
50 |
50 |
| Team contribution (as judged by your team mates) |
50 |
50 |
| Total points for class | 400 |
Points for the projects will be awarded using the following rubric.
| Standard Work | Above Standard | Excellent Work | |
| Organization | Straight-forward approach | Material is well organized | Organization of material flows well and the writing is easily moves from one point to the next |
| Evaluation of the literature | 3-6 articles (books) are used No clear reason selection criteria |
5-10 articles (books) are included Some criteria are used |
A large amount of research is identified and synthesized Reasons for inclusion of the literature are explained |
| Depth of analysis | No indication of an analysis | Some analysis of the project | Analysis clearly reflects considerable thoughtful reflection of the project |
| Exploration of research methods | Identify & discuss 2-3 research methods Selection of a research method is not discussed |
Identify & discuss 4-5 research methods Selection of 2-3 research methods |
Identify & discuss all known research methods Clearly articulated reasons why one or more research methods are selected for a specific library |
| Originality | Straight-forward approach to the project | Clear evidence of originality in terms of study design, and presentation of data |
Grading Scale
The standard SJSU SLIS Grading Scale is utilized for all SLIS courses:
| 97-100 | A |
| 94-96 | A- |
| 91-93 | B+ |
| 88-90 | B |
| 85-87 | B- |
| 82-84 | C+ |
| 79-81 | C |
| 76-78 | C- |
| 73-75 | D+ |
| 70-72 | D |
| 67-69 | D- |
| Below 67 | F |
Electronic Portfolio
SLIS has decided to use a e-Portfolio as evidence of professional competency and demonstrating your growth as a student. A content management server, named Plone, has been set up to support your portfolio (you may also use a personal Web site). Please familiarize with the software (tutorials are available) and create a personal portfolio site, if you have not yet done so, and publish your assignments.
Academic Dishonesty/Plagiarism
Academic dishonesty is a serious infraction. Assignments must be the student's own work and sources must be properly cited.
Academic Integrity
Your own commitment to learning, as evidenced by your enrollment at San José State University, and the University's Academic Integrity Policy requires you to be honest in all your academic course work. Faculty members are required to report all infractions to the Office of Student Conduct and Ethical Development. The policy on academic integrity can be found at http://sa.sjsu.edu/student_conduct.
Reasonable Accommodation of Disabilities
If you need course adaptations or accommodations because of a disability,
please e-mail me as soon as possible. Presidential Directive 97-03 requires
that students with disabilities register with the Disability Resource Center
(DRC) to establish record of their disability.
No matter where students reside, they should contact the SJSU DRC to register. The DRC Web site: http://www.drc.sjsu.edu/


