Jay S. Mendell, Ph. D. 
Professor of Public Administration, College of Architecture & Urban and Public Affairs
Florida Atlantic University, 2912 College Avenue, Liberal Arts Building 470, Davie, FL 33314.
Home phone, 954.755-8928. Cell phone, 954.895-6364
mendelljay@gmail.com

PAD 4704, Research Methods for Public Management
Sequence Number 13495, LA 303D Monday 07:10PM-10:00PM Davie 

Provides a basic overview and application of quantitative decision-making methods for public management. It includes research design, some major management techniques and computer applications.
                  Attendance and promptness are in no sense optional. On class evenings, I own you. Come on time and stay until the end. If you can't come regularly and promptly, expect to learn nothing and fail. Or learn something and fail anyway, for lack of attendance.

The textbook is available free online. More below.

 

                   
Grading.
Attendance, 20%
Miss no classes, high pass in attendance.

Miss 1 or 2 classes, pass in attendance
Miss 3 or 4 classes, fail in attendance
Miss 5 or more classes, fail the course.
 
Participation, 20%
Rated High pass, pass, or fail.
 
Quizzes. Two at 15% each
Average 85%. high pass in quizzes.

Average 70%.-84.9%, pass in quizzes.
Average 50%--69.5%. fail in quizzes.
Average less than 50%, fail in course.
Assignments, 30%
Good writing, good analysis, high pass in paper.

Good in one category, poor in the other, pass in paper.
Poor in both writing and analysis, fail in paper.

 

Block One.
Layman's Guide to Social Research Methods
Introduction
to Bill Trochim's Research Methods Knowledge Base.
Navigating
Bill Trochim's Research Methods Knowledge Base.
Contents
of Bill Trochim's Research Methods Knowledge Base

 

Block Two.
Foundations  
Language Of Research
 
Five Big Words
 
Types of Questions  
Variables
 
Hypotheses
 
Types of Data
 
Philosophy of Research
 
Ethics in Research 

 

Block Three.
Deduction & Induction  
Introduction to Validity
 
Sampling
 
External Validity
 
Sampling Terminology
 

 

Block Four.
Statistical Terms in Sampling  
Probability Sampling
 
Nonprobability Sampling
 

 

Block Five.
Measurement 
Construct Validity
Convergent & Discriminant Validity
Reliability  
Types of Reliability
 
Reliability & Validity
 

 

Block Six.
Levels of Measurement  
Survey Research
 
Types of Surveys
 
Selecting the Survey Method
 
Constructing the Survey
 
Types Of Questions
 


Block Seven.
Question Content  
Response Format
 
Question Wording
 
Question Placement

 

Block Eight.
Interviews  
Plus & Minus of Survey Methods

Unobtrusive Measures

 

Block Nine.
Single Group Threats
 
Regression to the Mean
  
Conclusion Validity
 
Threats to Conclusion Validity
 
Improving Conclusion Validity
 

 

Block Ten.
Inferential Statistics
 

 

Block Eleven.
Social Research Update  
Telephone Interviewing 
Focus groups  
Finding information on the World Wide Web

 

Please print the following material from stats.org  and bring the material to class.

[List will be provided later.]

 

Block Twelve.
Material will be noted here on public opinion data to be found on the Internet. Stand by.


 


Posted 2006-01-15-- Please, if you send me e-mail, include in your subject line, "I am a student in your PAD class." It is "PAD" that stops my spam filter from trashing your e-mail.

Here is guidance in opening an account to log on with your own username and password (http://www.ecs.fau.edu/labs/about/easydirections.htm).

Posted 2006-01-18--Let me explain why, at the start of every evening, I call attendance and write on the board a "shun list," the names of everyone who fails to answer to roll call.

There will be a midterm exam and a final exam. In the case of each exam, I will give very strong guidance in advance as to the questions, and I will allow and encourage students to work in groups of three or four to prep for the exams.

Here is the significance of  the "shun list." If someone appears often on the shun list  (1) they might not turn up for your group meeting, ort they might not do the work they promise to do for the group; (2) there is a high likelihood that they will not be able to answer the exam questions, so they may be useless to your group (or worse); and (3) in grading quizzes, I will be especially critical of work turned in by groups who contain "shun-worthy: students. 

Posted 2006-01-22 at 10:14 a. m. 
Here is a picture of a bell curve.

Posted 2006-01-24 at 10:00

Here is a HW due in class on 2006-01-30. Please hand it in printed, except for your name in the upper right of each page, where you may write.

There are two questions.

(1) Let's see if you were paying attention in class.

I mentioned that we took a satisfaction survey of our MPA
student but did not survey students who chose not
to enroll at FAU. Write two reasons we did not do 
a survey of non-FAU students. Two sentences will suffice.

(2) We choose to give multivitamins to lab rodents
and then test to see if MV improve their ability
to navigate a maze. Explain why you think this is a one-tailed or two-tailed experiment. Two sentence should
suffice.

Posted 2006-02-01 at 4:00 a. m.

A graduate student wishes to infer or determine the mean age of all 100,000 members of the North American Suntan Society. The society offers to sell all 100,000 names and addresses for $20,000, or all names in Florida for $3000, or any randomly selected sample for $0.30 each.

One of these purchases is likely to bias the results and make it likely that any estimate of mean salary will be inaccurate. Which purchase would that be, and why?

(Don't bother looking for the NASS on the Intertnet, as I made it up. It is an imaginary group of men and women devoted to developing their suntans.)  

Mr. Montgomery has pointed out that in one place I ask about mean salary and in another about mean age. I really makes no difference if you use age, salary, or both, since the answer comes out the same. Feel free to call me when you think I have made a mistake in posting a question.

Posted 2005-02-07 at 6:45 p. m.

This is HW, due no later than 2006-02-20. See additional HW for that date, posted below.

  Go to http://www.socialresearchmethods.net/kb/sampstat.htm and scroll down to the diagram of the bell-shaped curve where it says in a green font that “About 99% of the cases . . .”

 Notice that the curve is symmetrical and centered over 3.75.

 Before you go on, ask yourself if you understand points (1), (2), (3), and (4) below. You don’t have to write anything; just make sure you know why the following are true. Scratch out the numbers on paper to reinforce your understanding,  if that helps.

 (1) If there is a 95% probability that a given sample from the population will fall inside the range 3.25 to 4.25 there is a 5% probability it falls outside the range. Hint: 100% minus 95% leaves 5%.

 (2) Another way to describe the range 3.25 to 4.25 is to say “3.75 plus or minus 0.50.” Hint: 3.25 is 3.75minus 0.50, and 4.25 is 3.75 plus 0.50.

 (3) To increase the probability from 95% to 99%, you have to expand the range to 3.0 to 4.5, which is the same as 3.75 plus or minus 0.75. Hint, read what is says in green font. Do the addition and subtraction.

 (4) A way to restate (3) is “To increase the probability from 95% to 99%, you have to expand the range by a factor of 1.5.”

Hint: That’s 0.75/.50.

 Now, and this is very important, that’s a general rule: To increase the probability from 95% to 99%, you have to expand the range by a factor of 1.5.

 Now, consider the following scenario. You are considering making a run for the county commission, so you hire a political pollster to discover if voters might support your election. The pollster reports that 0.56 of the public say they would vote for you. (Don’t worry about issues of bias, since the pollster knows polling backwards and forwards. Just focus on sampling error.)

 “Wait a second,” you say, “what is the range of uncertainty?”

 “Relax,” she says. “Your numbers are a .55 proportion of approval, plus or minus 0.04. In other words, you are a likely winner, because the low end of that range is 0.51 approval and the upper end is .59 approval. So you should win somewhere between a landslide at .59 or a squeaker at .51. But either the low or the high number or anything in between will elect you, since you will have over half of the vote.” She adds, “And that’s with a 95% probability.

 But you want to know what the numbers are at 99%. Calculate the range at the 99% level and tell me if it exceeds .50 at the low end.

 Posted 2005-02-07 at 6:45 p. m.

 Our final exam will be on Monday, 24 April 2006.

Posted 2006-02-12

If you have submitted HW late via fax or email, it would be a very good idea to check with me to see if I have entered it into my grade sheet.

Posted 2006-02-14. 

HW due 2006-02-20.

You are the general manager of a TV station, and you are going to interview candidates for the jobs of (1) weatherperson and (2) sportscaster. I need you to write five questions you might ask each candidate in an interview.

Here are the ground rules.

(1)   Ask no generic questions such as “What do you want to do in your life?” or “Are you a people person?”

(2)   Ask the prospective weatherperson questions that clearly pertain to being a TV weatherperson, but not anything to do with reporting sports.

(3)   Ask the prospective sports reporter questions that clearly pertain to being a TV sports reporter, but not anything to do with weather reporting.

Be sure to consult http://www.citylinkmagazine.com/2000people.html and http://www.bls.gov/oco/ocos088.htm.

Posted 2006-02-20.


The first of two quizzes will be held on Monday, 20 March 2006. That is the second class after spring break.  

You are allowed to prepare for the exam in study groups or to work solo. Study groups work well if you are careful to let only reliable people into the group.

Below is a panel of twelve questions. Six of the questions will appear on the exam exactly as I list them in the panel, and there will be two other questions that are variants of questions from the panel. That makes an exam of eight questions, which is, of course, impossible o complete if you have not written your answers in advance for the twelve panel questions.

Let's say that you are part of a study group of four students. You can assign three questions to each member of the group or you can work as a group on all twelve panel questions. So long as you swap answers among the group, I will not call this plagiarism. Then you can word process four copies of each answer (one answer to a sheet, please, and give each member of the group a copy of each answer (which they should immediately label with their name).

Then each of the four of you (or however many are in the group) will come to the exam with answers to all twelve panel questions. There will be no study group collaboration during the exam. 

When I give you the exam, each of you will turn in the answers to the six questions that are identical on the exam and the panel, and then each of you can answer the two "variants."

This system works fine if everyone shows up and does what they agreed to. But it is a disaster for a team  that enlists an unreliable member.

Okay, here is your panel of twelve questions.

(1)  It is widely asserted that black people receive inferior treatment than white people in the health care system.

Suppose you want to formulate a research study. How would you make operational "inferior treatment"? Hint: one way would be to count the number of tests administered per patient. But what other measures (nominate three) might you use of quality of care?

(2) The Republican party wants to take a sample of political attitudes of a wide range of people in Deerfield Beach, Florida. They can afford to sample 1000 persons. They approach you as a consultant to see if you want to conduct a survey of 1000 residents of Century Village retirement community in Deerfield Beach.
 
What objections you would have to selecting randomly only in Century Village..

(3) A county government ended up defendingf itself in federal court because it administered an entrance exam for police academy to applicants for the fire academy. What is wrong with this? .

(4) You are conducting a face-to-face interview of a research subject in her office. The course textbook by Trochim advises you to "Be alert for any sign that the respondent is uncomfortable."

What would be three signs that the respondent is uncomfortable, and how would you accommodate to the signs? The answer is not in the text: use your common sense or ask a friend or colleague.

(5)  You have been invited by student government to sit in on two sessions of a course, to provide evaluation of how students "react to the professor personally." There are 300 students in the course, which is conducted in a huge lecture hall, so assume that your attendance will be unobtrusive, unless you draw attention to yourself.

What steps will you take so that the professor is not aware of your presence? What steps will you take to make yourself unobtrusive to the other students?

Remember that you are not there to evaluate the professor's teaching effectiveness, but rather to provide student government some measure or measures of the professor's rapport with students. What would you observe, and what would you report?  

(6)  Universities may make changes in their programs, to subvert  measurement of their performance by the legislature.

Select three from the following list and tell me how a university might noodle its way around the indicators by making changes that do not necessarily improve the performance that was intended to be measured.

(a) The retention rate of students.
(b) The proportion of lower division instructional courses taught by fulltime faculty with Ph. D. degrees.
(c) The minimum number of hours per semester required to be spent by faculty in student advisement.
(d) The proportion of graduate and undergraduate students participating in sponsored research programs. 
(e) Placement data on graduates.
(f) The proportional changes in the participation and graduation rates of students from groups historically underrepresented in higher education.
(g) The proportion of graduate students who received undergraduate degrees (A) at the institution, (B) within the state, (C) within the United States, and (D) from other nations.
(g) The number of full-time students who have transferred from a community college.
(i) Demonstrable evidence of improvements in student knowledge, capacities, and skills between entrance and graduation, where this evidence exists.
(j) Results of surveys of students regarding student attitudes and experiences, where the surveys exist."

 
(7) You have been appointed chair of the faculty-student committee on FAU building maintenance. You are going to train twenty student inspectors to visit elevators on campus and grade them A, B, C, etc. To maximize inter-rater reliability, write a brief set of instructions on how to score the elevators.

Here’s a hint. To see how others write instructions, visit the search engine google.com and use the search terms

"instructions for judges" scoring

(8)  I give my afternoon class in research methods the following quiz:
"a. Explain reliability.
"b. Explain validity."

I give my evening class in research methods the following quiz, presumably on the same subject.
"a. Explain figure 3.18, with reference to how reliability can be expressed as a simple ratio.
"b. How does systematic error affect the central tendency of a distribution?"

Do not answer these questions, but give me at least three reasons why these are not parallel forms of the test.

(9)  You are chairman of a student committee that is dissatisfied by the end-of-term student assessments of instruction. You want to perform telephone interviews of a sample of students, to ask questions that have been omitted from the written survey or questions that are better asked by phone interview.

Review the question set that I passed out on 2006-02-20. Then write five new questions. Explain in one or two sentences for each question why you would like to ask this question in an interview.

(10) A friend asks you to review a survey instrument that he is about to circulate among FAU students. Please review the following three questions and tell me what advice you would offer your friend to fix them. Don’t answer the questions.

Q 1 — I believe I am getting a topnotch education at FAU, as good as I would get at FSU.

___ Yes. I sure do agree.

---- I highly disagree.

___ I disagree.

___ I agree.

Q 2 — I would consider a summer abroad taking courses at a university in Sri Lanka.

_ Yes

_ No

Q 3 — Have you ever recently smoked marijuana (even once in the past)?

_ Occasionally

_ No

_ Frequently /

(11) A certain professor has a heavy foreign accent and is eager to know how students react to his lectures. He asks you to attend a single lecture and observe the reactions of the class to his speaking. What behavior would you be prepared observe in the students? This might included behavior that the professor can see but is too busy to notice, or behavior that the professor cannot recognize as being a reaction to his speaking.

 

(12) I want to determine the number of FAU students who are from Gabon. Data from other universities suggests that the fraction of Gabonese is no more than 1 in 2000 and they are equally distributed among universities (they are not all broup in a few universities). What would you think of taking a random sample of 1000 FAU students? Would it be likely to give me an accurate estimate of the number of Gabonese students at FAU?

Posted 2006-02-21.

There is no HW due on 2006-02-27. Take some time to think about the midterm exam.

 

Posted 2006-02-28

Here is a homework assignment due after Spring Break (due Monday 2006-03-13).

One thousand FAU students are selected at random and assigned to group A, and another one thousand randomly selected and assigned to group B. These samples are so large that sampling error can be ignored as the solution to the question below.

Group A is asked two questions: (a) Do you agree that Melbourne is the capital of Australia? and (b) Do you agree that Australia ought to recognize Randisa? In this group, 35% agreed with (a) and 65% with (b).

Group B is asked two questions: (a) Do you agree that Melbourne is NOT the capital of Australia? and (b) Do you agree that Australia ought to NOT recognize Randisa? In this group 75% agreed with (a) and 65% with (b).

How do you account for the evident unreliability of the (b) questions?

Hint: http://jonjayray.tripod.com/polls.html

 

 

Posted 2006-03-21

Florida Public Personnel Association

Annual Scholarship Application

 

The Florida Public Personnel Association (www.fppa.org) is an organization of public sector human resources professionals and consultants. Annually it awards up to four scholarships in the amount of $500 to qualified students seeking a degree in Human Resources.  Candidate requirements are:

 

  • Full or part-time enrollment in an accredited college or university program with major coursework in the field of Human Resources.
  • Enrollment in the program must be by May 1, 2006 or proof of future enrollment as of the same date.

 

Interested applicants should submit the following:

  • Resume
  • Transcripts
  • Proof of enrollment or future enrollment

 

Submit documents by May 22, 2006 to:

 

Arlette Steinberger, Past President

Florida Public Personnel Association

C/O City of Fort Lauderdale Department of Human Resources

100 North Andrews Avenue

Fort Lauderdale, FL 33301

Asteinberger@fortlauderdale.gov    

954-828-5300

 

A selection committee will evaluate qualified candidates. The Florida Public Personnel Executive Board must approve recommended candidates.  Scholarships will be granted by July 10, 2006. The Association reserves the right to announce the name of the recipients and their educational institution at its Annual Awards Luncheon on July 24, 2006.      

 
Posted 2006-03021. HW due 2006-03-27

Most of you are familiar with the survey known as Student Perception of Teaching (http://www.fau.edu/projects/spot/course.html) in which FAU students evaluate their professors. Well, in principle, professors are supposed to be evaluated by other professors. The University of Wisconsin has a Web site called Moo! that suggests various techniques of peer review (http://www.provost.wisc.edu/archives/ccae/MOO/topics.html).

Go to the Moo! site linked to above and examine several of the techniques suggested for professors to review the performance of other professors. Pick one that you believe is not likely to produce teaching that benefits the students, and briefy justify your choice.

Posted 2006-03-22. Professors' salaries. http://www.fau.edu/org/uff/Salaries.pdf
Posted on 2006-03-28. There is no HW due next Monday. Optiuonally, you may bring in any interesting surveys you are sent this week, and we will discuss them.
Posted 2006-03-30

Telephone surveys
http://www.irss.unc.edu/irss/bwiggins/shortcourses/telephonehandout.pdf
Focus groups
http://www.answers.com/FOCUS%20GROUPS
Research info on the Internet
http://searchenginewatch.com/facts/
http://www.answers.com/SEARCH%20ENGINES
http://www.answers.com/topic/deep-web?method=22
Public opinion
http://en.wikipedia.org/wiki/Opinion_polls
http://www.library.miami.edu/netguides/socopin.html

End of term
Post questions for final exam, no later than Thu 2006 13 April. (Seven questions, four to appear on the exam)
Final exam Monday 2006 April 24

 

Posted 2006-04-10

Here is a panel of seven questions. Four of them will appear verbatim on the final exam (open book, open notes, but no conferring), and one will appear in a variant form.

 

I will need a list of who is in your group, in alphabetical order, one list per group.

 

1.              Why is it difficult to enumerate the population of homeless people in Florida ? Be sure you understand “enumerate.” Give several reasons.

2.              You want to conduct a phone survey of attitudes toward this year’s tax forms. What screening questions will you ask before you interview whoever answers the phone?

3.              Bell South sends out a mail survey questionnaire to 500 of its customers. The object is to determine if customers prefer to be surveyed by mail, as opposed to phone. Only 5% of the customers reply, but they are overwhelmingly enthusiastic about mail surveys.
.
What should Bell South do next?

4.              What problem would you have with a survey question in the following form? .
. “The death penalty is justifiable under some circumstances. .
.
1       Strongly agree.
2       Disagree.
3       AGREE.
4.      Not sure,

5.              How would you react if we added the following to the end-of-term evaluation of the instructor. .
.
”In retrospect, would you take this course again?”

6.              My department head (Dr. Thaddesu), who detests me, offers to organize an focus group to evaluate my teaching. .
.
Why might I object?

7.              Explain “regression toward the mean”.