Tuesday, August 10, 2010

EDU 530 Fall 2010 Creswell Discussion Ch. 13

Please post your question, quote, and fact from chapter 13. Also, respond to at least two of your peers' posts as well as my questions.
Questions:
1.) Describe the purpose of surveys.
2.) Describe when you would use a survey research design.
3.) Define the population, the sample, and the target population.
4.) Discuss the types of interviews and questionnaries in surveys.
5.) What are the elements that go into creating good survey questions?
6.) How do researchers get a high return rate for their surveys?
7.) List the steps for conducting survey research.
8.) How do you evaluate a survey study?

31 comments:

  1. Question: Where do you find a list of individuals for a survey design who want to be in your study?
    Quote: In survey research, it is important to select as large a sample as possible so that the sample will exhibit similar characteristics to the target population.
    Fact: A pilot test of a questionnaire or interview survey is a procedure in which a researcher makes changes in an instrument based on feedback from a small number of individuals who complete and evaluate the instrument. The participants in the pilot test provide written comments directly on the survey, and the researcher modifies or changes the survey to reflect those concerns.

    ReplyDelete
  2. 1. Survey research designs are procedures in quantitative research in which investigators administer a survey to a sample or to the entire population of people to describe the attitudes, opinions, behaviors, or characteristics of the population. Survey studies describe trends inthe data.
    2. You use a survey to describe trends, such as community interests in school bond isues or state or national trends about mandatory student uniform policies. You also use a survey to determine individual opinions about policy issues. Surveys help identify important beliefs and attitudes of individuals. They may be used to follow up with graduates 5, 10, or 15 years after college to learn about their present careers. Surveys provide useful information to evaluate programs in schools.

    ReplyDelete
  3. 3. The population is the group of individuals having one characteristic that distinguishes them from other groups. The target population or sampling frame is the actual list of sampling units from which the sample is selected. The sample is the group of participants in a study selected from the target population from which the researcher generalizes to the target population.
    4. Four major types of questionnaires and interviews used in education are: mailed questionnaires, electronic questionnaires, one-on-one interviews, focus group interviews, and telephone interviews. A mailed questionnaire is a form of data collection in survey research in which the investigator mails a questionnaire to members of the sample. An electronic questionnaire is a survey instrument for collecting data that isavailable on the computer. In one-on-one interviewing in survey research investigators conduct an interview with an individual inthe sample and record resopnses to closed-ended questions. In focus group interviews in survey research, the researcher locates or develops a survey instrument, convenes a small group of people who can answer the questions on the instrument, and records their comments on the instrument.
    In telephone interview surveys, the researcher records the participants' comments to questions on instruments over the telephone.

    ReplyDelete
  4. 5. When survey researchers design an instrument for data collection, they typically perform the following steps:
    1. They write different types of questions.
    2. They use strategies for good question
    construction.
    3. They perform a pilot test of the questions.
    6. Researchers use several strategies to encourage high return rates. One is to prenotify participants that they will receive a questionnaire. Another strategy is to use good follow-up procedures. A three-step procedure that might be used is:
    1. Mail out the original questionnaire.
    2. Follow it 2 weeks later with a second questionnaire to the individuals who have not responded.
    3. After another 2 weeks, send a postcard to the nonrespondents, reminding them to complete the questionnaire.
    This three-step process should help you attain a good return rate. Another way to encourage a high response rate is to study a problem of interest to the population under study. Also, using a brief instrument usually encourages a high return rate. A final strategy is to consider the use of incentives.

    ReplyDelete
  5. 7. The steps are:
    Step 1. Decide if a survey is the best design to use.
    Step 2. Identify the research questions or hypotheses.
    Step 3. Identify the population, the sampling frame, and the sample.
    Step 4. Determine the survey design and data-collection procedures.
    Step 5. Develop or locate an instrument.
    Step 6. Administer the instrument.
    Step 7. Analyze the data to address the research questions or hypotheses.
    Step. 8. Write the report.

    ReplyDelete
  6. 8. If you plan to conduct a survey, you need to design and write a Methods section in you study that conveys the detailed survey research procedures. For educators who read and seek to use results from surveys, a checklist of elements to include in a survey design can provide basic information to look for in a published study.

    ReplyDelete
  7. 1.) Describe the purpose of surveys.
    A) The purpose of surveys are a way for the researcher to collect quantitative data on a populations: attitudes, opinions, behaviors, or characteristics. (Page 388)

    2.) Describe when you would use a survey research design.
    A) You use a survey research design when you want to describe a trend, or to determine individual’s opinions, identify beliefs and attitudes, or just to follow up on people and see what they are doing since the last time you saw them. (Page 388)

    ReplyDelete
  8. 3.) Define the population, the sample, and the target population.
    A) “The population is the group of individuals having one characteristic that distinguishes them from other groups.”

    “The Sample is the group of participants in a study selected from the target population from which the researcher generalizes to the target population.”

    “The target population or sampling frame is the actual list of sampling units from which the sample is selected.” (Page 393)

    ReplyDelete
  9. 4.) Discuss the types of interviews and questionnaires in surveys.
    A) The different types of interviews and questionnaires in surveys are: Mailed Questionnaires, Electronic Questionnaires, One-on-On Interviews, Focus Group Interviews, and Telephone Interviews.

    “Mailed Questionnaires are a form of data collection in survey research in which the investigator mails a questionnaire to members of the sample.” (page 395)

    Electronic Questionnaires are a survey instrument for collecting data that is available on the computer.” (Page 395)

    One-on-One Interviews are a form of survey data collection where the investigator conducts an interview with an individual in the sample and record responses to closed ended questions. (Page 396)

    “Focus Group Interviews are where the researcher locates or develops a survey instrument, convenes a small group of people who can answer the questions on the instrument, and records their comments on the instrument.” (Page 396)

    “Telephone Interviews, the research records the participants’ comments to questions on instruments over the telephone.” (page 396)

    ReplyDelete
  10. 5.) What are the elements that go into creating good survey questions?
    A) The elements that go into creating good survey questions is the instrument. “Consider whether a survey instrument is available to measure your variables. You might also consider modifying an existing instrument, If neither of these approaches will work, design your own instrument. (Page 397)

    6.) How do researchers get a high return rate for their surveys?
    A) “The response rate is high because individuals interviewed typically consent to the interview in advance. However, when questionnaires are used, the number of responses returned… will vary.” (Page 402)

    ReplyDelete
  11. 7.) List the steps for conducting survey research.
    A)
    1. Decide if a survey is the best design to use.
    2. Identify the research questions or hypotheses.
    3. Identify the population, the sample frame, and the sample.
    4. Determine the survey design and data-collection procedures.
    5. Develop or locate an instrument.
    6. Administer the instrument.
    7. Analyze the data to address the research questions or hypotheses.
    8. Write the report. (Page 414-415)

    ReplyDelete
  12. 8.) How do you evaluate a survey study?
    A)
    *Did you describe and specify the target population?
    *Did you specify the sampling procedures? If you did not use simple random sampling did you explain the reason for other sampling procedures?
    *Did you clearly identify the sample and the basis on which you chose it?
    *Did the type of survey match your questions or hypotheses?
    *Was it clear wither a questionnaire or an interview survey comprised you form of data collection? Did you identify the basis for selecting or developing the instrument?
    *Did you report information on the reliability and validity of scores from past use of the questionnaire or interview?
    *Did you mention the dates for administering the questionnaire or interview?
    *Did you clearly identify the administration procedures?
    *If you used a questionnaire, did you identify the procedures for obtaining responses? Did you identify follow-up procedures to ensure a high return rate?
    *If you used an interview survey, did you identify the field procedures for obtaining responses? Did you identify demographic characteristics, previous experience, training, and monitoring for the interviewer(s)?
    *Did you provide a sample of the questionnaire items or the interview questions to help the reader determine if you used good item construction strategies?
    *Did the data analysis match the research questions or hypotheses in the study?
    *Did you write the study in an acceptable scientific and ethically sound way? (Page 416)

    ReplyDelete
  13. QUESTION: I feel like all of this stuff included in your paper is what makes it so boring. Not everyone wants to know these things. I know that you need to have them to have a GOOD survey research, but it’s a lot that the typical person wouldn’t really need to know… right? (Page 416)

    QUOTE: There are two main types of survey designs: Cross-sectional designs “The researcher collects data at one point in time (ex. All 8th graders take a survey on teasing.)” (Page 389), and there are longitudinal survey designs “Collecting data over time on the same population and looking at the trends.” (Page 391)

    FACT: To do a good follow up procedure on the mailed questionnaire it can take about 6 weeks! (Page 403)

    ReplyDelete
  14. Helen,
    That is a VERY good question! I hate it when your hounded at the mall or other public places to do a study? Is there a site or something that people can sign up on so we aren't annoying people that don't want to do the study?

    ReplyDelete
  15. 1. Surveys describe the attidutes, opinions, behaviors or characteristics of a population.
    2. You use surveys to describe trends or to determine individual opinions about policy issues. Surveys can also identify important beliefs and attitudes of individuals. They can give us good follow up information on former employees or students.
    3. Population is a group of individuals that have one characteristic that distinguishes them form the other groups. Target population is the records of individuals in a population that a researcher can actually obtain. Sample is a group from the population that is actually studied.
    4. Mailed questionnaire is a questionnaire that is mailed to the sample. Electronic questionnaire is available on the computer. One on one interviews is when the researcher interviews one person from the sample and records their responses. Focus groups are a group of the sample who answers questions. Telephone interviews are conducted over the phone.
    5. The write different types of questions, they include personal attitudinal and behavior questions. They also include closed ended questions and sensitive questions. They use clear language and ask questions that are applicable to all participants. You should administer the questions first to a test group and then make changes based on that feedback.
    6. Pre-notify participants that they are getting a questionnaire. Then mail out questionnaire, follow it 2 weeks later with another questionnaire if they have not responded, then if they still haven’t responded in another 2 weeks send a postcard to remind them to response.
    7. Decide if a survey is best, identify research questions or hypothesis, identify the population , sampling frame, and sample, determine the survey design and data collection procedures, develop or locate instrument, administer, analyze data, and write the report.
    8. Did you describe target population or sampling frame, sampling procedures, identify sample, did survey match your hypothesis, clearly identify administration procedures, provide sample of questionnaire, and did you write the study in a scientific, ethical way.

    Fact:
    Surveys are a useful design when you want to collect data quickly and economically.
    Quote:
    Survey research is a popular design in education.
    Question:
    How do know, especially on electronic and mailed questionnaires, if the participants actually gave you true responses or if they just put stuff down just to get it done?

    ReplyDelete
  16. It would be nice if there was a place for people to sign up. I guess if you were doing a study a work you could put up a sign up sheet. I guess as fas as that goes you could even put an ad in the paper. I see lots of ads asking people to be part of a trial group, I guess it would work for surveys as well.

    ReplyDelete
  17. Rebecca,

    I agree that the paper contains a lot of information that the average joe wouldn't probably care about but if you had a table of contents or each section was labeled they could just jump to the info that they wanted. That way the you would satisfy both audiences.

    ReplyDelete
  18. Becky,
    The SurveyMonkey online for surveys seems user friendly. And when we use an online survey you aren't going to need postage. Good insights into this chapter.

    ReplyDelete
  19. Jessica,
    A high response would be 50% on a survey. I think pre and post tests are ideal. Your material is informative.

    ReplyDelete
  20. Helen,

    It depends on what group you are trying to study. If you want to study principals, DESE has a list of them. You could ask DESE for the list in some cases. Also, if you choose to survey teachers in a district, you could contact that district after you receive the school district IRB approval, and they could give you the teachers' e-mails to use. Survey Monkey can be used, and Class Climate too.

    Keep up the good work!

    ReplyDelete
  21. Rebecca,

    I concur, but this information helps another researcher replicate your study if they want to study the same thing.

    Keep up the good work!

    ReplyDelete
  22. Jessica,

    GREAT question! You have to critically evaluate the responses, and that will help some. Also, some programs allow you to see how long it took for the responses. If you are getting themes you did not expect, you can try to survey again too. Critically and from the literature review, you should have a good understanding.

    Keep up the good work!

    ReplyDelete
  23. 1. To collect data through questionnaires or interviews and draw conclusions or make inferences about the population.

    2. When researchers seek to collect data quickly and economically, study attitudes and opinions, and survey geographically dispersed individuals.

    3. Population- A group of individuals having one characteristic that distinguishes them from the other groups.
    Target population- the actual list of sampling units from which the sample is selected.
    Sample- a group of participants in a study selected from the target population from which the researcher generalizes to the target population.

    ReplyDelete
  24. 4. The major types of questionnaires are mailed questionnaires and electronic questionnaires. A mailed questionnaire is form of data collection in survey research in which the investigator mails a questionnaire to members of the sample. An electronic questionnaire is a survey instrument for collecting data available on the computer. Three major types of interviews are a.) One on one interview, where investigators conduct an interview with an individual in the sample and record responses to closed-end questions. b.) Focused group interviews are when the researcher locates a survey instrument, convenes a small group who can answer the questions on the instrument and record their comments on the instrument. c.) Telephone interviews are interviews in which the researcher records the participants comments to questions on instruments over the phone.

    5. Good question construction includes using clear language, making sure the answer options do no overlap, and posing questions that are applicable to all participants.

    6. When using interviews the response rate is higher when individuals interviewed consent to the interview in advance.

    7. The steps for conducting survey research are: a.) decide if the survey is the best design to use. b.} identify the research questions. c.) identify the population, sampling frame, and the sample. d.) determine the survey design and data collection procedures. e.) develop or locate an instrument. f.) administer the instrument. g.) analyze the data. h.) write the report.

    8. When evaluating a survey study some of the key elements to look for are: a.) did you describe and specify the target population? b.) did you clearly identify the administration procedures? c.) did you specify the sampling procedures? d.) did the data analysis match the research questions? e.) did you mention the dates for administering the questionnaire?

    Fact: Researchers use interviews surveys less frequently than mailed questionnaires in educational research.

    Quote: "Instead of a mailed survey, researchers might collect quantitative data using an interview survey instrument."

    Question: What is a pilot test?

    Helen, I agree that in survey research the target population needs to be as broad as possible. This will not only help in covering a wide variety of individuals to be surveyed, but will also help in obtaining enough response rate to validate the survey. Thanks for the good insight.

    Rebecca, the response rate on mailed surveys is a long wait, so the importance of being timely in initial mail outs and giving adequate response time is of great importance. Good reminder.

    ReplyDelete
  25. 1.) Describe the purpose of surveys.
    A: Survey research design has a purpose to find the answer for the entier population from the sample.
    2.) Describe when you would use a survey research design.
    A:
    The resarcher uses survey research when he or se wants to discribe trends.

    3.) Define the population, the sample, and the target population.
    A:
    Population is people who live in specifc area.
    The Sample is the person who researcher wants to study.
    The target population is the peopl who researchers wants their answers for ther study.

    4.) Discuss the types of interviews and questionnaries in surveys.
    A:
    1. Mailed questionnaires.
    2. Electronic questionnaires.
    3.One-one-one questionnaires.
    4. Focus group interviews.
    5. Telephone interviews.

    5.) What are the elements that go into creating good survey questions?
    A:
    1. There are different qustions.
    2. Clear questions.
    3. Flexible, can be change base on participants' answers.

    6.) How do researchers get a high return rate for their surveys?
    A:
    1.Telling participants in advance that they will be questioned.
    2. Following up the procedure.
    3. Study what people interested in.
    4. Give some reward for returning the questionnare forms.

    7.) List the steps for conducting survey research.
    1. Decide if a surveys is the best design to use.
    2. Identify the rrsearch questions or hypotheses.
    3. Identify the population, the sampling flame, and the sample.
    4 Determine the survey design and data collection process.
    5. Develop or lote and instrument.
    6. Administer the instrument.
    7. Analyze the data to address the research questions.
    8. Write the rsport.
    8.) How do you evaluate a survey study?
    A:Make sure that teh research has the quality of research standard.

    ReplyDelete
  26. Fact," Tere is a check list that researcher can evaluate their researc from Fowler (1988) and Neuman (2000), page 416"
    Quote, "Survey are also usful for assessing information at one point in time or over time."
    Question, "Can we do survey without asking people? for example, the survey about people living condition. If we ask participants, they may not tell the true. How we know their answers true or not?"

    ReplyDelete
  27. This comment has been removed by the author.

    ReplyDelete
  28. Prueska,

    You would use another type of research method then. Surveys use a series of questions for people to answer, but there are other methods you could use.

    ReplyDelete
  29. 1.) Describe the purpose of surveys.

    A survey is administered to a population or sample of the population by a researcher in order to describe the attitudes, characteristics, or behaviors, of the population. Surveys seek to describe trends in data and learn about a population.

    2.) Describe when you would use a survey research design.

    Surveys are used to describe trends, determine individual opinions about a policy issue, identify important beliefs of individuals, or as follow ups in a population. Surveys are focused on learning mor about a population than predicting outcomes.

    3.) Define the population, the sample, and the target population.

    The population is the broadest level and consists of a group of individuals that have one characteristic that distinguishes them from other groups. The target population or sometimes called the sampling frame, is a record of individuals in a population that a researcher can actually obtain. This is the actual list of sampling units from which the sample is selected. A sample is the actual participants in the study in which the researcher generalizes to the target population.

    ReplyDelete
  30. 4.) Discuss the types of interviews and questionnaires in surveys.

    A questionnaire is a form used in survey research designs in which a participant completes and returns the form to the researcher. A mailed questionnaire is a type of data collection in a survey in which the researcher mails a questionnaire to the sample in a study. An electronic questionnaire is an instrument used in survey designs in which the researcher uses an instrument on the computer to collect data.

    An interview survey is a form in which the researcher records the answers supplied by the participants in the study. A one-on-one survey is when the researcher records responses to closed ended questions to the participant. A focus group interview is when the researcher finds a small group of people for the study who answer the questions and record their comments on the instrument. A telephone interview survey is when the researcher records the participants’ answers to questions and comments over the telephone.

    5.) What are the elements that go into creating good survey questions?

    The survey should include different types of questions that include personal, attitudinal, and behavioral questions; sensitive questions; and closed on open-ended questions. The actual questions should use clear language to pose questions that all participants and that also do not overlap with any other questions. To determine if the questions need changes administer on a pilot group of individuals first and then make changes if needed based on feedback.

    6.) How do researchers get a high return rate for their surveys?

    The strategies for high return rate include, prenotify participants that they will receive a questionnaire, using good follow-up procedures, studying a problem or interest, and using incentives for the participants.

    ReplyDelete
  31. 7.) List the steps for conducting survey research.

    1. Determine if a survey is the best research design to use.
    2. Form questions or hypotheses.
    3.identify a population and sample to study.
    4. Identify the type of survey needed to reach the sample.
    5. Collects data and statistically analyzes the data to answer descriptive questions or to answer relationship questions.

    8.) How do you evaluate a survey study?

    You can evaluate a survey study by answering the following questions:
    -Did you specify the target population?
    -Did you specify the sampling procedures?
    -Did you clearly identify the sample and the basis on which you chose it?
    -Did the type of study match the research questions or hypotheses?
    -Was it clear whether a questionnaire or interview was used and if so did identify the basis for selecting the instrument?
    -Did you report information on the reliability and validity of scores from the past use of the instrument?
    -Did you mention dates for administering the questionnaire or interview?
    -Did you clearly identify the administration procedure?
    -If you used a questionnaire did you identify the procedure for obtaining responses?
    -If you used an interview survey did you mention the procedures of collecting the information and the selection and training of the interviewer?
    -Did you provide a sample of the questions to help the reader determine if you used good construction strategies?
    -Did the data analysis match the research questions or hypotheses?
    -Did you write the study in a scientific and ethically sound way?

    ReplyDelete