Document
Appendix F Appendix F 2019-2020 Questionnaire Items Library
ICR 201908-1850-006 · OMB 1850-0928 · Object 94448601.
⚠️ Notice: This form may be outdated. More recent filings and information on OMB 1850-0928 can be found here:
Document [pdf]
Download: pdf | txt
NATIONAL CENTER FOR EDUCATION STATISTICS NATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS National Assessment of Educational Progress (NAEP) 2019 and 2020 Long-Term Trend (LTT) 2020 Update 3 Appendix F Item Library for NAEP 2019 & 2020 Survey Questionnaires OMB# 1850-0928 v.17 September 2018 revised August 2019 This Appendix F provides the library of possible items to be used in the NAEP 2019 and 2020 questionnaires. Non-substantive wording changes to the questionnaire items (based on cognitive and pilot testing results) were made. The final selection of which items will be used in the final versions of the NAEP 2019 and 2020 questionnaires are provided as outlined below. The number of items selected for each type of respondent will be appropriate to the allocated time (as indicated in the Supporting Statement Part A section A.12). The final versions of all NAEP 2019 questionnaires in English language and Spanish-translated questionnaires are provided in Appendices K1, K2, K3, and K-S. The 2020 data collection instruments are provided in Appendices K-4 and K4-S. The confidentiality citation has been updated in September 2018. The final student and teacher/school administrator log-in screens will reflect the new confidentiality citation, as reflected in Part A. The Appendix is structured by respondent type: student, teacher, and then school. For each respondent, a table is included to help define what components are included in the library, when each component will be administered (2019 and/or 2020), which parts of this Appendix comprise each component, and the source of the content of each Appendix part (e.g., whether it was approved as part of Appendix F in OMB# 1850-0928 v.6, Appendix I in OMB# 1850-0928 v.7, or another source). Note, given that some of the previous administrations were from paper-and-pencil assessments and others were from digitally-based assessments, the item-level directions are not consistent (i.e., some items indicate to “fill in one oval” while others indicate to “select one answer choice” or “select one circle”). The final item-level directions that will be used in NAEP 2019-2020 will be appropriate to the mode of the testing, as indicated in Part A.12. Abbreviation Key BET: Background, Education, and Training CAFS: Computer Access and Familiarity COI: Classroom Organization and Instruction NIES: National Indian Education Study SCP: School Characteristics and Policies TEL: Technology and Engineering Literacy Login Screens for Survey Questionnaires Student Login Screen: Teacher/School Administrator Login Screens: Contents Library of Survey Questionnaires Appendix F-1: Student Questionnaires 9 Appendix F-1a: 2018 Pilot Grade 4 Core 13 Appendix F-1b: 2018 Cognitive Interviews Grade 4 Core 23 Appendix F-1c: 2018 Operational Grade 8 Core 26 Appendix F-1d: 2018 Cognitive Interviews Grade 8 Core 37 Appendix F-1e: 2018 Pilot Grade 12 Core 40 Appendix F-1f: 2018 Cognitive Interviews Grade 12 Core 56 Appendix F-1g: 2017 Operational Grade 4 Reading 59 Appendix F-1h: 2018 Cognitive Interviews Grade 4 Reading 67 Appendix F-1i: 2017 Operational Grade 8 Reading 71 Appendix F-1j: 2018 Cognitive Interviews Grade 8 Reading 80 Appendix F-1k: 2018 Pilot Grade 12 Reading 84 Appendix F-1l: 2017 Operational Grade 4 Mathematics 96 Appendix F-1m: 2018 Cognitive Interviews Grade 4 Mathematics 105 Appendix F-1n: 2017 Operational Grade 8 Mathematics 108 Appendix F-1o: 2018 Cognitive Interviews Grade 8 Mathematics 118 Appendix F-1p: 2018 Pilot Grade 12 Mathematics 123 Appendix F-1q: 2018 Pilot Grade 4 Science 142 Appendix F-1r: 2018 Pilot Grade 8 Science 152 Appendix F-1s: 2018 Pilot Grade 12 Science 162 Appendix F-1t: 2017 Operational Grade 4 Writing 175 Appendix F-1u: 2018 Cognitive Interviews Grade 4 Writing 181 Appendix F-1v: 2017 Operational Grade 8 Writing 186 Appendix F-1w: 2018 Cognitive Interviews Grade 8 Writing 197 Appendix F-1x: 2011 Operational Grade 12 Writing 200 Appendix F-1y: 2016 Pilot Grade 12 Writing 208 Appendix F-1z: 2018 Cognitive Interviews Grade 12 Writing 227 Appendix F-1aa: 2018 Operational Grade 8 Civics 235 Appendix F-1ab: 2010 Operational Grade 12 Civics 249 Appendix F-1ac: 2018 Operational Grade 8 Geography 256 Appendix F-1ad: 2010 Operational Grade 12 Geography 266 Appendix F-1ae: 2018 Operational Grade 8 U.S. History 272 Appendix F-1af: 2010 Operational Grade 12 U.S. History 285 Appendix F-1ag: 2012 Operational Grade 12 Economics 292 Appendix F-1ah: 2018 Operational Grade 8 TEL 299 Appendix F-1ai: 2015 Operational Grade 4 NIES 317 Appendix F-1aj: 2015 Operational Grade 8 NIES 325 Appendix F-1ak: 2017 Operational Grade 4 CAFS 338 Appendix F-1al: 2017 Operational Grade 8 CAFS 346 Appendix F-1am: 2015 Operational Grade 12 CAFS 361 Appendix F-1an: 2018 Cognitive Interviews Grade 4 Household Composition 377 Appendix F-1ao: 2015 Student Grade 4 Core 382 Appendix F-1ap: 2015 Student Grade 8 Core 386 Appendix F-1aq: 2015 Student Grade 12 Core 390 Appendix F-2: Teacher Questionnaires 395 Appendix F-2a: 2017 Operational Grade 4 Core (BET) 398 Appendix F-2b: 2018 Pilot Grade 4 Core (BET) 410 Appendix F-2c: 2018 Cognitive Interviews Grade 4 Core 421 Appendix F-2d: 2018 Cognitive Interviews Grade 8 Core 424 Appendix F-2e: 2017 Operational Grade 8 Core (BET-Reading/ Writing) 427 Appendix F-2f: 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) 438 Appendix F-2g: 2017 Operational Grade 8 Core (BET-Mathematics) 447 Appendix F-2h: 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) 458 Appendix F-2i: 2018 Pilot Grade 8 Core (BET-Science) 467 Appendix F-2j: 2018 Operational Grade 8 Core (BET-Social Studies) 479 Appendix F-2k: 2017 Operational Grade 4 Reading (COI) 491 Appendix F-2l: 2018 Cognitive Interviews Grade 4 Reading 499 Appendix F-2m: 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) 507 Appendix F-2n: 2017 Operational Grade 8 Reading (COI) 516 Appendix F-2o: 2018 Cognitive Interviews Grade 8 Reading 525 Appendix F-2p: 2017 Operational Grade 4 Mathematics (COI) 533 Appendix F-2q: 2018 Cognitive Interviews Grade 4 Mathematics 543 Appendix F-2r: 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) 546 Appendix F-2s: 2017 Operational Grade 8 Mathematics (COI) 555 Appendix F-2t: 2018 Cognitive Interviews Grade 8 Mathematics 565 Appendix F-2u: 2018 Pilot Grade 4 Science (COI) 568 Appendix F-2v: 2018 Pilot Grade 8 Science (COI) 579 Appendix F-2w: 2017 Operational Grade 4 Writing (COI) 590 Appendix F-2x: 2017 Operational Grade 8 Writing (COI) 600 Appendix F-2y: 2018 Operational Grade 8 Social Studies (COI) 610 Appendix F-2z: 2012 Operational Grade 12 Economics-Department Head 624 Appendix F-2aa: 2015 Operational Grade 4 NIES 629 Appendix F-2ab: 2015 Operational Grade 8 NIES 642 Appendix F-2ac: 2019 Operational Grade 4 & 8 CAFS 657 Appendix F-2ad: 2017 Operational Grade 4 & 8 Giving Back Items 662 Appendix F-3: School Questionnaires 664 Appendix F-3a: 2018 Pilot Grade 4 Core (SCP) 668 Appendix F-3b: 2018 Cognitive Interviews Grade 4 Core 682 Appendix F-3c: 2018 Operational Grade 8 Core (SCP) 684 Appendix F-3d: 2018 Cognitive Interviews Grade 8 Core 698 Appendix F-3e: 2018 Pilot Grade 12 Core (SCP) 700 Appendix F-3f: 2018 Cognitive Interviews Grade 12 Core 715 Appendix F-3g: 2018 Operational Grade 4 Charter School 717 Appendix F-3h: 2018 Cognitive Interviews Grade 4 Charter School 721 Appendix F-3i: 2018 Operational Grade 8 Charter School 723 Appendix F-3j: 2018 Cognitive Interviews Grade 8 Charter School 727 Appendix F-3k: 2018 Operational Grade 12 Charter School 729 Appendix F-3l: 2018 Cognitive Interviews Grade 12 Charter School 733 Appendix F-3m: 2017 Operational Grade 4 Reading 735 Appendix F-3n: 2018 Cognitive Interviews Grade 4 Reading 742 Appendix F-3o: 2017 Operational Grade 8 Reading 747 Appendix F-3p: 2018 Cognitive Interviews Grade 8 Reading 754 Appendix F-3q: 2017 Pilot Grade 8 Core, Reading, Mathematics (All Subjects) 759 Appendix F-3r: 2018 Pilot Grade 12 Reading 762 Appendix F-3s: 2017 Operational Grade 4 Mathematics 770 Appendix F-3t: 2018 Cognitive Interviews Grade 4 Mathematics 776 Appendix F-3u: 2017 Operational Grade 8 Mathematics 779 Appendix F-3v: 2018 Cognitive Interviews Grade 8 Mathematics 785 Appendix F-3w: 2017 Pilot Grade 8 Core, Reading, Mathematics (All Subjects) 788 Appendix F-3x: 2018 Pilot Grade 12 Mathematics 791 Appendix F-3y: 2018 Pilot Grade 4 Science 802 Appendix F-3z: 2018 Pilot Grade 8 Science 809 Appendix F-3aa: 2018 Pilot Grade 12 Science 816 Appendix F-3ab: 2017 Operational Grade 4 Writing 824 Appendix F-3ac: 2018 Cognitive Interviews Grade 4 Writing 831 Appendix F-3ad: 2017 Operational Grade 8 Writing 833 Appendix F-3ae: 2018 Cognitive Interviews Grade 8 Writing 839 Appendix F-3af: 2011 Operational Grade 12 Writing 841 Appendix F-3ag: 2016 Pilot Grade 12 Writing 844 Appendix F-3ah: 2018 Cognitive Interviews Grade 12 Writing 850 Appendix F-3ai: 2018 Operational Grade 8 Social Studies 852 Appendix F-3aj: 2010 Operational Grade 12 Social Studies 858 Appendix F-3ak: 2012 Operational Grade 12 Economics 866 Appendix F-3al: 2018 Operational Grade 8 TEL 873 Appendix F-3am: 2015 Operational Grade 4 NIES 889 Appendix F-3an: 2015 Operational Grade 8 NIES 899 Appendix F-3ao: 2017 Operational Grade 4, 8, & 12 Giving Back Items 910 Appendix F-1: Student Questionnaires 9 Table F.a. Assessment years for the student survey questionnaires and appendix parts. 2019 Grade 4 Core X 2020 X Appendix Survey Questionnaire Parts F-1a 2018 Pilot Grade 4 Core F-1b 2018 Cognitive Interviews Grade 4 Core Source location within OMB# 18500928 v.8 or other source Appendix I-1c F-1ao 2015 Operational Grade 4 Core 2015 Wave 2 Submittal, Volume II, Survey Questions, Part 1a, Grade 4 Core F-1c 2018 Operational Grade 8 Core Appendix I-1d F-1d 2018 Cognitive Interviews Grade 8 Core The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 F-1ap 2015 Operational Grade 8 Core 2018 Pilot Grade 12 Core 2018 Cognitive Interviews Grade 12 Core 2015 Wave 2 Submittal, Volume II, Survey Questions, Part 1b, Grade 8 Core Appendix I-1e F-1aq 2015 Operational Grade 12 Core 2015 Wave 2 Submittal, Volume II, Survey Questions, Part 1c, Grade 12 Core F-1g 2017 Operational Grade 4 Reading Appendix F-1d F-1h 2018 Cognitive Interviews Grade 4 Reading The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 F-1i 2017 Operational Grade 8 Reading Appendix F-1e F-1j 2018 Cognitive Interviews Grade 8 Reading The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 F-1k 2018 Pilot Grade 12 Reading Appendix F-1f F-1l 2017 Operational Appendix F-1g Grade 4 Mathematics F-1m 2018 Cognitive Interviews Grade 4 Mathematics 2017 Operational Grade 8 Mathematics The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 Appendix F-1h F-1o 2018 Cognitive Interviews Grade 8 Mathematics The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 F-1p 2018 Pilot Grade 12 Mathematics Appendix F-1i X Grade 8 Core X X X F-1e Grade 12 Core F-1f X X X Grade 4 Reading X Grade 8 Reading X Grade 12 Reading Grade 4 Mathematics X X X F-1n Grade 8 Mathematics Grade 12 Mathematics X X X The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 1 10 2019 2020 Grade 4 Science Appendix Survey Questionnaire Parts Source location within OMB# 18500928 v.8 or other source F-1q 2018 Pilot Grade 4 Science Appendix I-1i F-1r 2018 Pilot Grade 8 Science 2018 Pilot Grade 12 Science 2017 Operational Grade 4 Writing 2018 Cognitive Interviews Grade 4 Writing Appendix I-1j F-1v 2017 Operational Grade 8 Writing Appendix F-1q F-1w 2018 Cognitive Interviews Grade 8 Writing The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 F-1x 2011 Operational Grade 12 Writing 2016 Pilot Grade 12 Writing 2018 Cognitive Interviews Grade 12 Writing Appendix F-1r 2018 Operational Grade 8 Civics 2010 Operational Grade 12 Civics Appendix I-1m X Grade 8 Science Grade 12 Science X F-1s X F-1t Grade 4 Writing F-1u X Grade 8 Writing X F-1y Grade 12 Writing F-1z X Grade 8 Civics X F-1aa F-1ab Grade 12 Civics X Grade 8 Geography X Grade 8 U.S. History X Grade 12 U.S. History Grade 8 &12 TEL Appendix F-1s The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 The National Assessment of Educational Progress, Wave 1 Submittal for 2010 Volume II, Part 3c, Background Questions for 2010 Assessment, Student Grade 12 Civics questions Appendix I-1o F-1ad 2010 Operational Grade 12 Geography The National Assessment of Educational Progress, Wave 1 Submittal for 2010 Volume II, Part 3d, Background Questions for 2010 Assessment, Student Grade 12 Geography questions F-1ae 2018 Operational Grade 8 U.S. History Appendix I-1q F-1af 2010 Operational Grade 12 U.S. History F-1ag 2012 Operational Grade 12 Economics The National Assessment of Educational Progress, Wave 1 Submittal for 2010 Volume II, Part 3e, Background Questions for 2010 Assessment, Student Grade 12 U.S. History questions The National Assessment of Educational Progress, Wave 2 Submittal for 2012, Volume II, Part 2, Student Economics Background Questions for 2012 Assessment F-1ah 2018 Operational Grade 8 TEL X X The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 2018 Operational Grade 8 Geography X Grade 12 Economics Appendix F-1p F-1ac X Grade 12 Geography Appendix I-1k Appendix I-1r 2 11 2019 Grade 4 NIES Grade 8 NIES Grade 4 CAFS Grade 8 CAFS 2020 Appendix Survey Questionnaire Parts Source location within OMB# 18500928 v.8 or other source F-1ai 2015 Operational Grade 4 NIES Appendix F-1y F-1aj 2015 Operational Grade 8 NIES Appendix F-1z F-1ak 2017 Operational Grade 4 CAFS NAEP 2017 Survey Questionnaires (OMB# 1850-0928 v.1) Appendix I- 1; p.139 F-1al 2017 Operational Grade 8 CAFS NAEP 2017 Survey Questionnaires (OMB# 1850-0928 v.1) Appendix I- 1; p.147 F-1am 2015 Operational Grade 12 CAFS The National Assessment of Educational Progress, Wave 3 Submittal for 2015 Volume II, Special Studies Survey Questions, OMB #1850-0790, p. 33-47 F-1an 2018 Cognitive Interviews Grade 4 & 8 Household Composition National Assessment of Educational Progress (NAEP) Socioeconomic Status (SES) Indicator Items Development Studies; OMB# 1850- 0803 v.201 X X X X Grade 12 CAFS X Grade 4 and 8 SES-SQ X 3 12 Appendix F-1a: 2018 Pilot Grade 4 Core 13 VH240003 1. How important was it to you to do well on this test? A Not very important B Somewhat important C Important D Very important VH260313 2. How easy or difficult was this test? A Extremely difficult B Quite difficult C Somewhat difficult D Somewhat easy E Quite easy F Extremely easy VH333658 3. How much effort did you apply to succeed on this test? A No effort at all B Very little effort C Some effort D Quite a bit of effort E A lot of effort 14 VH333660 4. How challenging was taking this test? A Not challenging at all B A little challenging C Somewhat challenging D Quite challenging E Extremely challenging VH333661 5. How much time pressure did you feel when taking this test? A No time pressure at all B A little bit of time pressure C Some time pressure D Quite a bit of time pressure E A lot of time pressure 15 VH240387 6. Are you Hispanic or Latino? Select one or more answer choices. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240388 7. Which of the following best describes you? Select one or more answer choices. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander VH240186 8. About how many books are there in your home? A Few (0–10) B Enough to fill one shelf (11–25) C Enough to fill one bookcase (26–100) D Enough to fill several bookcases (more than 100) 16 VH271104 9. Do you have any of the following in your home? Select one answer choice on each row. a. b. c. d. e. Access to the Internet Clothes dryer just for your family Dishwasher Your own bedroom A desktop or laptop computer (including Chromebooks) that you can use f. A tablet (for example, Surface Pro, iPad, Kindle Fire) that you can use g. A smartphone (for example, iPhone, Samsung Galaxy, HTC One) that you can use Yes No A B VH271105 A B VH336756 A B VH336759 A B VH336762 A B VH591976 A B VH271110 A B VH271112 VH354591 10. How often do you use the Internet for homework at home? A Never B About once or twice a month C About once or twice a week D Almost every day E Every day VH240190 11. How many days were you absent from school in the last month? A None B 1 or 2 days C 3 or 4 days D 5 to 10 days E More than 10 days 17 VH240189 12. How often do you talk about things you have studied in school with someone in your family? A Never or hardly ever B Once every few weeks C About once a week D Two or three times a week E Every day VH271144 13. Do any of the following people live in your home? Select one answer choice on each row. a. Mother b. Stepmother c. Foster mother or other female legal guardian d. Father e. Stepfather f. Foster father or other male legal guardian Yes No A B VH271145 A B VH271146 A B VH271147 A B VH271148 A B VH271149 A B VH271150 VH591969 14. In this school year, how often did you use a laptop or desktop computer (including Chromebooks) during your classes at school? A Never B In some classes C In about half of the classes D In more than half of the classes E In all or almost all classes 18 VH271276 15. In this school year, how often did you use a tablet (for example, Surface Pro, iPad, Kindle Fire) during your classes at school? A Never B In some classes C In about half of the classes D In more than half of the classes E In all or almost all classes VH271337 16. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I finish whatever I begin. b. I try very hard even after making mistakes. c. I keep working hard even when I feel like quitting. d. I keep trying to improve myself, even when it takes a long time to get there. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH271338 A B C D E VH271339 A B C D E VH271342 A B C D E VH271345 19 VH733141 17. How much does each of the following statements describe you? Select one answer choice on each row. a. I finish whatever I begin. b. I try very hard even after making mistakes. c. I keep working hard even when I feel like quitting. d. I keep trying to improve myself, even when it takes a long time to get there. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH733142 A B C D E VH733143 A B C D E VH733145 A B C D E VH733144 VH271367 18. In this school year, how often have you done each of the following? Select one answer choice on each row. a. I started working on assignments right away rather than waiting until the last minute. b. I paid attention and resisted distractions. c. I stayed on task without reminders from my teacher. d. I paid attention in class even when I was not interested. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH271370 A B C D E VH271372 A B C D E VH271374 A B C D E VH271375 20 VH271749 19. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I like complex problems more than easy problems. b. I like activities that challenge my thinking abilities. c. I enjoy situations where I will have to think about something. d. I enjoy thinking about new solutions to problems. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH271750 A B C D E VH271752 A B C D E VH271753 A B C D E VH271756 VH733149 20. How much does each of the following statements describe you? Select one answer choice on each row. a. I like complex problems more than easy problems. b. I like activities that challenge my thinking abilities. c. I enjoy situations where I will have to think about something. d. I enjoy thinking about new solutions to problems. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH733150 A B C D E VH733151 A B C D E VH733155 A B C D E VH733154 21 VH271934 21. In this school year, how often have you felt any of the following ways about your school? Select one answer choice on each row. a. I felt awkward and out of place at school. b. I felt happy at school. c. I felt that I learned something that I can use in my daily life. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH271942 A B C D E VH271944 A B C D E VH336903 22 Appendix F-1b: 2018 Cognitive Interviews Grade 4 Core 23 VH810796 1. Are you taking an art course now, or have you taken an art course this school year? A Yes B No VH810813 2. Are you taking a music course now, or have you taken a music course this school year? A Yes B No VH810399 3. Do you have any of the following in your home? Select one answer choice on each row. a. A tablet (for example, Surface Pro, iPad, Kindle Fire) that you can use b. Your own tablet (for example, Surface Pro, iPad, Kindle Fire) c. Your own e-book reader (for example, Kindle, Nook, Kobo Aura) Yes No A B VH810410 A B VH810411 A B VH810412 24 VH810415 4. In this school year, how often have you felt any of the following ways about your school? Select one answer choice on each row. a. I did not feel safe on my way to or from school. b. I worried about crime and violence at my school. c. I felt that I was treated fairly by my teachers. d. I felt safe on my way to or from school. e. I did not worry about crime and violence at my school. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH810432 A B C D E VH810433 A B C D E VH810434 A B C D E VH810435 A B C D E VH810436 25 Appendix F-1c: 2018 Operational Grade 8 Core 26 VH240003 1. How important was it to you to do well on this test? A Not very important B Somewhat important C Important D Very important VH260313 2. How easy or difficult was this test? A Extremely difficult B Quite difficult C Somewhat difficult D Somewhat easy E Quite easy F Extremely easy VH333658 3. How much effort did you apply to succeed on this test? A No effort at all B Very little effort C Some effort D Quite a bit of effort E A lot of effort 27 VH333660 4. How challenging was taking this test? A Not challenging at all B A little challenging C Somewhat challenging D Quite challenging E Extremely challenging VH333661 5. How much time pressure did you feel when taking this test? A No time pressure at all B A little bit of time pressure C Some time pressure D Quite a bit of time pressure E A lot of time pressure 28 VH240387 6. Are you Hispanic or Latino? Select one or more answer choices. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240388 7. Which of the following best describes you? Select one or more answer choices. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander VH240186 8. About how many books are there in your home? A Few (0–10) B Enough to fill one shelf (11–25) C Enough to fill one bookcase (26–100) D Enough to fill several bookcases (more than 100) 29 VH271104 9. Do you have any of the following in your home? Select one answer choice on each row. a. b. c. d. e. Access to the Internet Clothes dryer just for your family Dishwasher Your own bedroom A desktop or laptop computer (including Chromebooks) that you can use f. A tablet (for example, Surface Pro, iPad, Kindle Fire) that you can use g. A smartphone (for example, iPhone, Samsung Galaxy, HTC One) that you can use Yes No A B VH271105 A B VH336756 A B VH336759 A B VH336762 A B VH591976 A B VH271110 A B VH271112 VH354591 10. How often do you use the Internet for homework at home? A Never B About once or twice a month C About once or twice a week D Almost every day E Every day VH240190 11. How many days were you absent from school in the last month? A None B 1 or 2 days C 3 or 4 days D 5 to 10 days E More than 10 days 30 VH240189 12. How often do you talk about things you have studied in school with someone in your family? A Never or hardly ever B Once every few weeks C About once a week D Two or three times a week E Every day VH240192 13. How far in school did your mother go? A She did not finish high school. B She graduated from high school. C She had some education after high school. D She graduated from college. E I don’t know. VH240193 14. How far in school did your father go? A He did not finish high school. B He graduated from high school. C He had some education after high school. D He graduated from college. E I don’t know. 31 VH336776 15. Does your mother work? A Yes B No C I don’t know. VH336779 16. Does your father work? A Yes B No C I don’t know. 32 VH271144 17. Do any of the following people live in your home? Select one answer choice on each row. a. Mother b. Stepmother c. Foster mother or other female legal guardian d. Father e. Stepfather f. Foster father or other male legal guardian Yes No A B VH271145 A B VH271146 A B VH271147 A B VH271148 A B VH271149 A B VH271150 VH591969 18. In this school year, how often did you use a laptop or desktop computer (including Chromebooks) during your classes at school? A Never B In some classes C In about half of the classes D In more than half of the classes E In all or almost all classes VH271276 19. In this school year, how often did you use a tablet (for example, Surface Pro, iPad, Kindle Fire) during your classes at school? A Never B In some classes C In about half of the classes D In more than half of the classes E In all or almost all classes 33 VH271337 20. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I finish whatever I begin. b. I try very hard even after making mistakes. c. I keep working hard even when I feel like quitting. d. I keep trying to improve myself, even when it takes a long time to get there. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH271338 A B C D E VH271339 A B C D E VH271342 A B C D E VH271345 VH733141 21. How much does each of the following statements describe you? Select one answer choice on each row. a. I finish whatever I begin. b. I try very hard even after making mistakes. c. I keep working hard even when I feel like quitting. d. I keep trying to improve myself, even when it takes a long time to get there. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH733142 A B C D E VH733143 A B C D E VH733145 A B C D E VH733144 34 VH271367 22. In this school year, how often have you done each of the following? Select one answer choice on each row. a. I started working on assignments right away rather than waiting until the last minute. b. I paid attention and resisted distractions. c. I stayed on task without reminders from my teacher. d. I paid attention in class even when I was not interested. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH271370 A B C D E VH271372 A B C D E VH271374 A B C D E VH271375 VH271749 23. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I like complex problems more than easy problems. b. I like activities that challenge my thinking abilities. c. I enjoy situations where I will have to think about something. d. I enjoy thinking about new solutions to problems. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH271750 A B C D E VH271752 A B C D E VH271753 A B C D E VH271756 35 VH733149 24. How much does each of the following statements describe you? Select one answer choice on each row. a. I like complex problems more than easy problems. b. I like activities that challenge my thinking abilities. c. I enjoy situations where I will have to think about something. d. I enjoy thinking about new solutions to problems. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH733150 A B C D E VH733151 A B C D E VH733155 A B C D E VH733154 VH271934 25. In this school year, how often have you felt any of the following ways about your school? Select one answer choice on each row. a. I felt awkward and out of place at school. b. I felt happy at school. c. I felt that I learned something that I can use in my daily life. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH271942 A B C D E VH271944 A B C D E VH336903 VH254028 26. Write the ZIP code of your home address in the box. 36 Appendix F-1d: 2018 Cognitive Interviews Grade 8 Core 37 VH810796 1. Are you taking an art course now, or have you taken an art course this school year? A Yes B No VH810813 2. Are you taking a music course now, or have you taken a music course this school year? A Yes B No VH810442 3. Are you taking a language course other than English now, or have you taken a course in a language other than English this school year? A Yes (Please specify which language): B No 38 VH810399 4. Do you have any of the following in your home? Select one answer choice on each row. a. A tablet (for example, Surface Pro, iPad, Kindle Fire) that you can use b. Your own tablet (for example, Surface Pro, iPad, Kindle Fire) c. Your own e-book reader (for example, Kindle, Nook, Kobo Aura) Yes No A B VH810410 A B VH810411 A B VH810412 VH810415 5. In this school year, how often have you felt any of the following ways about your school? Select one answer choice on each row. a. I did not feel safe on my way to or from school. b. I worried about crime and violence at my school. c. I felt that I was treated fairly by my teachers. d. I felt safe on my way to or from school. e. I did not worry about crime and violence at my school. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH810432 A B C D E VH810433 A B C D E VH810434 A B C D E VH810435 A B C D E VH810436 39 Appendix F-1e: 2018 Pilot Grade 12 Core 40 VH240003 1. How important was it to you to do well on this test? A Not very important B Somewhat important C Important D Very important VH260313 2. How easy or difficult was this test? A Extremely difficult B Quite difficult C Somewhat difficult D Somewhat easy E Quite easy F Extremely easy VH333658 3. How much effort did you apply to succeed on this test? A No effort at all B Very little effort C Some effort D Quite a bit of effort E A lot of effort 41 VH333660 4. How challenging was taking this test? A Not challenging at all B A little challenging C Somewhat challenging D Quite challenging E Extremely challenging VH333661 5. How much time pressure did you feel when taking this test? A No time pressure at all B A little bit of time pressure C Some time pressure D Quite a bit of time pressure E A lot of time pressure 42 VH240387 5. Are you Hispanic or Latino? Select one or more answer choices. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240388 6. Which of the following best describes you? Select one or more answer choices. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander VH240186 7. About how many books are there in your home? A Few (0–10) B Enough to fill one shelf (11–25) C Enough to fill one bookcase (26–100) D Enough to fill several bookcases (more than 100) 43 VH271104 8. Do you have any of the following in your home? Select one answer choice on each row. a. b. c. d. e. Access to the Internet Clothes dryer just for your family Dishwasher Your own bedroom A desktop or laptop computer (including Chromebooks) that you can use f. A tablet (for example, Surface Pro, iPad, Kindle Fire) that you can use g. A smartphone (for example, iPhone, Samsung Galaxy, HTC One) that you can use Yes No A B VH271105 A B VH336756 A B VH336759 A B VH336762 A B VH591976 A B VH271110 A B VH271112 VH354591 9. How often do you use the Internet for homework at home? A Never B About once or twice a month C About once or twice a week D Almost every day E Every day VH240190 10. How many days were you absent from school in the last month? A None B 1 or 2 days C 3 or 4 days D 5 to 10 days E More than 10 days 44 VH240189 11. How often do you talk about things you have studied in school with someone in your family? A Never or hardly ever B Once every few weeks C About once a week D Two or three times a week E Every day VH240192 12. How far in school did your mother go? A She did not finish high school. B She graduated from high school. C She had some education after high school. D She graduated from college. E I don’t know. VH240193 13. How far in school did your father go? A He did not finish high school. B He graduated from high school. C He had some education after high school. D He graduated from college. E I don’t know. 45 VH336776 14. Does your mother work? A Yes B No C I don’t know. 46 VH336878 15. What does your mother do for work? Select the choice that most closely describes what she does at work. 01 Accountant \ 22 Farmer \ 43 Religious worker \ 02 Artist \ 23 Firefighter \ 44 Repair technician \ 03 Athlete \ 24 Grounds worker \ 45 Salesperson \ 04 Carpenter \ 25 Health aide \ 46 Scientist \ 05 Cashier \ 26 Helper \ 47 Secretary \ 06 Cleaner \ 27 Housekeeper \ 48 Security guard \ 07 Clerk \ 28 Janitor \ 49 Server \ 08 College professor \ 29 Lawyer \ 50 Social worker \ 09 Construction worker \ 30 Librarian \ 51 Software developer \ 10 Cook \ 31 Manager \ 52 Stocker \ 11 Customer service \ 32 Marketing \ 53 Supervisor \ 12 Day care worker \ 33 Mechanic \ 54 Surgeon \ 13 Dental hygienist \ 34 Medical technician \ 55 Surveyor \ 14 Dentist \ 35 Military \ 56 Taxi driver \ 15 Designer \ 36 Miner \ 57 Teacher \ 16 Doctor \ 37 Nurse \ 58 Therapist \ 17 Education \ 38 Office support \ 59 Transportation \ 39 Painter \ 60 Truck driver \ 40 Pharmacist \ 61 Veterinarian \ 41 Police \ 62 Writer \ 42 Receptionist \ 63 Other (Please specify): \ administrator 18 Electrician \ 19 Engineer \ 20 Executive \ 21 Factory worker \ ___________________ 47 VH336779 16. Does your father work? A Yes B No C I don’t know. 48 VH336885 17. What does your father do for work? Select the choice that most closely describes what he does at work. 01 Accountant \ 22 Farmer \ 43 Religious worker \ 02 Artist \ 23 Firefighter \ 44 Repair technician \ 03 Athlete \ 24 Grounds worker \ 45 Salesperson \ 04 Carpenter \ 25 Health aide \ 46 Scientist \ 05 Cashier \ 26 Helper \ 47 Secretary \ 06 Cleaner \ 27 Housekeeper \ 48 Security guard \ 07 Clerk \ 28 Janitor \ 49 Server \ 08 College professor \ 29 Lawyer \ 50 Social worker \ 09 Construction worker \ 30 Librarian \ 51 Software developer \ 10 Cook \ 31 Manager \ 52 Stocker \ 11 Customer service \ 32 Marketing \ 53 Supervisor \ 12 Day care worker \ 33 Mechanic \ 54 Surgeon \ 13 Dental hygienist \ 34 Medical technician \ 55 Surveyor \ 14 Dentist \ 35 Military \ 56 Taxi driver \ 15 Designer \ 36 Miner \ 57 Teacher \ 16 Doctor \ 37 Nurse \ 58 Therapist \ 17 Education \ 38 Office support \ 59 Transportation \ 39 Painter \ 60 Truck driver \ 40 Pharmacist \ 61 Veterinarian \ 41 Police \ 62 Writer \ 42 Receptionist \ 63 Other (Please specify): \ administrator 18 Electrician \ 19 Engineer \ 20 Executive \ 21 Factory worker \ ___________________ 49 VH271144 18. Do any of the following people live in your home? Select one answer choice on each row. a. Mother b. Stepmother c. Foster mother or other female legal guardian d. Father e. Stepfather f. Foster father or other male legal guardian Yes No A B VH271145 A B VH271146 A B VH271147 A B VH271148 A B VH271149 A B VH271150 VH591969 19. In this school year, how often did you use a laptop or desktop computer (including Chromebooks) during your classes at school? A Never B In some classes C In about half of the classes D In more than half of the classes E In all or almost all classes 50 VH271276 20. In this school year, how often did you use a tablet (for example, Surface Pro, iPad, Kindle Fire) during your classes at school? A Never B In some classes C In about half of the classes D In more than half of the classes E In all or almost all classes VH271337 21. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I finish whatever I begin. b. I try very hard even after making mistakes. c. I keep working hard even when I feel like quitting. d. I keep trying to improve myself, even when it takes a long time to get there. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH271338 A B C D E VH271339 A B C D E VH271342 A B C D E VH271345 51 VH733141 22. How much does each of the following statements describe you? Select one answer choice on each row. a. I finish whatever I begin. b. I try very hard even after making mistakes. c. I keep working hard even when I feel like quitting. d. I keep trying to improve myself, even when it takes a long time to get there. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH733142 A B C D E VH733143 A B C D E VH733145 A B C D E VH733144 VH271367 23. In this school year, how often have you done each of the following? Select one answer choice on each row. a. I started working on assignments right away rather than waiting until the last minute. b. I paid attention and resisted distractions. c. I stayed on task without reminders from my teacher. d. I paid attention in class even when I was not interested. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH271370 A B C D E VH271372 A B C D E VH271374 A B C D E VH271375 52 VH271749 24. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I like complex problems more than easy problems. b. I like activities that challenge my thinking abilities. c. I enjoy situations where I will have to think about something. d. I enjoy thinking about new solutions to problems. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH271750 A B C D E VH271752 A B C D E VH271753 A B C D E VH271756 VH733149 25. How much does each of the following statements describe you? Select one answer choice on each row. a. I like complex problems more than easy problems. b. I like activities that challenge my thinking abilities. c. I enjoy situations where I will have to think about something. d. I enjoy thinking about new solutions to problems. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH733150 A B C D E VH733151 A B C D E VH733155 A B C D E VH733154 53 VH271934 26. In this school year, how often have you felt any of the following ways about your school? Select one answer choice on each row. a. I felt awkward and out of place at school. b. I felt happy at school. c. I felt that I learned something that I can use in my daily life. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH271942 A B C D E VH271944 A B C D E VH336903 54 VH740697 27. During this school year, which of the following have you done? Select one answer on each row. a. Taken the SAT or ACT College Entrance Exams b. Submitted the Free Application for Federal Student Aid (FAFSA) c. Applied to a 2-year college d. Been accepted to a 2-year college e. Applied to a 4-year college f. Been accepted to a 4-year college g. Applied to a certificate or diploma program at a school that provides occupational training (such as electrician, beautician, mechanic, computer programmer, etc.) h. Been accepted to a technical training program i. Talked with a military recruiter j. Enlisted in the military k. Applied for a full-time job l. Been interviewed for a full-time job Yes No A B VH740702 A B VH740703 A B VH740704 A B VH740705 A B VH740706 A B VH740708 A B VH740709 A B VH740710 A B VH740711 A B VH740712 A B VH740713 A B VH740714 VH240194 28. Which of the following best describes your high school program? A General B Academic or college preparatory C Vocational or technical VH254028 29. Write the ZIP code of your home address in the box. 55 Appendix F-1f: 2018 Cognitive Interviews Grade 12 Core 56 VH810796 1. Are you taking an art course now, or have you taken an art course this school year? A Yes B No VH810813 2. Are you taking a music course now, or have you taken a music course this school year? A Yes B No VH810442 3. Are you taking a language course other than English now, or have you taken a course in a language other than English this school year? A Yes (Please specify which language): B No VH810756 4. How well do you think your education has prepared you for the future you want to have after high school (for example, going to college or working a job)? A Has not prepared me at all B Has prepared me a little C Has prepared me somewhat D Has prepared me quite a bit E Has prepared me a lot 57 VH810399 5. Do you have any of the following in your home? Select one answer choice on each row. a. A tablet (for example, Surface Pro, iPad, Kindle Fire) that you can use b. Your own tablet (for example, Surface Pro, iPad, Kindle Fire) c. Your own e-book reader (for example, Kindle, Nook, Kobo Aura) Yes No A B VH810410 A B VH810411 A B VH810412 VH810415 6. In this school year, how often have you felt any of the following ways about your school? Select one answer choice on each row. a. I did not feel safe on my way to or from school. b. I worried about crime and violence at my school. c. I felt that I was treated fairly by my teachers. d. I felt safe on my way to or from school. e. I did not worry about crime and violence at my school. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH810432 A B C D E VH810433 A B C D E VH810434 A B C D E VH810435 A B C D E VH810436 58 Appendix F-1g: 2017 Operational Grade 4 Reading 59 VH332850 1. How often does your teacher ask you to read a book you have chosen yourself? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH332853 2. How often does your teacher ask you to discuss new or difficult vocabulary? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 60 VH332862 3. For school this year, how often do you work in pairs or small groups to talk about something that you have read? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH332871 4. For school this year, how often do you have a class discussion about something that the class has read? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH588774 5. For school this year, how often have you been asked to write long answers (several sentences or paragraphs) to questions on tests or assignments that involved reading? A Never B Once C Two or three times D Four or five times E More than five times 61 VH598672 6. On a typical school day, how much time do you use a computer or other digital device to do your English/language arts schoolwork and homework? A Less than 30 minutes B About 30 minutes C About 1 hour D About 2 hours E About 3 hours F 4 or more hours VH260228 7. In this school year, how often do you borrow reading materials (such as books or magazines) from your school library or media center? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 62 VH337050 8. Do you think you would be able to do each of the following when reading? Select one answer choice on each row. a. Figure out the meaning of a word you don’t know by using other words in the text b. Explain the meaning of something you have read c. Figure out the main idea of a text d. Find text in a reading passage to help you answer a question on a test e. Recognize when you don’t understand something you are reading f. Recognize the difference between fact and opinion in a text I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH260848 A B C D E VH260849 A B C D E VH260851 A B C D E VH260859 A B C D E VH260861 A B C D E VH260863 63 VH260926 9. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want other students to think I am good at reading. b. I want to show others that my English/ language arts schoolwork is easy for me. c. I want to look smart in comparison to the other students in my English/language arts class. d. I want to learn as much as possible in my English/language arts class. e. I want to become a better reader this year. f. I want to understand as much as I can in my English/language arts class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH260928 A B C D E VH260929 A B C D E VH260930 A B C D E VH260931 A B C D E VH260934 A B C D E VH260938 64 VH589132 10. How much does each of the following statements describe a person like you? Select one answer choice on each row. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH260271 A B C D E VH260272 A B C D E VH260275 A B C D E VH260277 a. Reading is one of my favorite activities. b. I like talking about books with other people. c. I think reading is important. d. I enjoy going to a bookstore or a library. VH598686 11. Besides doing homework, how much time do you spend reading outside of school? A Less than 30 minutes a day B About 30 minutes a day C About 1 hour a day D About 2 hours a day E About 3 hours a day F 4 or more hours a day VH332820 12. How often do you receive help from a tutor, family member, or friend with English/language arts outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 65 VH260906 13. How often do you typically do each of the following things outside of school? Select one answer choice on each row. a. Talk about books (print or online) with other people b. Go to my local library to borrow books (print or online) c. Read blogs d. Use social media (for example, Facebook, Twitter, Instagram) e. Help friends with reading homework Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH260907 A B C D E VH260911 A B C D E VH260913 A B C D E VH333261 A B C D E VH260917 66 Appendix F-1h: 2018 Cognitive Interviews Grade 4 Reading 67 VH811326 1. In this school year, how often do you borrow or download reading materials (such as books or magazines) from your school (for example, a classroom library, school library, or media center)? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH811332 2. How much does each of the following statements describe you? Select one answer choice on each row. a. I enjoy finding things to read online. b. I like talking about topics I read online with other people. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH811338 A B C D E VH811340 68 VH811346 3. How often do you typically do each of the following activities outside of school? Select one answer choice on each row. a. Read stories or novels b. Read newspapers or magazines c. Read comic books or graphic novels d. Read online about topics I am interested in e. Talk about things I read with other people f. Borrow or download books from my local library Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811355 A B C D E VH811356 A B C D E VH811357 A B C D E VH811359 A B C D E VH811365 A B C D E VH811366 VH811207 4. Do you think you can do each of the following activities when reading? Select one answer choice on each row. a. Critique an author’s craft or technique b. Use evidence from a text to support your answer I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH811213 A B C D E VH811215 69 VH811176 5. How often do you receive the following types of help with English/language arts schoolwork outside or after school? Select one answer choice on each row. a. Help from a teacher b. Help from a tutor c. Help from a family member or friend d. Help from online resources (for example, websites or apps) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811190 A B C D E VH811192 A B C D E VH811196 A B C D E VH811200 VH811276 6. How useful do you find each of the following types of help to understand your English/language arts schoolwork? Select one answer choice on each row. a. Help from a teacher b. Help from a tutor c. Help from a family member or friend d. Help from online resources (for example, websites or apps) Not useful at all Somewhat useful Very useful I don’t receive that type of help A B C D VH811287 A B C D VH811291 A B C D VH811302 A B C D VH811304 70 Appendix F-1i: 2017 Operational Grade 8 Reading 71 VH332887 1. For your English/language arts class this year, how often do you do each of the following? Select one answer choice on each row. a. Have a class discussion about something that the whole class has read b. Work in pairs or small groups to talk about something that you have read Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH332888 A B C D E VH332889 VH260254 2. In your English/language arts class this year, when reading a story, article, or other passage, how often does your teacher ask you to do the following? Select one answer choice on each row. a. Evaluate the main evidence in a persuasive/argument passage b. Analyze the author’s organization of information in a passage c. Critique the author’s craft or technique Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH260256 A B C D E VH333142 A B C D E VH333144 72 VH333074 3. In your English/language arts class this year, when reading a story, article, or other passage, how often does your teacher ask you to do the following? Select one answer choice on each row. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH333075 A B C D E VH333076 A B C D E VH333079 A B C D E VH333078 A B C D E VH333094 A B C D E VH333077 a. Summarize the passage b. Interpret the meaning of the passage c. Question the motives or feelings of the characters d. Identify the main ideas of the passage e. Identify the themes of the passage f. Analyze two or more texts on the same topic VH588774 4. For school this year, how often have you been asked to write long answers (several sentences or paragraphs) to questions on tests or assignments that involved reading? A Never B Once C Two or three times D Four or five times E More than five times 73 VH5986.. 5. On a typical school day, how much time do you use a computer or other digital device to do your English/language arts schoolwork and ome or ? A Less than 30 minutes B About 30 minutes C About 1 hour D About 2 hours E About 3 hours F 4 or more hours VH460 6. In this school year, how often do you borrow reading materials (such as books or magazines) from your classroom library or media center?A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 74 VH260847 7. Do you think you would be able to do each of the following when reading? Select one answer choice on each row. a. Figure out the meaning of a word you don’t know by using other words in the text b. Explain the meaning of something you have read c. Figure out the main idea of a text d. Find text in a reading passage to help you answer a question on a test e. Recognize when you don’t understand something you are reading I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH260848 A B C D E VH260849 A B C D E VH260851 A B C D E VH260859 A B C D E VH260861 75 VH611300 8. Do you think you would be able to do each of the following when reading? Select one answer choice on each row. a. Recognize the difference between fact and opinion in a text b. Judge the reliability of sources (for example, how a website might be biased or inaccurate) c. Critique an author’s craft or technique d. Use evidence from a text to support my answer e. Identify the author’s perspective in a persuasive text I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH260863 A B C D E VH260857 A B C D E VH260866 A B C D E VH616841 A B C D E VH260868 76 VH260926 9. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want other students to think I am good at reading. b. I want to show others that my English/ language arts schoolwork is easy for me. c. I want to look smart in comparison to the other students in my English/language arts class. d. I want to learn as much as possible in my English/language arts class. e. I want to become a better reader this year. f. I want to understand as much as I can in my English/language arts class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH260928 A B C D E VH260929 A B C D E VH260930 A B C D E VH260931 A B C D E VH260934 A B C D E VH260938 77 VH589132 10. How much does each of the following statements describe a person like you? Select one answer choice on each row. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH260271 A B C D E VH260272 A B C D E VH260275 A B C D E VH260277 a. Reading is one of my favorite activities. b. I like talking about books with other people. c. I think reading is important. d. I enjoy going to a bookstore or a library. VH598686 11. Besides doing homework, how much time do you spend reading outside of school? A Less than 30 minutes a day B About 30 minutes a day C About 1 hour a day D About 2 hours a day E About 3 hours a day F 4 or more hours a day VH332820 12. How often do you receive help from a tutor, family member, or friend with English/language arts outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 78 VH261065 13. How often do you typically read each of the following outside of school (print or online)? Select one answer choice on each row. a. b. c. d. e. f. g. h. Stories or novels Poems Plays Biographies Comic books Magazines E-mails Text messages Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH261066 A B C D E VH261067 A B C D E VH261068 A B C D E VH617043 A B C D E VH261070 A B C D E VH261071 A B C D E VH261074 A B C D E VH261075 VH260906 14. How often do you typically do each of the following things outside of school? Select one answer choice on each row. a. Talk about books (print or online) with other people b. Go to my local library to borrow books (print or online) c. Read blogs d. Use social media (for example, Facebook, Twitter, Instagram) e. Help friends with reading homework Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH260907 A B C D E VH260911 A B C D E VH260913 A B C D E VH333261 A B C D E VH260917 79 Appendix F-1j: 2018 Cognitive Interviews Grade 8 Reading 80 VH811326 1. In this school year, how often do you borrow or download reading materials (such as books or magazines) from your school (for example, a classroom library, school library, or media center)? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH811332 2. How much does each of the following statements describe you? Select one answer choice on each row. a. I enjoy finding things to read online. b. I like talking about topics I read online with other people. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH811338 A B C D E VH811340 81 VH811346 3. How often do you typically do each of the following activities outside of school? Select one answer choice on each row. a. Read stories or novels b. Read newspapers or magazines c. Read comic books or graphic novels d. Read online about topics I am interested in e. Talk about things I read with other people f. Borrow or download books from my local library Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811355 A B C D E VH811356 A B C D E VH811357 A B C D E VH811359 A B C D E VH811365 A B C D E VH811366 VH811176 4. How often do you receive the following types of help with English/language arts schoolwork outside or after school? Select one answer choice on each row. a. Help from a teacher b. Help from a tutor c. Help from a family member or friend d. Help from online resources (for example, websites or apps) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811190 A B C D E VH811192 A B C D E VH811196 A B C D E VH811200 82 VH811276 5. How useful do you find each of the following types of help to understand your English/language arts schoolwork? Select one answer choice on each row. Not useful at all Somewhat useful Very useful I don’t receive that type of help A B C D VH811287 A B C D VH811291 A B C D VH811302 A B C D VH811304 a. Help from a teacher b. Help from a tutor c. Help from a family member or friend d. Help from online resources (for example, websites or apps) VH811222 6. Do you think you can do each of the following activities when reading? Select one answer choice on each row. a. Analyze the author’s use of features in a text (for example, transition words, voice) b. Analyze the author’s use of figurative language (for example, symbolisms, metaphors, or foreshadowing) c. Recognize tools the author is using (for example, parallel structure, examples, or repetition) d. Evaluate the strength and quality of evidence used by the author to support his or her position I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH811227 A B C D E VH811229 A B C D E VH811231 A B C D E VH811233 83 Appendix F-1k: 2018 Pilot Grade 12 Reading 84 Grade 12 Grade 12 specific specific items items VH240417 1. For your English/language arts class this year, how many times have you done each of the following? Select one answer choice on each row. a. Made a presentation to the class about something that you have read b. Done a project about something that you have read (for example, written a play, created a website) 2 or 3 times 4 or 5 times 6 or more times Never Once A B C D E VH240420 A B C D E VH240421 VH332887 2. For your English/language arts class this year, how often do you do each of the following? Select one answer choice on each row. a. Have a class discussion about something that the whole class has read b. Work in pairs or small groups to talk about something that we have read c. Discuss different interpretations of what we have read Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH332888 A B C D E VH652035 A B C D E VH652037 85 VH240398 3. Are you currently enrolled in or have you taken an Advanced Placement (AP®) course in English/language arts? Select all that apply. A Yes, I am enrolled in or have taken Advanced Placement (AP) English Language and Composition. B Yes, I am enrolled in or have taken Advanced Placement (AP) English Literature and Composition. C No, I have never taken an Advanced Placement (AP) English/language arts course. VH240006 4. Are you currently enrolled in or have you taken the International Baccalaureate® (IB) Language A1 course? A Yes B No VH240007 5. Are you currently enrolled in or have you taken any online English/language arts courses for high school or college credit? A Yes B No 86 Items previously Items previously cleared cleared at at Grade Grade 88 and and proposed proposed for for Grade Grade 12 12 VH260254 1. In your English/language arts class this year, when reading a story, article, or other passage, how often does your teacher ask you to do the following? Select one answer choice on each row. a. Evaluate the main evidence in a persuasive/argument passage b. Analyze the author’s organization of information in a passage c. Critique the author’s craft or technique Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH260256 A B C D E VH333142 A B C D E VH333144 VH333074 2. In your English/language arts class this year, when reading a story, article, or other passage, how often does your teacher ask you to do the following? Select one answer choice on each row. a. Summarize the passage b. Interpret the meaning of the passage c. Question the motives or feelings of the characters d. Identify the main ideas of the passage e. Identify the themes of the passage f. Analyze two or more texts on the same topic Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH333075 A B C D E VH333076 A B C D E VH333079 A B C D E VH333078 A B C D E VH333094 A B C D E VH333077 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 87 VH588774 3. For school this year, how often have you been asked to write long answers (several sentences or paragraphs) to questions on tests or assignments that involved reading? A Never B Once C Two or three times D Four or five times E More than five times VH598636 4. On a typical school day, how much time do you use a computer or other digital device to do your English/language arts schoolwork? A Less than 30 minutes B About 30 minutes C About 1 hour D About 2 hours E About 3 hours F 4 or more hours VH460301 5. In this school year, how often do you borrow reading materials (such as books or magazines) from your classroom library, school library, or media center? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day Please Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 88 VH260847 6. Do you think you would be able to do each of the following when reading? Select one answer choice on each row. a. Figure out the meaning of a word you don’t know by using other words in the text b. Explain the meaning of something you have read c. Figure out the main idea of a text d. Find text in a reading passage to help you answer a question on a test e. Recognize when you don’t understand something you are reading I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH260848 A B C D E VH260849 A B C D E VH260851 A B C D E VH260859 A B C D E VH260861 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 89 VH611300 7. Do you think you would be able to do each of the following when reading? Select one answer choice on each row. a. Recognize the difference between fact and opinion in a text b. Judge the reliability of sources (for example, how a website might be biased or inaccurate) c. Critique an author’s craft or technique d. Use evidence from a text to support my answer e. Identify the author’s perspective in a persuasive text I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH260863 A B C D E VH260857 A B C D E VH260866 A B C D E VH616841 A B C D E VH260868 Please note: Please note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 90 VH260926 8. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want other students to think I am good at reading. b. I want to show others that my English/ language arts schoolwork is easy for me. c. I want to look smart in comparison to the other students in my English/language arts class. d. I want to learn as much as possible in my English/language arts class. e. I want to become a better reader this year. f. I want to understand as much as I can in my English/language arts class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH260928 A B C D E VH260929 A B C D E VH260930 A B C D E VH260931 A B C D E VH260934 A B C D E VH260938 Please note: Please note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 91 VH589132 9. How much does each of the following statements describe a person like you? Select one answer choice on each row. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH260271 A B C D E VH260272 A B C D E VH260275 A B C D E VH260277 a. Reading is one of my favorite activities. b. I like talking about books with other people. c. I think reading is important. d. I enjoy going to a bookstore or a library. VH598686 10. Besides doing homework, how much time do you spend reading outside of school? A Less than 30 minutes a day B About 30 minutes a day C About 1 hour a day D About 2 hours a day E About 3 hours a day F 4 or more hours a day VH332820 11. How often do you receive help from a tutor, family member, or friend with English/language arts outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day Please note: Please note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 92 VH261065 12. How often do you typically read each of the following outside of school (print or online)? Select one answer choice on each row. a. b. c. d. e. f. g. h. Stories or novels Poems Plays Biographies Comic books Magazines E-mails Text messages Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH261066 A B C D E VH261067 A B C D E VH261068 A B C D E VH617043 A B C D E VH261070 A B C D E VH261071 A B C D E VH261074 A B C D E VH261075 VH260906 13. How often do you typically do each of the following things outside of school? Select one answer choice on each row. a. Talk about books (print or online) with other people b. Go to my local library to borrow books (print or online) c. Read blogs d. Use social media (for example, Facebook, Twitter, Instagram) e. Help friends with reading homework Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH260907 A B C D E VH260911 A B C D E VH260913 A B C D E VH333261 A B C D E VH260917 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 93 VH240360 21. For school this year, how often do you write stories? A Never or hardly ever B A few times a year C Once or twice a month D At least once a week VH565091 22. For school this year, how often do you write reports? A Never or hardly ever B A few times a year C Once or twice a month D At least once a week 94 VH240359 23. For school this year, how often do you write letters? A Never or hardly ever B A few times a year C Once or twice a month D At least once a week VH312244 24. For school this year, how often do you typically write for each of the following purposes? Select one answer choice on each row. Never About once or twice a year About once or twice a month A B C D E VH312245 A B C D E VH312246 A B C D E VH312247 A B C D E VH312248 a. To explain something that you know or have read b. To convince or persuade someone c. To describe a real experience (for example, write about factual events or personal experiences) d. To describe an imagined experience (for example, tell a fictional story) About once Every day or or twice a almost week every day VH565092 25. For school this year, how often do you look for information on the Internet to include in your writing? A Never or hardly ever B A few times a year C Once or twice a month D At least once a week 95 Appendix F-1l: 2017 Operational Grade 4 Mathematics 96 21. VH350115 For school this year, how often have you been asked to write long answers (several sentences or paragraphs) to questions on tests or assignments that involved math? A Never B Once C Two or three times D Four or five times E More than five times VH350116 22. For school this year, how often do you work in pairs or small groups to talk about something that you have done in math? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 97 VH266754 23. How often do you use a computer or other digital device (excluding handheld calculators) for math at school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH591846 24. How often do you use a computer or other digital device (excluding handheld calculators) for math homework? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 98 VH336228 25. How often do you use the Internet to learn things about math? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH336231 26. How often do you use a calculator? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH336233 27. How often do you receive help or tutoring with math outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 99 VH267415 28. This school year, how often did the following things happen in your math class? Select one answer choice on each row. a. My teacher used computers or other digital devices when teaching math to my class. b. My teacher required us to use computers or other digital devices to complete math assignments. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH588077 A B C D E VH267419 VH268936 29. How often do you use math in everyday life outside of school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 100 VH268945 30. How often do you participate in each of the following activities outside of school? Select one answer choice on each row. a. Talk about math problems with your friends b. Play an instrument and read music c. Go to websites for help with your math homework Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH268946 A B C D E VH268961 A B C D E VH268962 VH336085 31. Have you ever helped your friends with their math homework? A Yes B No VH269037 32. Over the past seven days, how many days have you helped your friends with their math homework? Enter the number of days. 101 VH267672 33. Thinking about math, do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row. a. Estimate the weight of 5 apples using pounds (lbs.) b. Divide 42 stickers among 6 students c. Find the amount of carpet needed to cover a rectangular floor if you know its length and width d. Know when to take a turkey out of the oven if it goes in at 10:00 A.M. and it takes 3 hours and 45 minutes to cook I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH267674 A B C D E VH617317 A B C D E VH267682 A B C D E VH267683 102 VH269048 34. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want other students to think I am good at math. b. I want to show others that my math schoolwork is easy for me. c. I want to look smart in comparison to the other students in my math class. d. I want to learn as much as possible in my math class. e. I want to become better in math this year. f. I want to understand as much as I can in my math class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH269049 A B C D E VH269050 A B C D E VH269053 A B C D E VH269059 A B C D E VH269056 A B C D E VH269060 103 VH267478 35. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I enjoy doing math. b. I look forward to my math class. c. I am interested in the things I learn in math. d. I think making an effort in math is worthwhile. e. I think math will help me even when I am not in school. f. I think it is important to do well in math. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH267479 A B C D E VH267481 A B C D E VH617324 A B C D E VH267485 A B C D E VH267486 A B C D E VH267487 104 Appendix F-1m: 2018 Cognitive Interviews Grade 4 Mathematics 105 VH810469 1. This school year, how often did the following things happen in your math class? Select one answer choice on each row. a. My teacher used computers or other digital devices to go on websites or use apps when teaching math to my class. b. My teacher required us to use computers or other digital devices to go on websites or use apps to complete math assignments. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH810476 A B C D E VH810477 VH810881 2. Thinking about math, do you think that you can do each of the following problems? Do not actually solve the problems. Select one answer choice on each row. a. Find all the factors of a whole number (for example, find the factors of 16, or explain why 5 is a prime number) b. Show how many times larger or smaller one thing is than the other (for example, how many times larger is a basketball than a baseball?) I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH810883 A B C D E VH810885 106 VH810858 3. Thinking about math, do you think that you can do each of the following problems? Do not actually solve the problems. Select one answer choice on each row. a. Share 42 stickers equally among 6 students b. Calculate what time the movie ends if it starts at 11:00 AM and lasts for 2 hours and 45 minutes. I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH810864 A B C D E VH810865 VH810517 4. For school this year, how often do you work in pairs or small groups to talk about something that you are doing in math ? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 107 Appendix F-1n: 2017 Operational Grade 8 Mathematics 108 VH266769 25. What math class are you taking this year? Select one or more answer choices. A Eighth-grade math B General eighth-grade math C Algebra I course D First year of a two-year algebra course E Second year of a two-year algebra course F Algebra I (one-year course) G Algebra II H Geometry I Other VH240046 26. What math class do you expect to take next year? A Geometry B Algebra II C Algebra I (one-year course) D First year of a two-year Algebra I course E Second year of a two-year Algebra I course F Introduction to algebra or pre-algebra G Basic or general math H Business or consumer math I Other math class J I don’t know. 109 VH350115 27. For school this year, how often have you been asked to write long answers (several sentences or paragraphs) to questions on tests or assignments that involved math? A Never B Once C Two or three times D Four or five times E More than five times VH350116 28. For school this year, how often do you work in pairs or small groups to talk about something that you have done in math? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH266754 29. How often do you use a computer or other digital device (excluding handheld calculators) for math at school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH336233 30. How often do you receive help or tutoring with math outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 110 VH266808 31. In your math class this year, how often have you used the following types of calculators? Select one answer choice on each row. a. Basic calculator b. Graphing calculator Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH266809 A B C D E VH266810 VH589166 32. This school year, how often did the following things happen in your math class? Select one answer choice on each row. a. My teacher used computers or other digital devices to show us how to work through math problems. b. I used the Internet for my math work. c. My teacher used computers or other digital devices when teaching math to my class. d. My teacher required us to use computers or other digital devices to complete math assignments. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH267416 A B C D E VH267417 A B C D E VH588077 A B C D E VH267419 111 VH336036 33. In this school year, how often have you used a computer or other digital device (excluding handheld calculators) to complete your math assignments? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH336037 34. In this school year, how often have you used a computer or other digital device (excluding handheld calculators) to look online for resources for help with your math assignments? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 112 VH617207 35. In this school year, how often have you used a computer or other digital device (excluding handheld calculators) to take an online practice test? A Never B Once C Two or three times D Four or five times E More than five times VH268936 36. How often do you use math in everyday life outside of school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH589204 37. How often do you participate in each of the following activities outside of school? Select one answer choice on each row. a. Talk about math problems with your friends b. Program computers c. Play an instrument and read music d. Go to websites for help with your math homework Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH268946 A B C D E VH268949 A B C D E VH268961 A B C D E VH268962 113 VH336085 38. Have you ever helped your friends with their math homework? A Yes B No VH269037 39. Over the past seven days, how many days have you helped your friends with their math homework? Enter the number of days. VH589192 40. Thinking about math, do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row. a. Estimate the weight of 5 apples using pounds (lbs.) b. Divide 42 stickers among 6 students c. Determine a 20 percent tip of a 67-dollar restaurant dinner bill d. Describe the properties shared by every isosceles right triangle e. Find the amount of carpet needed to cover a rectangular floor if you know its length and width f. Know when to take a turkey out of the oven if it goes in at 10:00 A.M. and it takes 3 hours and 45 minutes to cook I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH267674 A B C D E VH617317 A B C D E VH267679 A B C D E VH267681 A B C D E VH267682 A B C D E VH267683 114 VH269048 41. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want other students to think I am good at math. b. I want to show others that my math schoolwork is easy for me. c. I want to look smart in comparison to the other students in my math class. d. I want to learn as much as possible in my math class. e. I want to become better in math this year. f. I want to understand as much as I can in my math class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH269049 A B C D E VH269050 A B C D E VH269053 A B C D E VH269059 A B C D E VH269056 A B C D E VH269060 115 VH267478 42. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I enjoy doing math. b. I look forward to my math class. c. I am interested in the things I learn in math. d. I think making an effort in math is worthwhile. e. I think math will help me even when I am not in school. f. I think it is important to do well in math. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH267479 A B C D E VH267481 A B C D E VH617324 A B C D E VH267485 A B C D E VH267486 A B C D E VH267487 116 VH267498 43. How much do you enjoy solving each of the following types of math problems? Select one answer choice on each row. a. Addition, subtraction, multiplication, and division b. Finding areas of shapes and figures c. Solving for probabilities and events (for example, card, coin, marble, and spinner problems) d. Solving equations or simplifying expressions e. Constructing and building different types of graphs (for example, bar graph, line graph, or box and whisker plots) f. Working with geometric figures like rectangles and squares Enjoy not at all Enjoy a little bit Enjoy somewhat Enjoy quite a bit Enjoy a lot A B C D E VH267499 A B C D E VH267501 A B C D E VH267502 A B C D E VH267503 A B C D E VH267504 A B C D E VH267505 117 Appendix F-1o: 2018 Cognitive Interviews Grade 8 Mathematics 118 VH810517 1. For school this year, how often do you work in pairs or small groups to talk about something that you are doing in math ? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH810469 2. This school year, how often did the following things happen in your math class? Select one answer choice on each row. a. My teacher used computers or other digital devices to go on websites or use apps when teaching math to my class. b. My teacher required us to use computers or other digital devices to go on websites or use apps to complete math assignments. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH810476 A B C D E VH810477 VH810589 3. In your math class this year, how often have you used the following types of calculators? Select one answer choice on each row. a. Basic calculator (for example, four-function) b. Scientific calculator Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH810619 A B C D E VH810621 119 VH810888 4. Thinking about math, do you think that you can do each of the following problems? Do not actually solve the problems. Select one answer choice on each row. a. Approximate the value of an irrational number (for example, place square root of 2 on a number line) b. Find the total sum of the interior angles of a pentagon with 5 equal sides c. Write an equation with a variable to solve a problem (for example, if pizza costs $2 per slice, then x number of slices can be bought for $16) I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH810891 A B C D E VH810892 A B C D E VH810893 VH810867 5. Thinking about math, do you think that you can do each of the following problems? Do not actually solve the problems. Select one answer choice on each row. a. Determine the likely number of red faces a cube has if the red face lands up 130 out of 400 times the cube is rolled. The 6 faces of the cube are painted red, yellow, or blue. b. Calculate how many cats a pet store has if the ratio of cats to dogs is 5 to 4, and the total number of cats and dogs the store has is 27. c. Center a 40 inch wide painting on a five foot wide wall I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH810874 A B C D E VH810876 A B C D E VH810878 120 VH810625 6. How much do you enjoy each of the following types of math activities? Select one answer choice on each row. a. Adding, subtracting, multiplying, and dividing fractions b. Solving problems about ratios and rates (for example, if 4 inches of rain fell in 16 hours, how many inches of rain is this per hour) c. Transforming geometric figures from one set of points to another (for example, rotating a rectangle 90 degrees) Enjoy not at all Enjoy a little bit Enjoy somewhat Enjoy quite a bit Enjoy a lot A B C D E VH810635 A B C D E VH810636 A B C D E VH810638 VH810512 7. In this school year, how often have you looked online for resources for help with your math assignments? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 121 VH810507 8. What math class do you expect to take next year? A Basic or general math B Introduction to algebra or pre-algebra C Algebra I D Geometry E Algebra II F Other math class. Please specify: G I don’t know. VH810501 9. What math class are you taking this year? Select one or more answer choices. A Eighth-grade math B Introduction to algebra or pre-algebra C Algebra I D Geometry E Algebra II F Other math class. Please specify: VH812003 10. Write a computer program 122 Appendix F-1p: 2018 Pilot Grade 12 Mathematics 123 Grade 12 Grade 12 specific specific items items VH240819 1. Which courses have you taken from eighth grade to the present? If you have taken a course more than once, give the most recent year you took it. INCLUDE courses taken in summer school, but DO NOT INCLUDE topics that were only taught as part of a longer course (such as trigonometry taught in drafting class or computer programming taught in Algebra II). Select one answer choice on each row. I have I took this I took this I took this I took this I took this never course in in course in course in course in taken this or before course Grade 9. Grade 10. Grade 11. Grade 12. course. Grade 8. a. Basic or general mathematics course b. Tech-prep mathematics, business mathematics, consumer mathematics, or other applied mathematics course c. Introduction to algebra or pre-algebra course d. Algebra I course e. Geometry course f. Algebra II course, with or without trigonometry g. Trigonometry (as a separate course) h. Pre-calculus course (also called introductory analysis) i. Integrated mathematics 1 (first year of a multi-year course) j. Integrated mathematics 2 (second year of a multi-year course) k. Integrated mathematics 3 (third year of a multi-year course) A B C D E F VH240820 A B C D E F VH240844 A B C D E F VH240822 A B C D E F VH240823 A B C D E F VH240824 A B C D E F VH240825 A B C D E F VH240826 A B C D E F VH240833 A B C D E F VH240841 A B C D E F VH240842 A B C D E F VH240843 124 I have I took this I took this I took this I took this I took this never course in in course in course in course in taken this or before course Grade 9. Grade 10. Grade 11. Grade 12. course. Grade 8. l. Integrated mathematics 4 (fourth year of a multi-year course) m. Probability or statistics course n. Calculus course o. Computer programming course (such as C⫹⫹, Visual Basic, etc.) p. Other mathematics course (Please specify): A B C D E F VH240821 A B C D E F VH240836 A B C D E F VH240829 A B C D E F VH240835 A B C D E F VH240834 VH250444 2. Are you currently enrolled in or have you taken any of the following Advanced Placement (AP®) courses? Select all that apply. A Yes, I am enrolled in or have taken Advanced Placement (AP) Calculus AB. B Yes, I am enrolled in or have taken Advanced Placement (AP) Calculus BC. C Yes, I am enrolled in or have taken Advanced Placement (AP) Statistics. D No, I have not taken any of the courses listed above. VH240048 3. Are you currently enrolled in or have you taken an International Baccalaureate® (IB) mathematics course? A Yes B No 125 VH240049 4. Are you currently enrolled in or have you taken any online mathematics courses for high school or college credit? A Yes B No VH240050 5. Was there a mathematics course that you would have liked to have taken this school year but did not take? A Yes, but my school does not offer the course. B Yes, but the course was full. C Yes, but I did not have the necessary prerequisites. D Yes, but my schedule was full. E No, there was no other course that I wanted to take. VH240763 6. Please indicate how much you DISAGREE or AGREE with the following statements. Select one answer choice on each row. a. Math is one of my favorite subjects. b. I take mathematics because it will help me in the future. c. I take mathematics to meet my high school graduation requirements. Strongly disagree Disagree Agree Strongly agree A B C D VH240768 A B C D VH240770 A B C D VH240767 126 VH267478 7. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I enjoy doing math. b. I look forward to my math class. c. I am interested in the things I learn in math. d. I think making an effort in math is worthwhile. e. I think math will help me even when I am not in school. f. I think it is important to do well in math. g. I take mathematics because it will help me in the future. h. I take mathematics to meet my high school graduation requirements. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH267479 A B C D E VH267481 A B C D E VH617324 A B C D E VH267485 A B C D E VH267486 A B C D E VH267487 A B C D E VH651872 A B C D E VH651874 VH240051 8. Are you currently taking a mathematics course? A Yes B No 127 Items previously Items previously cleared cleared at at Grade Grade 88 and and proposed proposed for for Grade Grade 12 12 VH350115 1. For school this year, how often have you been asked to write long answers (several sentences or paragraphs) to questions on tests or assignments that involved math? A Never B Once C Two or three times D Four or five times E More than five times VH350116 2. For school this year, how often do you work in pairs or small groups to talk about something that you have done in math? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day Please note: Please note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 128 VH266754 3. How often do you use a computer or other digital device (excluding handheld calculators) for math at school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH336233 4. How often do you receive help or tutoring with math outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day Please Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 129 VH266808 5. In your math class this year, how often have you used the following types of calculators? Select one answer choice on each row. a. Basic calculator b. Graphing calculator Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH266809 A B C D E VH266810 VH589166 6. This school year, how often did the following things happen in your math class? Select one answer choice on each row. a. My teacher used computers or other digital devices to show us how to work through math problems. b. I used the Internet for my math work. c. My teacher used computers or other digital devices when teaching math to my class. d. My teacher required us to use computers or other digital devices to complete math assignments. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH267416 A B C D E VH267417 A B C D E VH588077 A B C D E VH267419 Please note: Please note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 130 VH336036 7. In this school year, how often have you used a computer or other digital device (excluding handheld calculators) to complete your math assignments? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH336037 8. In this school year, how often have you used a computer or other digital device (excluding handheld calculators) to look online for resources for help with your math assignments? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 131 VH617207 9. In this school year, how often have you used a computer or other digital device (excluding handheld calculators) to take an online practice test? A Never B Once C Two or three times D Four or five times E More than five times VH268936 10. How often do you use math in everyday life outside of school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH589204 11. How often do you participate in each of the following activities outside of school? Select one answer choice on each row. a. Talk about math problems with your friends b. Program computers c. Play an instrument and read music d. Go to websites for help with your math homework Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH268946 A B C D E VH268949 A B C D E VH268961 A B C D E VH268962 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 132 VH336085 12. Have you ever helped your friends with their math homework? A Yes B No VH269037 13. Over the past seven days, how many days have you helped your friends with their math homework? Enter the number of days. VH589192 14. Thinking about math, do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row. a. Estimate the weight of 5 apples using pounds (lbs.) b. Divide 42 stickers among 6 students c. Determine a 20 percent tip of a 67-dollar restaurant dinner bill d. Describe the properties shared by every isosceles right triangle e. Find the amount of carpet needed to cover a rectangular floor if you know its length and width f. Know when to take a turkey out of the oven if it goes in at 10:00 A.M. and it takes 3 hours and 45 minutes to cook I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH267674 A B C D E VH617317 A B C D E VH267679 A B C D E VH267681 A B C D E VH267682 A B C D E VH267683 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 133 VH269048 15. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want other students to think I am good at math. b. I want to show others that my math schoolwork is easy for me. c. I want to look smart in comparison to the other students in my math class. d. I want to learn as much as possible in my math class. e. I want to become better in math this year. f. I want to understand as much as I can in my math class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH269049 A B C D E VH269050 A B C D E VH269053 A B C D E VH269059 A B C D E VH269056 A B C D E VH269060 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 134 VH267478 16. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. I enjoy doing math. b. I look forward to my math class. c. I am interested in the things I learn in math. d. I think making an effort in math is worthwhile. e. I think math will help me even when I am not in school. f. I think it is important to do well in math. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH267479 A B C D E VH267481 A B C D E VH617324 A B C D E VH267485 A B C D E VH267486 A B C D E VH267487 Please note: Please note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 135 VH267498 17. How much do you enjoy solving each of the following types of math problems? Select one answer choice on each row. a. Addition, subtraction, multiplication, and division b. Finding areas of shapes and figures c. Solving for probabilities and events (for example, card, coin, marble, and spinner problems) d. Solving equations or simplifying expressions e. Constructing and building different types of graphs (for example, bar graph, line graph, or box and whisker plots) f. Working with geometric figures like rectangles and squares Enjoy not at all Enjoy a little bit Enjoy somewhat Enjoy quite a bit Enjoy a lot A B C D E VH267499 A B C D E VH267501 A B C D E VH267502 A B C D E VH267503 A B C D E VH267504 A B C D E VH267505 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 136 VH460329 18. How often do you play digital games (for example, apps, video games, or computer games) outside of school that involve math? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH460337 19. How often do you use a computer, tablet, smartphone, or gaming console outside of school to play educational games that involve math? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH460341 20. How often do you use a computer, tablet, smartphone, or gaming console outside of school to play popular games that involve math? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day Please Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 137 VH613501 21. Thinking about math, do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row. a. Create a bar graph to represent the number of desks, chairs, and tables in your classroom b. Use a box plot to represent the height, in inches, of all of the students in your class c. Determine the probability of picking a blue marble without looking if you know the number of marbles of each color in a bag d. List all of the different possible outcomes when a coin is flipped three times I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH460348 A B C D E VH460355 A B C D E VH460381 A B C D E VH460382 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 138 VH613511 22. Thinking about math, do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row. a. Create an expression that represents the average number of miles you run in a week if you run 100 miles in w weeks b. Create an expression to show how old you will be in n years if you are 8 years old today c. Create an expression that shows the number of wheels on n wagons if each wagon has 4 wheels d. Explain how you know the number of books you can buy if you know the price of each book and you have $35 I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH460383 A B C D E VH460386 A B C D E VH460389 A B C D E VH460391 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 139 VH613523 23. Thinking about math, do you think that you would be able to do each of the following? Select one answer choice on each row. a. Decide if your classmate’s math work is correct b. Give an example to show that a math statement is false c. Explain to your classmate how you solved a math problem d. Use correct mathematical words and symbols to communicate ideas about math e. Use correct mathematical words and symbols when showing your work f. Use definitions of geometric shapes to support an argument I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH460398 A B C D E VH460399 A B C D E VH460910 A B C D E VH460900 A B C D E VH460902 A B C D E VH460912 Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. Please 140 VH460923 24. Have you ever participated in a math study group outside of school? A Yes B No VH460925 25. Over the past seven days, how many days have you participated in a math study group outside of school? Enter the number of days. VH460401 26. Have you ever participated in a math study group at school? A Yes B No VH460877 27. Over the past seven days, how many days have you participated in a math study group at school? Enter the number of days. Please Please note: note: (1) (1) Some Some grade grade 88 items items may may not not be be included included in in the the grade grade 12 12 pilot pilot if if they they do do not not perform perform well well in in the the 2017 2017 pilot. pilot. 141 Appendix F-1q: 2018 Pilot Grade 4 Science 142 2018 Pilot Science Student G4 VH639012 1. In your science class this year, how often have you learned about living things (for example, plants, animals, or bacteria)? A Never or hardly ever B Once in a while C Sometimes D Often E Very often VH639027 2. In your science class this year, how often have you learned about electricity (for example, circuits, batteries, or light bulbs)? A Never or hardly ever B Once in a while C Sometimes D Often E Very often VH639033 3. In your science class this year, how often have you learned about chemicals (for example, vinegar, baking soda, or hydrogen peroxide)? A Never or hardly ever B Once in a while C Sometimes D Often E Very often 143 VH639037 4. In your science class this year, how often have you learned about rocks or minerals (for example, diamond, iron, or lava rock)? A Never or hardly ever B Once in a while C Sometimes D Often E Very often VH639043 5. In your science class this year, how often have you done science activities using scientific tools (for example, microscopes, thermometers, beakers, or weighing scales)? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH639047 6. In your science class this year, how often have you read from a science textbook (print or digital)? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always 144 VH639055 7. In your science class this year, how often have you learned about science topics on the Internet? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH639057 8. In your science class this year, how often have you watched a short video clip, movie, or video about science topics? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH639060 9. In your science class this year, how often have you been asked to write about science topics (for example, a science journal, lab report, or essay)? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always 145 VH638997 10. In this school year, how often have you understood what the teacher talks about in science class? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH638999 11. In this school year, how often have you done well on your science tests? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH639003 12. In this school year, how often have you done well on your science assignments (for example, projects, homework, or worksheets)? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always 146 VH638866 13. Thinking about science, do you think that you would be able to do each of the following activities? Select one answer choice on each row. a. Describe different ways to heat or cool water b. Describe how the length of a vibrating string affects the sound it makes c. Design an experiment to show how sunlight affects the growth of a plant d. Use examples to show how one living thing has helped another to survive e. Describe what would happen to the number of frogs at a pond if all the insects were removed from the pond f. Decide which tool to use if you want to measure wind speed g. Describe why the weather in the summer is different than in the winter I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH638868 A B C D E VH638870 A B C D E VH638872 A B C D E VH638875 A B C D E VH638876 A B C D E VH638883 A B C D E VH638885 147 VH639079 14. How much does each of the following statements describe you? Select one answer choice on each row. a. I want other students to think I am good at science. b. I want to show others that science schoolwork is easy for me. c. I want to look smart in comparison to the other students in my science class. d. I want to get better science grades than most other students in my class. e. I want to learn as much as possible in my science class. f. I want to become better in science this year. g. I want to understand as much as I can in my science class. h. I want to master a lot of new science skills in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH639080 A B C D E VH639082 A B C D E VH639084 A B C D E VH732329 A B C D E VH639086 A B C D E VH639087 A B C D E VH639089 A B C D E VH732330 148 VH638951 15. In this school year, how often have you done each of the following activities outside of school? Select one answer choice on each row. a. Work on science-related projects (for example, making a volcano, growing plants from seeds, or building simple rockets) b. Write or blog about science topics c. Use scientific tools (for example, microscopes, thermometers, beakers, or weighing scales) d. Read about science topics in books or magazines (print or digital) e. Attend clubs or programs that include science or engineering activities (for example, chemistry club, robotics club, or coding programs) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH638970 A B C D E VH638983 A B C D E VH638985 A B C D E VH638987 A B C D E VH638991 149 VH639115 16. How much does each of the following statements describe you? Select one answer choice on each row. a. I enjoy science activities. b. I look forward to my science class. c. I am interested in the things I learn in science class. d. I think making an effort in science class is worthwhile. e. I think science will help me even when I am not in school. f. I think it is important to do well on science assignments. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH639117 A B C D E VH639120 A B C D E VH639122 A B C D E VH639125 A B C D E VH639127 A B C D E VH639128 150 VH639149 17. In this school year, how often have you done the following activities in your science class? Select one answer choice on each row. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH639156 A B C D E VH639162 A B C D E VH639164 A B C D E VH639166 A B C D E VH639169 a. Made a drawing that explains why or how something happens b. Used a science experiment to answer a question c. Put information you collected into a table or graph d. Used evidence to explain why something happens e. Found news articles about science on the Internet VH743438 18. How often do you talk about things you have learned in science class with someone in your family? A Never or hardly ever B Once in a while C Sometimes D Often E Very often 151 Appendix F-1r: 2018 Pilot Grade 8 Science 152 2018 Pilot Science Student G8 VH638997 1. In this school year, how often have you understood what the teacher talks about in science class? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH638999 2. In this school year, how often have you done well on your science tests? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH639003 3. In this school year, how often have you done well on your science assignments (for example, projects, homework, or worksheets)? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always 153 VH639071 4. In your science class this year, how often have you done hands-on activities or projects on any of the following topics? Select one answer choice on each row. a. Living things (for example, plants, animals, or bacteria) b. Electricity (for example, circuits, batteries, or light bulbs) c. Chemicals (for example, vinegar, baking soda, or hydrogen peroxide) d. Rocks or minerals (for example, diamond, iron, or lava rock) e. Technology and engineering (for example, robots, pulley systems, or ramps) Never or hardly ever Once in a while Sometimes Often Very often A B C D E VH639072 A B C D E VH639074 A B C D E VH639073 A B C D E VH639077 A B C D E VH639076 154 VH639311 5. In your science class this year, how often have you done each of the following activities? Select one answer choice on each row. a. Read from a science textbook (print or digital) b. Read a book or magazine (print or digital) about science topics c. Used the Internet to learn about science topics d. Watched a short video clip, movie, or video about science topics e. Used a magnifying glass or microscope for looking at small things f. Used a thermometer or weighing scale for making measurements Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH639313 A B C D E VH639315 A B C D E VH639314 A B C D E VH639312 A B C D E VH639075 A B C D E VH639078 155 VH638866 6. Thinking about science, do you think that you would be able to do each of the following activities? Select one answer choice on each row. a. Describe different ways to heat or cool water b. Describe how the length of a vibrating string affects the sound it makes c. Design an experiment to show how sunlight affects the growth of a plant d. Use examples to show how one living thing has helped another to survive e. Describe what would happen to the number of frogs at a pond if all the insects were removed from the pond f. Decide which tool to use if you want to measure wind speed g. Describe why the weather in the summer is different than in the winter I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH638868 A B C D E VH638870 A B C D E VH638872 A B C D E VH638875 A B C D E VH638876 A B C D E VH638883 A B C D E VH638885 156 VH639079 7. How much does each of the following statements describe you? Select one answer choice on each row. a. I want other students to think I am good at science. b. I want to show others that science schoolwork is easy for me. c. I want to look smart in comparison to the other students in my science class. d. I want to get better science grades than most other students in my class. e. I want to learn as much as possible in my science class. f. I want to become better in science this year. g. I want to understand as much as I can in my science class. h. I want to master a lot of new science skills in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH639080 A B C D E VH639082 A B C D E VH639084 A B C D E VH732329 A B C D E VH639086 A B C D E VH639087 A B C D E VH639089 A B C D E VH732330 157 VH638951 8. In this school year, how often have you done each of the following activities outside of school? Select one answer choice on each row. a. Work on science-related projects (for example, making a volcano, growing plants from seeds, or building simple rockets) b. Write or blog about science topics c. Use scientific tools (for example, microscopes, thermometers, beakers, or weighing scales) d. Read about science topics in books or magazines (print or digital) e. Attend clubs or programs that include science or engineering activities (for example, chemistry club, robotics club, or coding programs) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH638970 A B C D E VH638983 A B C D E VH638985 A B C D E VH638987 A B C D E VH638991 158 VH639115 9. How much does each of the following statements describe you? Select one answer choice on each row. a. I enjoy science activities. b. I look forward to my science class. c. I am interested in the things I learn in science class. d. I think making an effort in science class is worthwhile. e. I think science will help me even when I am not in school. f. I think it is important to do well on science assignments. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH639117 A B C D E VH639120 A B C D E VH639122 A B C D E VH639125 A B C D E VH639127 A B C D E VH639128 159 VH639733 10. In this school year, how often have you done the following activities in your science class? Select one answer choice on each row. a. Came up with research questions to explore how something works b. Made drawings that explain why or how something happens c. Came up with experiments that you could use to answer a research question d. Used tables or graphs to identify relationships between variables e. Used math equations to explain or support scientific conclusions f. Used evidence from experiments to explain why something happens g. Used information to disagree with someone about a scientific idea h. Combined information about science from multiple sources (for example, books, websites, or articles) for an assignment Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH639744 A B C D E VH639749 A B C D E VH639753 A B C D E VH639760 A B C D E VH639763 A B C D E VH639765 A B C D E VH639770 A B C D E VH639777 160 VH743438 11. How often do you talk about things you have learned in science class with someone in your family? A Never or hardly ever B Once in a while C Sometimes D Often E Very often 161 Appendix F-1s: 2018 Pilot Grade 12 Science 162 2018 Pilot Science Student G12 VH638997 1. In this school year, how often have you understood what the teacher talks about in science class? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH638999 2. In this school year, how often have you done well on your science tests? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always VH639003 3. In this school year, how often have you done well on your science assignments (for example, projects, homework, or worksheets)? A Never or hardly ever B Once in a while C Sometimes D Often E Always or almost always 163 VH639071 4. In your science class this year, how often have you done hands-on activities or projects on any of the following topics? Select one answer choice on each row. a. Living things (for example, plants, animals, or bacteria) b. Electricity (for example, circuits, batteries, or light bulbs) c. Chemicals (for example, vinegar, baking soda, or hydrogen peroxide) d. Rocks or minerals (for example, diamond, iron, or lava rock) e. Technology and engineering (for example, robots, pulley systems, or ramps) Never or hardly ever Once in a while Sometimes Often Very often A B C D E VH639072 A B C D E VH639074 A B C D E VH639073 A B C D E VH639077 A B C D E VH639076 164 VH639311 5. In your science class this year, how often have you done each of the following activities? Select one answer choice on each row. a. Read from a science textbook (print or digital) b. Read a book or magazine (print or digital) about science topics c. Used the Internet to learn about science topics d. Watched a short video clip, movie, or video about science topics e. Used a magnifying glass or microscope for looking at small things f. Used a thermometer or weighing scale for making measurements Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH639313 A B C D E VH639315 A B C D E VH639314 A B C D E VH639312 A B C D E VH639075 A B C D E VH639078 165 VH241146 6. Which courses have you taken from eighth grade to the present? If you have taken a course more than once, give the most recent year you took it. Select one answer choice on each row. INCLUDE courses taken in summer school, but DO NOT INCLUDE topics that were only taught as part of a longer course. I did not take this course. a. General science b. First-year biology c. Second-year biology d. Life science (other than biology) e. First-year chemistry f. Second-year chemistry g. First-year physics h. Second-year physics i. Physical science (other than chemistry or physics) j. Earth and space science k. Engineering and technology l. Other science course (Please specify): I am taking or I took this I took this I took this I took this have course in course in course in course in this Grade 8. Grade 9. Grade 10. Grade 11. taken course in Grade 12. A B C D E F VH241150 A B C D E F VH241151 A B C D E F VH241159 A B C D E F VH241148 A B C D E F VH241154 A B C D E F VH241155 A B C D E F VH241156 A B C D E F VH241157 A B C D E F VH241149 A B C D E F VH241147 A B C D E F VH241158 A B C D E F VH241153 VH240111 7. Are you currently enrolled in or have you taken any online science courses for high school or college credit? A Yes B No 166 VH240377 8. Are you currently enrolled in or have you taken an Advanced Placement® course in science? Select all that apply. A Yes, I am enrolled in or have taken Advanced Placement Biology. B Yes, I am enrolled in or have taken Advanced Placement Environmental Science. C Yes, I am enrolled in or have taken Advanced Placement Chemistry. D Yes, I am enrolled in or have taken Advanced Placement Physics C. E Yes, I am enrolled in or have taken Advanced Placement Physics 1. F Yes, I am enrolled in or have taken Advanced Placement Physics 2. G Yes, I am enrolled in or have taken Advanced Placement Computer Science A. H Yes, I am enrolled in or have taken Advanced Placement Computer Science Principles. I No, I have never taken an Advanced Placement science course. VH240112 9. Are you currently taking a science course? A Yes B No 167 VH651609 10. Thinking about science, do you think that you would be able to do each of the following activities? Select one answer choice on each row. a. Describe different ways to heat or cool water b. Describe how the length of a vibrating string affects the sound it makes c. Design an experiment to show how sunlight affects the growth of a plant d. Use examples to show how one living thing has helped another to survive e. Describe what would happen to the number of frogs at a pond if all the insects were removed from the pond f. Decide which tool to use if you want to measure wind speed g. Describe why the weather in the summer is different than in the winter h. Design an experiment to test how the growth of a plant is affected by light, water, and soil quality i. Create a diagram that shows how bees and plants need each other for survival j. Describe how the combination of parental genes can result in different traits in their offspring (for example, eye or hair color) I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH638868 A B C D E VH638870 A B C D E VH638872 A B C D E VH638875 A B C D E VH638876 A B C D E VH638883 A B C D E VH638885 A B C D E VH638877 A B C D E VH638878 A B C D E VH638879 168 VH639079 11. How much does each of the following statements describe you? Select one answer choice on each row. a. I want other students to think I am good at science. b. I want to show others that science schoolwork is easy for me. c. I want to look smart in comparison to the other students in my science class. d. I want to get better science grades than most other students in my class. e. I want to learn as much as possible in my science class. f. I want to become better in science this year. g. I want to understand as much as I can in my science class. h. I want to master a lot of new science skills in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH639080 A B C D E VH639082 A B C D E VH639084 A B C D E VH732329 A B C D E VH639086 A B C D E VH639087 A B C D E VH639089 A B C D E VH732330 169 VH638951 12. In this school year, how often have you done each of the following activities outside of school? Select one answer choice on each row. a. Work on science-related projects (for example, making a volcano, growing plants from seeds, or building simple rockets) b. Write or blog about science topics c. Use scientific tools (for example, microscopes, thermometers, beakers, or weighing scales) d. Read about science topics in books or magazines (print or digital) e. Attend clubs or programs that include science or engineering activities (for example, chemistry club, robotics club, or coding programs) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH638970 A B C D E VH638983 A B C D E VH638985 A B C D E VH638987 A B C D E VH638991 170 VH639115 13. How much does each of the following statements describe you? Select one answer choice on each row. a. I enjoy science activities. b. I look forward to my science class. c. I am interested in the things I learn in science class. d. I think making an effort in science class is worthwhile. e. I think science will help me even when I am not in school. f. I think it is important to do well on science assignments. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH639117 A B C D E VH639120 A B C D E VH639122 A B C D E VH639125 A B C D E VH639127 A B C D E VH639128 171 VH639733 14. In this school year, how often have you done the following activities in your science class? Select one answer choice on each row. a. Came up with research questions to explore how something works b. Made drawings that explain why or how something happens c. Came up with experiments that you could use to answer a research question d. Used tables or graphs to identify relationships between variables e. Used math equations to explain or support scientific conclusions f. Used evidence from experiments to explain why something happens g. Used information to disagree with someone about a scientific idea h. Combined information about science from multiple sources (for example, books, websites, or articles) for an assignment Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH639744 A B C D E VH639749 A B C D E VH639753 A B C D E VH639760 A B C D E VH639763 A B C D E VH639765 A B C D E VH639770 A B C D E VH639777 172 VH639871 15. How likely are you to pursue a career in science? A Not at all likely B Not likely C Somewhat likely D Quite likely E Extremely likely VH640721 16. In this school year, have you done any of the following activities to prepare for a career in science? Select one answer choice on each row. a. Attended a career fair b. Answered questions on a career interest survey (for example, the Vocational-Interest Inventory, the Career Interest Test, or the Strong Interest Inventory®) c. Taken a science course in addition to what you need to graduate d. Collected information about science-related careers on your own e. Collected information about science-related college programs on your own f. Spoken with a guidance counselor or teacher about science-related careers g. Spoken with a guidance counselor or teacher about science-related college programs h. Spoken with a family member or family friend who works in a scientific field about his or her job i. Shadowed a person who does science-related work at his or her job j. Worked as an intern or employee doing science-related work k. Other (Please specify): Yes No A B VH640739 A B VH640746 A B VH640748 A B VH640749 A B VH640750 A B VH640754 A B VH640757 A B VH640758 A B VH640771 A B VH640773 A B VH640776 173 VH743438 17. How often do you talk about things you have learned in science class with someone in your family? A Never or hardly ever B Once in a while C Sometimes D Often E Very often 174 Appendix F-1t: 2017 Operational Grade 4 Writing 175 VH240360 21. For school this year, how often do you write stories? A Never or hardly ever B A few times a year C Once or twice a month D At least once a week VH565091 22. For school this year, how often do you write reports? A Never or hardly ever B A few times a year C Once or twice a month D At least once a week 176 VH240359 23. For school this year, how often do you write letters? A Never or hardly ever B A few times a year C Once or twice a month D At least once a week VH312244 24. For school this year, how often do you typically write for each of the following purposes? Select one answer choice on each row. Never About once or twice a year About once or twice a month A B C D E VH312245 A B C D E VH312246 A B C D E VH312247 A B C D E VH312248 a. To explain something that you know or have read b. To convince or persuade someone c. To describe a real experience (for example, write about factual events or personal experiences) d. To describe an imagined experience (for example, tell a fictional story) About once Every day or or twice a almost week every day VH565092 25. For school this year, how often do you look for information on the Internet to include in your writing? A Never or hardly ever B A few times a year C Once or twice a month D At least once a week 177 VH565084 26. In a day, about how much time do you spend writing on paper for school assignments? A None B About 10 minutes C About 30 minutes D About 1 hour E More than 1 hour VH565085 27. In a day, about how much time do you spend writing on a computer for school assignments? A None B About 10 minutes C About 30 minutes D About 1 hour E More than 1 hour VH336201 28. Which best describes the way you type on a keyboard? A I don’t know how to type using a keyboard. B I can type with one or two fingers, but I have to search for where the letter keys are. C I can type with one or two fingers, and I know where most of the letter keys are. D I can type with all ten fingers when I look at the keyboard. E I can type with all ten fingers without looking at the keyboard. F I type using a way other than both hands. 178 VH589023 29. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Explain something in my writing b. Convince someone of something in my writing c. Tell an imaginary story in my writing d. Write a paper using correct grammar I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH311982 A B C D E VH616470 A B C D E VH311984 A B C D E VH315010 VH312034 30. Thinking about your English/language arts class this year, how much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want to be a better writer than my classmates. b. I want my teacher to think I am a good writer. c. I want to have my classmates believe I can write well. d. I want to become a better writer. e. I want to improve how I express my ideas. f. I want to better organize my ideas when writing. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH312048 A B C D E VH312050 A B C D E VH312043 A B C D E VH312042 A B C D E VH312038 A B C D E VH312051 179 VH312352 31. How much does each of the following statements describe a person like you? Select one answer choice on each row. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH312353 A B C D E VH312356 A B C D E VH314723 A B C D E VH314733 a. Writing is one of my favorite activities. b. Writing is easy for me. c. I enjoy expressing my thoughts in writing. d. I enjoy sharing my writing with others. VH312241 32. In a typical week, how many days do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? Fill in a number between 0 and 7. days VH616533 33. How often do you write to your friends or family using a computer or other digital device (for example, writing e-mails, blog posts, text messages, instant messages, or personal web pages)? A Never or hardly ever B Once or twice a month C Once or twice a week D Every day or almost every day 180 Appendix F-1u: 2018 Cognitive Interviews Grade 4 Writing 181 VH811325 1. In a typical week, how many days do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? Fill in a number between 0 and 7. days VH811369 2. In a typical week, about how many pages do you write for your English/ language arts homework? A None B Up to one page C One to three pages D Four to five pages E More than five pages VH811360 3. In a day, about how much time do you spend writing on paper for school assignments? A None B About 10 minutes C About 30 minutes D About 1 hour E More than 1 hour 182 VH811294 4. How often do you use each of the following tools for writing outside of school? Select one answer choice on each row. a. Paper and pen/pencil b. Desktop or laptop computer (including Chromebooks) c. Tablet (for example, Surface Pro, iPad, Kindle Fire) d. Smartphone (for example, iPhone, Samsung Galaxy, HTC One) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811295 A B C D E VH811299 A B C D E VH811300 A B C D E VH811297 VH811280 5. In your English/language arts class this year, how often do you use each of the following tools for writing? Select one answer choice on each row. a. Paper and pen/pencil b. Desktop or laptop computer (including Chromebooks) c. Tablet (for example, Surface Pro, iPad, Kindle Fire) d. Smartphone (for example, iPhone, Samsung Galaxy, HTC One) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811281 A B C D E VH811285 A B C D E VH811286 A B C D E VH811283 183 VH811341 6. For school this year, how often do you do each of the following activities? Select one answer choice on each row. a. b. c. d. Write stories Write reports Write letters Look for information on the Internet to include in your writing Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811342 A B C D E VH811343 A B C D E VH811345 A B C D E VH811352 184 Alternate version (for VH811325) In a typical week, how many hours do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? __________________ Alternate version (for VH811369) About how many hours a day do you spend on your English/language arts homework? A. Less than 30 minutes a day B. 30 minutes up to 1 hour a day C. 1 up to 2 hours a day D. 2 up to 3 hours a day E. 3 up to 4 hours a day F. More than 4 hours a day 185 Appendix F-1v: 2017 Operational Grade 8 Writing 186 VH312796 25. In your English/language arts class this year, how often do you practice each of the following? Select one answer choice on each row. a. Using new vocabulary in writing b. Typing on a keyboard c. Organizing ideas in writing (for example, outlining the order of my ideas before writing, re-organizing my ideas when I revise) d. Writing for different audiences or readers e. Writing different forms of text (for example, an essay, letter, or story) f. Citing sources correctly in writing g. Improving writing by revising first drafts h. Using details to develop ideas in writing Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH312801 A B C D E VH312802 A B C D E VH312806 A B C D E VH312807 A B C D E VH313344 A B C D E VH313380 A B C D E VH313384 A B C D E VH313385 187 VH311844 26. In your English/language arts class this year, how often do you get the following writing assignments? Select one answer choice on each row. a. Assignments that you have to complete within one session b. Assignments that you can work on over extended periods of time (for example, several class periods) c. Assignments that you have to complete together with other students d. Assignments that you have to complete on a computer or other digital device e. Assignments of two or more pages (for example, a paper or report) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH311876 A B C D E VH311881 A B C D E VH312058 A B C D E VH588405 A B C D E VH312074 188 VH312124 27. When you work on a longer writing assignment (for example, an assignment of two or more pages), how often do you typically do each of the following? Select one answer choice on each row. a. Organize my ideas before I write (for example, by creating an outline) b. Write a first draft c. Reread and revise my draft writing d. Use a spell-checker in word processing software e. Use a thesaurus or dictionary in word processing software Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH312137 A B C D E VH312140 A B C D E VH312141 A B C D E VH616556 A B C D E VH312795 189 VH428212 28. For school this year, how often do you typically write for each of the following purposes? Select one answer choice on each row. Never About once or twice a year About once or twice a month A B C D E VH312245 A B C D E VH312246 A B C D E VH312247 A B C D E VH312248 A B C D E VH312250 a. To explain something that you know or have read b. To convince or persuade someone c. To describe a real experience (for example, write about factual events or personal experiences) d. To describe an imagined experience (for example, tell a fictional story) e. To analyze (for example, collect and describe evidence for an issue or argument) About once Every day or or twice a almost week every day VH312229 29. During this school year, how often do you get writing assignments of a paragraph or more during each of the following classes? Select one answer choice on each row. a. English/language arts class b. Social studies class such as history, civics, government, or geography c. Science class d. Mathematics class Never About once or twice a year About once or twice a month About once or twice a week Every day or almost every day A B C D E F VH312230 A B C D E F VH312231 A B C D E F VH312232 A B C D E F VH312233 I don’t take this class. 190 VH312323 30. For school this year, how often do you use each of the following when you write a paper or report? Select one answer choice on each row. a. Use the Internet to look for information to include in the paper or report b. Use a computer or other digital device to make changes to the paper or report (for example, spell-check or cut and paste) c. Use a computer or other digital device to complete your writing Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH312325 A B C D E VH312327 A B C D E VH312328 VH314230 31. In your English/language arts class this year, how often do you use each of the following for writing? Select one answer choice on each row. a. Paper and pen/pencil b. Desktop or laptop computer (including Chromebooks) c. Tablet (for example, Surface Pro, iPad, Kindle Fire) d. Smartphone (for example, iPhone, Samsung Galaxy, HTC One) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314232 A B C D E VH588417 A B C D E VH314235 A B C D E VH592243 191 VH336201 32. Which best describes the way you type on a keyboard? A I don’t know how to type using a keyboard. B I can type with one or two fingers, but I have to search for where the letter keys are. C I can type with one or two fingers, and I know where most of the letter keys are. D I can type with all ten fingers when I look at the keyboard. E I can type with all ten fingers without looking at the keyboard. F I type using a way other than both hands. VH592330 33. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Explain something in my writing b. Convince someone of something in my writing c. Tell an imaginary story in my writing d. Present a clear position in my writing e. Support a position with reasons and examples in my writing I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH311982 A B C D E VH616470 A B C D E VH311984 A B C D E VH311985 A B C D E VH311986 192 VH592342 34. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Take different points of view into account in my persuasive writing b. Write a paper using correct grammar c. Write a paper without spelling mistakes d. Choose words in my writing that will effectively communicate my ideas e. Quickly come up with ideas about what to write for a timed writing task I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH311987 A B C D E VH315010 A B C D E VH315014 A B C D E VH315032 A B C D E VH311954 193 VH312034 35. Thinking about your English/language arts class this year, how much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want to be a better writer than my classmates. b. I want my teacher to think I am a good writer. c. I want to have my classmates believe I can write well. d. I want to become a better writer. e. I want to improve how I express my ideas. f. I want to better organize my ideas when writing. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH312048 A B C D E VH312050 A B C D E VH312043 A B C D E VH312042 A B C D E VH312038 A B C D E VH312051 VH312352 36. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. Writing is one of my favorite activities. b. Writing is easy for me. c. I enjoy expressing my thoughts in writing. d. I enjoy sharing my writing with others. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH312353 A B C D E VH312356 A B C D E VH314723 A B C D E VH314733 194 VH314380 37. How often do you use each of the following for writing outside of school? Select one answer choice on each row. a. Paper and pen/pencil b. Desktop or laptop computer (including Chromebooks) c. Tablet (for example, Surface Pro, iPad, Kindle Fire) d. Smartphone (for example, iPhone, Samsung Galaxy, HTC One) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314383 A B C D E VH588431 A B C D E VH314386 A B C D E VH592889 VH312241 38. In a typical week, how many days do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? Fill in a number between 0 and 7. days 195 VH314690 39. During this school year, how often do you do each of the following outside of school? Select one answer choice on each row. a. Practice my keyboarding skills b. Write journal entries or blog posts c. Get tutoring to improve my writing d. Help others with their writing Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314701 A B C D E VH616527 A B C D E VH314703 A B C D E VH314708 196 Appendix F-1w: 2018 Cognitive Interviews Grade 8 Writing 197 VH811325 1. In a typical week, how many days do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? Fill in a number between 0 and 7. days VH811369 2. In a typical week, about how many pages do you write for your English/ language arts homework? A None B Up to one page C One to three pages D Four to five pages E More than five pages VH811397 3. For school this year, how often do you use computers or other digital devices to do the following activities when you write a paper or report? Select one answer choice on each row. a. Use the Internet to look for information to include in the paper or report b. Revise or edit a document (for example, make changes to a paper or report) c. Complete your writing d. Use an online tool that allows others to edit your writing (for example, Google Docs or Google Classroom) Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH811398 A B C D E VH811400 A B C D E VH811399 A B C D E VH811413 198 Alternate version (for VH811325) In a typical week, how many hours do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? __________________ Alternate version (for VH811369) About how many hours a day do you spend on your English/language arts homework? A. Less than 30 minutes a day B. 30 minutes up to 1 hour a day C. 1 up to 2 hours a day D. 2 up to 3 hours a day E. 3 up to 4 hours a day F. More than 4 hours a day 199 Appendix F-1x: 2011 Operational Grade 12 Writing 200 SECTION 4 4 Section This section has 16 questions. Select only one circle for each question except where instructed otherwise. VE087975 1. In a typical school day, about how much time do you spend on writing assignments of a paragraph or more during each of the following classes? The writing could be on paper or on a computer. Select one circle on each line. I don’t take this class. 0 minutes Up to 15 minutes Between 15 and 30 minutes Between 30 and 60 minutes More than 60 minutes a. English/language arts class A B C D E F VE087986 b. Social studies class such as history, civics, government, or geography A B C D E F VE087989 c. Science class A B C D E F VE087992 d. Mathematics class A B C D E F VE087994 VE036761 2. In a typical day, about how much time do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? The writing could be on paper or on a computer. A 0 minutes B Up to 15 minutes C Between 15 and 30 minutes D Between 30 and 60 minutes E More than 60 minutes H3WB1-CBA Page 1 GO ON TO THE NEXT PAGE 201 Section 4 VE088001 3. How often do you write, in and out of school, for each of the following activities? Include only the writing that you do on paper. Select one circle on each line. Never or hardly ever Once or twice a month Once or twice a week Every day or almost every day a. Writing for school assignments (for example, reports, essays, or letters) A B C D VE088004 b. Writing that is not part of your schoolwork A B C D VE088005 VE126298 4. For school this year, how often do you write for each of the following purposes? The writing could be on paper or on a computer. Select one circle on each line. Never or hardly ever A few times a year Once or twice a month At least once a week a. To explain something that you know or have read A B C D VE126301 b. To convince or persuade someone A B C D VE126302 c. To convey a real or imagined experience A B C D VE126304 H3WB1-CBA Page 2 GO ON TO THE NEXT PAGE 202 Section 4 VE088007 5. For school this year, how often do you write for each of the following audiences? The writing could be on paper or on a computer. Select one circle on each line. Never or hardly ever A few times a year Once or twice a month At least once a week a. Family members A B C D VE088009 b. School officials A B C D VE088012 c. Other students A B C D VE088013 d. Community organizations, government officials, or businesses A B C D VE450490 VE088022 6. For school this year, how often do you write each of the following? The writing could be on paper or on a computer. Select one circle on each line. Never or hardly ever A few times a year Once or twice a month At least once a week a. Informational essays A B C D VE107515 b. Letters A B C D VE088029 c. Speeches A B C D VE088030 d. Personal essays A B C D VE088031 e. Stories A B C D VE088032 f. Poems A B C D VE088033 g. Journal entries A B C D VE088035 h. Book reviews A B C D VE450485 i. Job applications or résumés A B C D VE088036 j. Explanations of how you solved a mathematics or science problem A B C D VE088037 H3WB1-CBA Page 3 GO ON TO THE NEXT PAGE 203 Section 4 VE126329 7. Did you use the paper and pencil you were given to make notes, plan, or organize your writing for this test? Select one circle on each line. Yes No a. For the first writing task on this test A B VE126345 b. For the second writing task on this test A B VE126346 VE126358 8. Did you use the computer to make notes, plan, or organize your writing for this test? Select one circle on each line. Yes No a. For the first writing task on this test A B VE126360 b. For the second writing task on this test A B VE126361 VE036314 9. For school this year, how often do you use each of the following when you write a paper or report? Select one circle on each line. Never or hardly ever Sometimes Very often Always or almost always a. Use the Internet to look for information to include in the paper or report A B C D VE036318 b. Use a computer from the beginning to write the paper or report (for example, use a computer to write the first draft) A B C D VE036315 c. Use a computer to make changes to the paper or report (for example, spell-check or cut and paste) A B C D VE036316 d. Use a computer to complete your writing A B C D VE088274 H3WB1-CBA Page 4 GO ON TO THE NEXT PAGE 204 Section 4 VE088349 10. How often do you use a computer, in and out of school, for each of the following activities? Select one circle on each line. Never or hardly ever Once or twice a month Once or twice a week Every day or almost every day a. Writing for school assignments (for example, reports, essays, or letters) A B C D VE107503 b. Writing that is not part of your schoolwork A B C D VE107504 c. Writing e-mails A B C D VE107505 d. Writing using the Internet (for example, for blogs or personal web pages) A B C D VE107507 VE036713 11. In a typical week, about how many pages do you write for English/language arts homework? A None B Up to one page C One to three pages D Four to five pages E More than five pages H3WB1-CBA Page 5 GO ON TO THE NEXT PAGE 205 Section 4 VE035611 12. Please indicate how much you disagree or agree with the following statements about writing. Select one circle on each line. Strongly disagree Disagree Agree Strongly agree a. Writing is one of my favorite activities. A B C D VE035613 b. Writing allows me to express my ideas. A B C D VE035628 VE110951 13. If you had a choice, which of the following would you most prefer to write? A Stories B Letters or e-mails C Plays D Poems E Song lyrics F Comic books VE401773 14. How hard was this test compared to most other tests you have taken this year in school? A Easier than other tests B About as hard as other tests C Harder than other tests D Much harder than other tests H3WB1-CBA Page 6 GO ON TO THE NEXT PAGE 206 Section 4 VE401776 15. How hard did you try on this test compared to how hard you tried on most other tests you have taken this year in school? A Not as hard as on other tests B About as hard as on other tests C Harder than on other tests D Much harder than on other tests VE401779 16. How important was it to you to do well on this test? A Not very important B Somewhat important C Important D Very important H3WB1-CBA Page 7 STOP 207 Appendix F-1y: 2016 Pilot Grade 12 Writing 208 2016 Pilot Grade 12 Writing Student Items VH312124 1. When you work on a longer writing assignment (for example, an assignment of two or more pages), how often do you typically do each of the following? Select one answer choice on each row. a. Organize my ideas before I write (for example, by creating an outline) b. Write a first draft c. Reread and revise my draft writing d. Use word processing software to revise my own writing (for example, to use the backspace key or cut, copy, and paste text using the computer keyboard) e. Use a spell-check in word processing software f. Use a thesaurus or dictionary in word processing software Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH312137 A B C D E VH312140 A B C D E VH312141 A B C D E VH312791 A B C D E VH312792 A B C D E VH312795 209 2016 Pilot Grade 12 Writing Student Items VH311844 2. In your English/language arts class this year, how often do you get the following writing assignments? Select one answer choice on each row. a. Assignments that you have to complete under a strict time limit b. Assignments that you have to complete within one session c. Assignments that you can work on over extended periods of time (for example, several class periods) d. Assignments that you have to complete together with other students e. Assignments that you have to complete on a desktop or laptop computer f. Assignments of two or more pages (for example, a paper or report) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH311859 A B C D E VH311876 A B C D E VH311881 A B C D E VH312058 A B C D E VH312062 A B C D E VH312074 210 2016 Pilot Grade 12 Writing Student Items VH312796 3. In your English/language arts class this year, how often do you practice each of the following? Select one answer choice on each row. a. Using correct grammar in writing b. Using new vocabulary in writing c. Typing on a keyboard d. Using word processing software to edit and revise text e. Organizing ideas in writing (for example, outlining the order of my ideas before writing, re-organizing my ideas when I revise) f. Writing for different audiences or readers g. Writing for different purposes (for example, writing to persuade or writing to explain) h. Writing different forms of text (for example, an essay, letter, or story) i. Citing sources correctly in writing j. Improving writing by revising first drafts k. Using details to develop ideas in writing Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH312797 A B C D E VH312801 A B C D E VH312802 A B C D E VH312803 A B C D E VH312806 A B C D E VH312807 A B C D E VH312808 A B C D E VH313344 A B C D E VH313380 A B C D E VH313384 A B C D E VH313385 211 2016 Pilot Grade 12 Writing Student Items VH314230 4. In your English/language arts class this year, how often do you use each of the following for writing? Select one answer choice on each row. a. Paper and pen/pencil b. Desktop or laptop computer c. Tablet (for example, Surface Pro, iPad, Kindle Fire) d. Other digital device (Please specify): ____________________ Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314232 A B C D E VH314234 A B C D E VH314235 A B C D E VH314238 VH314380 5. How often do you use each of the following for writing outside of school? Select one answer choice on each row. a. Paper and pen/pencil b. Desktop or laptop computer c. Tablet (for example, Surface Pro, iPad, Kindle Fire) d. Other digital device (Please specify): ____________________ Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314383 A B C D E VH314385 A B C D E VH314386 A B C D E VH314387 212 2016 Pilot Grade 12 Writing Student Items VH314690 6. During this school year, how often do you do each of the following outside of school? Select one answer choice on each row. a. Participate in online discussions on a website (for example, in forums or social networks) b. Write for a blog, website, or online newspaper c. Practice my keyboarding skills d. Write journal entries e. Get tutoring to improve my writing f. Help others with their writing g. Engage in other writing activities outside of school (Please specify): ____________________ Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314694 A B C D E VH314695 A B C D E VH314701 A B C D E VH314702 A B C D E VH314703 A B C D E VH314708 A B C D E VH314715 213 2016 Pilot Grade 12 Writing Student Items VH312241 7. In a typical week, how many days do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? Fill in a number between 0 and 7. days VH336429 8. In a typical school week, on about how many days do you get writing assignments of a paragraph or more during each of the following classes? Fill in a number between 0 and 5 on each row. English/language arts class days days Social studies class such as history, civics, government, or geography Science class Mathematics class days days VH312229 9. During this school year, how often do you get writing assignments of a paragraph or more during each of the following classes? Select one answer choice on each row. a. English/language arts class b. Social studies class such as history, civics, government, or geography c. Science class d. Mathematics class Never About once or twice a year About once or twice a month About once or twice a week Every day or almost every day A B C D E F VH312230 A B C D E F VH312231 A B C D E F VH312232 A B C D E F VH312233 I don’t take this class. 214 2016 Pilot Grade 12 Writing Student Items VH312244 10. For school this year, how often do you typically write for each of the following purposes? Select one answer choice on each row. a. To explain something that you know or have read b. To convince or persuade someone c. To describe a real experience (for example, write about factual events or personal experiences) d. To describe an imagined experience (for example, tell a fictional story) e. To summarize (for example, write a summary of a longer text or story) f. To analyze (for example, collect and describe evidence for an issue or argument) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH312245 A B C D E VH312246 A B C D E VH312247 A B C D E VH312248 A B C D E VH312249 A B C D E VH312250 215 2016 Pilot Grade 12 Writing Student Items VH242613 11. For school this year, how often do you write for each of the following purposes? The writing could be on paper or on a computer. Select one answer choice on each row. Never or hardly ever A few times a year A B C D VH242614 A B C D VH242615 A B C D VH242616 a. To explain something that you know or have read b. To convince or persuade someone c. To convey a real or imagined experience Once or twice At least once a a month week VH312323 12. For school this year, how often do you use each of the following when you write a paper or report? Select one answer choice on each row. a. Use the Internet to look for information to include in the paper or report b. Use a computer or other digital device from the beginning to write the paper or report (for example, use a computer to write the first draft and final draft) c. Use a computer or other digital device to make changes to the paper or report (for example, spell-check or cut and paste) d. Use a computer or other digital device to complete your writing Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH312325 A B C D E VH312326 A B C D E VH312327 A B C D E VH312328 216 2016 Pilot Grade 12 Writing Student Items VH242650 13. For school this year, how often do you use each of the following when you write a paper or report? Select one answer choice on each row. a. Use the Internet to look for information to include in the paper or report b. Use a computer from the beginning to write the paper or report (for example, use a computer to write the first draft) c. Use a computer to make changes to the paper or report (for example, spell-check or cut and paste) d. Use a computer to complete your writing Never or hardly ever Sometimes Very often Always or almost always A B C D VH242653 A B C D VH242651 A B C D VH242654 A B C D VH242652 VH312339 14. In a typical week, how many pages are you assigned to write for homework in each of the following subjects? Select one answer choice on each row. a. English/language arts b. Social studies c. Science d. Mathematics I don’t take this class. None Up to one page One to three pages A B C D E F VH312340 A B C D E F VH312341 A B C D E F VH312342 A B C D E F VH312343 Four to More than five pages five pages 217 2016 Pilot Grade 12 Writing Student Items VH314998 15. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Write a paper using correct grammar b. Write a paper without spelling mistakes c. Write clear and complete sentences d. Choose words in my writing that will effectively communicate my ideas e. Judge the reliability of an online source for use in my writing (for example, whether a source from the Internet is biased) f. Cite others for their ideas in my writing (for example, citing sources, providing the references I used in my reports) I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH315010 A B C D E VH315014 A B C D E VH315016 A B C D E VH315032 A B C D E VH312010 A B C D E VH312011 218 2016 Pilot Grade 12 Writing Student Items VH311950 16. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Create an outline prior to writing b. Write a well-organized essay with an introduction, body, and conclusion c. Write a paragraph with a clear topic sentence d. Quickly come up with ideas about what to write for a timed writing task e. Start an essay with a clear introduction f. End an essay with a strong conclusion g. Complete a first draft of an essay within a class period I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH311951 A B C D E VH311952 A B C D E VH311953 A B C D E VH311954 A B C D E VH311956 A B C D E VH311957 A B C D E VH311958 219 2016 Pilot Grade 12 Writing Student Items VH311980 17. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Explain something in my writing b. Convince someone about something in my writing c. Tell an imaginary story in my writing d. Present a clear position in my writing e. Support a position with reasons and examples in my writing f. Take different points of view into account in my persuasive writing I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH311982 A B C D E VH311983 A B C D E VH311984 A B C D E VH311985 A B C D E VH311986 A B C D E VH311987 220 2016 Pilot Grade 12 Writing Student Items VH312034 18. Thinking about your English/language arts class this year, how much does each of the following statements describe a person like you? Select one answer choice on each row. a. I want to improve how I express my ideas. b. I want to keep people from thinking I’m a poor writer. c. I want to get a good grade in the class. d. I want to hide that I have a hard time writing. e. I want to become a better writer. f. I want to have my classmates believe I can write well. g. I want to pass my English/language arts class. h. I want to avoid making mistakes in front of my classmates. i. I want to be a better writer than my classmates. j. I want to hide how nervous I am about writing. k. I want my teacher to think I am a good writer. l. I want to better organize my ideas when writing. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH312038 A B C D E VH312039 A B C D E VH312040 A B C D E VH312041 A B C D E VH312042 A B C D E VH312043 A B C D E VH312044 A B C D E VH312045 A B C D E VH312048 A B C D E VH312049 A B C D E VH312050 A B C D E VH312051 221 2016 Pilot Grade 12 Writing Student Items VH312352 19. How much does each of the following statements describe a person like you? Select one answer choice on each row. a. Writing is one of my favorite activities. b. Writing is easy for me. c. I don’t like to write. d. I enjoy expressing my thoughts in writing. e. I try to avoid writing as much as possible. f. I enjoy sharing my writing with others. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH312353 A B C D E VH312356 A B C D E VH312358 A B C D E VH314723 A B C D E VH314729 A B C D E VH314733 VH271279 20. Which best describes the way you type on a keyboard? A I don’t know how to type using a keyboard. B I have to search for where the letter keys are. C I know where most of the letter keys are. D I can type without looking at the keyboard. E I type using a way other than both hands. VH336201 21. Which best describes the way you type on a keyboard? A I don’t know how to type using a keyboard. B I can type with one or two fingers, but I have to search for where the letter keys are. C I can type with one or two fingers, and I know where most of the letter keys are. D I can type with all ten fingers when I look at the keyboard. E I can type with all ten fingers without looking at the keyboard. F I type using a way other than both hands. 222 2016 Pilot Grade 12 Writing Student Items VH242642 22. Did you use the paper and pencil you were given to make notes, plan, or organize your writing for this test? Select one answer choice on each row. a. For the first writing task on this test b. For the second writing task on this test Yes No A B VH242643 A B VH242645 VH242646 23. Did you use the computer to make notes, plan, or organize your writing for this test? Select one answer choice on each row. a. For the first writing task on this test b. For the second writing task on this test Yes No A B VH242647 A B VH242649 VH240001 24. How hard was this test compared to most other tests you have taken this year in school? A Easier than other tests B About as hard as other tests C Harder than other tests D Much harder than other tests VH240002 25. How hard did you try on this test compared to how hard you tried on most other tests you have taken this year in school? A Not as hard as on other tests B About as hard as on other tests C Harder than on other tests D Much harder than on other tests 223 2016 Pilot Grade 12 Writing Student Items VH240003 26. How important was it to you to do well on this test? A Not very important B Somewhat important C Important D Very important VH260313 27. How easy or difficult was this test? A Extremely difficult B Quite difficult C Somewhat difficult D Somewhat easy E Quite easy F Extremely easy VH337141 28. How similar were the questions on this test to the questions on your writing quizzes and tests at school? A Not similar at all B Not similar C Somewhat similar D Quite similar E Extremely similar 224 2016 Pilot Grade 12 Writing Student Items VH260331 29. How much do you agree with each of the following statements? Select one answer choice on each row. Strongly disagree Disagree A B C A B A A a. I applied a lot of effort to succeed on this test. b. Taking this test was stressful. c. Taking this test was challenging. d. I felt time pressure when taking this test. Somewhat Somewhat disagree agree Agree Strongly agree D E F VH260334 C D E F VH260335 B C D E F VH260336 B C D E F VH260338 VH333658 30. How much effort did you apply to succeed on this test? A No effort at all B Very little effort C Some effort D Quite a bit of effort E A lot of effort VH333659 31. How stressful was taking this test? A Not stressful at all B A little stressful C Somewhat stressful D Quite stressful E Extremely stressful 225 2016 Pilot Grade 12 Writing Student Items VH333660 32. How challenging was taking this test? A Not challenging at all B A little challenging C Somewhat challenging D Quite challenging E Extremely challenging VH333661 33. How much time pressure did you feel when taking this test? A No time pressure at all B A little bit of time pressure C Some time pressure D Quite a bit of time pressure E A lot of time pressure 226 Appendix F-1z: 2018 Cognitive Interviews Grade 12 Writing 227 VH811325 1. In a typical week, how many days do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? Fill in a number between 0 and 7. days VH811369 2. In a typical week, about how many pages do you write for your English/ language arts homework? A None B Up to one page C One to three pages D Four to five pages E More than five pages VH811577 3. Did you make notes, plan, or organize your writing for this test? Select one circle on each row. a. For the first writing task on this test b. For the second writing task on this test Yes No A B VH811578 A B VH811579 228 VH811803 4. How often have you written or practiced writing the following texts? Select one answer choice on each row. a. A job application (print or online) b. A cover letter explaining how your educational and/or work experiences have prepared you for a job c. A resume listing your academic achievements and/or work experience d. A profile on a job search website (for example, Indeed) e. A profile on a professional networking website (for example, LinkedIn) Never Once Two or three times Four to five times More than five times A B C D E VH811804 A B C D E VH811805 A B C D E VH811806 A B C D E VH811807 A B C D E VH811808 229 VH811420 5. In your English/language arts class this year, how often do you practice each of the following activities? Select one answer choice on each row. a. Using new vocabulary in writing b. Organizing ideas in writing (for example, planning the order of my ideas before writing, re-organizing my ideas when I revise) c. Writing for different audiences or readers d. Writing different forms of text (for example, an essay, letter, or story) e. Improving writing by revising drafts f. Using details to develop ideas in writing Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811433 A B C D E VH811434 A B C D E VH811435 A B C D E VH811437 A B C D E VH811439 A B C D E VH811440 VH811397 6. For school this year, how often do you use computers or other digital devices to do the following activities when you write a paper or report? Select one answer choice on each row. a. Use the Internet to look for information to include in the paper or report b. Revise or edit a document (for example, make changes to a paper or report) c. Complete your writing Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH811398 A B C D E VH811400 A B C D E VH811399 230 d. Use an online tool that allows others to edit your writing (for example, Google Docs or Google Classroom) Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH811413 VH811458 7. For school this year, how often do you typically write for each of the following purposes? Select one answer choice on each row. a. To analyze (for example, collect and describe evidence for an issue or argument) b. To communicate with friends and family Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811465 A B C D E VH811466 231 VH811490 8. For school this year, how often do you write each of the following texts? The writing could be on paper, a computer, or other digital device (for example, tablet or smart phone). Select one answer choice on each row. a. Informational essays b. Journal entries or blogs c. Explanations of how you solved a mathematics or science problem d. Critical reviews e. Editorials Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH811484 A B C D E VH811485 A B C D E VH811486 A B C D E VH811487 A B C D E VH811488 VH811810 9. For school this year, how often do you do each of the following pre-writing tasks when writing a paper? Select one answer choice on each row. a. b. c. d. Brainstorming Planning Outlining Freewriting Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH811811 A B C D E VH811812 A B C D E VH811813 A B C D E VH811814 232 VH811766 10. Do you think you can do each of the following activities? Select one answer choice on each row. a. Organize my writing so the order of ideas (for example, sentences, paragraphs) is logical b. Use different sentence structure in my writing to keep the reader’s interest c. Write in a tone that is appropriate for my audience d. Write a paper using correct spelling, grammar, punctuation, and capitalization I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH811767 A B C D E VH811768 A B C D E VH811769 A B C D E VH811770 233 Alternate version (for VH811325) In a typical week, how many hours do you spend writing on your own and not for school—for example, writing stories or keeping a journal at home? __________________ Alternate version (for VH811369) About how many hours a day do you spend on your English/language arts homework? A. Less than 30 minutes a day B. 30 minutes up to 1 hour a day C. 1 up to 2 hours a day D. 2 up to 3 hours a day E. 3 up to 4 hours a day F. More than 4 hours a day 234 Appendix F-1aa: 2018 Operational Grade 8 Civics 235 VH456753 25. In which of the following grades have you learned about civics and/or United States government? Select one answer choice on each row. Yes, I took a No, I did not Yes, I took a class or course take a class or class or course that included course that mainly some civics taught civics focused on civics and/or and/or United and/or United States States United States government government government. topics. topics. a. 6th grade b. 7th grade c. 8th grade I don’t remember. A B C D VH457394 A B C D VH457396 A B C D VH457397 VH457356 26. In your social studies class this year, how much have you studied the following topics? Select one answer choice on each row. a. The United States Constitution b. The three branches of the United States government (executive, judicial, and legislative branches) c. How laws are made d. Political parties, elections, and voting e. Other countries’ governments (for example, their structure, how they are run, or interactions with the United States) f. International organizations (for example, the United Nations, World Bank, or World Health Organization) g. Current political and social issues Not at all Very little Some Quite a bit A lot A B C D E VH457358 A B C D E VH457359 A B C D E VH457363 A B C D E VH457366 A B C D E VH457368 A B C D E VH457369 A B C D E VH457372 236 VH716851 27. During this school year, how often do you do each of the following activities? Select one answer choice on each row. a. Read material from a civics and/or United States government textbook (print or digital) b. Read extra material about civics and/or United States government not in the regular textbook (for example, newspapers, magazines, or online sources) c. Conduct research about civics and/or United States government topics (for example, online, in a library, or through interviews) d. Listen to or watch movies, videos, or online content about civics and/or United States government topics Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH716852 A B C D E VH716853 A B C D E VH716855 A B C D E VH716854 237 VH716857 28. During this school year so far, how often have you done each of the following activities? Select one answer choice on each row. a. Gone on class field trips to learn about civics and/or United States government topics b. Given class presentations on civics and/or United States government topics c. Written about your opinion on a community problem or social issue (for example, in a letter, e-mail, or blog post) d. Taken part in political debates or panel discussions e. Taken part in role-playing, mock trials, or dramas about civics and/or United States government topics Never Once Two or three times Four or five times More than five times A B C D E VH716858 A B C D E VH716859 A B C D E VH716862 A B C D E VH716861 A B C D E VH716860 238 VH716863 29. During this school year, how often do you do each of the following activities when you study civics and/or United States government? Select one answer choice on each row. a. Study the rights and responsibilities of United States citizens b. Examine how the United States influences and is influenced by events in other countries c. Compare the roles and responsibilities of local, state, and national governments in the United States d. Study why it is important to pay attention to the political process and government e. Study why it is important for individuals to participate in the political process and government Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH716865 A B C D E VH716866 A B C D E VH716871 A B C D E VH716868 A B C D E VH727879 239 VH457531 30. In your social studies class this year, how often do you get the following assignments? Select one answer choice on each row. a. Assignments that you have to complete together with other students b. Short written responses (for example, a paragraph or less) c. Assignments that use different forms of media (for example, photos, videos, or music) d. Long written responses (for example, several paragraphs) e. Responses to questions based on information from several sources (for example, letters, cartoons, or maps) Never or hardly ever Less than half of the lessons About half of the lessons More than half of the lessons All or almost all of the lessons A B C D E VH457532 A B C D E VH457533 A B C D E VH457534 A B C D E VH457540 A B C D E VH457542 240 VH457547 31. When you study social studies, how often do you use computers or other digital devices to do the following? For this question, include both schoolwork and homework assignments. Select one answer choice on each row. a. Organize information about civics and/or United States government topics by creating tables, charts, or graphs b. Create reports or projects about civics and/or United States government using different forms of media (for example, a slide presentation that combines text and video clips) c. Participate in online discussions about civics and/or United States government on a website (for example, in forums or social media) d. Use the Internet to look for evidence or sources (for example, text documents, photographic images, or films) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH457548 A B C D E VH457549 A B C D E VH457550 A B C D E VH457551 241 VH716887 32. How much does each of the following statements describe you? Select one answer choice on each row. a. I think I can make a difference in my community. b. I think being actively involved in community issues is my responsibility. c. I think being concerned about state and local issues is an important responsibility for everybody. d. I have good ideas for programs and projects that would help solve problems in my community. e. I expect to be involved in improving my community three years from now. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH716888 A B C D E VH716893 A B C D E VH716891 A B C D E VH716892 A B C D E VH716890 242 VH457877 33. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Explain the roles and functions of the three branches of the United States government b. Explain the rights and responsibilities of United States citizens c. Explain how the United States influences and is influenced by events in other countries d. Compare the roles and responsibilities of local, state, and national governments in the United States e. Explain why it is important to pay attention to the political process and government f. Explain why it is important for individuals to participate in the political process and government I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH457878 A B C D E VH457879 A B C D E VH457880 A B C D E VH457882 A B C D E VH457884 A B C D E VH457885 243 VH716894 34. How much does each of the following statements describe you? Select one answer choice on each row. a. I want other students to think I am a good civics and/or United States government student. b. I want to show others that my civics and/or United States government schoolwork is easy for me. c. I want to look smart in comparison to the other students in my social studies, civics, and/or United States government class. d. I want to get better civics and/or United States government grades than most other students in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH716895 A B C D E VH716898 A B C D E VH716897 A B C D E VH716896 244 VH716899 35. How much does each of the following statements describe you? Select one answer choice on each row. a. I want to learn as much as possible about civics and/or United States government in my class. b. I want to master a lot of new civics and/or United States government skills in my class. c. I want to become a better civics and/or United States government student this year. d. I want to understand as much as I can about civics and/or United States government in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH716900 A B C D E VH716901 A B C D E VH716904 A B C D E VH716902 245 VH716873 36. How much does each of the following statements describe you? Select one answer choice on each row. a. Civics and/or United States government are my favorite topics to study. b. I enjoy doing schoolwork about civics and/or United States government. c. I enjoy discussing civics and/or United States government topics with others. d. I think that civics and/or United States government schoolwork helps me understand what is happening in the world around me. e. I think that learning about civics and/or United States government topics will be important for my future. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH716874 A B C D E VH716879 A B C D E VH716877 A B C D E VH716878 A B C D E VH716876 246 VH716880 37. During this school year, how often do you do each of the following activities outside of school? Select one answer choice on each row. a. Read about current political events in the media b. Watch movies, videos, and/or TV programs about current political events c. Participate in volunteer activities within a community d. Discuss current political events or issues with others (for example, people in my home or friends) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH716881 A B C D E VH716882 A B C D E VH716884 A B C D E VH716883 VH457791 38. How often do you receive help from a tutor, family member, or friend with social studies outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 247 VH459937 39. Approximately how many hours a day do you spend on your social studies homework? A Less than 30 minutes a day B 30 minutes up to 1 hour a day C 1 up to 2 hours a day D 2 up to 3 hours a day E 3 up to 4 hours a day F More than 4 hours a day 248 Appendix F-1ab: 2010 Operational Grade 12 Civics 249 C C P 7 4 | | 2 1 P 7 | | 4 2 1 P 7 SECTION 4 2 1 P 7 | | | | 4 Section 4 This section has 16 questions. Mark your answers in your booklet. Fill in only one oval for each question except where instructed otherwise. 4 2 1 1. In what grade(s) have you studied civics or government? Fill in all ovals that apply. VE216906 Yes No a. Grade 9 VE216908 b. Grade 10 VE216909 c. Grade 11 VE216913 d. Grade 12 VE216914 VC469156 2. In this school year, how often have you studied social studies? Never or hardly ever A few times a year Once or twice a month Once or twice a week Every day or almost every day 4 | | 2 1 P 7 | | 4 2 1 | P 7 4 2 1 P 7 | | | | 4 G3CB1 2 1 | 37 Page 1 GO ON TO THE NEXT PAGE 250 C 7 C P C C P Section 4 7 4 | | No No I don’t know. I don’t know. a. The United States Constitution a. The United States Constitution ID100217 ID100217 b. Congress b. Congress ID100218 ID100218 c. The President and the cabinet c. The President and the cabinet ID100219 ID100219 d. How laws are made d. How laws are made ID100220 ID100220 e. The court system e. The court system ID100221 ID100221 f. Political parties, elections, and voting f. Political parties, elections, and voting ID100222 ID100222 g. State and local government g. State and local government ID100223 ID100223 h. Other countries’ governments h. Other countries’ governments ID100224 ID100224 i. International organizations (such as the United i. International organizations (such as the United Nations) Nations) ID100225 ID100225 1 P ID100216 ID100216 3. During this school year, have you studied any of the following topics? Fill in one oval on 3. During this school year, have you studied any of the following topics? Fill in one oval on each line. each line. Yes Yes 2 | 7 4 2 | 1 P 7 4 2 1 | | P 7 | 4. Indicate 4. Indicate or gover or gover 4 2 | 1 a. Read a. Read text text b. Read b. Read the r the r new new map map c. Disc c. Disc stud stud d. Writ d. Writ para para ques ques e. Writ e. Writ f. f. Wor Wor g. Give g. Give the c the c bein bein h. Wat h. Wat i. i. Take Take j. j. Go o Go o outs outs k. Use k. Use com com to do to do l. l. P 7 4 | | 2 1 P | G3CB1 Page 2 7 4 GO ON TO THE NEXT PAGE GO ON TO THE NEXT PAGE 2 251 | | 1 Writ Writ opin opin com com m. Disc m. Disc P n. Take n. Take pane pane 7 4 2 1 | | o. Take o. Take moc moc P 7 | 4 2 | G3CB1 G3CB1 1 | 39 C C C C 4 | | ID100216 ID100216 ne oval on ne oval on 2 1 P | 7 4 2 know. know. | ID100217 ID100217 ID100218 ID100218 ID100219 ID100219 ID100220 ID100220 ID100221 ID100221 ID100222 ID100222 ID100223 ID100223 ID100224 ID100224 ID100225 ID100225 T PAGE T PAGE 1 P 7 Section 4 2 1 | | P 7 | VE132250 VE132250 4. Indicate how often you do each of the following when you study social studies or civics 4. Indicate how often you do each of the following when you study social studies or civics or government in school. Fill in one oval on each line. or government in school. Fill in one oval on each line. Never Never A few A fewa times times year a year Once or Once twiceor a twice montha month Once or Once twiceor a twice weeka week Almost Almost every every day day e. Write a report e. Write a report f. Work on a group project f. Work on a group project h. Watch movies or videos h. Watch movies or videos i. Take a test or quiz i. Take a test or quiz j. Go on field trips or have j. Go on field trips or have outside speakers outside speakers m. Discuss current events m. Discuss current events n. Take part in debates or n. Take part in debates or panel discussions panel discussions o. Take part in role-playing, o. Take part in role-playing, mock trials, or dramas mock trials, or dramas 4 2 | 1 a. Read material from a a. Read material from a textbook textbook b. Read extra material not in b. Read extra material not in the regular textbook (e.g., the regular textbook (e.g., newspapers, magazines, newspapers, magazines, maps, charts, or cartoons) maps, charts, or cartoons) c. Discuss the material c. Discuss the material studied studied d. Write short answers (a d. Write short answers (a paragraph or less) to paragraph or less) to questions questions g. Give a presentation to g. Give a presentation to the class on the topic the class on the topic being studied being studied k. Use the books or k. Use the books or computers in the library computers in the library to do schoolwork to do schoolwork l. Write a letter to give your l. Write a letter to give your opinion or help solve a opinion or help solve a community problem community problem P 7 4 | | 2 1 P | 7 4 2 | | 1 P 7 4 2 1 | | P 7 VE132269 VE132269 VE132303 VE132303 VE132307 VE132307 VE132309 VE132309 VE132316 VE132316 VE132322 VE132322 VE132323 VE132323 VE132324 VE132324 VE132326 VE132326 VE132327 VE132327 VE132330 VE132330 VE132333 VE132333 VE132335 VE132335 VE132338 VE132338 VE132340 VE132340 | 4 2 4 | G3CB1 G3CB1 1 | 39 Page 3 GO ON TO THE NEXT PAGE 252 C 7 C P C C | Section 4 P 7 | 4 2 1 VB610546 P VE139938 VE139938 5. This year in school, how often have you been asked to write long answers to questions or assignments that involved civics or government? 7. Think about all the courses since 7. Think about all the courses since the ninth grade in which you have the ninth grade in which you have studied civics or government. To what studied civics or government. To what extent have you used computers to extent have you used computers to do research projects about topics in do research projects about topics in civics or government using a CD or the civics or government using a CD or the Internet? Include both class work and Internet? Include both class work and homework assignments. homework assignments. Never Once or twice this year Once or twice a month Not at all At least once a week Small extent | | 7 4 2 1 P | 7 4 | 2 1 P | 9. How mu 9. How mu studies studies of your of your | Not Not li A A li lo A A lo 7 4 2 1 Not at all Small extent 10. Have yo 10. Have yo taking t taking t Placeme Placeme Govern Govern Moderate extent Moderate extent VE138990 6. This year, how often have you used computers at school for studying civics or government? Large extent Large extent Yes Yes No No Never or hardly ever Once every few weeks 11. Are you 11. Are you you tak you tak States g States g college college About once a week Two or three times a week Every day Yes Yes No No VC681400 VC681400 8. When you study social studies or civics or government, how often do you agree with the 8. When you study social studies or civics or government, how often do you agree with the following statements? Fill in one oval on each line. following statements? Fill in one oval on each line. Never orNever hardly or ever hardly Sometimes ever Sometimes a. I have a clear understanding of a. I have a clear understanding of what my social studies or civics or what my social studies or civics or government teacher is asking me to do. government teacher is asking me to do. b. The social studies or civics or b. The social studies or civics or government work is easy. government work is easy. c. The social studies or civics or c. The social studies or civics or government work is difficult. government work is difficult. d. The social studies or civics or d. The social studies or civics or government work is interesting. government work is interesting. G3CB1 Often Often 12. How mu 12. How mu will com will com Always orAlways almost oralways almost always II wi wi I wi VC681401 VC681401 I wi VC681402 VC681402 VC681403 VC681403 II wi wi high high | P 7 | 4 2 Page 4 VC681404 VC681404 1 P | | GO ON TO THE NEXT PAGE GO ON TO THE NEXT PAGE 7 4 2 1 253 | P II wi wi I wi | 7 4 I wi | 2 II do do 1 P | 7 4 G3CB1 G3CB1 2 1 | | 41 C C C C 7 | 4 2 1 VE139938 VE139938 since since u have u have t. To what t. To what uters to uters to opics in opics in a CD or the a CD or the work and work and P | | 7 4 2 1 P | 7 4 Section | 2 1 P | 7 4 2 1 VE132747 VE132747 9. How much do you agree that social 9. How much do you agree that social studies or civics or government is one studies or civics or government is one of your favorite subjects? of your favorite subjects? | Attending a vocational, technical, or business school A lot A lot Attending a two-year college ID100232 ID100232 Attending a four-year college, 10. Have you taken or are you currently 10. Have you taken or are you currently taking the College Board Advanced taking the College Board Advanced Placement course in United States Placement course in United States Government and Politics? Government and Politics? service academy, or university Serving in the military Other Yes Yes No No VB595182 14. How hard was this test compared to most other tests you have taken this year in school? VC681414 VC681414 11. Are you currently enrolled in or have 11. Are you currently enrolled in or have you taken any online courses in United you taken any online courses in United States government for high school or States government for high school or college credit? college credit? Easier than other tests About as hard as other tests Yes Yes No Harder than other tests No Much harder than other tests QK070697 QK070697 12. How much education do you think you 12. How much education do you think you will complete? will complete? ys ys most most ys ys Working full time A little VC681400 VC681400 not finish high school. II will will not finish high school. I will graduate from high school. VC681401 VC681401 I will graduate from high school. About as hard as on other tests high school. high school. | VC681403 VC681403 P 7 | 4 2 VC681404 VC681404 1 P | | 7 4 2 1 | P 7 4 Much harder than on other tests I will go to graduate school. | 2 know. II don’t don’t know. 1 P Harder than on other tests graduate from college. II will will graduate from college. I will go to graduate school. | VC034559 15. How hard did you try on this test compared to how hard you tried on most other tests you have taken this year in school? Not as hard as on other tests have some education after II will will have some education after VC681402 VC681402 T PAGE T PAGE VC101417 13. What do you expect that your main activity will be in the year after you leave high school? Not at all Not at all A little e with the e with the 4 | 7 4 G3CB1 G3CB1 2 1 | | 41 Page 5 GO ON TO THE NEXT PAGE 254 C P C | C C | Section 4 P 7 | 4 2 1 | VB595184 16. How important was it to you to do well on this test? P 7 4 | Not very important 2 1 P | 7 4 | 2 1 P 7 4 2 1 | | P | Somewhat important Important Very important | P 7 | 4 2 1 | P 7 G3CB1 Page 6 STOP 4 | 2 1 255 | 7 4 | 2 1 P 7 4 2 1 | | | 43 C C Appendix F-1ac: 2018 Operational Grade 8 Geography 256 VH459042 25. In which of the following grades have you learned about geography? Select one answer choice on each row. Yes, I took a No, I did not Yes, I took a class or course take a class or class or course that included course that mainly some taught focused on geography geography geography. topics. topics. a. 6th grade b. 7th grade c. 8th grade I don’t remember. A B C D VH459044 A B C D VH459045 A B C D VH459046 VH459048 26. In your social studies class this year, how much have you studied the following topics? Select one answer choice on each row. a. Use of physical or digital maps (for example, a road map, MapQuest, or Google Maps) and globes b. Natural resources (for example, oil, forests, or water) c. Countries and cultures d. Environmental issues (for example, pollution, recycling, climate change, or genetically modified food) Not at all Very little Some Quite a bit A lot A B C D E VH717072 A B C D E VH459050 A B C D E VH459051 A B C D E VH459052 257 VH717180 27. During this school year, how often do you do each of the following activities? Select one answer choice on each row. a. Read material from a geography textbook (print or digital) b. Read extra material about geography not in the regular textbook (for example, newspapers, magazines, or online sources) c. Conduct research about geography topics (for example, online, in a library, or through interviews) d. Listen to or watch movies, videos, or online content about geography topics Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH717181 A B C D E VH717182 A B C D E VH717184 A B C D E VH717183 VH717245 28. During this school year so far, how often have you done each of the following activities? Select one answer choice on each row. a. Gone on class field trips to learn about geography topics b. Given class presentations on geography topics c. Written about your opinion on geographic problems or issues (for example, in a letter, e-mail, or blog post) d. Taken part in environmental debates or panel discussions Never Once Two or three times Four or five times More than five times A B C D E VH717246 A B C D E VH717249 A B C D E VH717248 A B C D E VH717247 258 VH717200 29. During this school year, how often do you do each of the following activities when you study geography? Select one answer choice on each row. a. Use a map (for example, a road map, MapQuest, or Google Maps), atlas, or globe to locate different cities, countries, and continents b. Examine how natural features of Earth (for example, rivers or mountains) are formed c. Examine why groups of people migrate to different parts of the world d. Examine how humans affect the natural environment e. Examine how humans adjust to the natural environment f. Examine why different food and energy resources are traded globally g. Use geographic information (for example, maps, satellite images, or population data) to answer a question or solve a problem Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH717201 A B C D E VH717202 A B C D E VH717209 A B C D E VH717206 A B C D E VH717205 A B C D E VH717207 A B C D E VH717208 259 VH457531 30. In your social studies class this year, how often do you get the following assignments? Select one answer choice on each row. a. Assignments that you have to complete together with other students b. Short written responses (for example, a paragraph or less) c. Assignments that use different forms of media (for example, photos, videos, or music) d. Long written responses (for example, several paragraphs) e. Responses to questions based on information from several sources (for example, letters, cartoons, or maps) Never or hardly ever Less than half of the lessons About half of the lessons More than half of the lessons All or almost all of the lessons A B C D E VH457532 A B C D E VH457533 A B C D E VH457534 A B C D E VH457540 A B C D E VH457542 260 VH459263 31. When you study social studies, how often do you use computers or other digital devices to do the following? For this question, include both schoolwork and homework assignments. Select one answer choice on each row. a. Play games or use apps in which you play a role (for example, an explorer, geographer, or historian) b. Organize information about geography topics by creating tables, charts, or graphs c. Create reports or projects about geography using different forms of media (for example, a slide presentation that combines text and video clips) d. Participate in online discussions about geography on a website (for example, in forums or social media) e. Use the Internet to look for evidence or sources (for example, text documents, photographic images, or films) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH727929 A B C D E VH459268 A B C D E VH459269 A B C D E VH459270 A B C D E VH459271 261 VH459340 32. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Use a map (for example, a road map, MapQuest, or Google Maps), atlas, or globe to locate different cities, countries, and continents b. Describe how natural features of Earth (for example, rivers or mountains) are formed c. Explain why groups of people migrate to different parts of the world d. Explain how humans affect the natural environment e. Explain how humans adjust to the natural environment f. Explain why different food and energy resources are traded globally g. Use geographic information (for example, maps, satellite images, or population data) to answer a question or solve a problem I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH459342 A B C D E VH728006 A B C D E VH459357 A B C D E VH459358 A B C D E VH602980 A B C D E VH459359 A B C D E VH459361 262 VH717290 33. How much does each of the following statements describe you? Select one answer choice on each row. a. I want other students to think I am a good geography student. b. I want to show others that my geography schoolwork is easy for me. c. I want to look smart in comparison to the other students in my social studies or geography class. d. I want to get better geography grades than most other students in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH717291 A B C D E VH717294 A B C D E VH717292 A B C D E VH717293 VH717301 34. How much does each of the following statements describe you? Select one answer choice on each row. a. I want to learn as much as possible about geography in my class. b. I want to master a lot of new geography skills in my class. c. I want to become a better geography student this year. d. I want to understand as much as I can about geography in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH717302 A B C D E VH717303 A B C D E VH717305 A B C D E VH717306 263 VH717259 35. How much does each of the following statements describe you? Select one answer choice on each row. a. Geography is one of my favorite subjects to study. b. I enjoy doing schoolwork about geography. c. I enjoy discussing geography topics with others. d. I think that geography schoolwork helps me understand what is happening in the world around me. e. I think that learning about geography topics will be important for my future. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH717260 A B C D E VH717265 A B C D E VH717263 A B C D E VH717264 A B C D E VH717262 VH717389 36. During this school year, how often do you do each of the following activities outside of school? Select one answer choice on each row. a. Use online maps (for example, Google Maps, MapQuest, or Bing Maps) b. Read about geographic issues c. Travel to places outside of your town d. Talk to friends or family about geographic topics Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH717390 A B C D E VH717391 A B C D E VH717394 A B C D E VH717392 264 VH457791 37. How often do you receive help from a tutor, family member, or friend with social studies outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day VH459937 38. Approximately how many hours a day do you spend on your social studies homework? A Less than 30 minutes a day B 30 minutes up to 1 hour a day C 1 up to 2 hours a day D 2 up to 3 hours a day E 3 up to 4 hours a day F More than 4 hours a day 265 Appendix F-1ad: 2010 Operational Grade 12 Geography 266 SECTION 4 Section 4 This section has 16 questions. Mark your answers in your booklet. Fill in only one oval for each question except where instructed otherwise. VB345592 1. Did you take or do you expect to take a geography course in the following grades? Fill in one oval on each line. Yes No I don’t know. a. 9th grade A B C VB345606 b. 10th grade A B C VB345607 c. 11th grade A B C VB345608 d. 12th grade A B C VB345609 VC472881 2. In this school year, how often have you learned about geography? A Never or hardly ever B A few times a year C Once or twice a month D Once or twice a week E Every day or almost every day VB345597 3. How often have you studied the following geography skills and topics in school? Fill in one oval on each line. Almost every day Once or twice a week Once or twice a month Never or hardly ever a. Using maps and globes A B C D VB345598 b. Natural resources (for example, oil, forests, and water) A B C D VB345599 c. Countries and cultures A B C D VB345600 d. Environmental issues (for example, pollution and recycling) A B C D VB345601 G3GB1 Page 1 GO ON TO THE NEXT PAGE 267 Section 4 VE117406 4. Indicate how often you do each of the following when you study social studies or geography in school. Fill in one oval on each line. Never A few times a year Once or twice a month Once or twice a week Almost every day a. Read material from a textbook A B C D E VE117427 b. Read extra material not in the regular textbook (e.g., newspapers, magazines, maps, charts, or cartoons) A B C D E VE117428 c. Discuss the material studied A B C D E VE117429 d. Write short answers (a paragraph or less) to questions A B C D E VE117430 e. Write a report A B C D E VE117431 f. Work on a group project A B C D E VE117432 g. Give a presentation to the class on the topic being studied A B C D E VE117433 h. Watch movies or videos A B C D E VE117435 i. Take a test or quiz A B C D E VE117437 j. Go on field trips or have outside speakers A B C D E VE117438 k. Use the books or computers in the library to do schoolwork A B C D E VE117439 l. Listen to information presented online A B C D E VE131746 G3GB1 Page 2 GO ON TO THE NEXT PAGE 268 Section 4 VE111121 5. This year, how often have you used computers at school for studying geography? A Never or hardly ever B Once every few weeks C About once a week D Two or three times a week E Every day VE141477 6. Think about all the courses since the 9th grade in which you have studied history or geography. To what extent have you used computers to do the following? For this question include both class work and homework assignments. Fill in one oval on each line. Not at all Small extent Moderate extent Large extent a. Did research projects about topics in history or geography using a CD or the Internet A B C D VE141536 b. Used computer programs in which you play the role of an explorer, geographer, anthropologist, or historian A B C D VE141571 c. Created or used maps using geographic information systems (GIS) A B C D VE141603 d. Put history or geography information into tables, charts, or graphs on the computer A B C D VE141631 e. Wrote reports or other things about history or geography on the computer A B C D VE141656 f. Combined words, images, and sounds to create multimedia reports or projects about history or geography A B C D VE141692 g. Used e-mail or the Internet to communicate with others about history or geography A B C D VE141715 G3GB1 Page 3 GO ON TO THE NEXT PAGE 269 Section 4 VC629461 7. When you study social studies or geography, how often do you agree with the following statements? Fill in one oval on each line. Never or hardly ever Sometimes Often Always or almost always a. I have a clear understanding of what my social studies or geography teacher is asking me to do. A B C D VC629462 b. The social studies or geography work is easy. A B C D VC629463 c. The social studies or geography work is difficult. A B C D VC629465 d. The social studies or geography work is interesting. A B C D VC629473 VE131544 VE040688 8. How much do you agree that social studies or geography is one of your favorite subjects? 10. Are you currently enrolled in or have you taken an Advanced Placement course in Human Geography? A Not at all A Yes B A little B No C A lot VC473870 11. Are you currently enrolled in or have you taken any online geography courses for high school or college credit? VC473873 9. Are you currently enrolled in or have you taken an International Baccalaureate course in geography? A Yes A Yes B No B No C I don’t know. C I don’t know. G3GB1 Page 4 GO ON TO THE NEXT PAGE 270 Section QK070697 4 VC034559 12. How much education do you think you will complete? 15. How hard did you try on this test compared to how hard you tried on most other tests you have taken this year in school? A I will not finish high school. B I will graduate from high school. A Not as hard as on other tests C I will have some education after B About as hard as on other tests high school. C Harder than on other tests D I will graduate from college. D Much harder than on other tests E I will go to graduate school. F I don’t know. VB595184 16. How important was it to you to do well on this test? VC101417 A Not very important 13. What do you expect that your main activity will be in the year after you leave high school? B Somewhat important A Working full time C Important B Attending a vocational, technical, or D Very important business school C Attending a two-year college D Attending a four-year college, service academy, or university E Serving in the military F Other VB595182 14. How hard was this test compared to most other tests you have taken this year in school? A Easier than other tests B About as hard as other tests C Harder than other tests D Much harder than other tests G3GB1 Page 5 STOP 271 Appendix F-1ae: 2018 Operational Grade 8 U.S. History 272 VH459698 25. In which of the following grades have you learned about United States history? Select one answer choice on each row. Yes, I took a Yes, I took a No, I did not class or course class or course take a class or mainly that included course that focused on some United taught United United States States history States history history. topics. topics. a. 6th grade b. 7th grade c. 8th grade I don’t remember. A B C D VH459700 A B C D VH459701 A B C D VH459702 VH459719 26. In your social studies class this year, how much have you studied the following periods of United States history? Select one answer choice on each row. a. The period before 1815 (for example, age of exploration, colonization, settlement, or American Revolution) b. 1815 to 1865 (for example, expansion, reform, sectionalism, or the Civil War) c. 1865 to 1945 (for example, Reconstruction, industrial growth, United States role in world events, immigration, the Great Depression, or the First and Second World Wars) d. 1945 to the present (for example, the Cold War, Civil Rights movement, women’s rights movement, Vietnam War, or environmental movement) Not at all Very little Some Quite a bit A lot A B C D E VH459720 A B C D E VH459721 A B C D E VH459722 A B C D E VH459723 273 VH718236 27. During this school year, how often do you do each of the following activities? Select one answer choice on each row. a. Read material from a United States history textbook (print or digital) b. Read extra material about United States history not in the regular textbook (for example, newspapers, magazines, or online sources) c. Use primary sources (for example, letters, diaries, photographs, films, or essays written by people from the past) d. Conduct research about United States history topics (for example, online, in a library, or through interviews) e. Listen to or watch movies, videos, or online content about United States history topics Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH718237 A B C D E VH718238 A B C D E VH718242 A B C D E VH718241 A B C D E VH718239 274 VH718301 28. During this school year so far, how often have you done each of the following activities? Select one answer choice on each row. a. Gone on class field trips to learn about United States history topics b. Given class presentations on United States history topics c. Written about your opinion on historical issues (for example, in a letter, e-mail, or blog post) d. Taken part in historical debates or panel discussions e. Taken part in role-playing, mock trials, or dramas about United States history topics Never Once Two or three times Four or five times More than five times A B C D E VH718302 A B C D E VH718303 A B C D E VH718306 A B C D E VH718305 A B C D E VH718304 275 VH718591 29. During this school year, how often do you do each of the following activities when you study United States history? Select one answer choice on each row. a. Examine the causes and effects of important events in United States history b. Examine how time periods in United States history are similar or different c. Judge whether information from a source (for example, text, visual graphics, video, or audio) is accurate d. Analyze the relationship between two historical events e. Compare and evaluate different points of view about the past (for example, different ideas about what caused the Civil War) f. Come up with research questions about why or how something happened in the past (for example, what were the causes of the Great Depression) g. Take and defend a position about a historical issue (for example, how changes in transportation have affected the United States economy) Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH718592 A B C D E VH718593 A B C D E VH718594 A B C D E VH718598 A B C D E VH718596 A B C D E VH718597 A B C D E VH718595 276 VH457531 30. In your social studies class this year, how often do you get the following assignments? Select one answer choice on each row. a. Assignments that you have to complete together with other students b. Short written responses (for example, a paragraph or less) c. Assignments that use different forms of media (for example, photos, videos, or music) d. Long written responses (for example, several paragraphs) e. Responses to questions based on information from several sources (for example, letters, cartoons, or maps) Never or hardly ever Less than half of the lessons About half of the lessons More than half of the lessons All or almost all of the lessons A B C D E VH457532 A B C D E VH457533 A B C D E VH457534 A B C D E VH457540 A B C D E VH457542 277 VH459889 31. When you study social studies, how often do you use computers or other digital devices to do the following? For this question, include both schoolwork and homework assignments. Select one answer choice on each row. a. Play games or use apps in which you play a role (for example, an explorer, geographer, or historian) b. Organize information about United States history topics by creating tables, charts, or graphs c. Create reports or projects about United States history using different forms of media (for example, a slide presentation that combines text and video clips) d. Participate in online discussions about United States history on a website (for example, in forums or social media) e. Use the Internet to look for evidence or sources (for example, text documents, photographic images, or films) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH727925 A B C D E VH459892 A B C D E VH459893 A B C D E VH459894 A B C D E VH459895 278 VH719828 32. How much does each of the following statements describe you? Select one answer choice on each row. a. I form opinions about historical events only after I have information from more than one source. b. I need to know the history leading up to an event to truly understand it. c. I want to know what lies behind the story when I study a conflict in history. d. I try to understand others better by imagining how things look from their perspective. e. I try to look at everybody’s side of a disagreement before I make a decision. f. I think that there is more than one side to every question, and I try to look at all of them. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH719829 A B C D E VH719830 A B C D E VH719834 A B C D E VH719832 A B C D E VH719833 A B C D E VH719831 279 VH460009 33. Do you think that you would be able to do each of the following? Select one answer choice on each row. a. Explain the causes and effects of important events in United States history b. Explain how time periods in United States history are similar or different c. Judge whether information from a source (for example, text, visual graphics, video, or audio) is accurate d. Understand the relationship between two historical events e. Compare and evaluate different points of view about the past (for example, different ideas about what caused the Civil War) f. Come up with research questions about why or how something happened in the past (for example, what were the causes of the Great Depression) g. Take and defend a position about a historical issue (for example, how changes in transportation have affected the United States economy) I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH460011 A B C D E VH460016 A B C D E VH460017 A B C D E VH460041 A B C D E VH460042 A B C D E VH460043 A B C D E VH460044 280 VH719843 34. How much does each of the following statements describe you? Select one answer choice on each row. a. I want other students to think I am a good United States history student. b. I want to show others that my United States history schoolwork is easy for me. c. I want to look smart in comparison to the other students in my social studies or United States history class. d. I want to get better United States history grades than most other students in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH719844 A B C D E VH719847 A B C D E VH719845 A B C D E VH719846 VH720606 35. How much does each of the following statements describe you? Select one answer choice on each row. a. I want to learn as much as possible about United States history in my class. b. I want to master a lot of new United States history skills in my class. c. I want to become a better United States history student this year. d. I want to understand as much as I can about United States history in my class. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH720608 A B C D E VH720609 A B C D E VH720611 A B C D E VH720612 281 VH718413 36. How much does each of the following statements describe you? Select one answer choice on each row. a. United States history is one of my favorite subjects to study. b. I enjoy doing schoolwork about United States history. c. I enjoy discussing United States history topics with others. d. I think that United States history schoolwork helps me understand what is happening in the world around me. e. I think that learning about United States history topics will be important for my future. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH718414 A B C D E VH718419 A B C D E VH718417 A B C D E VH718418 A B C D E VH718416 282 VH718431 37. During this school year, how often do you do each of the following activities outside of school? Select one answer choice on each row. a. Read books about history b. Watch movies, videos, or TV programs about history c. Play video games about history d. Go to history museums or historical sites e. Do online research related to historical topics f. Talk to friends or family about historical topics Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH718432 A B C D E VH718433 A B C D E VH718434 A B C D E VH718438 A B C D E VH718436 A B C D E VH718435 VH457791 38. How often do you receive help from a tutor, family member, or friend with social studies outside of school or after school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 283 VH459937 39. Approximately how many hours a day do you spend on your social studies homework? A Less than 30 minutes a day B 30 minutes up to 1 hour a day C 1 up to 2 hours a day D 2 up to 3 hours a day E 3 up to 4 hours a day F More than 4 hours a day 284 Appendix F-1af: 2010 Operational Grade 12 U.S. History 285 C C | P 7 | 4 2 1 | P 7 | 4 2 1 P | 7 4 SECTION | 2 4 Section 4 1 This section has 16 questions. Mark your answers in your booklet. Fill in only one oval for each question except where instructed otherwise. P 7 4 | 2 1 | LC000126 1. Did you take a United States history course in the following grades? Fill in one oval on each line. Yes No I don’t know. a. 9th grade A B C LC000127 b. 10th grade A B C LC000128 c. 11th grade A B C LC000129 WP000118 2. Are you taking a United States history course now? A Yes B No 7 | 4 2 1 | P 7 | 4 2 1 | P | 7 4 | 2 1 P 7 4 | G3HB1 2 1 | | 45 Page 1 GO ON TO THE NEXT PAGE 286 C P C | C C | Section 4 P 7 | 4 2 1 P VB598171 VB598171 3. Since the beginning of middle school or junior high school, how much have you studied 3. Since the beginning of middle school or junior high school, how much have you studied the following periods of United States history? Fill in one oval on each line. the following periods of United States history? Fill in one oval on each line. 7 | | 4 2 1 P | 7 4 | 2 1 P 7 | | 4 4. When y 4. When y followin followin 2 Not at all Not at all Some Some A lot A lot a. The period before 1815: beginnings through a. The period before 1815: beginnings through the Revolution (e.g., colonization, the Revolution (e.g., colonization, settlement, revolution) settlement, revolution) A B C C VB598172 VB598172 b. The period between 1815 and 1865: b. The period between 1815 and 1865: the new nation through the Civil War the new nation through the Civil War (e.g., expansion, reform, crisis of the (e.g., expansion, reform, crisis of the Union) Union) A B C C VB598173 VB598173 b. Read b. Read in th in th (e.g. (e.g. histo histo c. The period between 1865 and 1945: c. The period between 1865 and 1945: the development of modern America the development of modern America (e.g., Reconstruction, industrial growth, (e.g., Reconstruction, industrial growth, United States’ role in world affairs, the United States’ role in world affairs, the Great Depression, the First and Second Great Depression, the First and Second World Wars, immigration) World Wars, immigration) A B C C VB598174 VB598174 c. Use c. Use or es or es histo histo d. The period between 1945 and the present: d. The period between 1945 and the present: contemporary America (e.g., civil rights contemporary America (e.g., civil rights movement, women’s rights movement, movement, women’s rights movement, Korean and Vietnam wars, environmental Korean and Vietnam wars, environmental movement) movement) A 1 a. Read a. Read text text d. Disc d. Disc stud stud B C C VB598175 VB598175 e. Writ e. Writ para para ques ques f. f. Writ Writ g. Wor g. Wor h. Give h. Give the c the c bein bein i. i. Wat Wat j. j. Take Take k. Go o k. Go o outs outs l. l. | P 7 | 4 2 1 P 7 G3HB1 Page 2 | | GO ON TO THE NEXT PAGE GO ON TO THE NEXT PAGE 4 2 1 287 | P m. Liste m. Liste pres pres | 7 4 | 2 1 P 7 | | 4 G3HB1 G3HB1 2 1 | Use Use com com to do to do 47 C C C C | 4 2 1 P VB598171 VB598171 7 | | 4 2 1 ot ot P | 7 4 Section | 2 1 P 7 | | 4 4. When you study history or social studies in school, how often do you do each of the 4. When you study history or social studies in school, how often do you do each of the following? Fill in one oval on each line. following? Fill in one oval on each line. Never Never A few A fewa times times year a year Once or Once twiceor a twice montha month Once or Once twiceor a twice weeka week Almost Almost every every day day A B C D E A B C D E A B C D E A B C D E A B C D E f. Write a report f. Write a report A B C D E g. Work on a group project g. Work on a group project A B C D E A B C D E i. Watch movies or videos i. Watch movies or videos A B C D E j. Take a test or quiz j. Take a test or quiz A B C D E k. Go on field trips or have k. Go on field trips or have outside speakers outside speakers A B C D E A B C D E A B C D E 2 1 VB598172 VB598172 a. Read material from a a. Read material from a textbook textbook C C VB598173 VB598173 b. Read extra material not b. Read extra material not in the regular textbook in the regular textbook (e.g., biographies or (e.g., biographies or historical stories) historical stories) C C VB598174 VB598174 c. Use letters, diaries, c. Use letters, diaries, or essays written by or essays written by historical people historical people C C d. Discuss the material d. Discuss the material studied studied VB598175 VB598175 T PAGE T PAGE e. Write short answers (a e. Write short answers (a paragraph or less) to paragraph or less) to questions questions h. Give a presentation to h. Give a presentation to the class on the topic the class on the topic being studied being studied l. Use the books or l. Use the books or computers in the library computers in the library to do schoolwork to do schoolwork | P 7 | 4 2 1 P 7 | | 4 2 1 | 4 P m. Listen to information m. Listen to information presented online presented online | 7 4 VE132663 VE132663 VE132669 VE132669 VE132671 VE132671 VE132685 VE132685 VE132686 VE132686 VE132687 VE132687 VE132692 VE132692 VE132697 VE132697 VE132698 VE132698 VE132699 VE132699 VE132700 VE132700 VE132701 VE132701 VE132704 VE132704 VE132706 VE132706 | 2 1 P 7 | | 4 G3HB1 G3HB1 2 1 | 47 Page 3 GO ON TO THE NEXT PAGE 288 C 7 u studied u studied C C P C | C C | Section 4 P 7 | 4 2 1 VB598168 P VE142965 VE142965 5. This year in school, how often have you been asked to write long answers to questions or assignments for history or social studies? 7. Think about all the courses since 7. Think about all the courses since the ninth grade in which you have the ninth grade in which you have studied history or social studies. To studied history or social studies. To what extent have you used computers what extent have you used computers to do research projects about topics in to do research projects about topics in history or social studies using a CD or history or social studies using a CD or the Internet? Include both class work the Internet? Include both class work and homework assignments. and homework assignments. A Never B Once or twice this year C Once or twice a month A Not at all D At least once a week B Small extent | 7 4 2 | 1 P | 7 4 | 2 1 P 7 | 4 2 | 9. How mu 9. How mu or socia or socia subjects subjects 1 A A Not Not B B A li A li C lo CA A lo Not at all Small extent 10. Are you 10. Are you you tak you tak course i course i C Moderate extent Moderate extent VE102054 6. This year, how often have you used computers at school for studying history or social studies? D Large extent Large extent A A Yes Yes B B No No A Never or hardly ever B Once every few weeks 11. Are you 11. Are you you tak you tak courses courses credit? credit? C About once a week D Two or three times a week A A Yes Yes B B No E Every day No C C II do do VC471044 VC471044 8. When you study social studies or history, how often do you agree with the following 8. When you study social studies or history, how often do you agree with the following statements? Fill in one oval on each line. statements? Fill in one oval on each line. Never orNever hardly or ever hardly Sometimes ever Sometimes Often Often Always orAlways almost oralways almost always a. I have a clear understanding of what a. I have a clear understanding of what my social studies or history teacher my social studies or history teacher is asking me to do. is asking me to do. A B C D D VC471046 VC471046 b. The social studies or history work is b. The social studies or history work is easy. easy. A B C D D VE132507 VE132507 D D VC471049 VC471049 c. The social studies or history work is c. The social studies or history work is difficult. difficult. A B C P 7 | 4 2 d. The social studies or history work is d. The social studies or history work is interesting. interesting. G3HB1 | A Page 4 B C D D VC471051 VC471051 1 P | 7 4 GO ON TO THE NEXT PAGE GO ON TO THE NEXT PAGE 2 289 | | 1 P | 7 4 | 2 1 P 7 | 4 2 | G3HB1 G3HB1 1 | 49 C C C C | P 7 | 4 2 1 VE142965 VE142965 since since u have u have dies. To dies. To omputers omputers t topics in t topics in ng a CD or ng a CD or ass work ass work . . P | 7 4 2 | 1 P | 7 4 Section | 2 1 VE098853 VE098853 P 7 | 4 2 | 9. How much do you agree that history 9. How much do you agree that history or social studies is one of your favorite or social studies is one of your favorite subjects? subjects? 1 A I will not finish high school. B I will graduate from high school. A little C I will have some education after C A lot CA lot high school. D I will graduate from college. VB598179 VB598179 10. Are you currently enrolled in or have 10. Are you currently enrolled in or have you taken an Advanced Placement you taken an Advanced Placement course in U.S. History? course in U.S. History? E I will go to graduate school. F I don’t know. A A Yes Yes B B No VC101417 13. What do you expect that your main activity will be in the year after you leave high school? No VC470692 VC470692 11. Are you currently enrolled in or have 11. Are you currently enrolled in or have you taken any online U.S. History you taken any online U.S. History courses for high school or college courses for high school or college credit? credit? A Working full time B Attending a vocational, technical, or business school A Yes A Yes B No B No C I don’t know. C I don’t know. VC471044 VC471044 QK070697 12. How much education do you think you will complete? A Not at all A Not at all B B A little owing owing C Attending a two-year college D Attending a four-year college, service academy, or university E Serving in the military F Other ys ys most most ys ys D D VE132507 VE132507 D D VC471049 VC471049 VB595182 14. How hard was this test compared to most other tests you have taken this year in school? A Easier than other tests | P 7 | 4 2 VC471051 VC471051 T PAGE T PAGE 1 P | 7 4 2 | | 1 P | B About as hard as other tests | C Harder than other tests 7 4 2 D Much harder than other tests 1 P 7 | 4 2 | G3HB1 G3HB1 1 | 49 Page 5 GO ON TO THE NEXT PAGE 290 C VC471046 VC471046 C D D D D 4 C C P Section 4 7 | 4 2 | 1 P VC034559 15. How hard did you try on this test compared to how hard you tried on most other tests you have taken this year in school? | | 7 4 2 1 P 7 4 | 2 1 P | | 7 4 2 1 | A Not as hard as on other tests B About as hard as on other tests C Harder than on other tests D Much harder than on other tests VB595184 16. How important was it to you to do well on this test? A Not very important B Somewhat important C Important D Very important P 7 | 4 2 | 1 P G3HB1 Page 6 | | STOP 7 4 2 1 291 | P 7 4 | 2 1 P | | 7 4 2 1 | | 51 C C Appendix F-1ag: 2012 Operational Grade 12 Economics 292 P 7 4 2 1 | | 7 2 1 Section 4 This section has 14 questions. Mark your answers in your booklet. Fill in only one oval for each question except where instructed otherwise. P 4 4 SECTION | | VB595239 1. Which economics-related courses have you taken from ninth grade to the present? Count each course only once. Include courses you are currently taking as well as courses taken in summer school. Fill in one or more ovals on each line. P Not taken Taken/taking in Grade 12 Taken in Grade 11 Taken in Grade 10 Taken in Grade 9 a. Economics course (general course other than Advanced Placement, International Baccalaureate®, or honors economics) A B C D E VB595240 b. Government and economics course (combined course) A B C D E VB595241 c. Consumer economics or personal finance course A B C D E VB595662 d. Advanced Placement Economics course A B C D E VB595663 e. International Baccalaureate Economics course A B C D E VB595664 f. Honors economics course (other than Advanced Placement or International Baccalaureate Economics) A B C D E VB595665 g. Business course such as entrepreneurship or business principles A B C D E VB595666 h. Any other economics course (specify) A B C D E VB595667 i. Any other course that includes an extended (at least 8-week long) unit on economics (specify) A B C D E VB595668 7 4 2 1 | | P 7 4 2 1 | | | I-H3EB1 33 Page 1 GO ON TO THE NEXT PAGE 293 P Section 4 7 | | | VB595669 2. Which of the following statements best describes your overall course-taking in economics? | A I have taken at least one of the courses listed in Question 1. ➔ Go to Question 3. 4 2 1 P 7 4 2 1 B I have not taken any of the courses listed in Question 1. ➔ Skip to Question 7. VC099117 3. For the course(s) you marked “Taken/taking in Grade 12” in Question 1, which of the following is true for you? Fill in all ovals that apply. A I am not taking any of these courses in grade 12. B I am currently enrolled in a year-long course. C I completed a semester-long course this school year. D I just started a semester-long course. VB595670 4. Think about the courses in Question 1. How much do you agree or disagree with the following statements about those courses that you took? Fill in one oval on each line. Strongly disagree Somewhat Somewhat disagree agree Strongly agree a. Taking the course(s) helped me understand the U.S. economy. A B C D VB595671 b. Taking the course(s) helped me understand the international economy. A B C D VB595672 c. Taking the course(s) helped me understand what I hear on the news about current events and public policy. A B C D VB595673 d. Taking the course(s) helped me understand how to manage my personal finances, now and in the future. A B C D VB595674 e. Taking the course(s) helped me make choices about my future education and career. A B C D VB595675 P 7 | | | | I-H3EB1 Page 2 GO ON TO THE NEXT PAGE 4 2 1 P 7 4 2 294 | 1 P 7 4 2 1 Section | | P VB595676 7 5. In your current or most recent course that included economics, how often are you or were you asked to write long answers to questions or assignments? 4 2 1 | | 4 VE464378 6. In your current or most recent course that included economics, how often do you or did you use the Internet to get economic data or information? Include both class work and homework. A Never A Never or hardly ever B Once or twice a year B Once every few weeks C Once or twice a month C About once a week D At least once a week D Two or three times a week E Every day P 7 4 2 1 | | P 7 4 2 1 | | | I-H3EB1 35 Page 3 GO ON TO THE NEXT PAGE 295 P Section 4 7 | | 7. Not including things you do for school, how often do you watch, read about, or listen to information on the following topics? Fill in one oval on each line. A few times a year Once or twice a month At least once a week a. The local economy (unemployment in your area, job opportunities, prices of goods and services, taxes, public budgets, etc.) A B C D VB595680 b. The U.S. economy (unemployment, inflation, economic growth, national economic policy, interest rates, the stock market, etc.) A B C D VB595681 c. The international economy (the state of economies in other countries, trade agreements and restrictions, globalization, etc.) A B C D VB595962 d. Personal finance (saving, investment, taxes, credit cards, etc.) A B C D VB595963 2 1 P VB595679 Never or hardly ever 4 | | 7 4 2 1 VB595964 8. To what extent do you use the following sources to learn about economic issues? Fill in one oval on each line. Not at all Small extent Moderate extent Large extent a. Newspapers and magazines A B C D VB595965 b. Radio and television A B C D VB595966 c. Internet A B C D VB595967 d. Family and friends A B C D VB595968 e. Personal experiences (such as having a job or keeping a budget) A B C D VB595969 P 7 | | 4 2 1 P I-H3EB1 Page 4 GO ON TO THE NEXT PAGE 296 | | 7 | 1 4 2 P 7 4 2 1 P 7 Section | | | | 4 4 VB595971 9. Since the beginning of ninth grade, have you ever participated in any of the following economics-related activities? Fill in one or more ovals on each line. 2 Yes, did this for a class Yes, did this, but not for a class No, never did this a. Future Business Leaders of America (FBLA) A B C VB595972 b. DECA (an association of marketing students) A B C VB595973 c. Junior Achievement A B C VB595974 d. Club (includes such things as an economics, entrepreneurship, or investment club) A B C VB595975 e. Academic competition (includes such things as Fed Challenge, Economics Challenge, or Academic Decathlon) A B C VB595976 f. Stock market game/simulation A B C VB595979 g. Student-managed school store A B C VB595980 h. Student-managed credit union or bank A B C VB595981 i. Other (specify) A B C VB607182 1 P 7 4 2 1 P 7 | | | | 4 I-H3EB1 2 1 | 37 Page 5 GO ON TO THE NEXT PAGE 297 P Section 4 7 VB607183 VB595182 10. Last summer, how much did you work? Include work you did for pay or for a family business. 12. How hard was this test compared to most other tests you have taken this year in school? A Did not work at all A Easier than other tests B Worked once in awhile or less than B About as hard as other tests | | 4 | P 2 1 7 4 | 2 1 5 hours a week C Harder than other tests C Worked between 5 and 10 hours a week D Much harder than other tests D Worked between 11 and 20 hours a week VC034559 13. How hard did you try on this test compared to how hard you tried on most other tests you have taken this year in school? E Worked more than 20 hours a week VB607184 11. Currently, how much do you work? Include work you do for pay or for a family business. A Not as hard as on other tests B About as hard as on other tests A Do not work at all C Harder than on other tests B Work once in awhile or less than D Much harder than on other tests 5 hours a week C Work between 5 and 10 hours a VB595184 14. How important was it to you to do well on this test? week D Work between 11 and 20 hours a A Not very important week B Somewhat important E Work more than 20 hours a week C Important D Very important P 7 I-H3EB1 Page 6 | | 4 | P 2 1 7 4 STOP 298 | | 2 1 Appendix F-1ah: 2018 Operational Grade 8 TEL 299 VE401779 1. How important was it to you to do well on this test? A Not very important B Somewhat important C Important D Very important VH694016 2. How easy or difficult was this test? A Extremely difficult B Quite difficult C Somewhat difficult D Somewhat easy E Quite easy F Extremely easy VH694055 3. How much effort did you apply to succeed on this test? A No effort at all B Very little effort C Some effort D Quite a bit of effort E A lot of effort 300 VH694119 4. How challenging was taking this test? A Not challenging at all B A little challenging C Somewhat challenging D Quite challenging E Extremely challenging VH694150 5. How much time pressure did you feel when taking this test? A No time pressure at all B A little bit of time pressure C Some time pressure D Quite a bit of time pressure E A lot of time pressure VE631435 6. Are you Hispanic or Latino? Select one or more squares. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. 301 VE631437 7. Which of the following best describes you? Select one or more squares. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander VE011083 8. About how many books are there in your home? A Few (0–10) B Enough to fill one shelf (11–25) C Enough to fill one bookcase (26–100) D Enough to fill several bookcases (more than 100) VH694177 9. Do you have any of the following in your home? Select one circle in each row. a. b. c. d. e. Access to the Internet Clothes dryer just for your family Dishwasher Your own bedroom A desktop or laptop computer (including Chromebooks) that you can use f. A tablet (for example, Surface Pro, iPad, Kindle Fire) that you can use g. A smartphone (for example, iPhone, Samsung Galaxy, HTC One) that you can use Yes No A B VH694206 A B VH694365 A B VH694389 A B VH694394 A B VH694398 A B VH694400 A B VH694403 302 VH694410 10. How often do you use the Internet for homework at home? A Never B About once or twice a month C About once or twice a week D Almost every day E Every day VE011111 11. How many days were you absent from school in the last month? A None B 1 or 2 days C 3 or 4 days D 5 to 10 days E More than 10 days VE011109 12. How often do you talk about things you have studied in school with someone in your family? A Never or hardly ever B Once every few weeks C About once a week D Two or three times a week E Every day 303 VH195634 13. How far in school did your mother go? A She did not finish high school. B She graduated from high school. C She had some education after high school. D She graduated from college. E I don’t know. VH195637 14. How far in school did your father go? A He did not finish high school. B He graduated from high school. C He had some education after high school. D He graduated from college. E I don’t know. VH694420 15. Does your mother work? A Yes B No C I don’t know. VH694425 16. Does your father work? A Yes B No C I don’t know. 304 VH694437 17. Do any of the following people live in your home? Select one circle in each row. a. Mother b. Stepmother c. Foster mother or other female legal guardian d. Father e. Stepfather f. Foster father or other male legal guardian Yes No A B VH694455 A B VH694458 A B VH694461 A B VH694466 A B VH694472 A B VH694478 VH694534 18. In this school year, how often did you use a laptop or desktop computer (including Chromebooks) during your classes at school? A Never B In some classes C In about half of the classes D In more than half of the classes E In all or almost all classes VH694537 19. In this school year, how often did you use a tablet (for example, Surface Pro, iPad, Kindle Fire) during your classes at school? A Never B In some classes C In about half of the classes D In more than half of the classes E In all or almost all classes 305 VH694545 20. How much does each of the following statements describe a person like you? Select one circle in each row. a. I finish whatever I begin. b. I try very hard even after making mistakes. c. I keep working hard even when I feel like quitting. d. I keep trying to improve myself, even when it takes a long time to get there. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH694552 A B C D E VH694561 A B C D E VH694570 A B C D E VH694587 VH694595 21. In this school year, how often have you done each of the following? Select one circle in each row. a. I started working on assignments right away rather than waiting until the last minute. b. I paid attention and resisted distractions. c. I stayed on task without reminders from my teacher. d. I paid attention in class even when I was not interested. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH694624 A B C D E VH694634 A B C D E VH694641 A B C D E VH694646 306 VH694660 22. How much does each of the following statements describe a person like you? Select one circle in each row. a. I like complex problems more than easy problems. b. I like activities that challenge my thinking abilities. c. I enjoy situations where I will have to think about something. d. I enjoy thinking about new solutions to problems. Not at all like me A little bit like me Somewhat like me Quite a bit like me Very much like me A B C D E VH694671 A B C D E VH694681 A B C D E VH694686 A B C D E VH694696 VH694701 23. In this school year, how often have you felt any of the following ways about your school? Select one circle in each row. a. I felt awkward and out of place at school. b. I felt happy at school. c. I felt that I learned something that I can use in my daily life. Never or hardly ever Less than half of the time About half of the time More than half of the time All or almost all of the time A B C D E VH694711 A B C D E VH694715 A B C D E VH694718 VE117468 24. Write the ZIP code of your home address in the box. 307 Student Questionnaire – Technology and Engineering Literacy The following questions are about your views and experiences related to technology and engineering. Technology refers to all the things people make and do to their natural environment in order to get the things they want and need. Engineering refers to using skills or knowledge to solve problems that meet people’s wants and needs. Some questions ask for facts while other questions ask for your opinions. Read each question carefully, and pick the answer you think is best. 308 VE639842 25. Have you ever taken or are you currently taking any of the following classes or subjects in school? Select one or more squares. A Industrial technology (for example, auto mechanics, carpentry) B Engineering (for example, robotics, bridge building, rocketry) C Any class that involves learning to use, program, or build computers D Any other technology-related class (for example, electronics, sewing, farming) E I have not taken any of the classes listed above. VE639847 26. Have you ever studied technology or engineering topics in any of the following classes or subjects in school? Select one or more squares. A Mathematics B Science C Social studies or history D I have not studied technology or engineering in any of the classes or subjects listed above. VE681624 27. In school, how often do you learn about or discuss the following? Select one circle in each row. a. How to judge reliability of sources (for example, how a website might be biased or inaccurate) b. How to credit others for their ideas (for example, citing sources, using endnotes and footnotes in reports) Never Rarely Sometimes Often A B C D VE681629 A B C D VE681632 309 VE639123 28. For school work, how often do you use a computer or other digital technology for the following activities? Select one circle in each row. a. Create, edit, or organize digital media b. Create a presentation c. Create a spreadsheet (a table or grid that displays data into columns and rows and may be used to create charts and graphs) Never or almost never A few times a year Once or twice a month Once or twice a week Every day or almost every day A B C D E VE639130 A B C D E VE639137 A B C D E VE639136 VF025108 29. In this question, please think about activities you do that are not related to your school work. How often do you use a computer or other digital technology for the following activities not for school work? Select one circle in each row. a. Create, edit, or organize digital media b. Create a presentation c. Create a spreadsheet (a table or grid that displays data into columns and rows and may be used to create charts and graphs) Never or almost never A few times a year Once or twice a month Once or twice a week Every day or almost every day A B C D E VF025112 A B C D E VF025117 A B C D E VF025116 310 VE682225 30. In school, how often have you learned about or discussed the following? Select one circle in each row. a. Designing or creating something to solve a problem b. Designing something when there is limited time, money, or materials Never Rarely Sometimes Often A B C D VE682228 A B C D VE682229 VE638956 31. In school, how often have you ever done the following activities? Select one circle in each row. a. Used different tools, materials, or machines to see which are best for a given purpose b. Built or tested a model to see if it solves a problem c. Figured out why something is not working in order to fix it d. Taken something apart in order to fix it or see how it works Never Once or twice Three to five times More than five times A B C D VE638959 A B C D VE638963 A B C D VE682247 A B C D VE638965 311 VE638983 32. Outside of school, how often have you ever done the following activities? Select one circle in each row. a. Used tools or materials to plan or design something (for example, cake recipe, party) b. Used different tools, materials, or machines to see which are best for a given purpose c. Built or tested a model to see if it solves a problem d. Figured out why something is not working in order to fix it e. Taken something apart in order to fix it or see how it works Never Once or twice Three to five times More than five times A B C D VF009777 A B C D VE638998 A B C D VE639038 A B C D VE682267 A B C D VE639042 312 VH008232 33. Do you think that you would be able to do each of the following? Select one circle in each row. a. Create presentations with sound, pictures, or video b. Organize information into a chart, graph, or spreadsheet c. Compare products using the Internet d. Use tools or materials to fix something e. Take something apart in order to fix it or see how it works f. Describe how inventions change society g. Compare how different activities affect the environment h. Explain why people have different tools, machines, or devices in different parts of the world I definitely can’t I probably can’t Maybe I probably can I definitely can A B C D E VH008238 A B C D E VH008240 A B C D E VH008241 A B C D E VH008243 A B C D E VH008244 A B C D E VH008245 A B C D E VH008247 A B C D E VH008248 313 VE638999 34. In school, how often have you learned about or discussed the following? Select one circle in each row. a. Inventions that change the way people live b. Choices people make that affect the environment c. Conditions that influence the use or availability of machines or devices d. The ways people work together to solve problems in their community or the world Never Rarely Sometimes Often A B C D VE639002 A B C D VE639004 A B C D VE639005 A B C D VE682300 VE639008 35. Outside of school, how often have you learned about or discussed the following? Select one circle in each row. a. Inventions that change the way people live b. Choices people make that affect the environment c. Conditions that influence the use or availability of machines or devices d. The ways people work together to solve problems in their community or the world Never Rarely Sometimes Often A B C D VE639012 A B C D VE639013 A B C D VE639014 A B C D VE682314 314 VE682274 36. Who taught you most of what you know about building things, fixing things, or how things work? A I taught myself. B Family members C Friends D Teachers E Someone else VE682215 37. Who taught you most of what you know about using computers or other digital technology for collecting or sharing information? A I taught myself. B Family members C Friends D Teachers E Someone else VE682315 38. Who taught you most of what you know about how technology, people, and the environment are related to each other? A I taught myself. B Family members C Friends D Teachers E Someone else 315 VF009358 39. Before today, had you ever taken an interactive computer test similar to the one you just took? Select one circle in each row. a. I had taken an interactive computer test in school. b. I had taken an interactive computer test outside of school. Yes No A B VF009360 A B VF009361 316 Appendix F-1ai: 2015 Operational Grade 4 NIES 317 SECTION 1 1 Section National Indian Education Study Grade 4 Student Questionnaire Some of the questions are about your American Indian or Alaska Native background. When you answer these questions, think about the American Indian tribe or Alaska Native group to which you and your family belong. You may call your tribe or group a nation, a village, a band, or a community. If you are connected to more than one American Indian tribe or Alaska Native group, answer for the one you know best. VC759180 1. How much do you know about your American Indian tribe or Alaska Native group? For example, you may know about the history, traditions, or arts and crafts of your tribe or group. A Nothing B A little C Some D A lot VH039733 2. Who taught you most of what you know about American Indian or Alaska Native history? A No one has taught me about American Indian or Alaska Native history. B Family members C Friends D Teachers E Tribal representatives or elders F Someone else (please specify): L1AIB Page 3 GO ON TO THE NEXT PAGE 318 Section 1 VH039760 3. Who taught you most of what you know about American Indian or Alaska Native traditions (ways of life, customs)? A No one has taught me about American Indian or Alaska Native traditions. B Family members C Friends D Teachers E Tribal representatives or elders F Someone else (please specify): VH040030 4. Who taught you most of what you know about American Indian or Alaska Native arts and crafts? A No one has taught me about American Indian or Alaska Native arts and crafts. B Family members C Friends D Teachers E Tribal representatives or elders F Someone else (please specify): VC759183 5. How often do you go to American Indian or Alaska Native ceremonies and gatherings? VC759193 6. How often do members of your family talk to each other in your American Indian or Alaska Native language? A Never A Never or hardly ever B Every few years B Once or twice a month C At least once a year C Once or twice a week D Several times a year D Every day or almost every day L1AIB Page 4 GO ON TO THE NEXT PAGE 319 1 Section VC759195 7. How often do people in your school talk to each other in your American Indian or Alaska Native language? A Never or hardly ever VH040050 9. How do you rate yourself in speaking an American Indian or Alaska Native language? A I cannot speak an American Indian or Alaska Native language. B Once or twice a month B I can speak a few words or phrases. C Once or twice a week C I can speak well. D Every day or almost every day VH040067 VH153907 8. How often do you attend classes in school that are taught in an American Indian or Alaska Native language? 10. How do you rate yourself in reading an American Indian or Alaska Native language? A I cannot read in an American A My school does not offer classes that are taught in an American Indian or Alaska Native language. B Never or hardly ever Indian or Alaska Native language. B I can read a few words or phrases. C I can read well. C Once or twice a month D Once or twice a week E Every day or almost every day VH040082 11. Who taught you most of what you know about an American Indian or Alaska Native language? A No one has taught me about an American Indian or Alaska Native language. B Family members C Friends D Teachers E Tribal representatives or elders F Someone else (please specify): L1AIB Page 5 GO ON TO THE NEXT PAGE 320 Section 1 VH158483 12. During 4th grade, have you attended school field trips to museums, traditional villages, or other places to learn about American Indian or Alaska Native people? VH153945 15. In school, do you have access to a library, media center, or resource center with books, videos, or other materials (including Internet resources) about American Indian or Alaska Native people? A Yes A Yes B No B No VH153935 13. During 4th grade, have you used books, videos, or other materials (including Internet resources) about American Indian or Alaska Native people in school? VH040212 16. When my teacher talks about American Indian or Alaska Native history or culture, I try to read more about it. A Yes, once or twice A This is not like me. B Yes, three or more times B This is a little like me. C No C This is a lot like me. VH153940 14. During 4th grade, have you used books, videos, or other materials (including Internet resources) about American Indian or Alaska Native people outside of school? VC759280 17. I enjoy reading about American Indian or Alaska Native people. A This is not like me. B This is a little like me. A Yes, once or twice C This is a lot like me. B Yes, three or more times C No VC759283 18. I enjoy reading about people who have different traditions and cultures (ways of life, customs) than I have. A This is not like me. B This is a little like me. C This is a lot like me. L1AIB Page 6 GO ON TO THE NEXT PAGE 321 1 Section VH040240 19. I put a lot of effort into my schoolwork. VH040391 23. If I put in enough effort, I will succeed in school. A This is not like me. A Strongly disagree B This is a little like me. B Disagree C This is a lot like me. C Agree VH040276 D Strongly agree 20. I want to be one of the best students in my class. VH040394 24. Trying hard in school will help me live a good life when I grow up. A This is not like me. B This is a little like me. A Strongly disagree C This is a lot like me. B Disagree VH040379 C Agree 21. I enjoy being challenged in my classes. D Strongly agree A This is not like me. B This is a little like me. VC759288 C This is a lot like me. VH040382 22. I feel that I belong at school. 25. How often does a parent or someone else from your family help you with your schoolwork? For example, they might help you to study for a test, help you with a school project, or go over your homework with you. A This is not like me. A Never or hardly ever B This is a little like me. B Once or twice a month C This is a lot like me. C Once or twice a week D Every day or almost every day L1AIB Page 7 GO ON TO THE NEXT PAGE 322 Section 1 VC759289 26. How often does a teacher or another adult from your school help you with your schoolwork? For example, they might help you to study for a test, help you with a school project, or go over your homework with you. VH040389 28. How often do you help other students from your school with their schoolwork? For example, you might help other students to study for a test, help them with a school project, or go over their homework with them. A Never or hardly ever A Never or hardly ever B Once or twice a month B Once or twice a month C Once or twice a week C Once or twice a week D Every day or almost every day D Every day or almost every day VC759290 27. How often does another student from your school help you with your schoolwork? For example, they might help you to study for a test, help you with a school project, or go over your homework with you. VC759293 29. How much do you like school? A Not at all B A little C Somewhat A Never or hardly ever D Very much B Once or twice a month C Once or twice a week VC759294 D Every day or almost every day 30. Do you know the name of the American Indian tribe or Alaska Native group you belong to or are enrolled in? A Yes B No C I’m not sure. L1AIB Page 8 GO ON TO THE NEXT PAGE 323 Section 1 VC759295 31. If you know the name of the American Indian tribe or Alaska Native group that you belong to or are enrolled in, or if you think you know it, please print it on the line below. Do not worry about spelling. If you belong to more than one American Indian tribe or Alaska Native group, write the names of as many as you know. VC759297 32. What else would you like to say about yourself, your school, or about American Indian or Alaska Native people? Use these lines to write your ideas. THANK YOU FOR YOUR HELP. YOUR IDEAS ARE IMPORTANT. L1AIB Page 9 STOP 324 Appendix F-1aj: 2015 Operational Grade 8 NIES 325 SECTION 1 1 Section National Indian Education Study Grade 8 Student Questionnaire Some of the questions are about your American Indian or Alaska Native background. When you answer these questions, think about the American Indian tribe or Alaska Native group to which you and your family belong. You may call your tribe or group a nation, a village, a band, or a community. If you are connected to more than one American Indian tribe or Alaska Native group, answer for the one you know best. VC996578 1. How much do you know about each of the following? Fill in one oval on each line. Nothing A little Some A lot a. Your American Indian or Alaska Native history A B C D b. Your American Indian or Alaska Native traditions and culture (way of life, customs) A c. Issues today that are important to American Indian or Alaska Native people A VC996581 B C D VC996582 B C D VC996583 VH039733 2. Who taught you most of what you know about American Indian or Alaska Native history? A No one has taught me about American Indian or Alaska Native history. B Family members C Friends D Teachers E Tribal representatives or elders F Someone else (please specify): L2AIB Page 3 GO ON TO THE NEXT PAGE 326 Section 1 VH039760 3. Who taught you most of what you know about American Indian or Alaska Native traditions (ways of life, customs)? A No one has taught me about American Indian or Alaska Native traditions. B Family members C Friends D Teachers E Tribal representatives or elders F Someone else (please specify): VH039931 4. Who taught you most of what you know about issues today that are important to American Indian or Alaska Native people? A No one has taught me about issues today that are important to American Indian or Alaska Native people. B Family members C Friends D Teachers E Tribal representatives or elders F Someone else (please specify): L2AIB Page 4 GO ON TO THE NEXT PAGE 327 1 Section VC996584 5. How often have you participated in each of the following? Fill in one oval on each line. Never Every few years At least once a year Several times a year a. Ceremonies and gatherings for people from your American Indian tribe or Alaska Native group A B C D VC996586 b. Ceremonies and gatherings that bring people together from many different American Indian tribes or Alaska Native groups A B C D VC996587 c. Other American Indian or Alaska Native activities A B C D VC996589 VC759193 6. How often do members of your family talk to each other in your American Indian or Alaska Native language? A Never or hardly ever B Once or twice a month C Once or twice a week D Every day or almost every day VC759195 7. How often do people in your school talk to each other in your American Indian or Alaska Native language? A Never or hardly ever B Once or twice a month C Once or twice a week D Every day or almost every day L2AIB Page 5 GO ON TO THE NEXT PAGE 328 Section 1 VH153907 8. How often do you attend classes in school that are taught in an American Indian or Alaska Native language? A My school does not offer classes that are taught in an American Indian or Alaska Native language. B Never or hardly ever C Once or twice a month D Once or twice a week E Every day or almost every day VH040050 9. How do you rate yourself in speaking an American Indian or Alaska Native language? A I cannot speak an American Indian or Alaska Native language. B I can speak a few words or phrases. C I can speak well. VH040067 10. How do you rate yourself in reading an American Indian or Alaska Native language? A I cannot read in an American Indian or Alaska Native language. B I can read a few words or phrases. C I can read well. L2AIB Page 6 GO ON TO THE NEXT PAGE 329 1 Section VH040082 11. Who taught you most of what you know about an American Indian or Alaska Native language? A No one has taught me about an American Indian or Alaska Native language. B Family members C Friends D Teachers E Tribal representatives or elders F Someone else (please specify): VC996590 12. During 8th grade, how often have any of your teachers talked to your class about the history, traditions, and cultures (ways of life, customs) of American Indian or Alaska Native people? A Never or hardly ever B Once or twice a month C Once or twice a week D Every day or almost every day L2AIB Page 7 GO ON TO THE NEXT PAGE 330 Section 1 VH158490 13. During 8th grade, have you attended any of the following activities organized by your school? Fill in one oval on each line. Yes No a. Presentations by American Indian or Alaska Native people about their traditions and cultures (ways of life, customs) A B VH158491 b. American Indian or Alaska Native art and craft demonstrations A B VH158492 c. Traditional American Indian or Alaska Native music and/or dance performances A B VH158493 d. Field trips to museums, traditional villages, or other places to learn about American Indian or Alaska Native people A B VH158494 VH040140 14. During 8th grade, have you participated in any of the following activities organized by your school? Fill in one oval on each line. Yes No a. Sports team A B VH040143 b. Music club, orchestra, or band A B VH040147 c. Cultural dances or other American Indian or Alaska Native activities (for example, drum groups) A B VH040150 d. Academic club (for example, math club) A B VH040152 L2AIB Page 8 GO ON TO THE NEXT PAGE 331 Section 1 VH159106 15. During 8th grade, have you used books, videos, or other materials (including Internet resources) about American Indian or Alaska Native people in school? A Yes, once or twice B Yes, three or more times C No VH159110 16. During 8th grade, have you used books, videos, or other materials (including Internet resources) about American Indian or Alaska Native people outside of school? A Yes, once or twice B Yes, three or more times C No VH153945 17. In school, do you have access to a library, media center, or resource center with books, videos, or other materials (including Internet resources) about American Indian or Alaska Native people? A Yes B No VC996624 18. Here are some sentences about reading. Fill in one oval on each line to show whether the sentence describes a person like you. This is not like me. This is a little like me. This is a lot like me. a. When my teacher talks about American Indian or Alaska Native history or culture, I try to read more about it. A B C VH043704 b. I enjoy reading about American Indian or Alaska Native people. A B C VC996627 c. I enjoy reading about people who have different traditions and cultures (ways of life, customs) than I have. A B C VC996628 L2AIB Page 9 GO ON TO THE NEXT PAGE 332 Section 1 VH040130 19. Here are some sentences about your school. Fill in one oval on each line to show whether the sentence describes a person like you. This is not like me. This is a little like me. This is a lot like me. a. I put a lot of effort into my schoolwork. A B C VH040131 b. I want to be one of the best students in my class. A B C VH040134 c. I enjoy being challenged in my classes. A B C VH040137 d. I feel that I belong at school. A B C VH040138 VH040157 20. How much do you agree with each of the following statements? Fill in one oval on each line. Strongly disagree Disagree Agree Strongly agree a. If I put in enough effort, I will succeed in school. A B C D VH040158 b. If I put in enough effort in school, I will get into college. A B C D VH040160 c. If I put in enough effort in school, I will get a good job. A B C D VH040161 VC759293 21. How much do you like school? A Not at all B A little C Somewhat D Very much L2AIB Page 10 GO ON TO THE NEXT PAGE 333 Section 1 VC996661 22. How much are the things you are learning in school preparing you for the life you want to lead? A Not at all B A little C A fair amount D Very much VC996641 23. During 8th grade, how often have you talked with any of your teachers outside of regular class periods? For example, to get extra help with your assignments, to talk about issues that matter to you, or just to visit. A Never or hardly ever B Once or twice a month C Once or twice a week D Every day or almost every day VH040389 24. How often do you help other students from your school with their schoolwork? For example, you might help other students to study for a test, help them with a school project, or go over their homework with them. A Never or hardly ever B Once or twice a month C Once or twice a week D Every day or almost every day L2AIB Page 11 GO ON TO THE NEXT PAGE 334 Section 1 VC996635 25. How often do any of the following people help you with your schoolwork? For example, they might help you to study for a test, help you with a school project, or go over your homework with you. Fill in one oval on each line. Never or hardly ever Once or twice a month Once or twice a week Every day or almost every day a. A parent or someone else from my family A B C D VC996636 b. A teacher or another adult from my school A B C D VC996637 c. Another student A B C D VC996639 d. A tribal representative or elder A B C D VH018268 VC996644 26. During 8th grade, how many times have you talked to each of the following people about the classes you should take in high school or about what you want to do after high school? Fill in one oval on each line. Never One time Two or three times a. A family member A B C D VC996645 b. A teacher A B C D VC996646 c. A school counselor A B C D VC996647 d. Another student A B C D VC996648 e. A tribal representative or elder A B C D VH026209 f. Someone else who lives in my community or is a friend of my family A B C D VH026211 L2AIB Page 12 Four or more times GO ON TO THE NEXT PAGE 335 Section 1 VC996650 27. Which of the following would you plan to do in your first year after high school? Fill in as many ovals as apply. a. Go to college full time A VC996651 b. Go to college part time B VC996652 c. Go to another school (for example, career training, technical, or trade/vocational) full time C VC996653 d. Go to another school (for example, career training, technical, or trade/vocational) part time D VC996654 e. Join the military E VC996655 f. Work full time F VC996656 g. Work part time G VC996657 h. Travel H VC996658 i. Care for family I VC996659 j. I don’t know. J VC996660 VH040216 28. To what extent is each of the following a problem in your school? Fill in one oval on each line. Not at all Small extent Moderate extent Large extent a. Student tardiness A B C D VH040217 b. Student health problems A B C D VH040219 c. Student misbehavior in class A B C D VH040221 d. Physical conflicts among students A B C D VH040223 e. Bullying A B C D VH040226 f. Low student motivation A B C D VH040227 L2AIB Page 13 GO ON TO THE NEXT PAGE 336 Section 1 VC759294 29. Do you know the name of the American Indian tribe or Alaska Native group you belong to or are enrolled in? A Yes B No C I’m not sure. VC759295 30. If you know the name of the American Indian tribe or Alaska Native group that you belong to or are enrolled in, or if you think you know it, please print it on the line below. Do not worry about spelling. If you belong to more than one American Indian tribe or Alaska Native group, write the names of as many as you know. VC759297 31. What else would you like to say about yourself, your school, or about American Indian or Alaska Native people? Use these lines to write your ideas. THANK YOU FOR YOUR HELP. YOUR IDEAS ARE IMPORTANT. L2AIB Page 14 STOP 337 Appendix F-1ak: 2017 Operational Grade 4 CAFS 338 VH270138 1. At home, do you have any of the following? Select one answer choice on each row. Yes No A B VH270141 A B VH270142 A B VH270139 A B VH270140 A B VH270143 A B VH270144 a. A laptop or desktop computer that is only for your use b. A laptop or desktop computer that is shared between you and others c. A tablet that is only for your use d. A tablet that is shared between you and others e. Wi-Fi or some other Internet connection you can use f. A smartphone that is only for your use VH270100 2. When did you first use a laptop or desktop computer? A I have never used one. B Before I was in kindergarten C When I was in kindergarten D When I was in first, second, or third grade E When I was in fourth grade VH270092 3. When did you first use a tablet? A Never until this assessment B Before I was in kindergarten C When I was in kindergarten D When I was in first, second, or third grade E When I was in fourth grade 339 VH270101 4. When did you first use a smartphone? A I have never used one. B Before I was in kindergarten C When I was in kindergarten D When I was in first, second, or third grade E When I was in fourth grade VH270147 5. On a weekday, about how many hours do you use a laptop or desktop computer for doing schoolwork, including homework? A None B Less than an hour C 1 to 2 hours D 2 to 3 hours E 3 to 4 hours F More than 4 hours VH270148 6. On a weekday, about how many hours do you use a tablet for doing schoolwork, including homework? A None B Less than an hour C 1 to 2 hours D 2 to 3 hours E 3 to 4 hours F More than 4 hours 340 VH597657 7. Were you taught any of the following at school? Select one answer choice on each row. a. How to type on a computer keyboard using the correct fingers b. How to write sentences and paragraphs using a computer c. How to edit text using a computer d. How to search for information on the Internet e. How to use a tablet f. How to look up the meaning of a word using a computer Yes No A B VH270150 A B VH270151 A B VH270164 A B VH270152 A B VH270156 A B VH270157 VH270165 8. Which of the following are true about the ways in which you and your teachers use computers at school? Select one answer choice on each row. a. In most of my classes there are laptop or desktop computers that I can use for schoolwork. b. In most of my classes there are tablets that I can use for schoolwork. c. There is Wi-Fi or some other Internet connection that I can use for schoolwork. d. Most of my teachers use computers when teaching my classes. e. Most of my teachers require us to use computers in the classroom. Yes No A B VH270166 A B VH270167 A B VH270170 A B VH270169 A B VH270168 VH270116 9. Has your school assigned you a laptop or desktop computer that only you can use? A No B Yes, but I cannot take it home with me. C Yes, and I can take it home with me (laptop only). 341 VH270117 10. Has your school assigned you a tablet that only you can use? A No B Yes, but I cannot take it home with me. C Yes, and I can take it home with me. 11. This school year, how often have you used a laptop or desktop computer to do each of the following? Select one answer choice on each row. Never a. Write a short paper (less than a page) for school b. Write a paper for school that was longer than a page c. Search the Internet for a school project d. Practice things in mathematics that you were having trouble learning e. Practice things in reading that you were having trouble learning f. Take a test every A few times Once few weeks VH597710 About once More than a week once a week A B C D E VH270172 A B C D E VH270173 A B C D E VH270174 A B C D E VH270181 A B C D E VH270177 A B C D E VH270175 342 VH597752 12. This school year, how often have you used a tablet to do each of the following? Select one answer choice on each row. Never a. Write a short paper (less than a page) for school b. Write a paper for school that was longer than a page c. Search the Internet for a school project d. Practice things in mathematics that you were having trouble learning e. Practice things in reading that you were having trouble learning f. Take a test every A few times Once few weeks About once More than a week once a week A B C D E VH270183 A B C D E VH270188 A B C D E VH270184 A B C D E VH270185 A B C D E VH270186 A B C D E VH270192 VH270130 13. Which best describes the way you type on a computer keyboard? A I don’t know how to type using a computer keyboard. B I can type with one or two fingers, but I have to search for where the letter keys are. C I can type with one or two fingers, and I know where most of the letter keys are. D I can type with all ten fingers when I look at the keyboard. E I can type with all ten fingers without looking at the keyboard. VH270132 14. Would you rather take a test at school using paper and pencil or using a computer? A Paper and pencil B Computer 343 VH597769 15. Do you think you would be able to do each of the following? Select one answer choice on each row. a. Write sentences and paragraphs using a computer b. Edit text using a computer c. Use a touchscreen on a computer, tablet, or smartphone d. Look up the meaning of a word using a computer e. Draw a picture using a computer I definitely can’t. I probably can’t. I probably can. I definitely can. A B C D VH270229 A B C D VH270218 A B C D VH270230 A B C D VH270225 A B C D VH270226 344 VH597794 16. How familiar are you with each of the following? Select one answer choice on each row. Never heard of Heard of it it once or twice a. b. c. d. e. f. g. h. i. j. k. Wi-Fi Firewall Neuro-digital computing Instant messaging Cut and paste Pyramidal browser Spreadsheet Limbic wire Spinalbyte Server Callosum board Heard of it often Know it well, understand the concept A B C D VH270196 A B C D VH270197 A B C D VH270199 A B C D VH270200 A B C D VH270203 A B C D VH270204 A B C D VH270206 A B C D VH270207 A B C D VH270208 A B C D VH270210 A B C D VH270214 345 Appendix F-1al: 2017 Operational Grade 8 CAFS 346 VH270138 1. At home, do you have any of the following? Select one answer choice on each row. Yes No A B VH270141 A B VH270142 A B VH270139 A B VH270140 A B VH270143 A B VH270144 a. A laptop or desktop computer that is only for your use b. A laptop or desktop computer that is shared between you and others c. A tablet that is only for your use d. A tablet that is shared between you and others e. Wi-Fi or some other Internet connection you can use f. A smartphone that is only for your use VH270145 2. When did you first use a laptop or desktop computer? A I have never used one. B Before I was in kindergarten C When I was in kindergarten D When I was in first, second, or third grade E When I was in fourth or fifth grade F When I was in sixth, seventh, or eighth grade VH270090 3. When did you first use a tablet? A Never until this assessment B Before I was in kindergarten C When I was in kindergarten D When I was in first, second, or third grade E When I was in fourth or fifth grade F When I was in sixth, seventh, or eighth grade 347 VH270146 4. When did you first use a smartphone? A I have never used one. B Before I was in kindergarten C When I was in kindergarten D When I was in first, second, or third grade E When I was in fourth or fifth grade F When I was in sixth, seventh, or eighth grade VH270147 5. On a weekday, about how many hours do you use a laptop or desktop computer for doing schoolwork, including homework? A None B Less than an hour C 1 to 2 hours D 2 to 3 hours E 3 to 4 hours F More than 4 hours VH270148 6. On a weekday, about how many hours do you use a tablet for doing schoolwork, including homework? A None B Less than an hour C 1 to 2 hours D 2 to 3 hours E 3 to 4 hours F More than 4 hours 348 VH270149 7. Were you taught any of the following at school? Select one answer choice on each row. a. How to type on a computer keyboard using the correct fingers b. How to write sentences and paragraphs using a computer c. How to edit text using a computer d. How to search for information on the Internet e. How to use a tablet f. How to look up the meaning of a word using a computer g. How to create a spreadsheet using a computer h. How to create a presentation using a computer i. How to run simulations using a computer j. How to write a computer program or app k. How to create a graph or chart using a computer l. How to troubleshoot problems with a computer Yes No A B VH270150 A B VH270151 A B VH270164 A B VH270152 A B VH270156 A B VH270157 A B VH270154 A B VH270155 A B VH270159 A B VH270160 A B VH270161 A B VH270158 349 VH270165 8. Which of the following are true about the ways in which you and your teachers use computers at school? Select one answer choice on each row. a. In most of my classes there are laptop or desktop computers that I can use for schoolwork. b. In most of my classes there are tablets that I can use for schoolwork. c. There is Wi-Fi or some other Internet connection that I can use for schoolwork. d. Most of my teachers use computers when teaching my classes. e. Most of my teachers require us to use computers in the classroom. Yes No A B VH270166 A B VH270167 A B VH270170 A B VH270169 A B VH270168 VH270116 9. Has your school assigned you a laptop or desktop computer that only you can use? A No B Yes, but I cannot take it home with me. C Yes, and I can take it home with me (laptop only). VH270117 10. Has your school assigned you a tablet that only you can use? A No B Yes, but I cannot take it home with me. C Yes, and I can take it home with me. 350 11. This school year, how often have you used a laptop or desktop computer to do each of the following? Select one answer choice on each row. Never a. Write a short paper (less than a page) for school b. Write a paper for school that was longer than a page c. Search the Internet for a school project d. Practice things in mathematics that you were having trouble learning e. Practice things in reading that you were having trouble learning f. Take a test g. Create a map h. Work on a website or blog that you maintain i. Create a multimedia presentation on your own j. Work collaboratively with a team of students to create a multimedia presentation every A few times Once few weeks VH270171 About once More than a week once a week A B C D E VH270172 A B C D E VH270173 A B C D E VH270174 A B C D E VH270181 A B C D E VH270177 A B C D E VH270175 A B C D E VH270178 A B C D E VH270179 A B C D E VH270180 A B C D E VH270176 351 VH270182 12. This school year, how often have you used a tablet to do each of the following? Select one answer choice on each row. Never a. Write a short paper (less than a page) for school b. Write a paper for school that was longer than a page c. Search the Internet for a school project d. Practice things in mathematics that you were having trouble learning e. Practice things in reading that you were having trouble learning f. Take a test g. Create a map h. Work on a website or blog that you maintain i. Create a multimedia presentation on your own j. Work collaboratively with a team of students to create a multimedia presentation every A few times Once few weeks About once More than a week once a week A B C D E VH270183 A B C D E VH270188 A B C D E VH270184 A B C D E VH270185 A B C D E VH270186 A B C D E VH270192 A B C D E VH270189 A B C D E VH270190 A B C D E VH270191 A B C D E VH270187 VH270130 13. Which best describes the way you type on a computer keyboard? A I don’t know how to type using a computer keyboard. B I can type with one or two fingers, but I have to search for where the letter keys are. C I can type with one or two fingers, and I know where most of the letter keys are. D I can type with all ten fingers when I look at the keyboard. E I can type with all ten fingers without looking at the keyboard. 352 VH270132 14. Would you rather take a test at school using paper and pencil or using a computer? A Paper and pencil B Computer 353 VH270215 15.. Do you think you would be able to do each of the following? Select one answer choice on each row. a. Write sentences and paragraphs using a computer b. Edit text using a computer c. Use a touchscreen on a computer, tablet, or smartphone d. Look up the meaning of a word using a computer e. Draw a picture using a computer f. View or download digital media g. Create a presentation using a computer h. Create a spreadsheet using a computer i. Install new software or apps j. Participate in online discussions, forums, social networking sites, or virtual communities k. Maintain a website or blog l. Search for information on the Internet m. Run simulations using a computer n. Create a graph or chart using a computer o. Write a computer program or app p. Troubleshoot a problem with a computer q. Figure out how to use new functions of a digital device that I am not yet familiar with I definitely can’t. I probably can’t. I probably can. I definitely can. A B C D VH270229 A B C D VH270218 A B C D VH270230 A B C D VH270225 A B C D VH270226 A B C D VH270216 A B C D VH270228 A B C D VH270231 A B C D VH270219 A B C D VH270220 A B C D VH270221 A B C D VH270222 A B C D VH270223 A B C D VH270224 A B C D VH270227 A B C D VH270232 A B C D VH270217 354 VH270233 16. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices are you? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 355 VH270236 17. Please read the descriptions of the following four eighth-grade students. After you read each description, you will be asked to answer a question about each student based on the information provided. Linda often uses apps to talk to her friends or to play games. She does some of her homework on her laptop and knows how to write and create tables using a computer. Linda cannot type with 10 fingers but is pretty fast with two fingers and mostly finds the right keys. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices do you think Linda is? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 356 VH270237 18. Tom often uses apps to talk to his friends or to play games. He does most of his homework on a computer and knows how to write and edit papers on a computer and how to create complex tables or charts. He also created a few presentations using a computer. Tom can type pretty accurately using ten fingers when looking at the computer keyboard. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices do you think Tom is? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 357 VH270238 19. Susan often uses apps on a smartphone or tablet and does most of her homework on a laptop. She is good at writing and editing papers on her computer and has experience with creating complex tables and charts. Susan can type fast and accurately with 10 fingers without looking at the computer keyboard. She also knows a couple of programming languages. This school year, she built her first app. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices do you think Susan is? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 358 VH270239 20. Kevin sometimes plays games on his smartphone or a computer, but he usually does not use a computer for his homework. He used a computer a couple of times to write a paper but never used a computer to create tables, charts, or presentations. Kevin can type with one or two fingers but has to search to find the correct keys on the computer keyboard. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices do you think Kevin is? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 359 VH270194 21. How familiar are you with each of the following? Select one answer choice on each row. Never heard of Heard of it it once or twice a. E-reader b. Wi-Fi c. Firewall d. Hyperlink e. Neuro-digital computing f. Instant messaging g. CPU h. Cut and paste i. Pyramidal browser j. Spreadsheet k. Limbic wire l. Spinalbyte m. Cloud computing n. Server o. Compiler p. Callosum board Heard of it often Know it well, understand the concept A B C D VH270195 A B C D VH270196 A B C D VH270197 A B C D VH270198 A B C D VH270199 A B C D VH270200 A B C D VH270201 A B C D VH270203 A B C D VH270204 A B C D VH270206 A B C D VH270207 A B C D VH270208 A B C D VH270209 A B C D VH270210 A B C D VH270212 A B C D VH270214 360 Appendix F-1am: 2015 Operational Grade 12 CAFS 361 SECTION 5 Section 5 This section has 23 questions. Mark your answers in your booklet. Fill in only one oval for each question. VH155319 1. How much do you know about using computers and other digital devices? A I hardly know anything at all. B I know something. C I know quite a bit. D I know a lot. VH155275 2. At home, do you have any of the following? Fill in one oval on each line. Yes No a. A laptop or desktop computer that is only for your use A B VH155283 b. A laptop or desktop computer that is shared between you and others A B VH155284 c. A tablet that is only for your use A B VH155280 d. A tablet that is shared between you and others A B VH155281 e. Wi-Fi or some other Internet connection you can use A B VH155285 f. A smartphone that is only for your use A B VH155287 L3NVXB1 Page 1 GO ON TO THE NEXT PAGE 362 Section 5 VH155339 3. When did you first use a laptop or desktop computer? VH155351 5. When did you first use a smartphone? A I have never used one. A I have never used one. B Before I was in kindergarten B Before I was in kindergarten C When I was in kindergarten C When I was in kindergarten D When I was in first, second, or D When I was in first, second, or third grade third grade E When I was in fourth or fifth grade E When I was in fourth or fifth grade F When I was in sixth, seventh, or F When I was in sixth, seventh, or eighth grade eighth grade G When I was in high school G When I was in high school VH155345 4. When did you first use a tablet? A I have never used one. B Before I was in kindergarten C When I was in kindergarten D When I was in first, second, or third grade E When I was in fourth or fifth grade F When I was in sixth, seventh, or eighth grade G When I was in high school L3NVXB1 Page 2 GO ON TO THE NEXT PAGE 363 Section VH155330 6. On a weekday, about how many hours do you use a laptop or desktop computer for doing schoolwork, including homework? 5 VH155332 7. On a weekday, about how many hours do you use a tablet for doing schoolwork, including homework? A None A None B Less than an hour B Less than an hour C 1 to 2 hours C 1 to 2 hours D 2 to 3 hours D 2 to 3 hours E 3 to 4 hours E 3 to 4 hours F More than 4 hours F More than 4 hours L3NVXB1 Page 3 GO ON TO THE NEXT PAGE 364 Section 5 VH155373 8. Were you taught any of the following at school? Fill in one oval on each line. Yes No a. How to type on a computer keyboard using the correct fingers A B VH155375 b. How to write sentences and paragraphs using a computer A B VH155376 c. How to edit text using a computer A B VH176918 d. How to search for information on the Internet A B VH155377 e. How to use a tablet A B VH155378 f. How to draw a picture using a computer A B g. How to look up the meaning of a word using a computer A B VH155380 h. How to create a spreadsheet using a computer A B VH155381 i. How to create a presentation using a computer A B VH155382 j. How to run simulations using a computer A B VH155384 k. How to write a computer program or app A B VH155385 l. How to create a graph or chart using a computer A B VH155386 m. How to maintain a website or blog A B VH155387 n. How to install new software or apps A B VH155388 o. How to troubleshoot problems with a computer A B VH155383 L3NVXB1 Page 4 VH155379 GO ON TO THE NEXT PAGE 365 5 Section VH155477 9. Which of the following are true about the ways in which you and your teachers use computers at school? Fill in one oval on each line. Yes No a. In most of my classes there are laptop or desktop computers that I can use for schoolwork. A B VH155479 b. In most of my classes there are tablets that I can use for schoolwork. A B VH155482 c. There is Wi-Fi or some other Internet connection that I can use for schoolwork. A B VH182383 d. Most of my teachers use computers when teaching my classes. A B VH155484 e. Most of my teachers require us to use computers in the classroom. A B VH155485 VH196393 10. Has your school assigned you a laptop or desktop computer that only you can use? VH196403 11. Has your school assigned you a tablet that only you can use? A No A No B Yes, but I cannot take it home B Yes, but I cannot take it home with me. with me. C Yes, and I can take it home C Yes, and I can take it home with me. with me (laptop only). L3NVXB1 Page 5 GO ON TO THE NEXT PAGE 366 Section 5 VH155495 12. This school year, how often have you used a laptop or desktop computer to do each of the following? Fill in one oval on each line. Never A few times Once every few weeks About once a week More than once a week a. Write a short paper (less than a page) for school A B C D E VH155496 b. Write a paper for school that was longer than a page A B C D E VH155497 c. Search the Internet for a school project A B C D E VH155498 d. Practice things in mathematics that you were having trouble learning A B C D E VH176943 e. Practice things in reading that you were having trouble learning A B C D E VH176945 f. Take a test A B C D E VH176946 g. Create a map A B C D E VH224684 h. Work on a website or blog that you maintain A B C D E VH224685 i. Create a multimedia presentation on your own A B C D E VH224686 j. Work collaboratively with a team of students to create a multimedia presentation A B C D E VH224690 L3NVXB1 Page 6 GO ON TO THE NEXT PAGE 367 Section 5 VH155524 13. This school year, how often have you used a tablet to do each of the following? Fill in one oval on each line. Never A few times Once every few weeks About once a week More than once a week a. Write a short paper (less than a page) for school A B C D E VH155525 b. Write a paper for school that was longer than a page A B C D E VH155528 c. Search the Internet for a school project A B C D E VH155527 d. Practice things in mathematics that you were having trouble learning A B C D E VH176938 e. Practice things in reading that you were having trouble learning A B C D E VH176925 f. Take a test A B C D E VH176927 g. Create a map A B C D E VH224714 h. Work on a website or blog that you maintain A B C D E VH224720 i. Create a multimedia presentation on your own A B C D E VH224722 j. Work collaboratively with a team of students to create a multimedia presentation A B C D E VH224725 L3NVXB1 Page 7 GO ON TO THE NEXT PAGE 368 Section 5 VH155541 14. Which best describes the way you type on a computer keyboard? VH155884 15. Compared to other students in your English/language arts class, how fast do you type on a computer keyboard? A I don’t know how to type using a computer keyboard. A I am slower than most students. B I can type with one or two fingers, but I have to search for where the letter keys are. B I type about the same speed as others. C I am faster than most students. C I can type with one or two fingers, and I know where most of the letter keys are. D I don’t know. D I can type with all ten fingers when I look at the keyboard. E I can type with all ten fingers VH176951 16. Would you rather take a test at school using paper and pencil or using a computer? without looking at the keyboard. A Paper and pencil B Computer L3NVXB1 Page 8 GO ON TO THE NEXT PAGE 369 Section 5 VH155799 17. Do you think you would be able to do each of the following? Fill in one oval on each line. I definitely I probably I probably I definitely can’t. can’t. can. can. a. Write sentences and paragraphs using a computer A B C D VH176967 b. Edit text using a computer A B C D VH155803 c. Use a touchscreen on a computer, tablet, or smartphone A B C D VH176970 d. Look up the meaning of a word using a computer A B C D VH155810 e. Draw a picture using a computer A B C D VH155811 f. A B C D VH155800 g. Create a presentation using a computer A B C D VH155820 h. Create a spreadsheet using a computer A B C D VH155802 i. Install new software or apps A B C D VH155804 j. Participate in online discussions, forums, social networking sites, or virtual communities A B C D VH155805 k. Maintain a website or blog A B C D VH155806 l. A B C D VH155807 m. Run simulations using a computer A B C D VH155808 n. Create a graph or chart using a computer A B C D VH155809 o. Write a computer program or app A B C D VH155812 p. Troubleshoot a problem with a computer A B C D VH196843 q. Figure out how to use new functions of a digital device that I am not yet familiar with A B C D VH224738 L3NVXB1 View or download digital media Search for information on the Internet Page 9 GO ON TO THE NEXT PAGE 370 Section 5 VH155876 18. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices are you? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 L3NVXB1 Page 10 GO ON TO THE NEXT PAGE 371 Section 5 VH155881 Please read the descriptions of the following four twelfth-grade students. After you read each description, you will be asked to answer a question about each student based on the information provided. VH155887 19. Linda often uses apps to talk to her friends or to play games. She does some of her homework on her laptop and knows how to write and create tables using a computer. Linda cannot type with 10 fingers but is pretty fast with two fingers and mostly finds the right keys. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices do you think Linda is? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 L3NVXB1 Page 11 GO ON TO THE NEXT PAGE 372 Section 5 VH155932 20. Tom often uses apps to talk to his friends or to play games. He does most of his homework on a computer and knows how to write and edit papers on a computer and how to create complex tables or charts. He also created a few presentations using a computer. Tom can type pretty accurately using ten fingers when looking at the computer keyboard. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices do you think Tom is? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 L3NVXB1 Page 12 GO ON TO THE NEXT PAGE 373 Section 5 VH155939 21. Susan often uses apps on a smartphone or tablet and does most of her homework on a laptop. She is good at writing and editing papers on her computer and has experience with creating complex tables and charts. Susan can type fast and accurately with 10 fingers without looking at the computer keyboard. She also knows a couple of programming languages. This school year, she built her first app. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices do you think Susan is? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 L3NVXB1 Page 13 GO ON TO THE NEXT PAGE 374 Section 5 VH155944 22. Kevin sometimes plays games on his smartphone or a computer, but he usually does not use a computer for his homework. He used a computer a couple of times to write a paper but never used a computer to create tables, charts, or presentations. Kevin can type with one or two fingers but has to search to find the correct keys on the computer keyboard. On a scale from 0 to 10, where 0 is not at all familiar and 10 is very familiar, how familiar with using computers and other digital devices do you think Kevin is? A 0 B 1 C 2 D 3 E 4 F 5 G 6 H 7 I 8 J 9 K 10 L3NVXB1 Page 14 GO ON TO THE NEXT PAGE 375 Section 5 VH155750 23. How familiar are you with each of the following? Fill in one oval on each line. Heard of Never it once or heard of it twice Know it well, Heard of understand it often the concept a. E-reader A B C D VH155751 b. Wi-Fi A B C D VH155752 c. Firewall A B C D VH155753 d. Hyperlink A B C D VH155756 e. Neuro-digital computing A B C D VH155757 f. A B C D VH155758 g. CPU A B C D VH155759 h. Track changes A B C D VH155760 i. Cut and paste A B C D VH155761 j. Pyramidal browser A B C D VH155762 k. Pivot table A B C D VH155763 l. Spreadsheet A B C D VH155765 m. Limbic wire A B C D VH155766 n. Spinalbyte A B C D VH155767 o. Cloud computing A B C D VH155768 p. Server A B C D VH155769 q. Root directory A B C D VH155770 r. Compiler A B C D VH155771 s. ASCII A B C D VH155772 t. Callosum board A B C D VH155779 L3NVXB1 Instant messaging Page 15 STOP 376 Appendix F-1an: 2018 Cognitive Interviews Grade 4 Household Composition 377 378 379 380 381 Appendix F-1ao: 2015 Student Grade 4 Core Student Grade 4 Core Questions The amount of time estimated to complete this form is 5 minutes. 382 P | 7 4 SECTION | 2 3 Section 3 1 P | 7 4 2 1 | In this section, please tell us about yourself and your family. Please answer questions about your home based on where you live most of the time during the school year. The section has 11 questions. Mark your answers in your booklet. Fill in only one oval for each question except where instructed otherwise. VB331330 1. Are you Hispanic or Latino? Fill in one or more ovals. VB331331 2. Which of the following best describes you? Fill in one or more ovals. A No, I am not Hispanic or Latino. A White B Yes, I am Mexican, Mexican B Black or African American American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander E Yes, I am from some other Hispanic or Latino background. P | 7 4 | 2 1 P | 7 J1D1 2 1 | | 41 Page 1 GO ON TO THE NEXT PAGE 383 C 4 C | Section 3 P 7 | 4 2 1 VB331335 3. About how many books are there in your home? A Few (0–10) B Enough to fill one shelf (11–25) C Enough to fill one bookcase (26–100) D Enough to fill several bookcases (more than 100) TB001101 TB001101 | 6. About how many pages a day do you 6. About how many pages a day do you have to read in school and for have to read in school and for homework? homework? P 7 4 | 2 1 A 5 or fewer 5 or fewer B 6–10 6–10 C 11–15 11–15 D 16–20 16–20 E More than 20 VB331336 4. Is there a computer at home that you use? More than 20 VB331339 VB331339 7. How often do you talk about things you 7. How often do you talk about things you have studied in school with someone in have studied in school with someone in your family? your family? A Yes B No A Never or hardly ever Never or hardly ever VF098664 5. Do you have the following in your home? Fill in ovals for all that apply. B Once every few weeks Once every few weeks C About once a week About once a week A Access to the Internet D Two or three times a week B Clothes dryer just for your family E Every day Two or three times a week Every day C Dishwasher D More than one bathroom E Your own bedroom VB331447 VB331447 8. How many days were you absent from 8. How many days were you absent from school in the last month? school in the last month? A None None B 1 or 2 days 1 or 2 days C 3 or 4 days 3 or 4 days D 5 to 10 days 5 to 10 days E More than 10 days More than 10 days | P 7 | 4 2 1 | P 7 J1D1 Page 2 4 GO ON TO THE NEXT PAGE GO ON TO THE NEXT PAGE | 2 1 384 | P | 7 4 Section | 3 2 1 VB331451 VB331451 P 7 4 2 1 | | 9. How often do people in your home talk 9. How often do people in your home talk to each other in a language other than to each other in a language other than English? English? VE102537 11. Write the ZIP code of your home address in the boxes. A A Never Never B in a while B Once Once in a while C half of the time C About About half of the time D or most of the time D All All or most of the time VF095730 VF095730 10. Do the following people live in your 10. Do the following people live in your home? Fill in ovals for all that apply. home? Fill in ovals for all that apply. A Mother A Mother B Stepmother B Stepmother C Foster mother or other female legal C Foster mother or other female legal guardian guardian D Father D Father E Stepfather E Stepfather F Foster father or other male legal F Foster father or other male legal guardian guardian P | 7 4 | 2 1 P 7 2 1 | | | J1D1 J1D1 43 Page 3 STOP 385 C 4 Appendix F-1ap: 2015 Student Grade 8 Core Student Grade 8 Core Questions The amount of time estimated to complete this form is 5 minutes. 386 P 7 SECTION 4 2 1 P 7 | | | | 4 2 1 3 Section 3 In this section, please tell us about yourself and your family. Please answer questions about your home based on where you live most of the time during the school year. The section has 13 questions. Mark your answers in your booklet. Fill in only one oval for each question except where instructed otherwise. VB331330 1. Are you Hispanic or Latino? Fill in one or more ovals. VB331331 2. Which of the following best describes you? Fill in one or more ovals. A No, I am not Hispanic or Latino. A White B Yes, I am Mexican, Mexican B Black or African American American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander E Yes, I am from some other Hispanic or Latino background. P 7 4 1 P 7 | | | | 4 J2D1 2 1 | 37 Page 1 GO ON TO THE NEXT PAGE 387 C 2 C P Section 3 7 4 | | VB331335 3. About how many books are there in your home? A Few (0–10) B Enough to fill one shelf (11–25) C Enough to fill one bookcase (26–100) D Enough to fill several bookcases (more than 100) 2 1 P TB001101 TB001101 6. About how many pages a day do you 6. About how many pages a day do you have to read in school and for have to read in school and for homework? homework? | 7 4 2 | 1 A 5 or fewer 5 or fewer B 6–10 6–10 C 11–15 11–15 D 16–20 16–20 E More than 20 VB331336 4. Is there a computer at home that you use? More than 20 VB331339 VB331339 7. How often do you talk about things you 7. How often do you talk about things you have studied in school with someone in have studied in school with someone in your family? your family? A Yes B No A Never or hardly ever Never or hardly ever VF098664 5. Do you have the following in your home? Fill in ovals for all that apply. B Once every few weeks Once every few weeks C About once a week About once a week A Access to the Internet D Two or three times a week B Clothes dryer just for your family E Every day Two or three times a week Every day C Dishwasher D More than one bathroom E Your own bedroom VB331447 VB331447 8. How many days were you absent from 8. How many days were you absent from school in the last month? school in the last month? A None None B 1 or 2 days 1 or 2 days C 3 or 4 days 3 or 4 days D 5 to 10 days 5 to 10 days E More than 10 days More than 10 days P 7 4 | | 2 1 P | J2D1 Page 2 7 4 GO ON TO THE NEXT PAGE GO ON TO THE NEXT PAGE 2 388 | | 1 P 7 Section 4 2 1 | | P 7 | VB330870 VB330870 9. How far in school did your mother go? 9. How far in school did your mother go? 4 2 A did not finish high school. A She She did not finish high school. | 1 B graduated from high school. B She She graduated from high school. C had some education after high C She She had some education after high school. school. 3 VF095730 12. Do the following people live in your home? Fill in ovals for all that apply. A Mother B Stepmother C Foster mother or other female legal guardian D graduated from college. D She She graduated from college. D Father E know. E II don’t don’t know. E Stepfather VB330871 VB330871 10. How far in school did your father go? 10. How far in school did your father go? F Foster father or other male legal guardian A did not finish high school. A He He did not finish high school. B graduated from high school. B He He graduated from high school. C had some education after high C He He had some education after high VE102537 13. Write the ZIP code of your home address in the boxes. school. school. D graduated from college. D He He graduated from college. E know. E II don’t don’t know. VB331451 VB331451 11. How often do people in your home talk 11. How often do people in your home talk to each other in a language other than to each other in a language other than English? English? A A Never Never B in a while B Once Once in a while C half of the time C About About half of the time D or most of the time D All All or most of the time P 7 4 2 1 | | P | 4 2 | J2D1 J2D1 | 39 1 Page 3 STOP 389 C 7 Appendix F-1aq: 2015 Student Grade 12 Core Student Grade 12 Core Questions The amount of time estimated to complete this form is 5 minutes. 390 P | 7 4 SECTION | 2 3 Section 3 1 P | 7 4 2 1 | In this section, please tell us about yourself and your family. Please answer questions about your home based on where you live most of the time during the school year. The section has 15 questions. Mark your answers in your booklet. Fill in only one oval for each question except where instructed otherwise. VB331330 1. Are you Hispanic or Latino? Fill in one or more ovals. VB331331 2. Which of the following best describes you? Fill in one or more ovals. A No, I am not Hispanic or Latino. A White B Yes, I am Mexican, Mexican B Black or African American American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander E Yes, I am from some other Hispanic or Latino background. P | 7 4 | 2 1 P | 7 J3D1 2 1 | | 41 Page 1 GO ON TO THE NEXT PAGE 391 C 4 C | Section 3 P 7 | 4 2 1 VB331335 3. About how many books are there in your home? A Few (0–10) B Enough to fill one shelf (11–25) C Enough to fill one bookcase (26–100) D Enough to fill several bookcases (more than 100) TB001101 TB001101 | 6. About how many pages a day do you 6. About how many pages a day do you have to read in school and for have to read in school and for homework? homework? P 7 4 | 2 1 A 5 or fewer 5 or fewer B 6–10 6–10 C 11–15 11–15 D 16–20 16–20 E More than 20 VB331336 4. Is there a computer at home that you use? More than 20 VB331339 VB331339 7. How often do you talk about things you 7. How often do you talk about things you have studied in school with someone in have studied in school with someone in your family? your family? A Yes B No A Never or hardly ever Never or hardly ever VF098664 5. Do you have the following in your home? Fill in ovals for all that apply. B Once every few weeks Once every few weeks C About once a week About once a week A Access to the Internet D Two or three times a week B Clothes dryer just for your family E Every day Two or three times a week Every day C Dishwasher D More than one bathroom E Your own bedroom VB331447 VB331447 8. How many days were you absent from 8. How many days were you absent from school in the last month? school in the last month? A None None B 1 or 2 days 1 or 2 days C 3 or 4 days 3 or 4 days D 5 to 10 days 5 to 10 days E More than 10 days More than 10 days | P 7 | 4 2 1 | P 7 J3D1 Page 2 4 GO ON TO THE NEXT PAGE GO ON TO THE NEXT PAGE | 2 1 392 | P | 7 4 Section | 3 2 1 VB330870 VB330870 P 9. How far in school did your mother go? 9. How far in school did your mother go? 7 4 2 1 A did not finish high school. A She She did not finish high school. B graduated from high school. B She She graduated from high school. C had some education after high C She She had some education after high | | school. school. VF095730 12. Do the following people live in your home? Fill in ovals for all that apply. A Mother B Stepmother C Foster mother or other female legal guardian D graduated from college. D She She graduated from college. E know. E II don’t don’t know. D Father E Stepfather VB330871 VB330871 10. How far in school did your father go? 10. How far in school did your father go? F Foster father or other male legal guardian A did not finish high school. A He He did not finish high school. B graduated from high school. B He He graduated from high school. C had some education after high C He He had some education after high school. school. D graduated from college. D He He graduated from college. E know. E II don’t don’t know. VB331451 VB331451 11. How often do people in your home talk 11. How often do people in your home talk to each other in a language other than to each other in a language other than English? English? A Never A Never B Once in a while B Once in a while C About half of the time C About half of the time D All or most of the time D All or most of the time P | 7 4 | 2 1 P 7 2 1 | | | J3D1 J3D1 43 Page 3 GO ON TO THE NEXT PAGE 393 C 4 C | Section 3 P 7 | 4 2 1 VF291224 13. During this school year, which of the following have you done? Fill in ovals for all that apply. A Taken the SAT or ACT College Entrance Exams HE002549 | 14. Which of the following best describes your high school program? P 7 | 4 2 A General 1 B Academic or college preparatory B Submitted the Free Application for Federal Student Aid (FAFSA) C Applied to a 2-year college C Vocational or technical VE102537 D Been accepted to a 2-year college 15. Write the ZIP code of your home address in the boxes. E Applied to a 4-year college F Been accepted to a 4-year college G Applied to a certificate or diploma program at a school that provides occupational training (such as electrician, beautician, mechanic, computer programmer, etc.) H Been accepted to a technical training program I Talked with a military recruiter J Enlisted in the military K Applied for a full-time job L Been interviewed for a full-time job M None of the above | P 7 | 4 2 1 | P 7 J3D1 Page 4 STOP | 4 2 1 394 | Appendix F-2: Teacher Questionnaires 395 Table F.b. Assessment years for the teacher survey questionnaires and appendix parts. Grade 4 Core (BET) Grade 8 Core (BET) Grade 8 Core (BETReading/Writing) Grade 8 Core (BETMathematics) 2019 2020 Appendix Survey Questionnaire Parts 2017 Operational Grade 4 Core F-2a (BET) F-2b 2018 Pilot Grade 4 Core (BET) X X 2018 Cognitive Interviews Grade 4 Core F-2c X X F-2d F-2e X X F-2f F-2g X X F-2h Grade 8 Core (BET-Science) Grade 8 Core (BET-Social Studies) X F-2i X Grade 4 Reading F-2j F-2k X F-2l Grade 8 Reading F-2m F-2n X F-2o Grade 4 Mathematics F-2p X X F-2q Source location within OMB# 18500928 v.8 or other source Appendix F-2a Appendix I-2c The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 2018 Cognitive Interviews Grade 8 The National Assessment of Core Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 2017 Operational Grade 8 Core (BET-Reading/ Writing) 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) Appendix F-2c 2017 Operational Grade 8 Core (BET-Mathematics) 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) Appendix F-2d 2018 Pilot Grade 8 Core (BETScience) 2018 Operational Grade 8 Core (BET-Social Studies) Appendix I-2d Appendix F-2g Appendix F-2g Appendix I-2b 2017 Operational Grade 4 Reading Appendix F-2h (COI) 2018 Cognitive Interviews Grade 4 The National Assessment of Reading Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) Appendix F-2g 2017 Operational Grade 8 Reading Appendix F-2i (COI) 2018 Cognitive Interviews Grade 8 The National Assessment of Reading Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 2017 Operational Grade 4 Appendix F-2j Mathematics (COI) 2018 Cognitive Interviews Grade 4 The National Assessment of Mathematics Educational Progress (NAEP) 2021 Items Pretesting; OMB# 1850-0803 v.219 396 Grade 8 Mathematics 2019 2020 Appendix Survey Questionnaire Source location within OMB# 1850Parts 0928 v.8 or other source 2017 Pilot Grade 8 Core, Reading, Appendix F-2g F-2r Mathematics (All subjects) X F-2t Appendix F-2k 2017 Operational Grade 8 Mathematics (COI) 2018 Cognitive Interviews Grade 8 The National Assessment of Educational Progress (NAEP) 2021 Items Pretesting; Mathematics OMB# 1850-0803 v.219 F-2s X Grade 4 Science X F-2u 2018 Pilot Grade 4 Science (COI) Appendix I-2f Grade 8 Science X F-2v 2018 Pilot Grade 8 Science (COI) Appendix I-2g 2017 Operational Grade 4 Writing (COI) 2017 Operational Grade 8 Writing (COI) 2018 Operational Grade 8 Social Studies (COI) 2012 Operational Grade 12 Economics-Department Head Appendix F-2p Grade 4 Writing Grade 8 Writing Grade 8 Social Studies Grade 12 Economics X F-2w X F-2x X F-2y X F-2z Appendix F-2q Appendix I-2i The National Assessment of Educational Progress Wave 2 Submittal for 2012 Volume II, Part 4, Economics Department Chair Questionnaire for 2012 Assessment Grade 4 NIES X F-2aa 2015 Operational Grade 4 NIES Appendix F-2s Grade 8 NIES X F-2ab 2015 Operational Grade 8 NIES Appendix F-2t X F-2ac 2019 Operational Grade 4 & 8 CAFS 2017 Operational Grade 4 & 8 Giving Back Items New material under consideration for pretesting Grade 4 & 8 CAFS Grade 4 & 8 Giving Back X X F-2ad Appendix F-2u 397 Appendix F-2a: 2017 Operational Grade 4 Core (BET) 398 VH240385 1. Are you Hispanic or Latino? Select all squares that apply. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240386 2. Which of the following best describes you? Select all squares that apply. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander VH240195 3. Excluding student teaching, how many years have you worked as an elementary or secondary teacher, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years 399 VH240196 4. Have you been awarded tenure by the school or district where you currently teach? A Yes B No C My school or district does not award tenure. VH240197 5. Do you hold a regular or standard certificate that is valid in the state in which you are currently teaching? A Yes, I hold a permanent certificate. B Yes, I hold a temporary certificate. (This type of certificate may require additional coursework, student teaching, etc.) C No, but I am currently working toward certification. D No, and I am not planning to obtain certification. VH240198 6. Did you enter teaching through an alternative route to certification program? (An alternative route to certification program is a program that was designed to expedite the transition of non-teachers to a teaching career, for example, a state, district, or university alternative route to certification program.) A Yes B No 400 VH240199 7. Are you certified by the National Board for Professional Teaching Standards in at least one content area? (The National Board for Professional Teaching Standards is a nongovernmental organization that administers National Board certification, a voluntary national assessment program that certifies teachers who meet high professional standards. In order to gain certification, the candidate must at least complete a portfolio of classroom practice and pass one or more tests of content knowledge.) A Yes, I am fully certified by the National Board for Professional Teaching Standards. B I am working towards my National Board certification. C No VH240200 8. What is the highest academic degree you hold? A High school diploma B Associate’s degree/vocational certification C Bachelor’s degree D Master’s degree E Education specialist’s or professional diploma based on at least one year’s work past master’s degree F Doctorate G Professional degree (e.g., M.D., LL.B., J.D., D.D.S.) 401 VH241753 9. Did you have a major, minor, or special emphasis in any of the following subjects as part of your undergraduate coursework? Select one circle in each row. a. Reading, language arts, or literacy education b. English c. Other language arts-related subject d. Mathematics education e. Mathematics f. Other mathematics-related subject such as statistics g. Education (including elementary or early childhood) h. Special education (including students with disabilities) i. English language learning Yes, a major Yes, a minor or special emphasis No A B C VH241758 A B C VH241754 A B C VH241784 A B C VH241760 A B C VH241761 A B C VH241776 A B C VH241762 A B C VH241781 A B C VH241782 VH240204 10. Since completing your undergraduate degree, have you taken any graduate courses? A Yes B No Question 11 is not applicable and will be skipped. 402 VH241785 11. Did you have a major, minor, or special emphasis in any of the following subjects as part of your graduate coursework? Select one circle in each row. Yes, a major Yes, a minor or special emphasis No A B C VH241791 A B C VH241789 A B C VH241810 A B C VH241792 A B C VH241793 A B C VH241794 A B C VH241795 A B C VH241807 A B C VH241808 a. Reading, language arts, or literacy education b. English c. Other language arts-related subject d. Mathematics education e. Mathematics f. Other mathematics-related subject such as statistics g. Education (including elementary or early childhood) h. Special education (including students with disabilities) i. English language learning VH241842 12. During the last two years, did you participate in or lead any of the following professional development activities related to the teaching of reading, writing, or literature? Select one circle in each row. a. College course taken after your first certification b. Workshop or training session c. Mentoring and/or peer observation and coaching as part of a formal arrangement d. Co-teaching/team teaching Yes No A B VH241843 A B VH241844 A B VH241847 A B VH241853 403 VH241899 13. During the last two years, did you participate in or lead any of the following professional development activities related to the teaching of mathematics? Select one circle in each row. a. College course taken after your first certification b. Workshop or training session c. Mentoring and/or peer observation and coaching as part of a formal arrangement d. Co-teaching/team teaching Yes No A B VH241900 A B VH241901 A B VH241904 A B VH241910 VH241893 14. During the last two years, have you received training from any source in any of the following areas? Select one circle in each row. a. b. c. d. Basic computer training Software applications Use of the Internet Use of other technology—for example, satellite access, wireless Web, interactive video, closed-circuit television, videoconferencing e. Integration of computers and other technology into classroom instruction No, I am already proficient. No, I have not. Yes A B C VH241894 A B C VH241895 A B C VH241898 A B C VH241897 A B C VH241896 VH294995 15. In this school year, did your school offer training for teachers on how to use computers or other digital devices? A Yes, to all teachers B Yes, to some teachers C No 404 VH295076 16. In this school year, have you participated in training on computers or other digital devices through your school? A No B Once C Twice D Several times VH617404 17. In this school year, did your school provide you with a laptop computer (including Chromebooks) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH617411 18. In this school year, did your school provide you with a tablet (for example, Surface Pro, iPad, Kindle Fire) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH592056 19. In this school year, which of the following types of computers or other digital devices are available in your school for student use? Select all squares that apply. A Desktop computers B Laptop computers (including Chromebooks) C Tablets (for example, Surface Pro, iPad, Kindle Fire) D Other digital devices (Please specify): 405 VH592052 20. How well do the desktop computers in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. VH592059 21. How well do the laptop computers (including Chromebooks) in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. VH592063 22. How well do the tablets (for example, Surface Pro, iPad, Kindle Fire) in your school work? A All tablets are functional and operate quickly. B All tablets are functional, but some run more slowly than others. C All tablets are functional, but all or almost all run slowly. D Some of the tablets do not operate and cannot be used. E I don’t know. 406 VH304679 23. How often do you do the following in this school? Select one circle in each row. a. Teach jointly as a team in the same class b. Observe other teachers’ classes and provide feedback c. Engage in discussions about the learning development of specific students d. Work with other teachers in my school to ensure common standards in evaluations for assessing student progress Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH304693 A B C D E VH304698 A B C D E VH304736 A B C D E VH304740 407 VH262652 24. In your school, how severe is each problem? Select one circle in each row. Not a problem Minor problem Moderate problem Serious problem A B C D VH262653 A B C D VH262654 A B C D VH262655 A B C D VH262656 A B C D VH262657 a. The school building needs significant repair. b. Classrooms are overcrowded. c. Teachers have too many teaching hours. d. Teachers do not have adequate workspace (e.g., for preparation, collaboration, or meeting with students). e. Teachers do not have adequate instructional materials and supplies. VH305005 25. How much does each of the following statements apply to you as a teacher? Select one circle in each row. a. I am satisfied with being a teacher at this school. b. My work inspires me. c. I am frustrated as a teacher at my school. d. I am supported by the teachers at my school. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH305016 A B C D E VH305024 A B C D E VH305032 A B C D E VH305033 408 VH329966 26. Whether a student does well or poorly in school may depend on a lot of different things. You may feel that some of these things are easier for your students to change than others. In school, how possible is it for your students to change each of the following? Select one circle in each row. a. Being intelligent b. Putting forth a lot of effort c. Behaving well in class Not at all possible to change A little possible to change Somewhat possible to change Quite possible to change Completely possible to change A B C D E VH329967 A B C D E VH329968 A B C D E VH329970 409 Appendix F-2b: 2018 Pilot Grade 4 Core (BET) 410 VH712259 1. What is your sex? A Male B Female VH240385 2. Are you Hispanic or Latino? Select all squares that apply. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240386 3. Which of the following best describes you? Select all squares that apply. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander 411 VH240195 4. Excluding student teaching, how many years have you worked as an elementary or secondary teacher, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years VH547397 5. Have you been awarded tenure by the school, district, or diocese where you currently teach? A Yes B No C My school, district, or diocese does not award tenure. VH240197 6. Do you hold a regular or standard certificate that is valid in the state in which you are currently teaching? A Yes, I hold a permanent certificate. B Yes, I hold a temporary certificate. (This type of certificate may require additional coursework, student teaching, etc.) C No, but I am currently working toward certification. D No, and I am not planning to obtain certification. 412 VH240198 7. Did you enter teaching through an alternative route to certification program? (An alternative route to certification program is a program that was designed to expedite the transition of non-teachers to a teaching career, for example, a state, district, or university alternative route to certification program.) A Yes B No VH240199 8. Are you certified by the National Board for Professional Teaching Standards in at least one content area? (The National Board for Professional Teaching Standards is a nongovernmental organization that administers National Board certification, a voluntary national assessment program that certifies teachers who meet high professional standards. In order to gain certification, the candidate must at least complete a portfolio of classroom practice and pass one or more tests of content knowledge.) A Yes, I am fully certified by the National Board for Professional Teaching Standards. B I am working towards my National Board certification. C No VH240200 9. What is the highest academic degree you hold? A High school diploma B Associate’s degree/vocational certification C Bachelor’s degree D Master’s degree E Education specialist’s or professional diploma based on at least one year’s work past master’s degree F Doctorate G Professional degree (e.g., M.D., LL.B., J.D., D.D.S.) 413 VH241753 10. Did you have a major, minor, or special emphasis in any of the following subjects as part of your undergraduate coursework? Select one circle in each row. a. Biology or other life science b. Physics, chemistry, or other physical science c. Earth or space science d. Mathematics or mathematics education e. Science education f. Engineering or engineering education g. Education (including elementary or early childhood) h. Special education (including students with disabilities) i. English language learning Yes, a major Yes, a minor or special emphasis No A B C VH241768 A B C VH241769 A B C VH241770 A B C VH241771 A B C VH241772 A B C VH241780 A B C VH241762 A B C VH241781 A B C VH241782 VH240204 11. Since completing your undergraduate degree, have you taken any graduate courses? A Yes B No Question 12 is not applicable and will be skipped. 414 VH241785 12. Did you have a major, minor, or special emphasis in any of the following subjects as part of your graduate coursework? Select one circle in each row. Yes, a major Yes, a minor or special emphasis No A B C VH241798 A B C VH241799 A B C VH241800 A B C VH241801 A B C VH241802 A B C VH241806 A B C VH241795 A B C VH241807 A B C VH241808 a. Biology or other life science b. Physics, chemistry, or other physical science c. Earth or space science d. Mathematics or mathematics education e. Science education f. Engineering or engineering education g. Education (including elementary or early childhood) h. Special education (including students with disabilities) i. English language learning VH736191 13. During the last two years, did you participate in any of the following professional development activities related to the teaching of science? Select one circle in each row. a. College course taken after your first certification b. Workshop or training session c. Mentoring and/or peer observation and coaching as part of a formal arrangement d. Co-teaching/team teaching Yes No A B VH736192 A B VH736193 A B VH736196 A B VH736202 415 VH241893 14. During the last two years, have you received training from any source in any of the following areas? Select one circle in each row. a. b. c. d. Basic computer training Software applications Use of the Internet Use of other technology—for example, satellite access, wireless Web, interactive video, closed-circuit television, videoconferencing e. Integration of computers and other technology into classroom instruction No, I am already proficient. No, I have not. Yes A B C VH241894 A B C VH241895 A B C VH241898 A B C VH241897 A B C VH241896 VH294995 15. In this school year, did your school offer training for teachers on how to use computers or other digital devices? A Yes, to all teachers B Yes, to some teachers C No VH295076 16. In this school year, have you participated in training on computers or other digital devices through your school? A No B Once C Twice D Several times 416 VH617404 17. In this school year, did your school provide you with a laptop computer (including Chromebooks) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH617411 18. In this school year, did your school provide you with a tablet (for example, Surface Pro, iPad, Kindle Fire) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH592056 19. In this school year, which of the following types of computers or other digital devices are available in your school for student use? Select all squares that apply. A Desktop computers B Laptop computers (including Chromebooks) C Tablets (for example, Surface Pro, iPad, Kindle Fire) D Other digital devices (Please specify): VH592052 20. How well do the desktop computers in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. 417 VH592059 21. How well do the laptop computers (including Chromebooks) in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. VH592063 22. How well do the tablets (for example, Surface Pro, iPad, Kindle Fire) in your school work? A All tablets are functional and operate quickly. B All tablets are functional, but some run more slowly than others. C All tablets are functional, but all or almost all run slowly. D Some of the tablets do not operate and cannot be used. E I don’t know. 418 VH304679 23. How often do you do the following in this school? Select one circle in each row. a. Teach jointly as a team in the same class b. Observe other teachers’ classes and provide feedback c. Engage in discussions about the learning development of specific students d. Work with other teachers in my school to ensure common standards in evaluations for assessing student progress Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH304693 A B C D E VH304698 A B C D E VH304736 A B C D E VH304740 VH262652 24. In your school, how severe is each problem? Select one circle in each row. a. The school building needs significant repair. b. Classrooms are overcrowded. c. Teachers have too many teaching hours. d. Teachers do not have adequate workspace (e.g., for preparation, collaboration, or meeting with students). e. Teachers do not have adequate instructional materials and supplies. Not a problem Minor problem Moderate problem Serious problem A B C D VH262653 A B C D VH262654 A B C D VH262655 A B C D VH262656 A B C D VH262657 419 VH305005 25. How much does each of the following statements apply to you as a teacher? Select one circle in each row. a. I am satisfied with being a teacher at this school. b. My work inspires me. c. I am frustrated as a teacher at my school. d. I am supported by the teachers at my school. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH305016 A B C D E VH305024 A B C D E VH305032 A B C D E VH305033 VH329966 26. Whether a student does well or poorly in school may depend on a lot of different things. You may feel that some of these things are easier for your students to change than others. In school, how possible is it for your students to change each of the following? Select one circle in each row. a. Being intelligent b. Putting forth a lot of effort c. Behaving well in class Not at all possible to change A little possible to change Somewhat possible to change Quite possible to change Completely possible to change A B C D E VH329967 A B C D E VH329968 A B C D E VH329970 420 Appendix F-2c: 2018 Cognitive Interviews Grade 4 Core 421 VH812654 1. What is the highest academic degree you hold? A High school diploma B Associate’s degree/vocational certification C Bachelor’s degree D Master’s degree E Education specialist degree F Professional degree or diploma based on at least one year’s work past master’s degree G Doctor of Education degree (i.e., Ed.D.) H Other doctoral degree (e.g., Ph.D, D.F.A., D.Sc) VH812662 2. During the last two years, have you received training from any source in any of the following areas? Select one circle in each row. No, I have not No, I have not received training needed training in from any source this area. in this area. a. b. c. d. Basic computer training Software applications Use of the Internet Use of other digital devices (e.g., tablets, mobile devices, Chromebooks, smart boards) e. Integration of computers and other digital devices into classroom instruction Yes A B C VH812663 A B C VH812664 A B C VH812665 A B C VH812666 A B C VH812667 422 VH812702 3. At the end of this school year, approximately what percentage of your students will be prepared for the next school year? A 0–10% B 11–25% C 26–50% D 51–75% E 76–90% F Over 90% 423 Appendix F-2d: 2018 Cognitive Interviews Grade 8 Core 424 2018 Cog Lab Teacher Core VH812654 1. What is the highest academic degree you hold? A High school diploma B Associate’s degree/vocational certification C Bachelor’s degree D Master’s degree E Education specialist degree F Professional degree or diploma based on at least one year’s work past master’s degree G Doctor of Education degree (i.e., Ed.D.) H Other doctoral degree (e.g., Ph.D, D.F.A., D.Sc) VH812662 2. During the last two years, have you received training from any source in any of the following areas? Select one circle in each row. No, I have not No, I have not received training needed training in from any source this area. in this area. a. b. c. d. Basic computer training Software applications Use of the Internet Use of other digital devices (e.g., tablets, mobile devices, Chromebooks, smart boards) e. Integration of computers and other digital devices into classroom instruction Yes A B C VH812663 A B C VH812664 A B C VH812665 A B C VH812666 A B C VH812667 425 VH812702 3. At the end of this school year, approximately what percentage of your students will be prepared for the next school year? A 0–10% B 11–25% C 26–50% D 51–75% E 76–90% F Over 90% 426 Appendix F-2e: 2017 Operational Grade 8 Core (BET-Reading/ Writing) 427 VH240385 1. Are you Hispanic or Latino? Select all squares that apply. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240386 2. Which of the following best describes you? Select all squares that apply. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander VH240195 3. Excluding student teaching, how many years have you worked as an elementary or secondary teacher, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years 428 VH240202 4. Excluding student teaching, how many years have you taught reading, writing, or language arts in grades 6 through 12, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years VH240196 5. Have you been awarded tenure by the school or district where you currently teach? A Yes B No C My school or district does not award tenure. VH240197 6. Do you hold a regular or standard certificate that is valid in the state in which you are currently teaching? A Yes, I hold a permanent certificate. B Yes, I hold a temporary certificate. (This type of certificate may require additional coursework, student teaching, etc.) C No, but I am currently working toward certification. D No, and I am not planning to obtain certification. 429 VH240198 7. Did you enter teaching through an alternative route to certification program? (An alternative route to certification program is a program that was designed to expedite the transition of non-teachers to a teaching career, for example, a state, district, or university alternative route to certification program.) A Yes B No VH240199 8. Are you certified by the National Board for Professional Teaching Standards in at least one content area? (The National Board for Professional Teaching Standards is a nongovernmental organization that administers National Board certification, a voluntary national assessment program that certifies teachers who meet high professional standards. In order to gain certification, the candidate must at least complete a portfolio of classroom practice and pass one or more tests of content knowledge.) A Yes, I am fully certified by the National Board for Professional Teaching Standards. B I am working towards my National Board certification. C No VH240200 9. What is the highest academic degree you hold? A High school diploma B Associate’s degree/vocational certification C Bachelor’s degree D Master’s degree E Education specialist’s or professional diploma based on at least one year’s work past master’s degree F Doctorate G Professional degree (e.g., M.D., LL.B., J.D., D.D.S.) 430 VH241753 10. Did you have a major, minor, or special emphasis in any of the following subjects as part of your undergraduate coursework? Select one circle in each row. a. Reading, language arts, or literacy education b. English c. Other language arts-related subject d. Elementary or secondary education e. Special education (including students with disabilities) f. English language learning Yes, a major Yes, a minor or special emphasis No A B C VH241758 A B C VH241754 A B C VH241784 A B C VH241767 A B C VH241781 A B C VH241782 VH240204 11. Since completing your undergraduate degree, have you taken any graduate courses? A Yes B No Question 12 is not applicable and will be skipped. 431 VH241785 12. Did you have a major, minor, or special emphasis in any of the following subjects as part of your graduate coursework? Select one circle in each row. Yes, a major Yes, a minor or special emphasis No A B C VH241791 A B C VH241789 A B C VH241810 A B C VH241797 A B C VH241807 A B C VH241808 a. Reading, language arts, or literacy education b. English c. Other language arts-related subject d. Elementary or secondary education e. Special education (including students with disabilities) f. English language learning VH241842 13. During the last two years, did you participate in or lead any of the following professional development activities related to the teaching of reading, writing, or literature? Select one circle in each row. a. College course taken after your first certification b. Workshop or training session c. Mentoring and/or peer observation and coaching as part of a formal arrangement d. Co-teaching/team teaching Yes No A B VH241843 A B VH241844 A B VH241847 A B VH241853 432 VH241893 14. During the last two years, have you received training from any source in any of the following areas? Select one circle in each row. a. b. c. d. Basic computer training Software applications Use of the Internet Use of other technology—for example, satellite access, wireless Web, interactive video, closed-circuit television, videoconferencing e. Integration of computers and other technology into classroom instruction No, I am already proficient. No, I have not. Yes A B C VH241894 A B C VH241895 A B C VH241898 A B C VH241897 A B C VH241896 VH294995 15. In this school year, did your school offer training for teachers on how to use computers or other digital devices? A Yes, to all teachers B Yes, to some teachers C No VH295076 16. In this school year, have you participated in training on computers or other digital devices through your school? A No B Once C Twice D Several times 433 VH617404 17. In this school year, did your school provide you with a laptop computer (including Chromebooks) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH617411 18. In this school year, did your school provide you with a tablet (for example, Surface Pro, iPad, Kindle Fire) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH592056 19. In this school year, which of the following types of computers or other digital devices are available in your school for student use? Select all squares that apply. A Desktop computers B Laptop computers (including Chromebooks) C Tablets (for example, Surface Pro, iPad, Kindle Fire) D Other digital devices (Please specify): VH592052 20. How well do the desktop computers in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. 434 VH592059 21. How well do the laptop computers (including Chromebooks) in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. VH592063 22. How well do the tablets (for example, Surface Pro, iPad, Kindle Fire) in your school work? A All tablets are functional and operate quickly. B All tablets are functional, but some run more slowly than others. C All tablets are functional, but all or almost all run slowly. D Some of the tablets do not operate and cannot be used. E I don’t know. 435 VH304679 23. How often do you do the following in this school? Select one circle in each row. a. Teach jointly as a team in the same class b. Observe other teachers’ classes and provide feedback c. Engage in discussions about the learning development of specific students d. Work with other teachers in my school to ensure common standards in evaluations for assessing student progress Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH304693 A B C D E VH304698 A B C D E VH304736 A B C D E VH304740 VH262652 24. In your school, how severe is each problem? Select one circle in each row. a. The school building needs significant repair. b. Classrooms are overcrowded. c. Teachers have too many teaching hours. d. Teachers do not have adequate workspace (e.g., for preparation, collaboration, or meeting with students). e. Teachers do not have adequate instructional materials and supplies. Not a problem Minor problem Moderate problem Serious problem A B C D VH262653 A B C D VH262654 A B C D VH262655 A B C D VH262656 A B C D VH262657 436 VH305005 25. How much does each of the following statements apply to you as a teacher? Select one circle in each row. a. I am satisfied with being a teacher at this school. b. My work inspires me. c. I am frustrated as a teacher at my school. d. I am supported by the teachers at my school. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH305016 A B C D E VH305024 A B C D E VH305032 A B C D E VH305033 VH329966 26. Whether a student does well or poorly in school may depend on a lot of different things. You may feel that some of these things are easier for your students to change than others. In school, how possible is it for your students to change each of the following? Select one circle in each row. a. Being intelligent b. Putting forth a lot of effort c. Behaving well in class Not at all possible to change A little possible to change Somewhat possible to change Quite possible to change Completely possible to change A B C D E VH329967 A B C D E VH329968 A B C D E VH329970 437 Appendix F-2f: 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) 438 VH547397 1. Have you been awarded tenure by the school, district, or diocese where you currently teach? A Yes B No C My school, district, or diocese does not award tenure. 439 If you do not teach Reading, please do not answer the next 2 questions. VH334360 2. When you teach English/language arts, how often do you use the following strategies? Select one circle in each row. a. I teach reading as a whole-class activity. b. I create student groups with the same achievement level. c. I create student groups with different achievement levels. d. I create groups by random assignment. e. I allow students to choose their own groups. f. I use differentiated instruction for reading (i.e., instruction tailored to student ability and learning style). g. I ask students to work independently on an assignment or task. h. I ask students to work independently on a task they choose themselves. i. Other strategies (Please specify): Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH334361 A B C D E VH334362 A B C D E VH548665 A B C D E VH334363 A B C D E VH334368 A B C D E VH562894 A B C D E VH548666 A B C D E VH548667 A B C D E VH562900 440 VH547867 3. In your eighth-grade English/language arts class this year, how often do your students do each of the following? Select one circle in each row. a. Build and practice vocabulary b. Build reading fluency c. Build reading comprehension d. Access reading-related websites e. Conduct research for projects Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH547868 A B C D E VH617114 A B C D E VH617116 A B C D E VH547871 A B C D E VH547872 441 If you do not teach Mathematics, please do not answer the next 4 questions. VH548937 4. In your mathematics class this year, do you use any of the following instructional materials during instruction? Select one circle in each row. Yes a. Textbooks provided by your district or school b. Other materials provided by your district or school c. Materials found on the Internet d. Printed workbooks e. Digital manipulatives f. Physical manipulatives (for example, ruler, protractor, compass) g. Digital games h. Interactive whiteboard i. Other materials not listed above (Please specify): No, I do not No, this resource prefer to use this is not available to resource. me. A B C VH548938 A B C VH548939 A B C VH548940 A B C VH548947 A B C VH548942 A B C VH548945 A B C VH548948 A B C VH548944 A B C VH548941 442 VH270281 5. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Use clear and precise language to discuss problem solving and reasoning b. Use models to explain calculations c. Represent a problem in multiple ways including using numbers, words, pictures, and charts d. Use models to examine real-life and mathematical examples e. Evaluate a problem-solving process f. Create equations g. Relate what your students know to the real world and make sense of it mathematically h. Use appropriate terminology when referring to the number system, functions, geometric figures, and data displays i. Evaluate the conclusions of other students j. Examine patterns in tables and graphs to describe relationships No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH562965 A B C D E VH562966 A B C D E VH562967 A B C D E VH549099 A B C D E VH562983 A B C D E VH562985 A B C D E VH562988 A B C D E VH562989 A B C D E VH549107 A B C D E VH562991 443 VH547430 6. Thinking about your eighth-grade mathematics classes this year, how often do you incorporate the following practices when teaching your students? Select one circle in each row. a. Posing questions during a lesson that will help students to reason and make sense of mathematical connections and relationships b. Using overall learning goals to guide instructional decisions c. Building procedural understanding to encourage the use of multiple problem-solving strategies d. Providing opportunities for students to productively struggle with mathematical ideas and relationships Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH547431 A B C D E VH547434 A B C D E VH547433 A B C D E VH547432 444 VH547461 7. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Use definitions and notation precisely b. Justify and explain their reasoning c. Identify and correct flawed mathematical reasoning d. Construct arguments using tables, graphs, or diagrams e. Make, test, and validate conjectures f. Use examples or counterexamples to support or refute a mathematical conjecture g. Engage in deductive reasoning and informal proofs No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH547462 A B C D E VH547463 A B C D E VH547464 A B C D E VH547468 A B C D E VH547466 A B C D E VH547467 A B C D E VH547465 445 VH617288 8. In your mathematics class this year, how often do you use each of the following strategies when teaching? Select one circle in each row. a. I teach mathematics as a whole-class activity. b. I create student groups with the same achievement level. c. I create groups by random assignment. d. I allow students to choose their own group. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH617289 A B C D E VH617290 A B C D E VH617291 A B C D E VH617292 446 Appendix F-2g: 2017 Operational Grade 8 Core (BET-Mathematics) 447 VH240385 1. Are you Hispanic or Latino? Select all squares that apply. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240386 2. Which of the following best describes you? Select all squares that apply. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander VH240195 3. Excluding student teaching, how many years have you worked as an elementary or secondary teacher, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years 448 VH240201 4. Excluding student teaching, how many years have you taught mathematics in grades 6 through 12, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years VH240196 5. Have you been awarded tenure by the school or district where you currently teach? A Yes B No C My school or district does not award tenure. VH240197 6. Do you hold a regular or standard certificate that is valid in the state in which you are currently teaching? A Yes, I hold a permanent certificate. B Yes, I hold a temporary certificate. (This type of certificate may require additional coursework, student teaching, etc.) C No, but I am currently working toward certification. D No, and I am not planning to obtain certification. 449 VH240198 7. Did you enter teaching through an alternative route to certification program? (An alternative route to certification program is a program that was designed to expedite the transition of non-teachers to a teaching career, for example, a state, district, or university alternative route to certification program.) A Yes B No VH240199 8. Are you certified by the National Board for Professional Teaching Standards in at least one content area? (The National Board for Professional Teaching Standards is a nongovernmental organization that administers National Board certification, a voluntary national assessment program that certifies teachers who meet high professional standards. In order to gain certification, the candidate must at least complete a portfolio of classroom practice and pass one or more tests of content knowledge.) A Yes, I am fully certified by the National Board for Professional Teaching Standards. B I am working towards my National Board certification. C No VH240200 9. What is the highest academic degree you hold? A High school diploma B Associate’s degree/vocational certification C Bachelor’s degree D Master’s degree E Education specialist’s or professional diploma based on at least one year’s work past master’s degree F Doctorate G Professional degree (e.g., M.D., LL.B., J.D., D.D.S.) 450 VH241753 10. Did you have a major, minor, or special emphasis in any of the following subjects as part of your undergraduate coursework? Select one circle in each row. a. Mathematics education b. Mathematics c. Other mathematics-related subject such as statistics d. Elementary or secondary education e. Special education (including students with disabilities) f. English language learning Yes, a major Yes, a minor or special emphasis No A B C VH241760 A B C VH241761 A B C VH241776 A B C VH241767 A B C VH241781 A B C VH241782 VH240204 11. Since completing your undergraduate degree, have you taken any graduate courses? A Yes B No Question 12 is not applicable and will be skipped. 451 VH241785 12. Did you have a major, minor, or special emphasis in any of the following subjects as part of your graduate coursework? Select one circle in each row. Yes, a major Yes, a minor or special emphasis No A B C VH241792 A B C VH241793 A B C VH241794 A B C VH241797 A B C VH241807 A B C VH241808 a. Mathematics education b. Mathematics c. Other mathematics-related subject such as statistics d. Elementary or secondary education e. Special education (including students with disabilities) f. English language learning VH241899 13. During the last two years, did you participate in or lead any of the following professional development activities related to the teaching of mathematics? Select one circle in each row. a. College course taken after your first certification b. Workshop or training session c. Mentoring and/or peer observation and coaching as part of a formal arrangement d. Co-teaching/team teaching Yes No A B VH241900 A B VH241901 A B VH241904 A B VH241910 452 VH241893 14. During the last two years, have you received training from any source in any of the following areas? Select one circle in each row. a. b. c. d. Basic computer training Software applications Use of the Internet Use of other technology—for example, satellite access, wireless Web, interactive video, closed-circuit television, videoconferencing e. Integration of computers and other technology into classroom instruction No, I am already proficient. No, I have not. Yes A B C VH241894 A B C VH241895 A B C VH241898 A B C VH241897 A B C VH241896 VH294995 15. In this school year, did your school offer training for teachers on how to use computers or other digital devices? A Yes, to all teachers B Yes, to some teachers C No VH295076 16. In this school year, have you participated in training on computers or other digital devices through your school? A No B Once C Twice D Several times 453 VH617404 17. In this school year, did your school provide you with a laptop computer (including Chromebooks) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH617411 18. In this school year, did your school provide you with a tablet (for example, Surface Pro, iPad, Kindle Fire) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH592056 19. In this school year, which of the following types of computers or other digital devices are available in your school for student use? Select all squares that apply. A Desktop computers B Laptop computers (including Chromebooks) C Tablets (for example, Surface Pro, iPad, Kindle Fire) D Other digital devices (Please specify): VH592052 20. How well do the desktop computers in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. 454 VH592059 21. How well do the laptop computers (including Chromebooks) in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. VH592063 22. How well do the tablets (for example, Surface Pro, iPad, Kindle Fire) in your school work? A All tablets are functional and operate quickly. B All tablets are functional, but some run more slowly than others. C All tablets are functional, but all or almost all run slowly. D Some of the tablets do not operate and cannot be used. E I don’t know. 455 VH304679 23. How often do you do the following in this school? Select one circle in each row. a. Teach jointly as a team in the same class b. Observe other teachers’ classes and provide feedback c. Engage in discussions about the learning development of specific students d. Work with other teachers in my school to ensure common standards in evaluations for assessing student progress Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH304693 A B C D E VH304698 A B C D E VH304736 A B C D E VH304740 VH262652 24. In your school, how severe is each problem? Select one circle in each row. a. The school building needs significant repair. b. Classrooms are overcrowded. c. Teachers have too many teaching hours. d. Teachers do not have adequate workspace (e.g., for preparation, collaboration, or meeting with students). e. Teachers do not have adequate instructional materials and supplies. Not a problem Minor problem Moderate problem Serious problem A B C D VH262653 A B C D VH262654 A B C D VH262655 A B C D VH262656 A B C D VH262657 456 VH305005 25. How much does each of the following statements apply to you as a teacher? Select one circle in each row. a. I am satisfied with being a teacher at this school. b. My work inspires me. c. I am frustrated as a teacher at my school. d. I am supported by the teachers at my school. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH305016 A B C D E VH305024 A B C D E VH305032 A B C D E VH305033 VH329966 26. Whether a student does well or poorly in school may depend on a lot of different things. You may feel that some of these things are easier for your students to change than others. In school, how possible is it for your students to change each of the following? Select one circle in each row. a. Being intelligent b. Putting forth a lot of effort c. Behaving well in class Not at all possible to change A little possible to change Somewhat possible to change Quite possible to change Completely possible to change A B C D E VH329967 A B C D E VH329968 A B C D E VH329970 457 Appendix F-2h: 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) 458 VH547397 1. Have you been awarded tenure by the school, district, or diocese where you currently teach? A Yes B No C My school, district, or diocese does not award tenure. 459 If you do not teach Reading, please do not answer the next 2 questions. VH334360 2. When you teach English/language arts, how often do you use the following strategies? Select one circle in each row. a. I teach reading as a whole-class activity. b. I create student groups with the same achievement level. c. I create student groups with different achievement levels. d. I create groups by random assignment. e. I allow students to choose their own groups. f. I use differentiated instruction for reading (i.e., instruction tailored to student ability and learning style). g. I ask students to work independently on an assignment or task. h. I ask students to work independently on a task they choose themselves. i. Other strategies (Please specify): Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH334361 A B C D E VH334362 A B C D E VH548665 A B C D E VH334363 A B C D E VH334368 A B C D E VH562894 A B C D E VH548666 A B C D E VH548667 A B C D E VH562900 460 VH547867 3. In your eighth-grade English/language arts class this year, how often do your students do each of the following? Select one circle in each row. a. Build and practice vocabulary b. Build reading fluency c. Build reading comprehension d. Access reading-related websites e. Conduct research for projects Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH547868 A B C D E VH617114 A B C D E VH617116 A B C D E VH547871 A B C D E VH547872 461 If you do not teach Mathematics, please do not answer the next 4 questions. VH548937 4. In your mathematics class this year, do you use any of the following instructional materials during instruction? Select one circle in each row. Yes a. Textbooks provided by your district or school b. Other materials provided by your district or school c. Materials found on the Internet d. Printed workbooks e. Digital manipulatives f. Physical manipulatives (for example, ruler, protractor, compass) g. Digital games h. Interactive whiteboard i. Other materials not listed above (Please specify): No, I do not No, this resource prefer to use this is not available to resource. me. A B C VH548938 A B C VH548939 A B C VH548940 A B C VH548947 A B C VH548942 A B C VH548945 A B C VH548948 A B C VH548944 A B C VH548941 462 VH270281 5. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Use clear and precise language to discuss problem solving and reasoning b. Use models to explain calculations c. Represent a problem in multiple ways including using numbers, words, pictures, and charts d. Use models to examine real-life and mathematical examples e. Evaluate a problem-solving process f. Create equations g. Relate what your students know to the real world and make sense of it mathematically h. Use appropriate terminology when referring to the number system, functions, geometric figures, and data displays i. Evaluate the conclusions of other students j. Examine patterns in tables and graphs to describe relationships No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH562965 A B C D E VH562966 A B C D E VH562967 A B C D E VH549099 A B C D E VH562983 A B C D E VH562985 A B C D E VH562988 A B C D E VH562989 A B C D E VH549107 A B C D E VH562991 463 VH547430 6. Thinking about your eighth-grade mathematics classes this year, how often do you incorporate the following practices when teaching your students? Select one circle in each row. a. Posing questions during a lesson that will help students to reason and make sense of mathematical connections and relationships b. Using overall learning goals to guide instructional decisions c. Building procedural understanding to encourage the use of multiple problem-solving strategies d. Providing opportunities for students to productively struggle with mathematical ideas and relationships Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH547431 A B C D E VH547434 A B C D E VH547433 A B C D E VH547432 464 VH547461 7. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Use definitions and notation precisely b. Justify and explain their reasoning c. Identify and correct flawed mathematical reasoning d. Construct arguments using tables, graphs, or diagrams e. Make, test, and validate conjectures f. Use examples or counterexamples to support or refute a mathematical conjecture g. Engage in deductive reasoning and informal proofs No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH547462 A B C D E VH547463 A B C D E VH547464 A B C D E VH547468 A B C D E VH547466 A B C D E VH547467 A B C D E VH547465 465 VH617288 8. In your mathematics class this year, how often do you use each of the following strategies when teaching? Select one circle in each row. a. I teach mathematics as a whole-class activity. b. I create student groups with the same achievement level. c. I create groups by random assignment. d. I allow students to choose their own group. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH617289 A B C D E VH617290 A B C D E VH617291 A B C D E VH617292 466 Appendix F-2i: 2018 Pilot Grade 8 Core (BET-Science) 467 VH712259 1. What is your sex? A Male B Female VH240385 2. Are you Hispanic or Latino? Select all squares that apply. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240386 3. Which of the following best describes you? Select all squares that apply. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander 468 VH240195 4. Excluding student teaching, how many years have you worked as an elementary or secondary teacher, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years VH240203 5. Excluding student teaching, how many years have you taught science in grades 6 through 12, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years VH547397 6. Have you been awarded tenure by the school, district, or diocese where you currently teach? A Yes B No C My school, district, or diocese does not award tenure. 469 VH240197 7. Do you hold a regular or standard certificate that is valid in the state in which you are currently teaching? A Yes, I hold a permanent certificate. B Yes, I hold a temporary certificate. (This type of certificate may require additional coursework, student teaching, etc.) C No, but I am currently working toward certification. D No, and I am not planning to obtain certification. VH240198 8. Did you enter teaching through an alternative route to certification program? (An alternative route to certification program is a program that was designed to expedite the transition of non-teachers to a teaching career, for example, a state, district, or university alternative route to certification program.) A Yes B No VH240199 9. Are you certified by the National Board for Professional Teaching Standards in at least one content area? (The National Board for Professional Teaching Standards is a nongovernmental organization that administers National Board certification, a voluntary national assessment program that certifies teachers who meet high professional standards. In order to gain certification, the candidate must at least complete a portfolio of classroom practice and pass one or more tests of content knowledge.) A Yes, I am fully certified by the National Board for Professional Teaching Standards. B I am working towards my National Board certification. C No 470 VH240200 10. What is the highest academic degree you hold? A High school diploma B Associate’s degree/vocational certification C Bachelor’s degree D Master’s degree E Education specialist’s or professional diploma based on at least one year’s work past master’s degree F Doctorate G Professional degree (e.g., M.D., LL.B., J.D., D.D.S.) 471 VH241753 11. Did you have a major, minor, or special emphasis in any of the following subjects as part of your undergraduate coursework? Select one circle in each row. a. Biology or other life science b. Physics, chemistry, or other physical science c. Earth or space science d. Mathematics or mathematics education e. Science education f. Engineering or engineering education g. Elementary or secondary education h. Special education (including students with disabilities) i. English language learning Yes, a major Yes, a minor or special emphasis No A B C VH241768 A B C VH241769 A B C VH241770 A B C VH241771 A B C VH241772 A B C VH241780 A B C VH241767 A B C VH241781 A B C VH241782 VH240204 12. Since completing your undergraduate degree, have you taken any graduate courses? A Yes B No Question 13 is not applicable and will be skipped. 472 VH241785 13. Did you have a major, minor, or special emphasis in any of the following subjects as part of your graduate coursework? Select one circle in each row. Yes, a major Yes, a minor or special emphasis No A B C VH241798 A B C VH241799 A B C VH241800 A B C VH241801 A B C VH241802 A B C VH241806 A B C VH241797 A B C VH241807 A B C VH241808 a. Biology or other life science b. Physics, chemistry, or other physical science c. Earth or space science d. Mathematics or mathematics education e. Science education f. Engineering or engineering education g. Elementary or secondary education h. Special education (including students with disabilities) i. English language learning VH736191 14. During the last two years, did you participate in any of the following professional development activities related to the teaching of science? Select one circle in each row. a. College course taken after your first certification b. Workshop or training session c. Mentoring and/or peer observation and coaching as part of a formal arrangement d. Co-teaching/team teaching Yes No A B VH736192 A B VH736193 A B VH736196 A B VH736202 473 VH241893 15. During the last two years, have you received training from any source in any of the following areas? Select one circle in each row. a. b. c. d. Basic computer training Software applications Use of the Internet Use of other technology—for example, satellite access, wireless Web, interactive video, closed-circuit television, videoconferencing e. Integration of computers and other technology into classroom instruction No, I am already proficient. No, I have not. Yes A B C VH241894 A B C VH241895 A B C VH241898 A B C VH241897 A B C VH241896 VH294995 16. In this school year, did your school offer training for teachers on how to use computers or other digital devices? A Yes, to all teachers B Yes, to some teachers C No VH295076 17. In this school year, have you participated in training on computers or other digital devices through your school? A No B Once C Twice D Several times 474 VH617404 18. In this school year, did your school provide you with a laptop computer (including Chromebooks) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH617411 19. In this school year, did your school provide you with a tablet (for example, Surface Pro, iPad, Kindle Fire) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH592056 20. In this school year, which of the following types of computers or other digital devices are available in your school for student use? Select all squares that apply. A Desktop computers B Laptop computers (including Chromebooks) C Tablets (for example, Surface Pro, iPad, Kindle Fire) D Other digital devices (Please specify): VH592052 21. How well do the desktop computers in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. 475 VH592059 22. How well do the laptop computers (including Chromebooks) in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. VH592063 23. How well do the tablets (for example, Surface Pro, iPad, Kindle Fire) in your school work? A All tablets are functional and operate quickly. B All tablets are functional, but some run more slowly than others. C All tablets are functional, but all or almost all run slowly. D Some of the tablets do not operate and cannot be used. E I don’t know. 476 VH304679 24. How often do you do the following in this school? Select one circle in each row. a. Teach jointly as a team in the same class b. Observe other teachers’ classes and provide feedback c. Engage in discussions about the learning development of specific students d. Work with other teachers in my school to ensure common standards in evaluations for assessing student progress Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH304693 A B C D E VH304698 A B C D E VH304736 A B C D E VH304740 VH262652 25. In your school, how severe is each problem? Select one circle in each row. a. The school building needs significant repair. b. Classrooms are overcrowded. c. Teachers have too many teaching hours. d. Teachers do not have adequate workspace (e.g., for preparation, collaboration, or meeting with students). e. Teachers do not have adequate instructional materials and supplies. Not a problem Minor problem Moderate problem Serious problem A B C D VH262653 A B C D VH262654 A B C D VH262655 A B C D VH262656 A B C D VH262657 477 VH305005 26. How much does each of the following statements apply to you as a teacher? Select one circle in each row. a. I am satisfied with being a teacher at this school. b. My work inspires me. c. I am frustrated as a teacher at my school. d. I am supported by the teachers at my school. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH305016 A B C D E VH305024 A B C D E VH305032 A B C D E VH305033 VH329966 27. Whether a student does well or poorly in school may depend on a lot of different things. You may feel that some of these things are easier for your students to change than others. In school, how possible is it for your students to change each of the following? Select one circle in each row. a. Being intelligent b. Putting forth a lot of effort c. Behaving well in class Not at all possible to change A little possible to change Somewhat possible to change Quite possible to change Completely possible to change A B C D E VH329967 A B C D E VH329968 A B C D E VH329970 478 Appendix F-2j: 2018 Operational Grade 8 Core (BET-Social Studies) 479 VH712259 1. What is your sex? A Male B Female VH240385 2. Are you Hispanic or Latino? Select all squares that apply. A No, I am not Hispanic or Latino. B Yes, I am Mexican, Mexican American, or Chicano. C Yes, I am Puerto Rican or Puerto Rican American. D Yes, I am Cuban or Cuban American. E Yes, I am from some other Hispanic or Latino background. VH240386 3. Which of the following best describes you? Select all squares that apply. A White B Black or African American C Asian D American Indian or Alaska Native E Native Hawaiian or other Pacific Islander 480 VH240195 4. Excluding student teaching, how many years have you worked as an elementary or secondary teacher, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years VH614182 5. Excluding student teaching, how many years have you taught civics, geography, history, or social studies in grades 6 through 12, counting this year? A Less than 1 year B 1–2 years C 3–5 years D 6–10 years E 11–20 years F 21 or more years VH547397 6. Have you been awarded tenure by the school, district, or diocese where you currently teach? A Yes B No C My school, district, or diocese does not award tenure. 481 VH240197 7. Do you hold a regular or standard certificate that is valid in the state in which you are currently teaching? A Yes, I hold a permanent certificate. B Yes, I hold a temporary certificate. (This type of certificate may require additional coursework, student teaching, etc.) C No, but I am currently working toward certification. D No, and I am not planning to obtain certification. VH240198 8. Did you enter teaching through an alternative route to certification program? (An alternative route to certification program is a program that was designed to expedite the transition of non-teachers to a teaching career, for example, a state, district, or university alternative route to certification program.) A Yes B No VH240199 9. Are you certified by the National Board for Professional Teaching Standards in at least one content area? (The National Board for Professional Teaching Standards is a nongovernmental organization that administers National Board certification, a voluntary national assessment program that certifies teachers who meet high professional standards. In order to gain certification, the candidate must at least complete a portfolio of classroom practice and pass one or more tests of content knowledge.) A Yes, I am fully certified by the National Board for Professional Teaching Standards. B I am working towards my National Board certification. C No 482 VH240200 10. What is the highest academic degree you hold? A High school diploma B Associate’s degree/vocational certification C Bachelor’s degree D Master’s degree E Education specialist’s or professional diploma based on at least one year’s work past master’s degree F Doctorate G Professional degree (e.g., M.D., LL.B., J.D., D.D.S.) 483 VH241753 11. Did you have a major, minor, or special emphasis in any of the following subjects as part of your undergraduate coursework? Select one circle in each row. a. History or history education b. Geography or geography education c. Political science d. General social science or social studies education e. Other social science (for example, economics, sociology, psychology, anthropology) f. Elementary or secondary education g. Special education (including students with disabilities) h. English language learning Yes, a major Yes, a minor or special emphasis No A B C VH614158 A B C VH614159 A B C VH614160 A B C VH614162 A B C VH614164 A B C VH241767 A B C VH241781 A B C VH241782 VH240204 12. Since completing your undergraduate degree, have you taken any graduate courses? A Yes B No Question 13 is not applicable and will be skipped. 484 VH241785 13. Did you have a major, minor, or special emphasis in any of the following subjects as part of your graduate coursework? Select one circle in each row. Yes, a major Yes, a minor or special emphasis No A B C VH614171 A B C VH614172 A B C VH614173 A B C VH614174 A B C VH614175 A B C VH241797 A B C VH241807 A B C VH241808 a. History or history education b. Geography or geography education c. Political science d. General social science or social studies education e. Other social science (for example, economics, sociology, psychology, anthropology) f. Elementary or secondary education g. Special education (including students with disabilities) h. English language learning VH614376 14. During the last two years, did you participate in or lead any of the following professional development activities related to the teaching of civics, geography, history, or social studies? Select one circle in each row. a. College course taken after your first certification b. Workshop or training session c. Mentoring and/or peer observation and coaching as part of a formal arrangement d. Co-teaching/team teaching Yes No A B VH614381 A B VH614382 A B VH614383 A B VH614385 485 VH241893 15. During the last two years, have you received training from any source in any of the following areas? Select one circle in each row. a. b. c. d. Basic computer training Software applications Use of the Internet Use of other technology—for example, satellite access, wireless Web, interactive video, closed-circuit television, videoconferencing e. Integration of computers and other technology into classroom instruction No, I am already proficient. No, I have not. Yes A B C VH241894 A B C VH241895 A B C VH241898 A B C VH241897 A B C VH241896 VH294995 16. In this school year, did your school offer training for teachers on how to use computers or other digital devices? A Yes, to all teachers B Yes, to some teachers C No VH295076 17. In this school year, have you participated in training on computers or other digital devices through your school? A No B Once C Twice D Several times 486 VH617404 18. In this school year, did your school provide you with a laptop computer (including Chromebooks) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH617411 19. In this school year, did your school provide you with a tablet (for example, Surface Pro, iPad, Kindle Fire) to use for teaching and class preparation? A Yes, and I can take it home. B Yes, but I cannot take it home. C No VH592056 20. In this school year, which of the following types of computers or other digital devices are available in your school for student use? Select all squares that apply. A Desktop computers B Laptop computers (including Chromebooks) C Tablets (for example, Surface Pro, iPad, Kindle Fire) D Other digital devices (Please specify): VH592052 21. How well do the desktop computers in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. 487 VH592059 22. How well do the laptop computers (including Chromebooks) in your school work? A All computers are functional and operate quickly. B All computers are functional, but some run more slowly than others. C All computers are functional, but all or almost all run slowly. D Some of the computers do not operate and cannot be used. E I don’t know. VH592063 23. How well do the tablets (for example, Surface Pro, iPad, Kindle Fire) in your school work? A All tablets are functional and operate quickly. B All tablets are functional, but some run more slowly than others. C All tablets are functional, but all or almost all run slowly. D Some of the tablets do not operate and cannot be used. E I don’t know. 488 VH304679 24. How often do you do the following in this school? Select one circle in each row. a. Teach jointly as a team in the same class b. Observe other teachers’ classes and provide feedback c. Engage in discussions about the learning development of specific students d. Work with other teachers in my school to ensure common standards in evaluations for assessing student progress Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH304693 A B C D E VH304698 A B C D E VH304736 A B C D E VH304740 VH262652 25. In your school, how severe is each problem? Select one circle in each row. a. The school building needs significant repair. b. Classrooms are overcrowded. c. Teachers have too many teaching hours. d. Teachers do not have adequate workspace (e.g., for preparation, collaboration, or meeting with students). e. Teachers do not have adequate instructional materials and supplies. Not a problem Minor problem Moderate problem Serious problem A B C D VH262653 A B C D VH262654 A B C D VH262655 A B C D VH262656 A B C D VH262657 489 VH305005 26. How much does each of the following statements apply to you as a teacher? Select one circle in each row. a. I am satisfied with being a teacher at this school. b. My work inspires me. c. I am frustrated as a teacher at my school. d. I am supported by the teachers at my school. Not at all like me A little bit like me Somewhat like me Quite a bit like me Exactly like me A B C D E VH305016 A B C D E VH305024 A B C D E VH305032 A B C D E VH305033 VH329966 27. Whether a student does well or poorly in school may depend on a lot of different things. You may feel that some of these things are easier for your students to change than others. In school, how possible is it for your students to change each of the following? Select one circle in each row. a. Being intelligent b. Putting forth a lot of effort c. Behaving well in class Not at all possible to change A little possible to change Somewhat possible to change Quite possible to change Completely possible to change A B C D E VH329967 A B C D E VH329968 A B C D E VH329970 490 Appendix F-2k: 2017 Operational Grade 4 Reading (COI) 491 VH240015 1. Which best describes your role in teaching English/language arts to this class? Language arts refers to reading, writing, literature, and related topics. Select one circle. A I do not teach English/language arts to this class. Questions 2–11 are not applicable and will be skipped. B I teach all or most subjects, including English/language arts. C The only subject I teach is English/language arts. D We team teach, and I have primary responsibility for teaching English/language arts. VH261160 2. How many students are in this class? Enter the number of students. VH334214 3. In a typical week, about how much time in total do you spend with this class on English/language arts instruction? Language arts refers to reading, writing, literature, and related topics. Enter the hours and minutes. hours and minutes per week 492 VH240522 4. To what extent have you provided instruction in the following in English/language arts class so far this year? Select one circle in each row. Not at all Small extent Moderate extent Large extent A B C D VH240523 A B C D VH240524 A B C D VH240528 A B C D VH240526 A B C D VH240527 A B C D VH240525 a. b. c. d. e. Fiction Literary nonfiction Poetry Exposition Argumentation and persuasion f. Procedural texts and documents VH261229 5. When reading a story, article, or other passage with your students, how often do you ask your students to do the following? Select one circle in each row. a. Summarize the passage b. Interpret the meaning of the passage c. Question the motives or feelings of the characters d. Identify the main ideas of the passage e. Identify the themes of the passage f. Analyze two or more texts on the same topic Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH261231 A B C D E VH261232 A B C D E VH261233 A B C D E VH261235 A B C D E VH335897 A B C D E VH261240 493 VH261255 6. This school year, to what extent have you emphasized the following cognitive processes when teaching informational and literary texts in class? Select one circle in each row. a. Locate and recall (e.g., identify main ideas or focus on specific elements of a story) b. Integrate and interpret (e.g., make comparisons, explain character motivation, or examine relations of ideas across the text) c. Critique and evaluate (e.g., evaluate text critically from many perspectives or evaluate overall text quality) No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH261256 A B C D E VH261257 A B C D E VH261258 494 VH334360 7. When you teach English/language arts, how often do you use the following strategies? Select one circle in each row. a. I teach reading as a whole-class activity. b. I create student groups with the same achievement level. c. I create groups by random assignment. d. I allow students to choose their own groups. e. I use individualized instruction for reading. f. Students work independently on an assigned plan or goal. g. Students work independently on a goal they choose themselves. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH334361 A B C D E VH334362 A B C D E VH334363 A B C D E VH334368 A B C D E VH334364 A B C D E VH334365 A B C D E VH334366 495 VH262696 8. When you teach English/language arts to your students, how do you use each of the following resources? Select one circle in each row. a. Hardback textbooks, workbooks, or worksheets b. Electronic textbooks c. A variety of children’s books (e.g., novels, collections of stories, nonfiction) d. Materials from different curricular areas e. Children’s newspapers and/or magazines f. Reading-related websites or apps g. Reading-related educational games Not used Supplement Basis for instruction A B C VH262697 A B C VH262698 A B C VH262701 A B C VH262703 A B C VH262704 A B C VH262707 A B C VH262714 496 VH262481 9. In your fourth-grade English/language arts class this year, how often do your students use a computer or other digital device to do each of the following? Select one circle in each row. a. Build and practice vocabulary b. Build reading fluency c. Build reading comprehension d. Practice spelling and grammar e. Access reading-related websites f. Conduct research for reading projects Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH262482 A B C D E VH617099 A B C D E VH617100 A B C D E VH262485 A B C D E VH262487 A B C D E VH262488 497 VH262946 10. Suppose your students did very well on their last English/language arts test. How likely do you think each of the following explanations is in this situation? Select one circle in each row. Not at all likely Not likely Somewhat likely Quite likely Extremely likely A B C D E VH262948 A B C D E VH262949 A B C D E VH262950 A B C D E VH262951 A B C D E VH337286 A B C D E VH337287 a. My students did well because they studied and were prepared. b. My students did well because they put in a lot of effort. c. My students did well because they always do well on tests. d. My students did well because I taught the concepts well. e. My students did well because they guessed well on the test. f. My students did well because they are just good at reading. VH262634 11. In your view, to what extent do the following limit how you teach this class? Select one circle in each row. a. Students lacking prerequisite knowledge or skills b. Students with special needs (e.g., physical disabilities, mental or emotional/psychological impairment) c. Disruptive students d. Uninterested students Not applicable Not at all Some A lot A B C D VH262636 A B C D VH262637 A B C D VH262638 A B C D VH262639 498 Appendix F-2l: 2018 Cognitive Interviews Grade 4 Reading 499 VH812038 1. This school year, to what extent have you emphasized the following tasks when teaching informational and literary texts in class? Select one circle in each row. a. Locate and recall (e.g., identify main ideas or focus on specific elements of a story) b. Integrate and interpret (e.g., make comparisons, explain character motivation, or examine relations of ideas across the text) c. Critique and evaluate (e.g., evaluate text critically from many perspectives or evaluate overall text quality) No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH812042 A B C D E VH812044 A B C D E VH812047 500 VH812457 2. To what extent have you provided instruction in the following types of text in English/language arts class so far this year? Select one circle in each row. a. b. c. d. e. Fiction Literary nonfiction Poetry Exposition Argumentation and persuasion f. Procedural texts and documents g. Mixed media texts (e.g., texts including images, infographics, or animations) Not at all Small extent Moderate extent Large extent A B C D VH812465 A B C D VH812466 A B C D VH812469 A B C D VH812470 A B C D VH812471 A B C D VH812473 A B C D VH812477 501 VH812117 3. When you teach English/language arts, how often do you use the following pedagogical techniques or tools? Select one circle in each row. a. I teach reading as a whole-class activity. b. I create student groups with the same achievement level. c. I create student groups with mixed achievement levels. d. I create groups by random assignment. e. I allow students to choose their own groups. f. I use individualized instruction for reading. g. Students work independently on an assigned plan or goal. h. Students work independently on a goal they choose themselves. i. Students use self-paced reading programs or apps. j. I create opportunities for students to participate in online book clubs. k. Students collaborate with peers and experts through the Internet or other digital connections. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH812171 A B C D E VH812172 A B C D E VH812418 A B C D E VH812421 A B C D E VH812425 A B C D E VH812426 A B C D E VH812428 A B C D E VH812429 A B C D E VH812430 A B C D E VH812431 A B C D E VH812433 502 VH812558 4. When you teach English/language arts to your students, how do you use each of the following resources? Select one circle in each row. a. Hardback or soft cover/paperback textbooks, workbooks, or worksheets b. Electronic textbooks, workbooks or worksheets c. Children’s books (e.g., novels, collections of stories, nonfiction, graphic novels) d. Materials from different curricular areas e. Children’s newspapers and/or magazines f. Reading-related websites or apps g. Reading-related educational games h. Materials found on the Internet i. Mixed media texts (e.g., texts including images, infographics, or animations) Not used Supplement Basis for instruction A B C VH812584 A B C VH812586 A B C VH812587 A B C VH812589 A B C VH812590 A B C VH812593 A B C VH812594 A B C VH812598 A B C VH812599 503 VH811986 5. When reading a story, article, or other passage with your students, how often do you ask your students to do the following activities? Select one circle in each row. a. Summarize the passage b. Interpret the meaning of the passage c. Question the motives or feelings of the characters d. Identify the main ideas of the passage e. Identify the themes of the passage f. Analyze two or more texts on the same topic g. Evaluate the main evidence in a persuasive/argument passage h. Analyze the author’s organization of information in a passage i. Critique the author’s craft or technique j. Analyze the author’s use of mixed media (e.g., texts including images, infographics, or animations) Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH811995 A B C D E VH811997 A B C D E VH811998 A B C D E VH812000 A B C D E VH812001 A B C D E VH812005 A B C D E VH812008 A B C D E VH812009 A B C D E VH812011 A B C D E VH812013 504 VH812070 6. In your fourth-grade English/language arts class this year, how often do your students do each of the following activities? Select one circle in each row. a. Build and practice vocabulary b. Build reading fluency c. Build reading comprehension d. Practice spelling, grammar, capitalization, punctuation, and other mechanics e. Access reading-related websites f. Conduct research for reading projects g. Read something they have chosen themselves h. Work in pairs or small groups to talk about something they have read i. Build background knowledge with online resources and media Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH812077 A B C D E VH812078 A B C D E VH812083 A B C D E VH812084 A B C D E VH812086 A B C D E VH812088 A B C D E VH812089 A B C D E VH812091 A B C D E VH812112 505 VH812540 7. How well has your teacher preparation program prepared you to teach students with the following attributes? Select one circle in each row. a. Students lacking prerequisite knowledge or skills b. Students with special needs (e.g., physical disabilities, mental or emotional/ psychological impairment) c. Disruptive students d. Uninterested students e. English-language learners (ELL) f. Gifted and talented students Not well at all A little Somewhat Quite a bit Extremely well A B C D E VH812546 A B C D E VH812547 A B C D E VH812549 A B C D E VH812550 A B C D E VH812551 A B C D E VH812553 506 Appendix F-2m: 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) 507 VH547397 1. Have you been awarded tenure by the school, district, or diocese where you currently teach? A Yes B No C My school, district, or diocese does not award tenure. 508 If you do not teach Reading, please do not answer the next 2 questions. VH334360 2. When you teach English/language arts, how often do you use the following strategies? Select one circle in each row. a. I teach reading as a whole-class activity. b. I create student groups with the same achievement level. c. I create student groups with different achievement levels. d. I create groups by random assignment. e. I allow students to choose their own groups. f. I use differentiated instruction for reading (i.e., instruction tailored to student ability and learning style). g. I ask students to work independently on an assignment or task. h. I ask students to work independently on a task they choose themselves. i. Other strategies (Please specify): Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH334361 A B C D E VH334362 A B C D E VH548665 A B C D E VH334363 A B C D E VH334368 A B C D E VH562894 A B C D E VH548666 A B C D E VH548667 A B C D E VH562900 509 VH547867 3. In your eighth-grade English/language arts class this year, how often do your students do each of the following? Select one circle in each row. a. Build and practice vocabulary b. Build reading fluency c. Build reading comprehension d. Access reading-related websites e. Conduct research for projects Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH547868 A B C D E VH617114 A B C D E VH617116 A B C D E VH547871 A B C D E VH547872 510 If you do not teach Mathematics, please do not answer the next 4 questions. VH548937 4. In your mathematics class this year, do you use any of the following instructional materials during instruction? Select one circle in each row. Yes a. Textbooks provided by your district or school b. Other materials provided by your district or school c. Materials found on the Internet d. Printed workbooks e. Digital manipulatives f. Physical manipulatives (for example, ruler, protractor, compass) g. Digital games h. Interactive whiteboard i. Other materials not listed above (Please specify): No, I do not No, this resource prefer to use this is not available to resource. me. A B C VH548938 A B C VH548939 A B C VH548940 A B C VH548947 A B C VH548942 A B C VH548945 A B C VH548948 A B C VH548944 A B C VH548941 511 VH270281 5. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Use clear and precise language to discuss problem solving and reasoning b. Use models to explain calculations c. Represent a problem in multiple ways including using numbers, words, pictures, and charts d. Use models to examine real-life and mathematical examples e. Evaluate a problem-solving process f. Create equations g. Relate what your students know to the real world and make sense of it mathematically h. Use appropriate terminology when referring to the number system, functions, geometric figures, and data displays i. Evaluate the conclusions of other students j. Examine patterns in tables and graphs to describe relationships No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH562965 A B C D E VH562966 A B C D E VH562967 A B C D E VH549099 A B C D E VH562983 A B C D E VH562985 A B C D E VH562988 A B C D E VH562989 A B C D E VH549107 A B C D E VH562991 512 VH547430 6. Thinking about your eighth-grade mathematics classes this year, how often do you incorporate the following practices when teaching your students? Select one circle in each row. a. Posing questions during a lesson that will help students to reason and make sense of mathematical connections and relationships b. Using overall learning goals to guide instructional decisions c. Building procedural understanding to encourage the use of multiple problem-solving strategies d. Providing opportunities for students to productively struggle with mathematical ideas and relationships Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH547431 A B C D E VH547434 A B C D E VH547433 A B C D E VH547432 513 VH547461 7. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Use definitions and notation precisely b. Justify and explain their reasoning c. Identify and correct flawed mathematical reasoning d. Construct arguments using tables, graphs, or diagrams e. Make, test, and validate conjectures f. Use examples or counterexamples to support or refute a mathematical conjecture g. Engage in deductive reasoning and informal proofs No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH547462 A B C D E VH547463 A B C D E VH547464 A B C D E VH547468 A B C D E VH547466 A B C D E VH547467 A B C D E VH547465 514 VH617288 8. In your mathematics class this year, how often do you use each of the following strategies when teaching? Select one circle in each row. a. I teach mathematics as a whole-class activity. b. I create student groups with the same achievement level. c. I create groups by random assignment. d. I allow students to choose their own group. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH617289 A B C D E VH617290 A B C D E VH617291 A B C D E VH617292 515 Appendix F-2n: 2017 Operational Grade 8 Reading (COI) 516 VH240015 1. Which best describes your role in teaching English/language arts to this class? Language arts refers to reading, writing, literature, and related topics. Select one circle. A I do not teach English/language arts to this class. Questions 2–12 are not applicable and will be skipped. B I teach all or most subjects, including English/language arts. C The only subject I teach is English/language arts. D We team teach, and I have primary responsibility for teaching English/language arts. VH261160 2. How many students are in this class? Enter the number of students. VH334255 3. In a typical week, about how much time in total do you spend with one of your eighth-grade English/language arts classes? Enter the hours and minutes. hours and minutes per week VH334381 4. Which best describes how English/language arts instruction is organized for eighth-grade students at this school? Select one circle. A English/language arts is taught primarily as a discrete subject with little or no integration with instruction in other subjects. B Some English/language arts instruction is integrated with other subjects, and some English/language arts instruction is presented as a discrete subject. C English/language arts lessons are primarily integrated with instruction in other subjects. 517 VH240522 5. To what extent have you provided instruction in the following in English/language arts class so far this year? Select one circle in each row. a. b. c. d. e. Fiction Literary nonfiction Poetry Exposition Argumentation and persuasion f. Procedural texts and documents Not at all Small extent Moderate extent Large extent A B C D VH240523 A B C D VH240524 A B C D VH240528 A B C D VH240526 A B C D VH240527 A B C D VH240525 518 VH334294 6. When reading a story, article, or other passage with your students, how often do you ask your students to do the following? Select one circle in each row. a. Summarize the passage b. Interpret the meaning of the passage c. Question the motives or feelings of the characters d. Identify the main ideas of the passage e. Identify the themes of the passage f. Analyze two or more texts on the same topic g. Evaluate the main evidence in a persuasive/argument passage h. Analyze the author’s organization of information in a passage i. Critique the author’s craft or technique Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH334295 A B C D E VH334296 A B C D E VH334299 A B C D E VH334298 A B C D E VH335901 A B C D E VH334297 A B C D E VH334300 A B C D E VH334302 A B C D E VH334305 519 VH261255 7. This school year, to what extent have you emphasized the following cognitive processes when teaching informational and literary texts in class? Select one circle in each row. a. Locate and recall (e.g., identify main ideas or focus on specific elements of a story) b. Integrate and interpret (e.g., make comparisons, explain character motivation, or examine relations of ideas across the text) c. Critique and evaluate (e.g., evaluate text critically from many perspectives or evaluate overall text quality) No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH261256 A B C D E VH261257 A B C D E VH261258 520 VH334360 8. When you teach English/language arts, how often do you use the following strategies? Select one circle in each row. a. I teach reading as a whole-class activity. b. I create student groups with the same achievement level. c. I create groups by random assignment. d. I allow students to choose their own groups. e. I use individualized instruction for reading. f. Students work independently on an assigned plan or goal. g. Students work independently on a goal they choose themselves. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH334361 A B C D E VH334362 A B C D E VH334363 A B C D E VH334368 A B C D E VH334364 A B C D E VH334365 A B C D E VH334366 521 VH334484 9. When you teach English/language arts to your students, how do you use each of the following resources? Select one circle in each row. a. Hardback textbooks, workbooks, or worksheets b. Electronic textbooks c. A variety of books (e.g., novels, collections of stories, nonfiction) d. Materials from different curricular areas e. Newspapers and/or magazines f. Reading-related websites or apps g. Reading-related educational games Not used Supplement Basis for instruction A B C VH334485 A B C VH334486 A B C VH262702 A B C VH334498 A B C VH262705 A B C VH334495 A B C VH334491 522 VH262575 10. In your eighth-grade English/language arts class this year, how often do your students use a computer or other digital device to do each of the following? Select one circle in each row. a. Build and practice vocabulary b. Build reading fluency c. Build reading comprehension d. Access reading-related websites e. Conduct research for reading projects Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH262577 A B C D E VH617489 A B C D E VH617490 A B C D E VH262579 A B C D E VH262581 523 VH262946 11. Suppose your students did very well on their last English/language arts test. How likely do you think each of the following explanations is in this situation? Select one circle in each row. Not at all likely Not likely Somewhat likely Quite likely Extremely likely A B C D E VH262948 A B C D E VH262949 A B C D E VH262950 A B C D E VH262951 A B C D E VH337286 A B C D E VH337287 a. My students did well because they studied and were prepared. b. My students did well because they put in a lot of effort. c. My students did well because they always do well on tests. d. My students did well because I taught the concepts well. e. My students did well because they guessed well on the test. f. My students did well because they are just good at reading. VH262634 12. In your view, to what extent do the following limit how you teach this class? Select one circle in each row. a. Students lacking prerequisite knowledge or skills b. Students with special needs (e.g., physical disabilities, mental or emotional/psychological impairment) c. Disruptive students d. Uninterested students Not applicable Not at all Some A lot A B C D VH262636 A B C D VH262637 A B C D VH262638 A B C D VH262639 524 Appendix F-2o: 2018 Cognitive Interviews Grade 8 Reading 525 VH812038 1. This school year, to what extent have you emphasized the following tasks when teaching informational and literary texts in class? Select one circle in each row. a. Locate and recall (e.g., identify main ideas or focus on specific elements of a story) b. Integrate and interpret (e.g., make comparisons, explain character motivation, or examine relations of ideas across the text) c. Critique and evaluate (e.g., evaluate text critically from many perspectives or evaluate overall text quality) No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH812042 A B C D E VH812044 A B C D E VH812047 526 VH812457 2. To what extent have you provided instruction in the following types of text in English/language arts class so far this year? Select one circle in each row. a. b. c. d. e. Fiction Literary nonfiction Poetry Exposition Argumentation and persuasion f. Procedural texts and documents g. Mixed media texts (e.g., texts including images, infographics, or animations) Not at all Small extent Moderate extent Large extent A B C D VH812465 A B C D VH812466 A B C D VH812469 A B C D VH812470 A B C D VH812471 A B C D VH812473 A B C D VH812477 527 VH812117 3. When you teach English/language arts, how often do you use the following pedagogical techniques or tools? Select one circle in each row. a. I teach reading as a whole-class activity. b. I create student groups with the same achievement level. c. I create student groups with mixed achievement levels. d. I create groups by random assignment. e. I allow students to choose their own groups. f. I use individualized instruction for reading. g. Students work independently on an assigned plan or goal. h. Students work independently on a goal they choose themselves. i. Students use self-paced reading programs or apps. j. I create opportunities for students to participate in online book clubs. k. Students collaborate with peers and experts through the Internet or other digital connections. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH812171 A B C D E VH812172 A B C D E VH812418 A B C D E VH812421 A B C D E VH812425 A B C D E VH812426 A B C D E VH812428 A B C D E VH812429 A B C D E VH812430 A B C D E VH812431 A B C D E VH812433 528 VH816560 4. When you teach English/language arts to your students, how do you use each of the following resources? Select one circle in each row. a. Hardback or soft cover/paperback textbooks, workbooks, or worksheets b. Electronic textbooks, workbooks or worksheets c. Books (e.g., novels, collections of stories, nonfiction, graphic novels d. Materials from different curricular areas e. Newspapers and/or magazines f. Reading-related websites or apps g. Reading-related educational games h. Materials found on the Internet i. Mixed media texts (e.g., texts including images, infographics, or animations) Not used Supplement Basis for instruction A B C VH812584 A B C VH812586 A B C VH812596 A B C VH812589 A B C VH812597 A B C VH812593 A B C VH812594 A B C VH812598 A B C VH812599 529 VH811986 5. When reading a story, article, or other passage with your students, how often do you ask your students to do the following activities? Select one circle in each row. a. Summarize the passage b. Interpret the meaning of the passage c. Question the motives or feelings of the characters d. Identify the main ideas of the passage e. Identify the themes of the passage f. Analyze two or more texts on the same topic g. Evaluate the main evidence in a persuasive/argument passage h. Analyze the author’s organization of information in a passage i. Critique the author’s craft or technique j. Analyze the author’s use of mixed media (e.g., texts including images, infographics, or animations) Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH811995 A B C D E VH811997 A B C D E VH811998 A B C D E VH812000 A B C D E VH812001 A B C D E VH812005 A B C D E VH812008 A B C D E VH812009 A B C D E VH812011 A B C D E VH812013 530 VH812503 6. In your eighth-grade English/language arts class this year, how often do your students use a computer or other digital device to do each of the following activities? Select one circle in each row. a. Build and practice vocabulary b. Build reading fluency c. Build reading comprehension d. Access reading-related websites e. Conduct research for reading projects f. Read something they have chosen themselves g. Work in pairs or small groups to talk about something they have read h. Build background knowledge with online resources and media Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH812511 A B C D E VH812512 A B C D E VH812515 A B C D E VH812518 A B C D E VH812519 A B C D E VH812521 A B C D E VH812522 A B C D E VH812523 531 VH812540 7. How well has your teacher preparation program prepared you to teach students with the following attributes? Select one circle in each row. a. Students lacking prerequisite knowledge or skills b. Students with special needs (e.g., physical disabilities, mental or emotional/ psychological impairment) c. Disruptive students d. Uninterested students e. English-language learners (ELL) f. Gifted and talented students Not well at all A little Somewhat Quite a bit Extremely well A B C D E VH812546 A B C D E VH812547 A B C D E VH812549 A B C D E VH812550 A B C D E VH812551 A B C D E VH812553 532 Appendix F-2p: 2017 Operational Grade 4 Mathematics (COI) 533 VH240054 1. Which best describes your role in teaching mathematics to this class? A I do not teach mathematics to this class. Questions 2–20 are not applicable and will be skipped. B I teach all or most subjects, including mathematics. C The only subject I teach is mathematics. D We team teach, and I have primary responsibility for teaching mathematics. VH261160 2. How many students are in this class? Enter the number of students. VH336581 3. In a typical week, about how much time in total do you spend with this class on mathematics instruction? Enter the hours and minutes. hours and minutes per week VH336584 4. Are students assigned to this class by achievement level? A Yes B No VH336588 5. Do you create groups within this class for mathematics instruction on the basis of achievement level? A Yes B No 534 VH240060 6. What kind of calculator do your students usually use during mathematics lessons? A None B Basic four-function (addition, subtraction, multiplication, division) C Scientific (not graphing) D Graphing VH240058 7. Approximately how much mathematics homework do you assign to students in this class each day? A None B 15 minutes C 30 minutes D 45 minutes E One hour F More than one hour VH240059 8. To what extent are students permitted to use calculators during mathematics lessons? A Unrestricted use B Restricted use C Calculators are not permitted. VH240061 9. When you give students a mathematics test or quiz, how often do they use a calculator? A Never B Sometimes C Always 535 VH269921 10. In your mathematics class this year, how often do your students use a computer or other digital device (excluding handheld calculators) to do each of the following? Select one circle in each row. a. Practice or review mathematics topics b. Extend mathematics learning with enrichment activities c. Research mathematics topics on the Internet Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH269922 A B C D E VH269923 A B C D E VH269924 VH269858 11. In your mathematics class this year, how often do you use assessment results to do each of the following? Select one circle in each row. a. Discuss the progress your students have made toward individually set goals b. Adjust your teaching strategies to meet the current learning needs of individual students c. Adjust your teaching strategies to reflect your instructional objectives for the classroom d. Discuss class progress with school administrators e. Discuss class progress with other colleagues Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH269862 A B C D E VH269864 A B C D E VH269865 A B C D E VH269868 A B C D E VH269871 536 VH270256 12. In your mathematics class this year, do you use any of the following instructional materials? Select one circle in each row. a. Textbooks provided by your district or school b. Other materials provided by your district or school c. Materials found on the Internet d. Materials you have created e. Other materials (Please specify): Yes No A B VH270257 A B VH270258 A B VH270259 A B VH617626 A B VH270260 537 VH270271 13. Thinking about your fourth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Determine what the problem is asking and the best way to solve it b. Use alternate methods to solve problems when the first method does not work c. Explain one’s thinking and make connections between models and equations d. Make assumptions e. Make approximations f. Represent a problem situation with numbers, words, pictures, or charts g. Understand tools for problem solving and limitations of use h. Use clear and precise language when students are discussing their problem solving and reasoning No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH270272 A B C D E VH270274 A B C D E VH270275 A B C D E VH617226 A B C D E VH617227 A B C D E VH270277 A B C D E VH270278 A B C D E VH270279 538 VH240850 14. Think about your plans for this mathematics class for the entire year. How much emphasis did you or will you give each of the following? Select one circle in each row. a. b. c. d. Little or no emphasis Moderate emphasis Heavy emphasis A B C VH240851 A B C VH240852 A B C VH240853 A B C VH240856 Numbers and operations Measurement Geometry Data analysis, statistics, and probability VH240873 15. When you teach mathematics to your fourth-grade class, do you do any of the following? Select one circle in each row. a. Set different achievement standards for some students b. Supplement the regular course curriculum with additional material for some students c. Have some students engage in different classroom activities d. Use a different set of methods in teaching some students e. Pace my teaching differently for some students Not at all Small extent Moderate extent Large extent A B C D VH240874 A B C D VH240875 A B C D VH240878 A B C D VH240877 A B C D VH240876 539 VH269351 16. How often do you use each of the following to assess student progress in mathematics? Select one circle in each row. Never or hardly ever a. Multiple-choice tests b. Small project-based assignments c. Individual students collaborating on group assignments Once or twice Once or twice Once or twice a year a month a week A B C D VH269353 A B C D VH269357 A B C D VH336538 VH269925 17. In your mathematics class this year, how often do you do each of the following with individual students to assess their progress in mathematics? Select one circle in each row. a. Regularly discuss each student’s current level of performance with them b. Set goals for specific progress the student would like to make c. Discuss progress the student has made toward goals previously set d. Determine how to adjust your teaching strategies to meet the student’s current learning needs Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH269926 A B C D E VH269928 A B C D E VH269930 A B C D E VH269931 540 VH270305 18. Suppose your students did very well on their last mathematics test. How likely do you think each of the following explanations is in this situation? Select one circle in each row. a. My students did well because they studied and were prepared. b. My students did well because they put in a lot of effort. c. My students did well because they always do well on tests. d. My students did well because I taught the concepts well. e. My students did well because they guessed well on the test. f. My students did well because they are just good at math. Not at all likely Not likely Somewhat likely Quite likely Extremely likely A B C D E VH270306 A B C D E VH270307 A B C D E VH270308 A B C D E VH270309 A B C D E VH270311 A B C D E VH270313 VH270361 19. In your mathematics classes this year, how often did you encourage your students to participate in mathematics activities outside of school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 541 VH270362 20. In this school year, how many times did you provide direct opportunities for your students to participate in mathematics activities outside of school? A Never B Once C Two or three times D Four or five times E More than five times 542 Appendix F-2q: 2018 Cognitive Interviews Grade 4 Mathematics 543 VH811594 4. In your mathematics class this year, do you use any of the following instructional materials? Select one circle in each row. a. Textbooks (print or digital) provided by your district or school b. Other materials provided by your district or school (e.g., math manipulatives, math board games, or math puzzles) c. Math software and/or apps (game-based or lesson-based) Yes No A B VH811602 A B VH811624 A B VH811626 VH811630 5. When you teach mathematics to your fourth-grade class, do you do any of the following? Select one circle in each row. a. Set different achievement standards for some students b. Provide multiple representation of concepts, and guide students to express what they know using various formats Not at all Small extent Moderate extent Large extent A B C D VH811637 A B C D VH811643 544 VH812823 6. Thinking about your fourth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Determine what the problem is asking and the best way to solve it b. Use alternate methods to solve problems when the first method does not work c. Explain one’s thinking and make connections between models and equations d. Make assumptions using mathematical knowledge to simplify a problem e. Make approximations f. Represent a problem situation with numbers, words, pictures, or charts g. Understand tools for problem solving and limitations of use h. Use clear and precise language when students are discussing their problem solving and reasoning No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH812833 A B C D E VH812834 A B C D E VH812843 A B C D E VH812846 A B C D E VH812849 A B C D E VH812850 A B C D E VH812851 A B C D E VH812853 545 Appendix F-2r: 2017 Pilot Grade 8 Core, Reading, Mathematics (All subjects) 546 VH547397 1. Have you been awarded tenure by the school, district, or diocese where you currently teach? A Yes B No C My school, district, or diocese does not award tenure. 547 If you do not teach Reading, please do not answer the next 2 questions. VH334360 2. When you teach English/language arts, how often do you use the following strategies? Select one circle in each row. a. I teach reading as a whole-class activity. b. I create student groups with the same achievement level. c. I create student groups with different achievement levels. d. I create groups by random assignment. e. I allow students to choose their own groups. f. I use differentiated instruction for reading (i.e., instruction tailored to student ability and learning style). g. I ask students to work independently on an assignment or task. h. I ask students to work independently on a task they choose themselves. i. Other strategies (Please specify): Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH334361 A B C D E VH334362 A B C D E VH548665 A B C D E VH334363 A B C D E VH334368 A B C D E VH562894 A B C D E VH548666 A B C D E VH548667 A B C D E VH562900 548 VH547867 3. In your eighth-grade English/language arts class this year, how often do your students do each of the following? Select one circle in each row. a. Build and practice vocabulary b. Build reading fluency c. Build reading comprehension d. Access reading-related websites e. Conduct research for projects Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH547868 A B C D E VH617114 A B C D E VH617116 A B C D E VH547871 A B C D E VH547872 549 If you do not teach Mathematics, please do not answer the next 4 questions. VH548937 4. In your mathematics class this year, do you use any of the following instructional materials during instruction? Select one circle in each row. Yes a. Textbooks provided by your district or school b. Other materials provided by your district or school c. Materials found on the Internet d. Printed workbooks e. Digital manipulatives f. Physical manipulatives (for example, ruler, protractor, compass) g. Digital games h. Interactive whiteboard i. Other materials not listed above (Please specify): No, I do not No, this resource prefer to use this is not available to resource. me. A B C VH548938 A B C VH548939 A B C VH548940 A B C VH548947 A B C VH548942 A B C VH548945 A B C VH548948 A B C VH548944 A B C VH548941 550 VH270281 5. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Use clear and precise language to discuss problem solving and reasoning b. Use models to explain calculations c. Represent a problem in multiple ways including using numbers, words, pictures, and charts d. Use models to examine real-life and mathematical examples e. Evaluate a problem-solving process f. Create equations g. Relate what your students know to the real world and make sense of it mathematically h. Use appropriate terminology when referring to the number system, functions, geometric figures, and data displays i. Evaluate the conclusions of other students j. Examine patterns in tables and graphs to describe relationships No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH562965 A B C D E VH562966 A B C D E VH562967 A B C D E VH549099 A B C D E VH562983 A B C D E VH562985 A B C D E VH562988 A B C D E VH562989 A B C D E VH549107 A B C D E VH562991 551 VH547430 6. Thinking about your eighth-grade mathematics classes this year, how often do you incorporate the following practices when teaching your students? Select one circle in each row. a. Posing questions during a lesson that will help students to reason and make sense of mathematical connections and relationships b. Using overall learning goals to guide instructional decisions c. Building procedural understanding to encourage the use of multiple problem-solving strategies d. Providing opportunities for students to productively struggle with mathematical ideas and relationships Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH547431 A B C D E VH547434 A B C D E VH547433 A B C D E VH547432 552 VH547461 7. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Use definitions and notation precisely b. Justify and explain their reasoning c. Identify and correct flawed mathematical reasoning d. Construct arguments using tables, graphs, or diagrams e. Make, test, and validate conjectures f. Use examples or counterexamples to support or refute a mathematical conjecture g. Engage in deductive reasoning and informal proofs No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH547462 A B C D E VH547463 A B C D E VH547464 A B C D E VH547468 A B C D E VH547466 A B C D E VH547467 A B C D E VH547465 553 VH617288 8. In your mathematics class this year, how often do you use each of the following strategies when teaching? Select one circle in each row. a. I teach mathematics as a whole-class activity. b. I create student groups with the same achievement level. c. I create groups by random assignment. d. I allow students to choose their own group. Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH617289 A B C D E VH617290 A B C D E VH617291 A B C D E VH617292 554 Appendix F-2s: 2017 Operational Grade 8 Mathematics (COI) 555 VH240054 1. Which best describes your role in teaching mathematics to this class? A I do not teach mathematics to this class. Questions 2–19 are not applicable and will be skipped. B I teach all or most subjects, including mathematics. C The only subject I teach is mathematics. D We team teach, and I have primary responsibility for teaching mathematics. VH261160 2. How many students are in this class? Enter the number of students. VH336581 3. In a typical week, about how much time in total do you spend with this class on mathematics instruction? Enter the hours and minutes. hours and minutes per week VH336584 4. Are students assigned to this class by achievement level? A Yes B No VH240060 5. What kind of calculator do your students usually use during mathematics lessons? A None B Basic four-function (addition, subtraction, multiplication, division) C Scientific (not graphing) D Graphing 556 VH240058 6. Approximately how much mathematics homework do you assign to students in this class each day? A None B 15 minutes C 30 minutes D 45 minutes E One hour F More than one hour VH269921 7. In your mathematics class this year, how often do your students use a computer or other digital device (excluding handheld calculators) to do each of the following? Select one circle in each row. a. Practice or review mathematics topics b. Extend mathematics learning with enrichment activities c. Research mathematics topics on the Internet Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH269922 A B C D E VH269923 A B C D E VH269924 VH240061 8. When you give students a mathematics test or quiz, how often do they use a calculator? A Never B Sometimes C Always 557 VH240059 9. To what extent are students permitted to use calculators during mathematics lessons? A Unrestricted use B Restricted use C Calculators are not permitted. VH269858 10. In your mathematics class this year, how often do you use assessment results to do each of the following? Select one circle in each row. a. Discuss the progress your students have made toward individually set goals b. Adjust your teaching strategies to meet the current learning needs of individual students c. Adjust your teaching strategies to reflect your instructional objectives for the classroom d. Discuss class progress with school administrators e. Discuss class progress with other colleagues Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH269862 A B C D E VH269864 A B C D E VH269865 A B C D E VH269868 A B C D E VH269871 558 VH270256 11. In your mathematics class this year, do you use any of the following instructional materials? Select one circle in each row. a. Textbooks provided by your district or school b. Other materials provided by your district or school c. Materials found on the Internet d. Materials you have created e. Other materials (Please specify): Yes No A B VH270257 A B VH270258 A B VH270259 A B VH617626 A B VH270260 559 VH270281 12. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Make assumptions b. Make approximations c. Use models to explain calculations d. Represent a problem situation in multiple ways, including numbers, words, pictures, and charts e. Evaluate a problem-solving process f. Create equations g. Relate what your students know to the real world and make sense of it mathematically h. Use appropriate terminology when referring to the number system, functions, geometric figures, and data displays i. Examine patterns in tables and graphs to generate equations and describe relationships No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH617994 A B C D E VH617995 A B C D E VH270284 A B C D E VH270285 A B C D E VH270286 A B C D E VH270288 A B C D E VH270289 A B C D E VH270290 A B C D E VH270292 560 VH240850 13. Think about your plans for this mathematics class for the entire year. How much emphasis did you or will you give each of the following? Select one circle in each row. Little or no emphasis Moderate emphasis Heavy emphasis A B C VH240851 A B C VH240852 A B C VH240853 A B C VH240856 A B C VH240854 a. b. c. d. Numbers and operations Measurement Geometry Data analysis, statistics, and probability e. Algebra and functions VH240899 14. When you teach mathematics to your eighth-grade class, do you do any of the following? Select one circle in each row. a. Set different achievement standards for some students b. Supplement the regular course curriculum with additional material for some students c. Have some students engage in different classroom activities d. Use a different set of methods in teaching some students e. Pace my teaching differently for some students Not at all Small extent Moderate extent Large extent A B C D VH240900 A B C D VH240901 A B C D VH240904 A B C D VH240903 A B C D VH240902 561 VH269351 15. How often do you use each of the following to assess student progress in mathematics? Select one circle in each row. Never or hardly ever a. Multiple-choice tests b. Small project-based assignments c. Individual students collaborating on group assignments Once or twice Once or twice Once or twice a year a month a week A B C D VH269353 A B C D VH269357 A B C D VH336538 VH269925 16. In your mathematics class this year, how often do you do each of the following with individual students to assess their progress in mathematics? Select one circle in each row. a. Regularly discuss each student’s current level of performance with them b. Set goals for specific progress the student would like to make c. Discuss progress the student has made toward goals previously set d. Determine how to adjust your teaching strategies to meet the student’s current learning needs Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH269926 A B C D E VH269928 A B C D E VH269930 A B C D E VH269931 562 VH270305 17. Suppose your students did very well on their last mathematics test. How likely do you think each of the following explanations is in this situation? Select one circle in each row. a. My students did well because they studied and were prepared. b. My students did well because they put in a lot of effort. c. My students did well because they always do well on tests. d. My students did well because I taught the concepts well. e. My students did well because they guessed well on the test. f. My students did well because they are just good at math. Not at all likely Not likely Somewhat likely Quite likely Extremely likely A B C D E VH270306 A B C D E VH270307 A B C D E VH270308 A B C D E VH270309 A B C D E VH270311 A B C D E VH270313 VH270361 18. In your mathematics classes this year, how often did you encourage your students to participate in mathematics activities outside of school? A Never B About once or twice a year C About once or twice a month D About once or twice a week E Every day or almost every day 563 VH270362 19. In this school year, how many times did you provide direct opportunities for your students to participate in mathematics activities outside of school? A Never B Once C Two or three times D Four or five times E More than five times 564 Appendix F-2t: 2018 Cognitive Interviews Grade 8 Mathematics 565 VH811594 4. In your mathematics class this year, do you use any of the following instructional materials? Select one circle in each row. a. Textbooks (print or digital) provided by your district or school b. Other materials provided by your district or school (e.g., math manipulatives, math board games, or math puzzles) c. Math software and/or apps (game-based or lesson-based) Yes No A B VH811602 A B VH811624 A B VH811626 VH811646 5. When you teach mathematics to your eighth-grade class, do you do any of the following? Select one circle in each row. a. Set different achievement standards for some students b. Provide multiple representation of concepts, and guide students to express what they know using various formats Not at all Small extent Moderate extent Large extent A B C D VH811653 A B C D VH811659 566 VH812855 6. Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on teaching your students each of the following? Select one circle in each row. a. Make assumptions using mathematical knowledge to simplify a problem b. Make approximations c. Use models to explain calculations d. Represent a problem situation in multiple ways, including numbers, words, pictures, and charts No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH812897 A B C D E VH812898 A B C D E VH812879 A B C D E VH812881 567 Appendix F-2u: 2018 Pilot Grade 4 Science (COI) 568 VH240113 1. Which best describes your role in teaching science to this class? Select one circle. A I do not teach science to this class. B I teach all or most subjects, including science. C The only subject I teach is science. D We team teach, and I have primary responsibility for teaching science. VH261160 2. How many students are in this class? Enter the number of students. VH704560 3. In a typical week, how much time do you spend teaching science to the students in this class? Write in the hours and minutes. hours and minutes per week VH240114 4. Are students assigned to this class by achievement level? A Yes B No 569 VH241164 5. How often do you use each of the following methods to assess student progress in science? Select one circle in each row. Never or hardly ever a. Multiple-choice tests b. Short written responses (e.g., a phrase or sentence) c. Long written responses (e.g., several sentences or paragraphs) d. Performance-based assessments e. Group projects Once or twice Once or twice a month a week Almost every day A B C D VH241165 A B C D VH241166 A B C D VH241169 A B C D VH241168 A B C D VH241167 VH639433 6. In this class, about how much time do you spend on each of the following areas of science? Select one circle in each row. a. Life science b. Earth and space science c. Physical science d. Engineering and technology No time Very little time Some time Quite a bit of time A lot of time A B C D E VH639434 A B C D E VH639436 A B C D E VH639435 A B C D E VH639437 570 VH639586 7. About how often do your science students do each of the following activities? Select one circle in each row. a. Work with other students on a science activity or project b. Write about science (e.g., papers, reports, or student science journals) c. Watch you do a science activity d. Talk about the measurements and results from their hands-on activities e. Discuss the kinds of problems that engineers can solve (e.g., how to build a bridge or how to collect energy from the Sun) f. Figure out different ways to solve a science problem g. Present what they have learned about science Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH639589 A B C D E VH639600 A B C D E VH639856 A B C D E VH639594 A B C D E VH639597 A B C D E VH639846 A B C D E VH639593 571 VH641162 8. In your science class this year, how much emphasis have you devoted to teaching your students each of the following skills? Select one circle in each row. a. Making observations of natural phenomena (e.g., making measurements) b. Making predictions based on prior experimental observations c. Creating models of scientific principles (e.g., a graphic, manipulative, or demonstration that illustrates the principle) d. Reading data in tables or charts to draw conclusions about hypotheses e. Deciding which tools would be most appropriate to gather data f. Designing and testing a solution to a problem No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH641163 A B C D E VH641166 A B C D E VH641167 A B C D E VH641169 A B C D E VH641172 A B C D E VH641174 572 VH640891 9. Thinking about your science class this year, how much emphasis did you place on teaching your students each of the following skills? Select one circle in each row. a. Developing good research questions b. Using drawings or models to explain events or phenomena c. Coming up with experiments or other tests to answer a scientific question d. Organizing data into a chart, graph, or spreadsheet to test a solution e. Deciding when to use quantitative versus qualitative data f. Generating explanations based on observations and measurements g. Evaluating the quality of data h. Teaching science ideas to others (e.g., students or teachers) No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH640901 A B C D E VH640902 A B C D E VH640903 A B C D E VH640906 A B C D E VH640907 A B C D E VH640908 A B C D E VH640909 A B C D E VH640911 573 VH241190 10. To what extent do you emphasize each of the following objectives in teaching science to your fourth-grade class? Select one circle in each row. a. Increasing students’ interest in science b. Increasing awareness of the importance of science in daily life c. Teaching the iterative process of scientific inquiry d. Teaching the iterative process of scientific practice e. Developing problem-solving skills f. Developing scientific writing skills Not at all Small extent Moderate extent Large extent A B C D VH241202 A B C D VH241203 A B C D VH639755 A B C D VH748077 A B C D VH241197 A B C D VH241200 574 VH639520 11. To what extent are the following resources available to you in your school system (including your school and school district)? Select one circle in each row. a. Science textbooks (print or online) b. Science magazines and books (print or online) c. Supplies or equipment for science labs or demonstrations d. Space to conduct science labs e. Computers for students’ use in class f. Computer labs g. Computers for teachers’ use h. Science kits i. Scientific measurement instruments (e.g., microscopes, thermometers, beakers, or weighing scales) Not at all Small extent Moderate extent Large extent A B C D VH639521 A B C D VH639522 A B C D VH639523 A B C D VH639525 A B C D VH639532 A B C D VH639527 A B C D VH639528 A B C D VH639531 A B C D VH639526 575 VH641306 12. To what extent do you use each of the following technological resources for science instruction? Select one circle in each row. a. Desktop or laptop computer(s) (including Chromebooks) b. Tablet(s) (e.g., Surface Pro, iPad, Kindle Fire) c. Online content (e.g., online software, podcasts, or videos) d. Interactive web spaces or virtual classrooms (e.g., websites where students can interact and share class materials) e. Smart board(s) Not at all Small extent Moderate extent Large extent A B C D VH641307 A B C D VH641308 A B C D VH641309 A B C D VH641310 A B C D VH641311 VH639626 13. In this school year, how often do you meet with students one-on-one to give feedback on their work and evaluate their progress in science? A Never or hardly ever B A few times a year C Once or twice a month D Once or twice a week E Every day or almost every day 576 VH639633 14. In this school year, how often do you do each of the following activities with individual students to evaluate their progress in science? Select one circle in each row. a. Regularly discuss each student’s current level of performance with them b. Set goals for specific progress the student would like to make c. Discuss progress the student has made toward goals previously set d. Determine how to adjust your teaching strategies to meet the student’s current learning needs Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH639634 A B C D E VH639635 A B C D E VH639636 A B C D E VH639637 577 VH641262 15. Suppose your students did very well on their last science test. How likely do you think each of the following explanations is in this situation? Select one circle in each row. a. My students did well because they studied and were prepared. b. My students did well because they put in a lot of effort. c. My students did well because they always do well on tests. d. My students did well because I taught the concepts well. e. My students did well because they guessed well on the test. f. My students did well because they are just good in science. Not at all likely Not likely Somewhat likely Quite likely Extremely likely A B C D E VH641273 A B C D E VH641276 A B C D E VH641277 A B C D E VH641279 A B C D E VH641281 A B C D E VH641284 VH641332 16. In this school year, did your school offer any of the following supplemental activities? Select one answer choice in each row. a. Opportunities for students to work together to solve problems in their community or the world b. Opportunities for students to engage in group science activities c. Opportunities for students to use scientific instruments (e.g., thermometers, microscopes, or telescopes) d. Opportunities for students to participate in science outreach programs (e.g., partnerships with colleges, museums, or foundations) Yes No A B VH641334 A B VH641338 A B VH641339 A B VH641341 578 Appendix F-2v: 2018 Pilot Grade 8 Science (COI) 579 VH240113 1. Which best describes your role in teaching science to this class? Select one circle. A I do not teach science to this class. B I teach all or most subjects, including science. C The only subject I teach is science. D We team teach, and I have primary responsibility for teaching science. VH261160 2. How many students are in this class? Enter the number of students. VH704560 3. In a typical week, how much time do you spend teaching science to the students in this class? Write in the hours and minutes. hours and minutes per week VH240114 4. Are students assigned to this class by achievement level? A Yes B No 580 VH241164 5. How often do you use each of the following methods to assess student progress in science? Select one circle in each row. Never or hardly ever a. Multiple-choice tests b. Short written responses (e.g., a phrase or sentence) c. Long written responses (e.g., several sentences or paragraphs) d. Performance-based assessments e. Group projects Once or twice Once or twice a month a week Almost every day A B C D VH241165 A B C D VH241166 A B C D VH241169 A B C D VH241168 A B C D VH241167 VH639433 6. In this class, about how much time do you spend on each of the following areas of science? Select one circle in each row. a. Life science b. Earth and space science c. Physical science d. Engineering and technology No time Very little time Some time Quite a bit of time A lot of time A B C D E VH639434 A B C D E VH639436 A B C D E VH639435 A B C D E VH639437 581 VH639586 7. About how often do your science students do each of the following activities? Select one circle in each row. a. Work with other students on a science activity or project b. Write about science (e.g., papers, reports, or student science journals) c. Watch you do a science activity d. Talk about the measurements and results from their hands-on activities e. Discuss the kinds of problems that engineers can solve (e.g., how to build a bridge or how to collect energy from the Sun) f. Figure out different ways to solve a science problem g. Present what they have learned about science Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH639589 A B C D E VH639600 A B C D E VH639856 A B C D E VH639594 A B C D E VH639597 A B C D E VH639846 A B C D E VH639593 582 VH641162 8. In your science class this year, how much emphasis have you devoted to teaching your students each of the following skills? Select one circle in each row. a. Making observations of natural phenomena (e.g., making measurements) b. Making predictions based on prior experimental observations c. Creating models of scientific principles (e.g., a graphic, manipulative, or demonstration that illustrates the principle) d. Reading data in tables or charts to draw conclusions about hypotheses e. Deciding which tools would be most appropriate to gather data f. Designing and testing a solution to a problem No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH641163 A B C D E VH641166 A B C D E VH641167 A B C D E VH641169 A B C D E VH641172 A B C D E VH641174 583 VH640891 9. Thinking about your science class this year, how much emphasis did you place on teaching your students each of the following skills? Select one circle in each row. a. Developing good research questions b. Using drawings or models to explain events or phenomena c. Coming up with experiments or other tests to answer a scientific question d. Organizing data into a chart, graph, or spreadsheet to test a solution e. Deciding when to use quantitative versus qualitative data f. Generating explanations based on observations and measurements g. Evaluating the quality of data h. Teaching science ideas to others (e.g., students or teachers) No emphasis Very little emphasis Some emphasis Quite a bit of emphasis A lot of emphasis A B C D E VH640901 A B C D E VH640902 A B C D E VH640903 A B C D E VH640906 A B C D E VH640907 A B C D E VH640908 A B C D E VH640909 A B C D E VH640911 584 VH241250 10. To what extent do you emphasize each of the following objectives in teaching science to your eighth-grade class? Select one circle in each row. a. Increasing students’ interest in science b. Increasing awareness of the importance of science in daily life c. Teaching the iterative process of scientific inquiry d. Teaching the iterative process of scientific practice e. Developing problem-solving skills f. Developing scientific writing skills Not at all Small extent Moderate extent Large extent A B C D VH241262 A B C D VH241263 A B C D VH639689 A B C D VH748071 A B C D VH241257 A B C D VH241260 585 VH639520 11. To what extent are the following resources available to you in your school system (including your school and school district)? Select one circle in each row. a. Science textbooks (print or online) b. Science magazines and books (print or online) c. Supplies or equipment for science labs or demonstrations d. Space to conduct science labs e. Computers for students’ use in class f. Computer labs g. Computers for teachers’ use h. Science kits i. Scientific measurement instruments (e.g., microscopes, thermometers, beakers, or weighing scales) Not at all Small extent Moderate extent Large extent A B C D VH639521 A B C D VH639522 A B C D VH639523 A B C D VH639525 A B C D VH639532 A B C D VH639527 A B C D VH639528 A B C D VH639531 A B C D VH639526 586 VH241281 12. In your eighth-grade class, how often do your students use a computer or other digital device to do each of the following activities? Select one circle in each row. Never or hardly ever a. Conduct a search for science information b. Simulate a physical or biological process or see how something works (e.g., how planets orbit the Sun or how gas expands) c. Make a chart or graph that shows results of a science project Once or twice Once or twice a month a week Every day or almost every day A B C D VH241282 A B C D VH241284 A B C D VH241283 VH641306 13. To what extent do you use each of the following technological resources for science instruction? Select one circle in each row. a. Desktop or laptop computer(s) (including Chromebooks) b. Tablet(s) (e.g., Surface Pro, iPad, Kindle Fire) c. Online content (e.g., online software, podcasts, or videos) d. Interactive web spaces or virtual classrooms (e.g., websites where students can interact and share class materials) e. Smart board(s) Not at all Small extent Moderate extent Large extent A B C D VH641307 A B C D VH641308 A B C D VH641309 A B C D VH641310 A B C D VH641311 587 VH639626 14. In this school year, how often do you meet with students one-on-one to give feedback on their work and evaluate their progress in science? A Never or hardly ever B A few times a year C Once or twice a month D Once or twice a week E Every day or almost every day VH639633 15. In this school year, how often do you do each of the following activities with individual students to evaluate their progress in science? Select one circle in each row. a. Regularly discuss each student’s current level of performance with them b. Set goals for specific progress the student would like to make c. Discuss progress the student has made toward goals previously set d. Determine how to adjust your teaching strategies to meet the student’s current learning needs Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH639634 A B C D E VH639635 A B C D E VH639636 A B C D E VH639637 588 VH641262 16. Suppose your students did very well on their last science test. How likely do you think each of the following explanations is in this situation? Select one circle in each row. a. My students did well because they studied and were prepared. b. My students did well because they put in a lot of effort. c. My students did well because they always do well on tests. d. My students did well because I taught the concepts well. e. My students did well because they guessed well on the test. f. My students did well because they are just good in science. Not at all likely Not likely Somewhat likely Quite likely Extremely likely A B C D E VH641273 A B C D E VH641276 A B C D E VH641277 A B C D E VH641279 A B C D E VH641281 A B C D E VH641284 VH641332 17. In this school year, did your school offer any of the following supplemental activities? Select one answer choice in each row. a. Opportunities for students to work together to solve problems in their community or the world b. Opportunities for students to engage in group science activities c. Opportunities for students to use scientific instruments (e.g., thermometers, microscopes, or telescopes) d. Opportunities for students to participate in science outreach programs (e.g., partnerships with colleges, museums, or foundations) Yes No A B VH641334 A B VH641338 A B VH641339 A B VH641341 589 Appendix F-2w: 2017 Operational Grade 4 Writing (COI) 590 VH336855 1. Overall, approximately what percentage of your instructional time teaching writing is spent on each of the following? Fill in integer numbers between 0 and 100 so that the total sums up to 100. Development of ideas % Organization of ideas % Effectiveness of expression (e.g., sentence variety, word choice, tone) % Mechanics and conventions (e.g., spelling, grammar, punctuation) Keyboarding skills Word processing skills % % % Other (Please specify): _______________________________ % VH336860 2. When grading/evaluating your students’ writing, approximately what percentage of the grade/evaluation is based on each of the following? Fill in integer numbers between 0 and 100 so that the total sums up to 100. Development of ideas % Organization of ideas % Effectiveness of expression (e.g., sentence variety, word choice, tone) % Mechanics and conventions (e.g., spelling, grammar, punctuation) Other (Please specify): _______________________________ % % 591 VH588515 3. In your English/language arts class this year, how much time have you devoted to teaching your students each of the following? Select one circle in each row. a. Writing a paper using correct grammar b. Writing a paper without spelling mistakes c. Choosing words in students’ writing that will effectively communicate ideas d. Typing a longer text (several paragraphs) with few errors using a keyboard e. Using a spell-checker in word processing software f. Finding words to use in their writing from the thesaurus in word processing software g. Applying cut, copy, and paste using the keyboard or mouse h. Creating an outline prior to writing i. Coming up with ideas about what to write for a timed writing task No time Very little time Some time Quite a bit of time A lot of time A B C D E VH315433 A B C D E VH315441 A B C D E VH315464 A B C D E VH316147 A B C D E VH616593 A B C D E VH316153 A B C D E VH316155 A B C D E VH316239 A B C D E VH316242 592 VH314290 4. In your English/language arts class this year, how often do you do each of the following when teaching writing? Select one circle in each row. a. Ask students to work in small groups to share and revise their writing b. Ask students to write more than one draft for a writing assignment Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH314291 A B C D E VH314295 VH242729 5. How often do you ask your students to do the following when you ask them to write about something? Select one circle in each row. a. Use a computer or other digital device for drafting and revising their writing b. Use the Internet to get information for their writing c. Assess their own writing by using a specific rubric d. Assess the writing of other students by using rubrics Never or hardly ever Less than half of the time About half of the time More than half of the time Always or almost always A B C D E VH242730 A B C D E VH242736 A B C D E VH242734 A B C D E VH242735 593 VH242691 6. How often do you ask your students to write for each of the following purposes? Select one circle in each row. a. Explain (i.e., provide information about a topic or steps in a process) b. Persuade (i.e., convince someone to do something) c. Convey real experience (i.e., write about factual events or personal experiences) d. Convey imagined experience (i.e., tell a fictional story) e. Analyze (i.e., collect and describe evidence for an issue or argument) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH242692 A B C D E VH242693 A B C D E VH314053 A B C D E VH314054 A B C D E VH314056 594 VH314218 7. In your English/language arts class this year, how often do you give the following writing assignments to your students? Select one circle in each row. a. Assignments that students have to complete within one session b. Assignments that are designed for students to work on over extended periods of time (e.g., several class periods) c. Assignments that students have to complete together with other students d. Assignments of at least a couple of pages (e.g., a paper or report) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314220 A B C D E VH314222 A B C D E VH314224 A B C D E VH314229 VH314325 8. In your English/language arts class this year, how often do you use each of the following to assess student progress in writing? Select one circle in each row. a. Long written responses (e.g., several sentences or paragraphs) b. Timed assessments (i.e., tests where students have to produce text under a time limit) c. Digitally based writing tests d. Extended constructed-response questions Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314328 A B C D E VH314331 A B C D E VH616571 A B C D E VH616573 595 VH314348 9. In your English/language arts class this year, how often do you use results from writing assessments for each of the following? Select one circle in each row. a. Determine students’ current levels of writing performance b. Set specific goals for progress for individual students c. Monitor progress students have made toward previously set writing goals d. Determine how to adjust teaching strategies to meet students’ current learning needs Never or hardly ever Less than half of the time About half of the time More than half of the time Always or almost always A B C D E VH314349 A B C D E VH314350 A B C D E VH314351 A B C D E VH314352 596 VH315397 10. In your English/language arts class this year, what kinds of feedback do you typically give your students about their writing assignments? Select one circle in each row. a. I give them a grade. b. I write a general comment at the end of the paper. c. I correct their spelling and grammar mistakes. d. I provide specific suggestions on re-organizing their ideas. e. I meet with students one-on-one to go over their writing. Never or hardly ever Less than half of the time About half of the time More than half of the time Always or almost always A B C D E VH315402 A B C D E VH315405 A B C D E VH315407 A B C D E VH315416 A B C D E VH315419 597 VH242676 11. To what extent do you use each of the following technological resources for writing instruction? Select one circle in each row. a. Desktop or laptop computer(s) (including Chromebooks) b. Tablet(s) (e.g., Surface Pro, iPad, Kindle Fire) c. Online content (e.g., online software, podcasts, or streaming videos) d. Interactive web spaces (e.g., forums where students can interact and share materials) e. Smart board(s) Not at all Small extent Moderate extent Large extent A B C D VH587512 A B C D VH314038 A B C D VH242686 A B C D VH314040 A B C D VH314041 VH335099 12. Based on keyboarding instruction at your school, which of the following best describes the keyboarding skills expected of students at the grade level you teach? A No typing skill is expected. Question 13 is not applicable and will be skipped. B They can type with one or two fingers, but might search for where the letter keys are. C They can type with one or two fingers, and they know where most of the letter keys are. D They can type with all ten fingers when they look at the keyboard. E They can type with all ten fingers without looking at the keyboard. VH587499 13. Approximately what percentage of the students in your fourth-grade English/language arts class meet the expectations regarding their keyboarding skills? % 598 VH587503 14. Which of the following word processing tools are your fourth-grade grade students expected to be able to use for writing? Select one circle in each row. a. b. c. d. Cut, copy, and paste Spell-checker Thesaurus Formatting tools (e.g., bold, underline, italics) Yes No A B VH587504 A B VH587507 A B VH587506 A B VH587505 VH587500 15. Approximately what percentage of the students in your fourth-grade English/language arts class meet the expectations regarding their word processing skills? % 599 Appendix F-2x: 2017 Operational Grade 8 Writing (COI) 600 VH336855 1. Overall, approximately what percentage of your instructional time teaching writing is spent on each of the following? Fill in integer numbers between 0 and 100 so that the total sums up to 100. Development of ideas % Organization of ideas % Effectiveness of expression (e.g., sentence variety, word choice, tone) % Mechanics and conventions (e.g., spelling, grammar, punctuation) Keyboarding skills Word processing skills % % % Other (Please specify): _______________________________ % VH336860 2. When grading/evaluating your students’ writing, approximately what percentage of the grade/evaluation is based on each of the following? Fill in integer numbers between 0 and 100 so that the total sums up to 100. Development of ideas % Organization of ideas % Effectiveness of expression (e.g., sentence variety, word choice, tone) % Mechanics and conventions (e.g., spelling, grammar, punctuation) Other (Please specify): _______________________________ % % 601 VH588515 3. In your English/language arts class this year, how much time have you devoted to teaching your students each of the following? Select one circle in each row. a. Writing a paper using correct grammar b. Writing a paper without spelling mistakes c. Choosing words in students’ writing that will effectively communicate ideas d. Typing a longer text (several paragraphs) with few errors using a keyboard e. Using a spell-checker in word processing software f. Finding words to use in their writing from the thesaurus in word processing software g. Applying cut, copy, and paste using the keyboard or mouse h. Creating an outline prior to writing i. Coming up with ideas about what to write for a timed writing task No time Very little time Some time Quite a bit of time A lot of time A B C D E VH315433 A B C D E VH315441 A B C D E VH315464 A B C D E VH316147 A B C D E VH616593 A B C D E VH316153 A B C D E VH316155 A B C D E VH316239 A B C D E VH316242 602 VH314290 4. In your English/language arts class this year, how often do you do each of the following when teaching writing? Select one circle in each row. a. Ask students to work in small groups to share and revise their writing b. Ask students to write more than one draft for a writing assignment Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH314291 A B C D E VH314295 VH242729 5. How often do you ask your students to do the following when you ask them to write about something? Select one circle in each row. a. Use a computer or other digital device for drafting and revising their writing b. Use the Internet to get information for their writing c. Assess their own writing by using a specific rubric d. Assess the writing of other students by using rubrics Never or hardly ever Less than half of the time About half of the time More than half of the time Always or almost always A B C D E VH242730 A B C D E VH242736 A B C D E VH242734 A B C D E VH242735 603 VH242691 6. How often do you ask your students to write for each of the following purposes? Select one circle in each row. a. Explain (i.e., provide information about a topic or steps in a process) b. Persuade (i.e., convince someone to do something) c. Convey real experience (i.e., write about factual events or personal experiences) d. Convey imagined experience (i.e., tell a fictional story) e. Analyze (i.e., collect and describe evidence for an issue or argument) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH242692 A B C D E VH242693 A B C D E VH314053 A B C D E VH314054 A B C D E VH314056 604 VH314218 7. In your English/language arts class this year, how often do you give the following writing assignments to your students? Select one circle in each row. a. Assignments that students have to complete within one session b. Assignments that are designed for students to work on over extended periods of time (e.g., several class periods) c. Assignments that students have to complete together with other students d. Assignments of at least a couple of pages (e.g., a paper or report) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314220 A B C D E VH314222 A B C D E VH314224 A B C D E VH314229 VH314325 8. In your English/language arts class this year, how often do you use each of the following to assess student progress in writing? Select one circle in each row. a. Long written responses (e.g., several sentences or paragraphs) b. Timed assessments (i.e., tests where students have to produce text under a time limit) c. Digitally based writing tests d. Extended constructed-response questions Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH314328 A B C D E VH314331 A B C D E VH616571 A B C D E VH616573 605 VH314348 9. In your English/language arts class this year, how often do you use results from writing assessments for each of the following? Select one circle in each row. a. Determine students’ current levels of writing performance b. Set specific goals for progress for individual students c. Monitor progress students have made toward previously set writing goals d. Determine how to adjust teaching strategies to meet students’ current learning needs Never or hardly ever Less than half of the time About half of the time More than half of the time Always or almost always A B C D E VH314349 A B C D E VH314350 A B C D E VH314351 A B C D E VH314352 606 VH315397 10. In your English/language arts class this year, what kinds of feedback do you typically give your students about their writing assignments? Select one circle in each row. a. I give them a grade. b. I write a general comment at the end of the paper. c. I correct their spelling and grammar mistakes. d. I provide specific suggestions on re-organizing their ideas. e. I meet with students one-on-one to go over their writing. Never or hardly ever Less than half of the time About half of the time More than half of the time Always or almost always A B C D E VH315402 A B C D E VH315405 A B C D E VH315407 A B C D E VH315416 A B C D E VH315419 607 VH242676 11. To what extent do you use each of the following technological resources for writing instruction? Select one circle in each row. a. Desktop or laptop computer(s) (including Chromebooks) b. Tablet(s) (e.g., Surface Pro, iPad, Kindle Fire) c. Online content (e.g., online software, podcasts, or streaming videos) d. Interactive web spaces (e.g., forums where students can interact and share materials) e. Smart board(s) Not at all Small extent Moderate extent Large extent A B C D VH587512 A B C D VH314038 A B C D VH242686 A B C D VH314040 A B C D VH314041 VH335099 12. Based on keyboarding instruction at your school, which of the following best describes the keyboarding skills expected of students at the grade level you teach? A No typing skill is expected. Question 13 is not applicable and will be skipped. B They can type with one or two fingers, but might search for where the letter keys are. C They can type with one or two fingers, and they know where most of the letter keys are. D They can type with all ten fingers when they look at the keyboard. E They can type with all ten fingers without looking at the keyboard. VH316542 13. Approximately what percentage of the students in your eighth-grade English/language arts class meet the expectations regarding their keyboarding skills? % 608 VH316545 14. Which of the following word processing tools are your eighth-grade grade students expected to be able to use for writing? Select one circle in each row. a. b. c. d. Cut, copy, and paste Spell-checker Thesaurus Formatting tools (e.g., bold, underline, italics) Yes No A B VH316547 A B VH616651 A B VH316553 A B VH316554 VH316610 15. Approximately what percentage of the students in your eighth-grade English/language arts class meet the expectations regarding their word processing skills? % 609 Appendix F-2y: 2018 Operational Grade 8 Social Studies (COI) 610 VH492737 1. Which best describes your role in teaching social studies to this class? Select all that apply. A I teach all or most subjects, including social studies. B The only subject I teach is social studies. C We team teach, and I have primary responsibility for teaching social studies. D I have primary responsibility for teaching civics and/or United States government. E I have primary responsibility for teaching geography. F I have primary responsibility for teaching United States history. VH588602 2. How many students are in this class? Enter the number of students. If you teach more than one eighth-grade social studies class, please enter the number of students in the class you are using as the basis for answering this survey. VH492738 3. In a typical week, about how much time in total do you spend with this class on social studies instruction? hours and minutes per week VH566810 4. Which best describes how social studies instruction in your school is organized? A Social studies is taught primarily as a discrete subject with little or no integration with instruction in other subjects. B Some social studies instruction is integrated with other subjects, and some social studies instruction is presented as a discrete subject. C Social studies lessons are primarily integrated with instruction in other subjects. 611 VH493388 5. During what percentage of social studies instruction time in this class is your primary focus on each of the following subjects? Select one circle in each row. a. Civics and/or United States government b. Geography c. United States history d. Other social studies subject (Please specify): None 1–10% 11–40% 41–60% 61–90% More than 90% A B C D E F VH493389 A B C D E F VH493390 A B C D E F VH493391 A B C D E F VH493392 VH493502 6. During this school year, how often do you do the following as part of social studies instruction with this class? Select one circle in each row. a. Have students read material from a social studies textbook b. Have students read extra material about social studies not in the regular textbook (e.g., newspapers, magazines, or online sources) c. Have students conduct research about social studies topics (e.g., online, in a library, or through interviews) d. Have students use primary sources (e.g., letters, diaries, photographs, films, or essays written by people from the past) Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH493504 A B C D E VH493506 A B C D E VH493509 A B C D E VH493512 612 VH493515 7. During this school year so far, how often have you done each of the following as part of social studies instruction with this class? Select one circle in each row. a. Had students give class presentations on social studies topics b. Had students write about their opinion on a problem or issue (e.g., in a letter, e-mail, or blog post) c. Had students take part in debates or panel discussions d. Had students take part in role-playing, mock trials, or dramas about social studies topics Never Once Two or three times Four or five times More than five times A B C D E VH493518 A B C D E VH493523 A B C D E VH493524 A B C D E VH493525 613 VH493490 8. When students in this class work on social studies, to what extent do they use computers or other digital devices to do the following? Select one circle in each row. a. Use the Internet to look for evidence or sources (e.g., text documents, photographic images, or films) b. Play games or use apps in which students play a role (e.g., an explorer, geographer, or historian) c. Create reports or projects about social studies using different forms of media (e.g., a slide presentation that combines text and video clips) d. Organize information about social studies topics by creating tables, charts, or graphs e. Participate in online discussions about social studies on a website (e.g., in forums or social media) Never or hardly ever Once in a while Sometimes Often Always or almost always A B C D E VH493491 A B C D E VH728046 A B C D E VH493494 A B C D E VH493496 A B C D E VH493498 614 VH493539 9. In your social studies class this year, how often do you use each of the following to assess student progress in social studies? Select one circle in each row. a. Tests with multiple-choice, true/ false, or matching type questions b. Short written responses (e.g., a paragraph or less) c. Long written responses (e.g., several paragraphs) d. Responses to questions based on information from several sources (e.g., letters, cartoons, or maps) e. Computer-based or online assessments Never About once or twice a year About once or twice a month About once Every day or or twice a almost week every day A B C D E VH493530 A B C D E VH739504 A B C D E VH493540 A B C D E VH493541 A B C D E VH493544 VH493773 10. When giving assessments in your social studies class this year, how often do you use the assessment results to do each of the following? Select one circle in each row. a. Regularly discuss each student’s current level of performance with them b. Set goals for specific progress the student would like to make c. Discuss progress the student has made toward goals previously set d. Determine how to adjust your teaching strategies to meet the student’s current learning needs Never or hardly ever Less than half of the time About half of the time More than half of the time Always or almost always A B C D E VH493774 A B C D E VH493775 A B C D E VH493777 A B C D E VH493778 615 VH566822 11. Do you give instruction in civics and/or United States government to your students? A Yes B No Questions 12, 13, and 14 are not applicable and will be skipped. VH728253 12. In your social studies class this year, how much have you emphasized the following topics in civics and/or United States government? Select one circle in each row. a. Political parties, elections, and voting b. Other countries’ governments (e.g., their structure, how they are run, or interactions with the United States) c. International organizations (e.g., the United Nations, World Bank, or World Health Organization) d. Current political and social issues Never or hardly ever Less than half of the lessons About half of the lessons More than half of the lessons All or almost all of the lessons A B C D E VH728261 A B C D E VH728259 A B C D E VH728260 A B C D E VH728257 616 VH493643 13. In your social studies class this school year, how much have you emphasized teaching your students each of the following? Select one circle in each row. a. Examining the roles and functions of the three branches of the United States government b. Examining the rights and responsibilities of United States citizens c. Examining how the United States influences and is influenced by events in other countries d. Comparing the roles and responsibilities of local, state, and national governments in the United States e. Examining why it is important to pay attention to the political process and government f. Examining why it is important for individuals to participate in the political process and government g. Discussing the political process and government with others Not at all Very little Some Quite a bit A lot A B C D E VH493645 A B C D E VH493646 A B C D E VH493647 A B C D E VH493648 A B C D E VH493650 A B C D E VH493651 A B C D E VH493658 617 VH717115 14. During the past two years, have you attended professional development programs (e.g., training sessions and workshops, including online classes) aimed at improving your ability to teach civics and/or United States government? Select all that apply. A Yes, I have attended programs that are required by my school or district. B Yes, I have attended programs that are not required by my school or district. C No VH493705 15. Do you give instruction in geography to your students? A Yes B No Questions 16, 17, and 18 are not applicable and will be skipped. VH493706 16. In your social studies class this year, how much have you emphasized the following topics in geography? Select one circle in each row. a. Countries and cultures b. Environmental issues (e.g., pollution, recycling, climate change, or genetically modified food) c. Basic concepts of physical and human geography d. Variation among regions and how people interact across space via communication, transportation, or trade Not at all Very little Some Quite a bit A lot A B C D E VH493708 A B C D E VH493709 A B C D E VH493710 A B C D E VH493711 618 VH493725 17. In your social studies class this school year, how much have you emphasized teaching your students each of the following? Select one circle in each row. a. Using a map (e.g., a road map, MapQuest, or Google Maps), atlas, or globe to locate different cities, countries, and continents b. Examining how natural features of Earth (e.g., rivers or mountains) are formed c. Measuring distances and the sizes of areas on maps d. Examining what makes different regions in the United States unique e. Examining why groups of people migrate to different parts of the world f. Examining how humans affect the natural environment g. Examining how humans adjust to the natural environment h. Examining why different food and energy resources are traded globally i. Using geographic information (e.g., maps, satellite images, or population data) to answer a question or solve a problem Not at all Very little Some Quite a bit A lot A B C D E VH493726 A B C D E VH728062 A B C D E VH493729 A B C D E VH493730 A B C D E VH493736 A B C D E VH493737 A B C D E VH603016 A B C D E VH493740 A B C D E VH493743 619 VH717116 18. During the past two years, have you attended professional development programs (e.g., training sessions and workshops, including online classes) aimed at improving your ability to teach geography? Select all that apply. A Yes, I have attended programs that are required by my school or district. B Yes, I have attended programs that are not required by my school or district. C No VH566823 19. Do you give instruction in United States history to your students? A Yes B No Questions 20, 21, and 22 are not applicable and will be skipped. 620 VH493550 20. In your social studies class this year, how much have you emphasized the following periods of United States history? Select one circle in each row. a. The period before 1815 (e.g., age of exploration, colonization, settlement, or American Revolution) b. 1815 to 1865 (e.g., expansion, reform, sectionalism, or the Civil War) c. 1865 to 1945 (e.g., Reconstruction, industrial growth, United States role in world events, immigration, the Great Depression, or the First and Second World Wars) d. 1945 to the present (e.g., the Cold War, Civil Rights movement, women’s rights movement, Vietnam War, or environmental movement) Not at all Very little Some Quite a bit A lot A B C D E VH493552 A B C D E VH493553 A B C D E VH493554 A B C D E VH493556 621 VH493578 21. In your social studies class this school year, how much have you emphasized teaching your students each of the following? Select one circle in each row. a. Examining the causes and effects of important events in United States history b. Examining how time periods in United States history are similar or different c. Judging whether information from a source (e.g., text, visual graphics, video, or audio) is accurate d. Analyzing the relationship between two historical events e. Comparing and evaluating different points of view about the past (e.g., different ideas about what caused the Civil War) f. Coming up with research questions about why or how something happened in the past (e.g., what were the causes of the Great Depression) g. Taking and defending a position about a historical issue (e.g., how changes in transportation have affected the United States economy) Not at all Very little Some Quite a bit A lot A B C D E VH493580 A B C D E VH493582 A B C D E VH493583 A B C D E VH493587 A B C D E VH493589 A B C D E VH493590 A B C D E VH493591 622 VH717110 22. During the past two years, have you attended professional development programs (e.g., training sessions and workshops, including online classes) aimed at improving your ability to teach history? Select all that apply. A Yes, I have attended programs that are required by my school or district. B Yes, I have attended programs that are not required by my school or district. C No VH493813 23. Suppose your students did very well on their last social studies test. How likely do you think each of the following explanations is in this situation? Select one circle in each row. a. My students did well because they studied and were prepared. b. My students did well because they put in a lot of effort. c. My students did well because they always do well on tests. d. My students did well because I taught the concepts well. e. My students did well because they guessed well on the test. f. My students did well because they are just good at social studies. Not at all likely Not likely Somewhat likely Quite likely Extremely likely A B C D E VH493814 A B C D E VH493815 A B C D E VH493816 A B C D E VH493817 A B C D E VH493818 A B C D E VH493819 623 Appendix F-2z: 2012 Operational Grade 12 Economics-Department Head 624 --p --7 --· --2 --1 --p --7 --· --2 --1 Economics Department Chair The questionnaire should be completed by the head of the department that offers the most economics-related courses in the current academic year. For the purposes of this questionnaire, "economics" means the study of the basic problem of limited resources and how people choose to use these resources. ----------------------p Economics may be taught from an academic perspective, or it may be taught in an applied context, including: • An individual and household context, including decisions about earning, saving, and personal financial challenges • A business context, with a focus on entrepreneurs, workers, producers, and investors • A public context, including government, policy, citizenship, and domestic and international organizations VB607573 1. What is your department? CE> Social studies or history<0 VB607672 c. Professional development workshop or program of more than 6 hours VB607673 VB607674 7. With regard to economics coursework, what are the district hiring requirements for teachers in your department who teach economics-related courses? Fill in all ovals that apply. ® There are no requirements involving economics. ® Some college coursework in economics, but not a major or a minor © Certification in economics ® A college minor in economics
File Type application/pdf File Title Appendix F Appendix F 2019-2020 Questionnaire Items Library Author Stainthorpe, Anne E File Modified 2019-08-23 File Created 2018-03-01