Research Question by Data Source Matrix

Task Order 27
Study of Digital Learning Resources for
Instructing English Learner Students
Task 4.4 (Part 21) Research Question by Data Source Matrix

July 11, 2016

Submitted to:
U.S. Department of Education
Office of Planning, Evaluation and Policy Development

Submitted by:
Westat
1600 Research Boulevard
Rockville, Maryland 20850-3129
(301) 251-1500

Study of Digital Learning Resources for
Instructing English Learner Students
Task 4.4 (Part 21) Research Question by Data Source Matrix

Prepared by:
Annette Zehler
Adrienne von Glatz
Karin Katterfeld
Jennifer Flynn
Eva Chen
Mihiri Silva
Westat
Philip Vahey
Savitha Moorthy
Daniela Torre
Kea Vogt
SRI International
Yesim Yilmazel-Sahin
OneWorld Linguistic Consulting, LLC
Michael Jay
Educational Systemics

Case study protocols

Mainstream Teacher
of ELs

IT Coach or Specialist

10,
11

13

12,
13

13,
14

13,
14

4, 5

4, 6

4, 6

3, 4,
9,10,
11

13

13

13

13

4,5

4, 6

4, 6

5, 6,
10,
11

13

14

13

25

12

13

26,
27

13

14

21-23

411

5-12

1.2 What criteria do districts use in identifying and
8(c), 12,
selecting DLRs? To what extent do these decisions
13
specifically consider EL students’ needs?
1.How do districts and
teachers identify and 1.3 To what extent do districts identify DLRs that are
select DLRs in general? designed for EL students?
How do districts and
12, 13
teachers identify and
select DLRs specifically
to support EL students? 1.4 In what ways do teachers identify possible DLRs?

1.5 What criteria do teachers use in selecting DLRs for
their instruction in general? For instruction of their EL
students specifically?
2.What types of DLRs do 2.1 To what extent do teachers report using DLRs in
districts report using to instructional activities for their instruction in general?
In instructional activities for their EL students
support English
learners? What types of specifically?
DLRs do teachers report 2.2 What types of DLRs do district administrators
9, 10,
using in instructing and report obtaining for their students? What types of
22
structuring learning
DLRS do districts report that they obtain specifically

4, 5,
6

4

4, 5

5,6,
11

DLR Demonstration

EL Specialist Teacher

4

Classroom
Observation

School EL Coordinator

6

Principal

4

Curriculum and
Instruction

11

EL Services

1.1 Who identifies DLRs and makes decisions about
purchase of and access to DLRs within the district?

Other
protocols

School interviews

Technology Director

Subquestion

Teacher Survey

Research question

District Survey

Surveys

District
administrator
interviews

3

3

4, 5

13,
14

1

Case study protocols

5,8,
10

6,7,8

7, 9

8, 10

6, 7
8

DLR Demonstration

4,7,
9

Classroom
Observation

IT Coach or Specialist

Mainstream Teacher
of ELs

School EL Coordinator

Principal

Curriculum and
Instruction

EL Services

Technology Director

Other
protocols

School interviews
EL Specialist Teacher

activities for their EL
students?

Subquestion

Teacher Survey

Research question

District Survey

Surveys

District
administrator
interviews

1, 3

1, 2

to address the needs of EL students?
2.3 What types of DLRs do teachers report using for
instruction of EL students?
2.4 To what extent are the DLRs identified by districts
or used by teachers designed specifically for EL
students or include features to support EL students?

3.1 What are the purposes for which teachers
currently use DLRs? (e.g. student engagement,
motivation, skills practice, content knowledge, family
engagement)
3.2 What are the areas of knowledge or skills
instruction for which teachers use DLRs?
3.How do teachers of EL 3.3 What instructional activity contexts (such as
students use DLRs in
teacher-led, whole class, small group, individual work
the instruction of EL
or a combination of these contexts) do teachers
students?
report for use of DLRs in instruction?
3.4 To what extent do teachers combine use of DLRs
and non-DLR activities?
3.5 What are teachers’ perceptions of the value of
DLR use in general and in particular, with EL
students?

21-23
10

5,
10,
11

24, 27

5,6

4,5,
6

4, 5

29

5

4

4, 5

6, 8,
9, 10

4,
10

5,
11

6, 7
8

3, 4,
5

6

23, 29

5

4

4, 5

6, 8,
9, 10

4

5

6,
7, 8

3, 4,
5

7

6

7

2, 3,
5

9

6

7

3, 5

9

11

12

30

16

1,2,
4

13

2

Case study protocols

IT Coach or Specialist

7, 8,
9

13,
14,
15

15,
16,

16,
17

17,
18

9,
10

20, 34,
37

8,9

7,8

7, 8,
9

13

15,
16

16

17

9,
10

15

16,
17

17,
18

11

14

15

16,
17

17,
18

35, 36

5.1 What barriers to use of DLRs with ELs do district
5.What are barriers to
15
administrators report?
and supports for (1) the
use of DLRs in
5.2 What barriers do teachers report for their use of
31
instruction of EL
DLRs in the classroom for instruction of ELs?
students and (2) the use 5.3 What supports for use of DLRs with ELs do district
14, 19,
of DLRs by students at administrators report?
21
home? How can
districts, schools, and 5.4 What supports do teachers report for their use of
20, 35,
DLR developers address DLRs for instruction of ELs?
36
these?

11

10

7, 8

11,
12

DLR Demonstration

Mainstream Teacher
of ELs

7,8

Classroom
Observation

EL Specialist Teacher

8,9

Principal

20, 35,
36

Curriculum and
Instruction

School EL Coordinator

14

EL Services

4.1. What PD do teachers receive that is related to
4.To what extent do
use of DLRs in general? Related to instruction of ELs
teachers receive
and to use of DLRs for instructing EL students? What
professional
are the topics addressed by the PD?
development (PD) in
effective use of DLRs for
instruction? Which
4.2 Who provides the PD, and how much PD have
professional
teachers received?
development
approaches do teachers 4.3 What types of PD on use of DLRs do teachers
report to be most
identify as most helpful?
helpful in supporting
their use of DLRs in
instruction?

Other
protocols

School interviews

Technology Director

Subquestion

Teacher Survey

Research question

District Survey

Surveys

District
administrator
interviews

7,8,
9
11,
12

11

7, 13

3

Case study protocols

7.How could developers
and practitioners
improve the usefulness
of DLRs for instructing
EL students?

16-18,
20

12,
13

11,
12

13,
14,
15

14
10,
14

9,
13

16

21

9, 16

17

40

9, 10

21,22

4, 5

7.4. What other needs do districts or teachers
identify related to the use of DLRs for instructing ELs?

23

38, 40

10,
14

9,
13

11,
12

5, 6

5

16,
17

15,
16

6, 8, 9, 6, 7,
10
8, 9

15,
17

10,
13

15

16
19

7.3. Do districts and/or teachers report using the full
range of types of DLRs available? If there are gaps
between what is available and what is used, what are
these gaps and their implications for developers and
educators?

DLR Demonstration

20

Classroom
Observation

17,
18

12

32, 33

7.1. What do district administrators report as gaps in
15(i), 23
DLRs available for instructing ELs?
7.2. What do teachers report as gaps in DLRs for
instructing ELs?

16,
17

IT Coach or Specialist

School EL Coordinator

Principal

Curriculum and
Instruction

EL Services

28(g)

Mainstream Teacher
of ELs

6.How do districts and
teachers define and
measure the success of 6.2 What do teachers report as their indicators of
their use of technology successful use of DLRs?
to support EL students?

Other
protocols

School interviews
EL Specialist Teacher

5.5 What supports do teachers report as helpful for
engaging (1) students and (2) parents or family
members in working with DLRs with students, in use
of DLRs outside of the classroom?
6.1 What do district administrators report as their
indicators of successful use of DLRs?

Technology Director

Subquestion

Teacher Survey

Research question

District Survey

Surveys

District
administrator
interviews

18,
19

20

11

5, 8,
9, 10

6, 7,
8

1, 2

19,
20

16

11,
12

4