Preview: EPIC-S (Post)
This is a read-only preview of the standard MASDER EPIC-S (Post) survey. Required sections are marked. Optional sections can be customized per course.
We recommend viewing the full list of survey items on the
Survey Info page to assist you as you customize.
Optional Consent (1 questions) Optional
instructor_consent:
Click to write the question text
Click to write Choice 1
Click to write Choice 2
Required Masder Consent (1 questions) Required
consent:
Environment, Pedagogy, Institution, Course Inventory for Statistics
Post-Course Inventory
Title of research study: Developing Validated Instruments to Measure Student/Faculty Attitudes in Undergraduate Statistics and Data Science Education
IRB #: IRB-FY2025-79
Investigator: Michael A. Posner, Professor of Statistics and Data Science, michael.posner@villanova.edu, 610-519-3016
Key Information: This study involves research and is voluntary. You can stop at any time without penalty.
Purpose of the Research: We are gathering data on attitudes toward statistics. We are interested in (1) what these attitudes are, and (2) how attitudes relate to student and instructor characteristics and classroom environment. The following inventory asks about the learning environment, pedagogical practices, and other course characteristics. The long term goal of this research is to improve instruction in statistics courses.
Procedures: The entire survey should take about 20 minutes to complete. We request that you complete every item, but you are not required to do so. Your survey responses may be linked with other data collected as a part of this study.
You have been asked to give us your name and email address. The purpose is to verify your participation in this study, and to link your survey responses with any other responses you complete as part of this project. The EPIC inventory is administered in a pre-course and post-course format which we will link together.
A dataset that excludes all personal identifying information will be made publicly available for educational researchers. The study investigator may grant access to approved researchers to use identifiable data for validated studies after a Data Use Agreement has been signed.
Risks / Discomforts: This study is educational research and does not have any known associated risks.
Benefits to Prospective Subjects and/or to Others: By filling out this survey, you may gain deeper insights into your pedagogical practices.
Your responses may also aid statistics education researchers in improving instruction in statistics courses.
For Villanova-specific resources and other mental health resources, visit the Villanova IRB website. To view these online, navigate to irb.villanova.edu and click “Participating in a Research Study.”
As a participant in research, you have rights. Visit the Villanova IRB website to read the Participant Bill of Rights. To read online, navigate to irb.villanova.edu and click “Participating in a Research Study.”
Consent will be given through clicking “I accept” on Qualtrics surveys, by selecting one of the following options:
I have read and understand the terms and conditions of this research study and agree to participate. I understand my participation is voluntary and that I may withdraw at any time without penalty. By clicking "yes" I am indicating my permission to participate in this study.
Yes: I agree to participate.
No: I do not agree to participate.
Required Course Section Info (4 questions) Required
course_reminder:
You are filling out the EPIC-S post-survey for ${e://Field/course_prefix_num}: ${e://Field/course_name} (${e://Field/course_descr}).
You are filling out the EPIC-S post-survey for ${e://Field/course_prefix_num}: ${e://Field/course_name} (${e://Field/course_descr}).
instructor_first:
Instructor first name
instructor_last:
Instructor last name
section_choice:
Indicate which section(s) of ${e://Field/course_prefix_num}: ${e://Field/course_name} (${e://Field/course_descr}) you are currently teaching. Select all that apply.
Section ${e://Field/sec_id_1}: ${e://Field/sec_desc_1}
Section ${e://Field/sec_id_2}: ${e://Field/sec_desc_2}
Section ${e://Field/sec_id_3}: ${e://Field/sec_desc_3}
Section ${e://Field/sec_id_4}: ${e://Field/sec_desc_4}
Section ${e://Field/sec_id_5}: ${e://Field/sec_desc_5}
Section ${e://Field/sec_id_6}: ${e://Field/sec_desc_6}
Section ${e://Field/sec_id_7}: ${e://Field/sec_desc_7}
Section ${e://Field/sec_id_8}: ${e://Field/sec_desc_8}
Section ${e://Field/sec_id_9}: ${e://Field/sec_desc_9}
Section ${e://Field/sec_id_10}: ${e://Field/sec_desc_10}
Required Course Section Items (8 questions) Required
intro:
Please answer the following questions based on the ${lm://Field/1} section of your course.
Please answer the following questions based on the ${lm://Field/1} section of your course.
classsize_post:
How many students were enrolled in this class when students were asked to complete the post S-SOMAS? (This value will be used to calculate response rate.)
live_meet:
Did your course have live meetings?
Yes, the class had in-person meetings.
Yes, the class had online synchronous meetings.
Yes, the class had both in person and online synchronous meetings.
No, this class did not have live meetings (it was only asynchronous).
tsr_class:
My students feel comfortable asking me questions during class.
Strongly Disagree
Disagree
Somewhat Disagree
Neither Agree Nor Disagree
Somewhat Agree
Agree
Strongly Agree
resource_live:
Which of the following describes the primary resource that you intend for students to use for learning?
Live, instructor-led lectures
Pre-recorded videos created by the instructor (me)
Pre-recorded videos created by another instructor
Pre-recorded videos created by the textbook publisher
Textbook
Other
resource_notlive:
Which of the following describes the primary resource that you intend for students to use for learning?
Pre-recorded videos created by the instructor (me)
Pre-recorded videos created by another instructor
Pre-recorded videos created by the textbook publisher
Textbook
Other
classroom:
For each of the following items, please indicate the extent to which you agree with the statement about your physical classroom environment.
| Seating areas are arranged so students can interact and participate in classroom activities. |
|
|
|
|
|
|
|
| Furniture is, or can be, arranged to allow for the instructor to maneuver between students. |
|
|
|
|
|
|
|
| There is a technology display method such as a smartboard or a projector. |
|
|
|
|
|
|
|
| There is a method to communicate information such as a chalkboard or whiteboard. |
|
|
|
|
|
|
|
| All comfort elements of my classroom (such as lighting, temperature, and ambient noise level) are appropriate. |
|
|
|
|
|
|
|
| The number of students in the classroom makes it challenging to interact with the students. |
|
|
|
|
|
|
|
classroom_comments:
If you have any additional comments about the physical classroom, please provide them in the space below.
Optional F Impact (20 questions)
f_instructions:
The questions on this page are from the Faculty Inventory of Methods and Practices Associated with Competent Teaching (F-IMPACT). The F-IMPACT is a modification of the Teaching Practices Inventory (TPI) to be valid for both face-to-face and online course modalities by a team led by Chistopher Moore at University of Nebraska, Omaha. (https://www.unomaha.edu/academic-affairs/stem-trail-center/research/impact.php)
The questions on this page are from the Faculty Inventory of Methods and Practices Associated with Competent Teaching (F-IMPACT). The F-IMPACT is a modification of the Teaching Practices Inventory (TPI) to be valid for both face-to-face and online course modalities by a team led by Chistopher Moore at University of Nebraska, Omaha. (https://www.unomaha.edu/academic-affairs/stem-trail-center/research/impact.php)
support_course:
I. Course Information and Supporting Materials
Check all of the course information that you provided to students via hard copy or a course web page.
List of topics to be covered
List of topic-specific competencies (skills, expertise, …) students should achieve (what students should be able to do)
List of competencies that are not topic related (critical thinking, problem solving, …)
Affective goals – changing students’ attitudes and beliefs (interest, motivation, relevant beliefs about their competencies, how to master the material)
material_course:
Check all of the supporting materials that you provided to students in this course.
Student wikis or discussion boards with little or no contribution from you
Student wikis or discussion boards with significant contribution from you or a teaching assistant (undergraduate or graduate)
Solutions to homework assignments
Worked examples (text, pencast, or other format)
Practice exams, or previous year’s exams
Videos, animations, or simulations related to course materials
Lecture notes or course PowerPoint presentations (partial/skeletal or complete)
Articles from related academic literature
Examples of exemplary papers, projects, or other assignments
Grading rubrics for papers, problem solutions, or large projects
None of these
Other (please specify)
assignments:
II. Assignments and ExamsCheck all that applied to assignments in this course.
Homework was assigned or suggested, but did not contribute to course grade
Homework was assigned and contributed to course grade
Paper or project (an assignment taking longer than two weeks and involving some degree of student control in choice of topic or design)
Students encouraged to work collaboratively on their assignments
Explicit group assignments
Student presentations (verbal or poster, either live or through video)
None of these
Other (please specify)
num_assignments:
How many tests or major assignments were assigned during the term (e.g. midterm exams, papers, projects)?
reasoning_pct:
What was the approximate fraction of test questions or major assignment criteria that required students to explain their reasoning?
0-5%
6-10%
11-15%
16-25%
25+%
final_pct:
What percentage did a final exam, paper, or project contribute to the total course grade?
70% or greater
61-69%
51-60%
41-50%
31-40%
30% or less
No final exam, paper, or project
feedback_freq:
III. FeedbackHow often did you explicitly solicit feedback about the course from students during the term?
Not including end of term course evaluations, student feedback about the course was not requested during the term.
One midterm course evaluation asking for student feedback about the course
Repeated student feedback about the course requested (more than once)
type_feedback:
Check all of the following feedback provided by you to students during the term.
Assignments with feedback from instructor, teaching assistant, or peer before grading or with opportunity to redo work to improve grade
Assignments graded within 1 week after student submission
Students see graded assignments
Students see assignment answer key and/or grading rubric
Students see their graded midterm exam(s)/quizzes, papers, or projects
Students see midterm exam(s)/quizzes answer key(s) and/or grading rubric(s)
Students explicitly encouraged to meet individually with you
None of these
Other (please specify)
question_freq:
IV. Instructional Features and ActivitiesPer week, how many times did you ask for questions (in lectures, embedded prompts in videos/readings, posted discussion boards, or through other means)?
discussion_freq:
Per week, how many times did you have group student-student discussions or problem solving (includes online discussion boards)?
useful_freq:
Per term, how many times did you have discussions on why the material is useful and/or interesting from students' perspective?
concept_pct:
Considering the time spent on the major topics, approximately what fraction was spent on the process by which the theory/model/concept was developed, including the methods and results that support specific theories or ideas?
listening_pct:
What fraction of a typical class or online equivalent did students spend listening to lectures directly or through video (presentation of content, derivation of results/solutions, etc.)?
0-20%
20-40%
40-60%
60-80%
80-100%
type_response:
A student response method is any means used to collect responses from all students in real time either during class (e.g. clickers, online polls, online chat) or embedded in the middle of readings or videos. Check all that occurred in your course.
More than one student response question is posed per class or online equivalent, not counted towards the course grade
More than one student response question is posed per class or online equivalent, counted towards the course grade
More than one student response question is posed per class or online equivalent, followed by student-student discussion (synchronous or asynchronous, such as via online discussion boards)
None of these
Other (please specify)
meta_cognition:
Check all that typically occurred both before and after class or online equivalent.
Students asked to read/view material for upcoming class or online equivalent
Students read/view material on upcoming class or online equivalent and complete assignments or quizzes on it shortly before the beginning of the class or online equivalent
Reflective activity at end of class or online equivalent (students briefly answering questions, reflecting on lecture and/or their learning, etc.)
None of these
Other (please specify)
assessment_type:
V. Course Assessment and InnovationCheck all that occured in your course.
Assessment given at beginning of course to assess background knowledge
Use of instructor-independent pre-post test (e.g. concept inventory) to measure learning
Use of pre-post test that is repeated in multiple offerings of the course to measure and compare learning
Use of pre-post survey of student interest and/or perceptions about the subject
Opportunities for students’ self-evaluation of learning
Students provided with opportunities to have some control over their learning, such as choice of topics for course, paper, or project, choice of assessment methods, etc.
New teaching methods or materials were tried along with measurements to determine their impact on student learning
None of these
Other (please specify)
collaboration_freq:
VI. Collaboration and Sharing in TeachingHow often do you discuss how to teach this course with colleague(s)?
lit_freq:
How often do you read literature about teaching and learning relevant to this course?
observation_freq:
How often do you observe a colleague’s class (any class) to get/share ideas for teaching?
Required Stat Pedagogy (1 questions) Required
extent:
For each item below, indicate the extent to which you do this in your course.
Teach statistics as an investigative process of problem-solving and decision making. |
|
|
|
|
| Incorporate multivariable thinking (e.g., confounding, visualization with more than two variables, multiple regression, etc.). |
|
|
|
|
| Focus on conceptual understanding of core concepts. |
|
|
|
|
| Use primarily real data. |
|
|
|
|
| Teach students to understand context in which data was gathered before making interpretations. |
|
|
|
|
| Cultivate active learning (activities, group work, discussion, etc.). |
|
|
|
|
| Teach using the flipped or inverted classroom structure (i.e., students spend class time applying material first encountered before class). |
|
|
|
|
| Regularly address ethical issues related to statistical practice and data collection. |
|
|
|
|
| Assign project(s) as an integral part of learning. |
|
|
|
|
| Obtain immediate student feedback using personal response systems (e.g., clickers, polling software, ABCD cards, etc.) whenever possible. |
|
|
|
|
| Use games and/or fun (songs, tricks, art, puzzles, jokes, etc.) to engage students. |
|
|
|
|
| Teach students to conduct ANOVA analyses. |
|
|
|
|
| Use variety of assessments to measure student learning. |
|
|
|
|
| Focus on procedural knowledge through the use of calculations/computations. |
|
|
|
|
| Incorporate scenarios that address diversity, equity, and/or inclusion throughout the course. |
|
|
|
|
| Leverage statistical software and/or applets to facilitate student learning. |
|
|
|
|
| Focus on mastery of statistical programming. |
|
|
|
|
| Teach students to construct graphs by hand. |
|
|
|
|
| Prioritize probability theory and random variables. |
|
|
|
|
| Require use of distribution tables. |
|
|
|
|
Required Tsr (1 questions) Required
tsr_grid:
For each item given, indicate the amount to which you agree with each statement.
| My students feel comfortable contacting me with questions outside of class. |
|
|
|
|
|
|
|
| I place a high priority on students knowing that I care about them. |
|
|
|
|
|
|
|
| All interactions I have with my students are positive. |
|
|
|
|
|
|
|
| I know my students individually. |
|
|
|
|
|
|
|
| I know the names of all or most of my students in this class. |
|
|
|
|
|
|
|
| I have high expectations for my students. |
|
|
|
|
|
|
|
| I intentionally create opportunities for students to build community in class. |
|
|
|
|
|
|
|
Required Constraints Assignments (8 questions) Required
constrints:
Identify any constraints that keep you from making changes that you would like to implement to improve your course. Select all that apply.
Your personal time constraints or priorities
Your professional time constraints or priorities
Format or modality of the course
Mandated curriculum or coordinated course
Required textbook
Class size typically too small
Class size typically too large
The teaching assistants with whom you work
Technology constraints in classroom (e.g., lack of computer lab, cost of software)
Financial constraints for the students (e.g., cost or access of technology and/or materials)
Institutional/Departmental values placed on teaching
Characteristics of students (e.g., preparedness, interest)
Physical characteristics of some classrooms (e.g., lack of flexible seating)
Other constraints
lms:
This question is about how you deliver your assignments. Excluding exams, how do you assign assessments (quizzes, homework assignments, labs, etc.)? Please select all that apply.
I do not give assessment.
I use a university-sponsored learning management system (LMS) such as CANVAS, Moodle, Blackboard, etc.
I use publisher's LMS such as MyStatLab (Pearson), WebAssign (Cengage), etc.
I use publicly-available LMS, such as, MyOpenMath, WeBWorK, etc.
I do not use an LMS for assignments. (For example, assignments on paper or PDFs given to the student.)
I use a grading tool to collect and grade assignments, such as Gradescope.
I hand out assessments on paper and students complete work on paper.
Other, please describe.
assignments:
Identify the types of student learning assessments typically used in this class. Please select all that apply. Some assessments may satisfy multiple items (e.g., a project where students also present).
Exams
Quizzes
Projects (individual or group)
Presentations (individual or group)
In-class activities
Papers or reports
Discussion boards
Other
num_exams:
How many exams (including the final exam) are given in this class?
who_proctor:
Who is proctoring (whether remotely or in person) the exams?
Instructors and/or teaching assistants
Proctoring or testing center
An AI-based proctoring tool such as ExamRoom.AI, ProctorEdu, etc.
No one. Students take exams without a proctor.
where_take:
Where do students take the exams?
In a classroom
In a proctoring or testing center
In a location of their choice but they must turn on their computer camera.
In a location of their choice
exams_admin:
What is the format in which the exams are administered?
On paper (includes using software to perform calculation)
Online with software that restricts web browsing
Online without restrictive software
Orally
A combination of formats
quest_type:
Broadly speaking, what types of questions are on the exams?
All or almost all multiple choice questions
Some multiple choice and some open-ended questions
All or almost all open-ended questions
Required Conclusion (1 questions) Required
coursecomment_post:
Are there any important aspects of this course which have not been captured above? (For example, an honors section, non-standard assessment, modality change mid-course, etc.)
Optional Add Questions (0 questions)