IST Teaching

Teaching In IST

  • Home
  • COVID Modes
    • Delivery Mode Planning
    • Communicating Before Spring
    • Getting to Know Students
    • Engaging Students
    • Assessment
    • COVID LionPATH Codes
    • Resources
    • Events and Recordings
    • FAQs
  • Resources
    • Teaching Methods
    • Course Design
    • Course Administration
    • Curriculum
    • Instructional Support
    • Teaching Community Seminars
    • Feedback From Students
    • Learning Assistants
  • Courses
    • Undergraduate Courses
      • Undergraduate CYBER Courses
        • CYBER 100
        • CYBER 199
        • CYBER 262
        • CYBER 294
        • CYBER 296
        • CYBER 297
        • CYBER 299
        • CYBER 342W
        • CYBER 362
        • CYBER 366
        • CYBER 399
        • CYBER 440
        • CYBER 494
        • CYBER 496
        • CYBER 497
        • CYBER 499
        • CYBER 99
      • Undergraduate DS Courses
        • DS 120
        • DS 197
        • DS 199
        • DS 200
        • DS 220
        • DS 294
        • DS 296
        • DS 297
        • DS 299
        • DS 300
        • DS 310
        • DS 320
        • DS 330
        • DS 340W
        • DS 396
        • DS 397
        • DS 399
        • DS 402
        • DS 410
        • DS 440
        • DS 442
        • DS 494
        • DS 496
        • DS 497
        • DS 97
        • DS 99
      • Undergraduate HCDD Courses
        • HCDD 113
        • HCDD 264
        • HCDD 340
        • HCDD 364W
        • HCDD 440
      • Undergraduate IST Courses
        • IST 110
        • IST 130
        • IST 140
        • IST 170N
        • IST 197
        • IST 199
        • IST 210
        • IST 220
        • IST 222H
        • IST 230
        • IST 234N
        • IST 235
        • IST 237
        • IST 240
        • IST 242
        • IST 250
        • IST 256
        • IST 261
        • IST 294
        • IST 295A
        • IST 295B
        • IST 296
        • IST 297
        • IST 298
        • IST 299
        • IST 301
        • IST 302
        • IST 310
        • IST 311
        • IST 331
        • IST 337
        • IST 341
        • IST 361
        • IST 389
        • IST 390
        • IST 397
        • IST 398
        • IST 399
        • IST 402
        • IST 411
        • IST 412
        • IST 413
        • IST 420
        • IST 421
        • IST 422
        • IST 423
        • IST 424
        • IST 425
        • IST 426
        • IST 431
        • IST 432
        • IST 437
        • IST 440W
        • IST 441
        • IST 442
        • IST 443
        • IST 444
        • IST 445
        • IST 446
        • IST 450A
        • IST 450B
        • IST 451
        • IST 452
        • IST 453
        • IST 454
        • IST 456
        • IST 461
        • IST 462
        • IST 489H
        • IST 494
        • IST 495
        • IST 496
        • IST 497
        • IST 498
        • IST 97
        • IST 99
      • Undergraduate SRA Courses
        • SRA 1
        • SRA 111
        • SRA 197
        • SRA 199
        • SRA 211
        • SRA 221
        • SRA 231
        • SRA 268
        • SRA 294
        • SRA 296
        • SRA 297
        • SRA 299
        • SRA 311
        • SRA 365
        • SRA 397
        • SRA 399
        • SRA 421
        • SRA 433
        • SRA 440W
        • SRA 450
        • SRA 468
        • SRA 471
        • SRA 472
        • SRA 480
        • SRA 494
        • SRA 496
        • SRA 497
        • SRA 99
    • Graduate Courses
      • EA Courses
        • EA 594
        • EA 871
        • EA 872
        • EA 873
        • EA 874
        • EA 876
      • Graduate IST Courses
        • IST 501
        • IST 503
        • IST 504
        • IST 505
        • IST 510
        • IST 511
        • IST 512
        • IST 520
        • IST 521
        • IST 525
        • IST 526
        • IST 530
        • IST 532
        • IST 541
        • IST 543
        • IST 554
        • IST 555
        • IST 557
        • IST 558
        • IST 561
        • IST 562
        • IST 564
        • IST 590
        • IST 594
        • IST 596
        • IST 597
        • IST 600
        • IST 601
        • IST 602
        • IST 610
        • IST 611
        • IST 815
        • IST 816
        • IST 820
        • IST 836
        • IST 841
        • IST 852
        • IST 868
        • IST 885
        • IST 888
    • Associate Courses
      • Associate IST Courses
        • IST 111
        • IST 225
        • IST 226
        • IST 227
        • IST 228
        • IST 255
        • IST 257
        • IST 260
    • Course Committees
    • Course Proposals
    • LionPath Course Catalog
  • Learning @ IST
  • Orientation
  • Contact Us

CORONAVIRUS UPDATES:

Keep up with information on Penn State's Keep Teaching site for faculty along with College resources for delivery of residential courses. In October-December the College will accept Spring 2021 applications for undergraduate Learning Assistants (LA), Master’s Instructional Assistants (IA), and doctoral Teaching Assistants (TA); and faculty are encouraged to recruit undergraduate students, in particular.

Assessment

This page provides recommendations for creating good, high-quality examination questions. We also share technical and policy guidance for instructors who wish to modify their F2F exam processes to accommodate remote settings. Additional information will follow as more details about exam expectations are shared at the University level.

Content

This page includes guidance on the following topics:

  1. Resources for creating quality exams
  2. How final exams may be altered
  3. Academic integrity considerations
  4. Preparing students for remote delivery exams
  5. Reminders about student conduct during remote delivery exams
  6. Student disability accommodations
  7. Additional references
  8. Allowable technology for administering exams

1. Resources for creating quality exams

Use exam writing tips for constructing high-quality exams.

The wording and placement of exam items matter in creating a high-quality exam. For a clear discussion of what to pay attention to, see the following resources:

  • Multiple-Choice Item-Writing Rules (2-page guide)
  • Making Multiple Choice Tests More Effective (PPT from testing expert, Linda Suskie)
  • Tomorrow’s Professor newsletter #1743
  • Vanderbilt University Center for Teaching’s Multiple Choice Test Question Guide

Use multiple-choice questions to address higher-order thinking.

Writing items that address more than memorized terminology will help you assess what students understand at deeper levels. For examples of what these items look like in a multiple-choice format, see the following resources:

  • Examples of Higher-Order Multiple Choice Items and Basics of Writing Tests (Presentation from 2008 testing workshop—see last 4 slides for examples)
  • Best Practices for High-Quality Exam Questions (video of workshop presented by testing expert, Hoi Suen, Penn State Professor Emeritus, 2018)

2. How final exams may be altered from your usual exams for F2F courses

Change the question format.

Question format refers to options such as multiple-choice, short answer, essay, problem-solving, or original coding. If you previously taught with multiple-choice exams for your residential F2F course, you may want to consider changing questions to another format to better ensure academic integrity. Communicate your choice to students, so they know what to expect and can choose appropriate study strategies.

Change the exam format.

Exam format refers to closed-book or open-book. If you previously administered closed-book exams for your residential F2F course, you may want to consider adopting an open-book format. Communicate your choice to students, so they know what to expect and can choose appropriate study strategies. Also, consider communicating how to study for open-book exams, as many students think that “open book” means that they don’t need to study.

Changing the difficulty level of the exam is not recommended.

Adding many more questions to an exam with the same amount of time that you would give in a F2F course or making exam questions tricky, in an attempt to catch cheaters, is not good practice. It is unfair to students who study. Use other strategies to dissuade cheating (see Academic Integrity Considerations below).


3. Academic integrity considerations

What instructors can assume regarding academic integrity.

Students will likely have access to textbooks and course materials during the exam, even if you ask them to not use them.

Students may have communication with other students in the class via GroupMe or other texting mechanisms.

Students will likely multitask during the examination and may end up using the internet to look up answers.

What instructors can’t assume regarding academic integrity.

You cannot assume that all students will have the same technology (webcams, microphones, etc.), or reliable high-speed internet access.

You cannot assume that students will abide by restrictions for the use of electronic devices. Some exam proctoring tools might be able to tell if a student is accessing other applications and websites from the same computer. Do not assume that the student isn’t also accessing another nearby computer, tablet, or phone.

You cannot assume that students won’t have previous copies of exams and won’t share the current exam to future students. Regardless of the technology used to lock down the browser, we cannot assume that students won’t have the ability to copy the exam in its entirety to share with others.

Design exams according to the assumptions that instructors can and can’t make.

Design exams, based on reasonable assumptions, in ways that best preserve the integrity of the exam, the exam experience for students, and exam results. Specifically, consider the following:

  • Employ tips for writing quality exams (and see Resources for Creating Quality Exams above)
  • Write items that test more than memorization—consider Bloom’s Taxonomy as a guide for thinking about questions that address various levels of learning
  • Use a quiz item bank with many questions
  • Shuffle answer options on different questions
  • Shuffle questions to create several versions of the exam
  • Consider the appropriate amount of time for the exam and set a time limit
  • Set a specific date and time of day for the exam
  • Decide whether to proctor and the manner in which you will proctor
  • If using Canvas for exams, consult academic integrity suggestions when testing in Canvas (see this PowerPoint Presentation, slides 6-7, from Online Faculty Experts Panel), and choose which measures you want to employ, given your particular exam context
  • Consider the guidance above for creating quality exams, especially that from the Schreyer Institute about making multiple-choice tests more effective and from the College of IST workshop on Best Practices for High-Quality Exam Questions

4. Preparing students for remote delivery exams

Share with students how best to prepare for remote delivery exams.

In all cases, students should study for exams, whether they are open-book or closed-book. However, the type of studying that they should do should match what you are going to ask of them on the exam.

Will your exam test recall of vocabulary and recognition of examples of concepts? If so, memorization techniques and the ability to categorize examples will be important. Will your exam test the application of concepts in new settings? If so, study techniques that test students’ ability to explain concepts and processes, make connections, and perhaps do some problem solving will be important. Talk with your students about what they should be able to do and suggest appropriate strategies that will prepare them for the exam so that they don’t waste valuable studying time.

Share resources to assist students in organizing for studying:

  • Adjusting your Study Habits
  • iStudy Modules on Study Skills and Time Management

5. Reminders about student conduct during remote delivery exams

Prior to giving an exam, express expectations with regard to academic integrity.

Students need to know that academic integrity matters—to students, to faculty, and to the quality of the degree that students earn. Share that Penn State expects all students (in residence and at a distance) to abide by the principles of academic integrity and that the same procedures are in place for dealing with misconduct whether courses are held face to face or in a remote setting.

Consider sharing the following information with students:

  • College of IST Academic Integrity webpage with information for students
  • Penn State Code of Conduct

6. Student disability accommodations

Students with registered disability accommodations should receive accommodations for exams, regardless of whether the course is remote or F2F. If you have students who have made an accommodation request, please reach out to the Student Disability Resources to discuss alternative arrangements if you have questions about how to offer appropriate accommodations.

Students can read about disability resources on the Remote Learning FAQ page.


7. Additional References

The guidelines presented here are distilled from the following resources on exams, curated by the Schreyer Institute for Teaching Excellence (SITE); a cross-campus committee of teaching- and technology-support units; and faculty leadership, administrators, and teaching support in the College of IST.

  • https://www.schreyerinstitute.psu.edu/AdaptingAssessments (Adapting assessments)
  • https://www.schreyerinstitute.psu.edu/RTandA (Remote teaching and assessment strategies)
  • https://keepteaching.psu.edu/teaching-and-testing/assessment-options/ (Assessment options)

In general, the College recommends following SITE recommendations and using the Keep Teaching site for specific options and directions.


8. Allowable technology for administering exams

See the Remote Exam Proctoring Options and Requiring Webcams pages on the Penn State Keep Teaching site for information about this.


Office of Teaching, Learning, & Assessment


E101 Westgate Building
(814) 865-8947
Contact Us? learning@ist.psu.edu

  • Privacy
  • Non-Discrimination
  • Equal Opportunity
  • Accessibility
  • Legal

Copyright © 2021 · Education Pro Theme on Genesis Framework · WordPress · Log in