Slashdot Mirror


Preventing Networked Gizmo Use During Exams?

bcrowell writes "I'm a college physics professor. My students all want to use calculators during exams, and some of them whose native language isn't English also want to use electronic dictionaries. I had a Korean student who was upset and dropped the course when I told her she couldn't use her iPod during an exam — she said she used it as a dictionary. It gets tough for me to distinguish networked devices (iPhone? iTouch?) from non-networked ones (calculator? electronic dictionary? iPod?). I give open-notes exams, so it's not memory that's an issue, it's networking. Currently our classrooms have poor wireless receptivity (no Wi-Fi, possible cell, depending on your carrier), but as of spring 2011 we will have Wi-Fi everywhere. What's the best way to handle this? I'd prefer not to make them all buy the same overpriced graphing calculator. I'm thinking of buying 30 el-cheapo four-function calculators out of my pocket, but I'm afraid that less-adaptable students will be unable to handle the switch from the calculator they know to an unfamiliar (but simpler) one."

11 of 870 comments (clear)

  1. Open Notes & Well-Designed Exams by slifox · · Score: 5, Insightful

    First off -- I applaud your use of open-note exams. That is the ONLY real-world way to learn and demonstrate knowledge. There is almost never a situation in the professional world where one must solve a problem with absolutely no references (and it would be stupid to do so on a production system -- when solving a critical problem, why risk everything based on what you *think* is right, when you can verify against documentation; at least if something breaks, you can point to the incorrect docs...)

    Some people can simply memorize anything they look at, while others struggle at this. A proper exam should be designed to test one's ability to demonstrate processes: exams should give you all the information you need, but the questions should be designed such that only someone who has invested prior effort in practice and learning will be able to solve the questions in the allotted time.

    For less-concrete subjects such as the arts, I'm not so sure how this can be accomplished. However this is a trivial design decision for exams in maths, sciences, programming, and engineering.

    Furthermore, I think any physics or math exam that requires a complex calculator really has a wrong approach. Assuming everyone at this level has already demonstrated their ability to perform arithmetic several times over, the calculator should only be there to free them from making mistakes on the menial number crunching (addition, subtraction, multiplication, division, squares, squareroots, proper value of e,Pi, etc...). The exam should test for core concepts: ideas where you simply must understand the knowledge through prior practice and learning.

    Sadly, I think many professors fall back on rote-memorization exams just because they can't be bothered to design proper exams each semester. These types often teach straight from the textbook-provided lesson plans, and then wonder why students cheat...

    But honestly -- an exam is but one facet of demonstrating proficiency in a subject. Personally, I think projects & labs the best way: sure one can cheat, but it's easy to determine who has spent time polishing a proper unique lab report. In this respect, open-ended projects are the best, as the room for creativity limits the possibility for undetectable cheating, and lets the students show their enthusiasm for the subject. If you're really worried about cheating, a lab-practical may even be a legitimate tool: it's pretty damn hard to make stuff up as you go while you've got a one-person audience of the professor.

    Short answer: let them use basic scientific calculators, the textbook, their notes, and a dictionary; design your tests so that students have all the resources they need, but don't have enough time to learn-as-they-go during the exam.

    "Never memorize something that you can look up." --Albert Einstein

    1. Re:Open Notes & Well-Designed Exams by jdong · · Score: 5, Insightful

      The design of the exam is not the problem -- if students have networking access to someone inside the exam room (or worse, outside the exam room), no matter how hard you make the exam, you are testing the brainpower of their lifelines, not them. This the 2010 version of "how do I prevent students from whispering to each other during a test", for which there is no straightforward solution short of "no electronics in the exam room".

    2. Re:Open Notes & Well-Designed Exams by Anonymous Coward · · Score: 5, Insightful

      if students have networking access to someone inside the exam room (or worse, outside the exam room), no matter how hard you make the exam, you are testing the brainpower of their lifelines, not them.

      This.

      I didn't come here to troll, but I feel obliged to point out that the grandparent poster lost himself in a forest of his own self-righteousness regarding assessment design. The problem under discussion is that two students in the room working on the same test at the same time could have IM ability through wireless networking, and so one could do the work while passing the answers wirelessly to the other, who could simply copy what he sees on IM.

      Parent is almost right: there is no solution short of "no unapproved electronics." Students with poor English abilities who need dictionaries should bring their dictionaries to office hours for inspection; the invigilating TA's (if this is a large lecture) could be notified on the sign-in roster (I'm assuming a sign-in procedure for a large lecture) or be introduced personally to the student in question to be sure they recognize them. The policy would have to be on the syllabus and announced in class the first day. It's not a simple solution, but it's probably more fair to students not fluent in English than denying all electronics.

      Of course, the administration could also try requiring that all course instruction and assessment (outside classical/modern languages in Arts & Sciences) be conducted in English, and that all students entering pass an unaided (no lexicon!) English proficiency exam that's not a total joke. I mean, imagine a student going to France and expecting accommodations because he doesn't know French... Of course, administrations in the US will never enforce a convenient language policy, so you're going to have to make allowances for electronic devices like dictionaries if you ban electronics from testing sites.

    3. Re:Open Notes & Well-Designed Exams by Antisyzygy · · Score: 5, Informative

      The GRE was the biggest joke of a test I have ever taken. It did nothing to test my capabilities. It only tested whether or not I actually bothered to purchase the prep materials from the private company that administers it.

      --
      That brings me to an interesting point, / . is just "the ramblings of socially-inept, technology-literate news-mongers".
    4. Re:Open Notes & Well-Designed Exams by Austerity+Empowers · · Score: 5, Funny

      Yahoo Question: If I have a crumpled up piece of paper in one hand, and a baseball in another, both hands are 1m from the ground and I release both objects at the same time, which one hits the ground first?

      Best Yahoo Answer: Can't answer this question without knowing if there is writing on the paper.

      Answer: If the crumbled up paper is in the left hand, it hits first.

      Answer: The ball, it's heavier, duh.

      Answer: Fucking nerd.

      Answer: Nerd's don't fuck, idiot.

      Answer: Oh yeah? I'm pregnant.

    5. Re:Open Notes & Well-Designed Exams by Iron+Condor · · Score: 5, Insightful

      so you're going to have to make allowances for electronic devices like dictionaries if you ban electronics from testing sites.

      I heard they have a totally newfangled dictionary now, that works entirely without electronics. It consists of lots of sheets of paper, with the words printed on it. Like as if you made a big printout of a site-rip of m-w.com.

      --
      We're all born with nothing.
      If you die in debt, you're ahead.
  2. 10 years ago by porkThreeWays · · Score: 5, Insightful

    What the hell did these students do 10 years ago? AFAIK two semesters of English and perhaps 1 semester of literature are the norm at every reputable college in the U.S. If their English is too poor for your physics exam, they probably have no hope of graduating.

    --
    If an officer ever threatens to taze you, say you have a pacemaker.
  3. No calculators by bziman · · Score: 5, Interesting

    When I took undergraduate physics, there were no calculators allowed... there were no numbers on the exams. Problems were like "If you throw a rock horizontally off a bridge at (v) m/s and it hits the ground after (t) seconds, how far away from the base of the bridge did the rock hit the ground, and how tall is the bridge?" And then the student has to understand that this problem requires the use of the projectile motion equations, and they to know what the question is actually asking and solve for it:

    w = v t
    h = g t^2

    One particularly sadistic (but awesome) professor asked a question like this "Suppose you're stuck in the middle of a frozen pond with a perfectly smooth (frictionless) surface. Propose a way to escape the pond." My (correctly marked) proposal was throw away a shoe. Of course, I could show equations for conservation of momentum, but the point was to see if students understood what it meant to be a frictionless surface and to simply be aware of conservation of momentum.

  4. cultures AND pressures by Lord+Ender · · Score: 5, Insightful

    First remember that foreign students pay FAR more than we do to go to US schools. Compound that with the fact that many come from poor countries. The pressure to succeed is EXTREME. Furthermore, not all cultures despise cheating as much as Western culture. The results are predictable.

    Personal anecdote: I was invited to the Indian CS students' "study session" once while on a group project. I was AMAZED. They had a library of homework and test questions and answers. They passed them around casually. They also begged me for graded solutions from my previous courses to add to their collection. They were all cheating their way through and thought it was normal.

    They also kept asking me how I could come up with working algorithms to programming assignments on my own (without copying from something). It was as if actually being able to program was wizardry to them. I wonder why.......

    --
    A slashdotter who didn't build his own computer is like a Jedi who didn't build his own lightsaber.
  5. Pen. by drolli · · Score: 5, Informative

    I hold a PHD in physics.

    -A pen is enough. In physics exams students should prove they can transform formulas symbolically. Typing in number can be done by people at the cashier desk. Graphing calculators are a disease.

    -Everybody who wants, can take in a standalone mp3-player - these are cheap.

    -Regarding the dictionary - these exist in paper and are cheap - and faster than an ipod.

    Most important: who uses sophistication to cheat and i caught should be removed from the studies immediately.

  6. Re:Well not sure if this is the right approach but by Mike+Kristopeit · · Score: 5, Insightful

    perhaps you haven't heard of ad hoc networks.... even inside a faraday cage, as long as one student is willing to help others cheat, all students are capable of cheating.