Slashdot Mirror


Ask Slashdot: How To Allow Test Takers Internet Access, But Minimize Cheating?

New submitter linjaaho writes "I work as lecturer in a polytechnic. I think traditional exams are not measuring the problem-solving skills of engineering students, because in normal job you can access the internet and literature when solving problems. And it is frustrating to make equation collections and things like that. It would be much easier and more practical to just let the students use the internet to find information for solving problems. The problem: how can I let the students access the internet and at same time make sure that it is hard enough to cheat, e.g. ask for ready solution for a problem from a site like Openstudy, or help via IRC or similar tool from another student taking the exam? Of course, it is impossible to make it impossible to cheat, but how to make cheating as hard as in traditional exams?"

21 of 330 comments (clear)

  1. Sometime the old ways by h2oliu · · Score: 5, Interesting

    I remember being allowed to bring notes with me to class. Would just making this open book/open notes accomplish the same thing?

    --
    Ok, I give up, why you?
    1. Re:Sometime the old ways by Mashiki · · Score: 5, Interesting

      Some of the toughest exams I've ever taken have been open book. Mostly because they require you to understand not only the theory, but the application of the theory and law to the problem. This usually shows that both the instructor, and the student understands the course material. And that it was being taught, and understood correctly.

      --
      Om, nomnomnom...
    2. Re:Sometime the old ways by John+Bresnahan · · Score: 5, Funny
      When I had "open-book" tests, I would always forget to bring my book

      When I had "take-home" tests, I would always forget where I lived.

    3. Re:Sometime the old ways by AliasMarlowe · · Score: 4, Interesting

      Some of the toughest exams I've ever taken have been open book.

      Same here. My observation was that if the test was "open-book", the books would not be much help.

      --
      Those who can make you believe absurdities can make you commit atrocities. - Voltaire
    4. Re:Sometime the old ways by dcollins · · Score: 5, Funny

      I had a student once -- Whenever we had an "in-class" test, his mother would always have a heart attack.

      --
      We know where leadership by an anti-intellectual "strongman" who scapegoats minorities and likes boisterous rallies goes
    5. Re:Sometime the old ways by 19thNervousBreakdown · · Score: 4, Funny

      Then stop having in-class tests! My god, you're killing the woman!

      --
      <xml><I><am><so><damn>Web 2.0</damn></so></am></I></xml>
    6. Re:Sometime the old ways by Grishnakh · · Score: 4, Insightful

      I disagree entirely. First, you need to distinguish between secondary and higher education; the two are very different here in the US. The submitter said he worked as a lecturer in a polytechnic, so that's university-level, not grade school. Back in the early 90s when I was in college, open-book and open-note tests were totally common; rote memorization was not. Everyone (at least in engineering school) had graphing calculators (mostly the venerable HP48), so trying to prevent students from bringing in stuff on their calculators was an exercise in futility, so in many classes like freshman Chemistry, we were allowed to have one sheet of paper with all the notes we could cram onto it when we took an exam.

      By most accounts, our universities are pretty effective at educating people; it's our grade schools that suck and get all the criticism. The main criticism of colleges is that the tuition is much too high (it wasn't nearly as expensive when I attended; it's skyrocketed in the past couple decades for some reason).

    7. Re:Sometime the old ways by Minwee · · Score: 4, Insightful

      Could a professor put questions on the test that he or she knows aren't easily solved by using the Internet?

      I don't know. Is there a question which cannot be answered by visiting www.gmail.com and having a helpful friend or highly paid accomplice on the outside write up the solution for you?

      If your answer to that question is 'No', then you're starting to see the problem. If your answer is 'Yes', then I have an amazing investment opportunity for you. It's a combination of a perpetual motion machine, time cube, and weight loss device that is made entirely from recycled ophidian extracts...

    8. Re:Sometime the old ways by thesandtiger · · Score: 5, Insightful

      Absolutely there's a question that can't be answered that way:

      "Minwee, on your previous exams you struggled to even articulate the most basic concepts involved in XYZ. Yet here on your final exam you managed to put forth an elegant solution. Please, from memory, walk me through your solution and how you came up with it step-by-step."

      The tricky part (and it isn't that tricky) is how to know who's done suspiciously well and who is just a really good student.

      For me, when I teach courses, I handle that by giving 2 grades for each assignment. One is the letter grade, the other is a meta-grade that explains why they got that letter. I also mix up assignment types and methods - some are open book, some are spontaneous and WAY too short (2-3 minutes at most) to get any real kind of response from an IRC enabled accomplice, etc.

      The meta grade thing is simple: I might have 3 students who do an assignment and get a C. One might have gotten a C because they got an answer that was incorrect BUT they derived it through a process that is sensible and correct (usually just some kind of error they didn't catch); One might have gotten a C because they got a correct answer but their process made no sense; One might have gotten a C because they got the right answer but didn't show their work at all. Over time I develop a profile for each student based on those metas and so I can spot outliers not just in the actual letter grade they got but also in the reason for the grade.

      When I have a student who routinely does very well but doesn't show their work, I'll sit with them and ask them to explain their work. If they can't do it adequately I'll remind them that cheating will get them an F for the course and possibly expelled, so I expect that in the future they'll be able to explain how they got those ever-so-correct answers the next time. It's shocking how many "correct but inarticulate" students suddenly become "frequently incorrect but extremely verbose" when they realize I'm on to them.

      The other thing is that by and large, cheaters are not very consistent students when it comes to those meta grades, even if their letter grades might be. When I see a student with a very inconsistent pattern, that's another sign I need to have a talk with them.

      I figure if a student can both figure out and slide past my system they deserve to get away with it.

      Anyway, the thing is that it requires a faculty member who is actually invested in teaching their students rather than just herding them through a course.

      --
      Since I can't tell them apart, I treat all ACs as the same person.
  2. Whitelist it. by Samantha+Wright · · Score: 5, Insightful

    They don't need the whole internet; only a handful of sites. Set up a proxy that permits only GET requests to a few domains like Wikipedia, disable Javascript for good measure, and you're done.

    --
    Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
    1. Re:Whitelist it. by Samantha+Wright · · Score: 4, Funny

      I think that falls under the "no harder than usual" clause. Personally, when I get my PhD I'm going to demand that all of my students write their exams in panspectral Faraday cages.

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
    2. Re:Whitelist it. by wierd_w · · Score: 4, Funny

      Panspectral? Not merely multispectral?

      Will the students be issued flashlights, or will the tests be administered in braile?

  3. What are you testing by Oswald+McWeany · · Score: 5, Insightful

    In "real life" students will have access to all those things. Perhaps it isn't cheating but rather utilizing tools that they would have access to in "real life".

    Assume they'll use every tool at their disposal- and write the tests in such a way that they can't copy the question into a search bar and google the answer.

    --
    "That's the way to do it" - Punch
    1. Re:What are you testing by Samantha+Wright · · Score: 4, Insightful

      Perhaps the professor's goal is to avoid creating—please excuse the harsh wording—parasites? I've heard a lot of horror stories about students who were able to ride on the success of others. At a certain point, you might as well expect everyone to just use the Internet and their social networks to answer everything for them, and never bother instructing them in the first place.

      --
      Bio questions? Ask me to start a Q&A journal. Computer analogies available for most topics!
  4. You don't know what teaching is. by Anonymous Coward · · Score: 5, Insightful

    Teaching means showing the way to solve problems. Nobody cares about correct solutions to school problems. It's all about the process of solving the problem, a scheme of thinking.

  5. just your basic setup... by wierd_w · · Score: 4, Informative

    Block all traffic except port 80 http. (They don't need https, do they? They aren't checking bills online or using email, or some other security oriented task...)

    Block all udp connections.

    Dns filter a blacklist of known cheating sites.

    Block bullshit sites like facebook, myspace and pals too. That's just good sense.

  6. Suck It Up by dcollins · · Score: 4, Insightful

    "And it is frustrating to make equation collections and things like that."

    (A) Suck it up and do the work once.
    (B) Use a textbook that comes with a premade formula card for use on tests.
    (C) Find a premade formula card online and distribute that for tests.

    Personally, I use option (B) for my math classes. Trying to make the internet non-communicable is like making water not wet.

    --
    We know where leadership by an anti-intellectual "strongman" who scapegoats minorities and likes boisterous rallies goes
  7. Use Random Variables and have a time limit. by roeguard · · Score: 5, Interesting

    When I was in grad school, in many classes we were allowed to use the internet on tests, as well as our notes, any spreadsheets/programs/scripts we had pre-made, etc. The caveat was that the tests were structured in a way that if you didn't already know what to do, you wouldn't have enough time to look it up and still finish the test. Googling things takes time. And the test really only provided enough time to actually do what you already knew.

    You can also use random variables for each test, or groupings of tests, to prevent direct copying of answers. With a time limit, cheaters would have to wait for someone else taking the test to find the correct answer, send it out, and then modify it to match their own variables. If they can do all of that in a crunch, chances are they understand it pretty well on their own, even if they are lazy.

  8. i don't buy it by callmebill · · Score: 4, Insightful

    So what happens when all the "original content" makers die off? If we just search the web, we'll only get old information. Let people figure out how to create their own OC by searching within and solving/exploring on their own, so that the future internet will have new information. In the meantime, grade on the curve just to keep the education process moving.

  9. Open-note = nearly guaranteed pass by sirwired · · Score: 5, Funny

    Many of my engineering classes allowed "formula sheets" or a "formula card", usually a single sheet of paper or a 4x6 index card, that the student was responsible for formulating themselves.

    I used this to completely ace the exam in several of my EE classes where I otherwise would have had great difficulty. (Analog just wasn't my thing while becoming a CompE; I rocked my digital and computer classes.)

    My tactic: Virtually all professors provide sets of review problems, and the answers to the review problems (along with all homework questions and mid-terms) were on file with the library. I'd go the library and make copies of those materials. I would then go back to my room and pass-through every single homework assignment, mid-term, and review question, and solve every problem to the point where the remainder of the solution was "busy-work." If, after much staring, I simply could not figure out how the professor got from point A to point B, I simply copied the entire solution to that problem (writing very small with a very sharp pencil if I was confined to a card, or just about 3 rounds of reducing on the copy machine if I wasn't) onto my formula sheet/card.

    90% of the time, the problems where I had to copy the solutions wholesale onto the card ended up on the exam (with some trivial parts changed), and I was invariably one of the few people in the class to get it right, despite the fact that I had utterly no idea how the solution worked.

  10. You're solving the problem the wrong way by LrdDimwit · · Score: 4, Informative

    This problem is not amenable to technical solution. Trying to stop attackers from cheating via the Internet, by using some a filter or other form of limited access -- is as futile as trying to solve the halting problem, and enumerate the irrationals, at the same time.

    The halting problem fails because it's too easy to craft countermeasures aimed deliberately at the scanner. Enumerating the irrationals fails because there is so much complexity, it's literally impossible to go throgh it all.

    But just because you can't solve this problem technically doesn't mean it can't be solved. It's difficult, but I believe it might be possible. Don't bother beyond the basics. Get a computer lab set up with computers you control. Don't allow the students to bring in any USB sticks or CDs.

    Then simply install tracking software on every PC. (You can also use a network sniffer to back this up.) The idea isn't that to prevent cheating technically; rather, you want to preserve the ability to tell that people have cheated, and simply punishing them under the existing rules.

    You tell everyone in the class that you'll be monitoring their internet usage during the exam. Then tell everyone what you consider cheating. Have your grad students go through the logs manually; the difference should be fairly obvious.