"ExamSoft" Bar Exam Software Fails Law Grads 100
New submitter BobandMax writes ExamSoft, the management platform software that handles digital bar exam submissions for multiple states, experienced a severe technical meltdown on Tuesday, leaving many graduates temporarily unable to complete the exams needed to practice law. The snafu also left bar associations from nearly 20 states with no choice but to extend their submission deadlines.
It's not the first time, either: a classmate of mine had to re-do a state bar exam after an ExamSoft glitch on the first go-'round. Besides handling the uploading of completed exam questions, ExamSoft locks down the computer on which it runs, so Wikipedia is not an option.
Really? (Score:5, Funny)
"leaving many graduates temporarily unable to complete the exams needed to practice law."
And that's a bad thing, because ... ?
Re: (Score:1)
Because they would like to practice law and earn money, presumably.
Re: (Score:2)
Yeah, mob rule is so much better than law and order...
(I'm not saying all that lawyers do is in the public good - far from it - but you're still an idiot.)
Re: Really? (Score:4, Interesting)
That is, they are a solution to a problem they create.
You can look back at just about every functionjng society for most of human history and neither find mob rule nor lawyers. You also find law that is comprehensible to a lay person.
Not saying our legal system is better or worse than old legal systems, just that the point you made about mob rule is certainly not necessarily true.
Re: (Score:2)
Interesting points; thank you.
As I understand it, in China, the lawmakers are generally not lawyers, and they have more ex-engineer politicians. I have no idea if their laws are more comprehensible, though.
Re: Really? (Score:4, Funny)
I still can't read a word of it though
Re: (Score:2)
The same critique applies to the the general sort reading this site. You can look back at just about every society for most of human history and find that they're unnecessary... right?
If you want to create complex systems to automate data processing and other ta
Re: (Score:2)
That's a pretty naive view of what lawyers do and when they're needed. A lawyer is just an expert in certain things, and they assist people who need to do something they aren't themselves an expert at:
- If you want to present a persuasive case in court, you want someone who is an expert in reviewing and presenting evidence. A lawyer can be that person
You also want someone who can explain the case to the court in a persuasive way. A lawyer can be that person.
- If you want to prepare a contract
Re:Really? (Score:4, Funny)
"Yeah, mob rule is so much better than law and order..."
I have never seen "Mob Rule" but "Law and Order" stopped being good after Jerry Orbach died.
Re: (Score:2)
Re: (Score:1)
Anarchy does not specifically imply immoral behavior. It does however, allow me to beat the ever loving shit out of you for committing immoral acts under the color of law.
Re:Really? (Score:5, Informative)
The business next door proctors these and similar exams. They are expensive and not available in every community, so the test takers have often paid a relatively large amount of money at this stage of their lives, not just several hundred to take the test, but also travel, accommodations, missing day(s) of work, etc. to be where the test is available. The proctoring company does not charge them for the second attempt, but all of the expenses needed to be there get doubled.
Re: (Score:1)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
I don't know about that. Say the average first year lawyer makes $60,000 (pulled directly from my butt; I have no idea what the actual number is and don't care to look). Suppose that 80% of bar takers pass the exam. That means the expected income for the next six months of a random person taking the bar is 60K * .8 * .5 = 24K. This is the number that a good lawyer could convince a judge (who is a lawyer) that these young, brilliant, aspiring lawyers should be compensated by the testing firm (who is not a la
Re: (Score:1)
I'm going to go ahead and say you have no idea what you are talking about.
First: Law graduate salaries are heavily bi-modal. While the average salary is around $60,000, that average is heavily skewed by high-earners. My starting salary upon law school graduation was $160,000. Most large law firms (500+ lawyers), which employ approximately 10% of new graduates, pay exactly that salary to first-years. My offer was explicitly contingent on passing the bar. If I had failed, there would have been approximatel
Re: (Score:1)
Re: (Score:2)
Re: (Score:2)
So yeah, it's a pretty huge deal to be sentenced to 6 months of unemployment...
Wait - you can still work as a paralegal or in a similar support role until you pass the bar as a full-blown lawyer, no?
Re: (Score:1)
Wrong - bad summary (Score:2)
Students weren't unable to complete exams; they were unable to upload the exams, which you need to do after you get home (or to a hotel) after the exam. It gets stores on your laptop (presumably with public key encryption) in the meantime. Examsoft's servers ran at least 50% slower than they had in the past; the company hasn't announced why.
The only trick is that some jurisdictions required you to upload the exam within a few hours, so Examsoft had to contact those jurisdictions and get them to extend the
Re: (Score:1)
Re: (Score:2)
of course not.
"glitch in a widely used system to upload bar exam answers and essays temporarily failed, meaning their answers were not uploaded or sent to various state websites."
Lockdown (Score:4, Insightful)
Besides handling the uploading of completed exam questions, ExamSoft locks down the computer on which it runs, so Wikipedia is not an option.
Yeah, that'll work, because nobody has internet capable cellphones, secondary machines or even Virtual Machines.
Re: (Score:2, Insightful)
Besides handling the uploading of completed exam questions, ExamSoft locks down the computer on which it runs, so Wikipedia is not an option.
Yeah, that'll work, because nobody has internet capable cellphones, secondary machines or even Virtual Machines.
and exams are never held in controlled conditions on known hardware with invigilators..... but sure lets let law students BYOD to there exams....
Re:Lockdown (Score:4, Insightful)
You have to drive to the exam site but you're expected to bring your own equipment? Who thought that up? Rather than trying to intrusively lock down everyone's machine it would be far better to simply issue everyone a cheap tablet or netbook on which to take the exam. Controlled hardware, no need to try to "lock down" innumerable variations of BYOD. The ExamSoft web site says the software runs on "any modern machine", defined as Windows, Mac, or iPad purchased in the past 3-4 years. But disable any anti-virus, and no VMs. They're basically trying to secure any random machine off the street to prevent cheating. That's a very fine example of "doing it wrong".
Re: (Score:1)
Even better, when I took the exams, they didn't even provide internet access to upload. You had to wait until you got home or other internet access to upload it. Goodness only knows what could have happened in the mean time. Plus, a guy in my class ran it in a virtual machine as all he had was a Linux machine. Apparently, running dmidecode and vboxmanage was enough to do so.
Re: (Score:1)
Re: (Score:2)
I had wondered about that myself... Do they seriously not require taking the Bar on controlled hardware? Hell, a bunch of geeks should take and "ace" the Bar just for the sake of making fun of it.
"Oh, JD huh? Yeah, I have one of those too, figured I'd just drop by in my spare time and take a go at it, and whaddya know, perfect score. Oh, sorry about all those 100 hour weeks of study you pu
Re: (Score:3)
TFS mentions Wiki, but you'll notice that TFA did not, nor did I. No doubt, if someone seriously tried to do this, Wikipedia would fall pretty far down the list of places to look for answers.
That said, what the GGP and I jokingly pointed out counts as a much
Re: (Score:2)
Sure a bunch of geeks with no legal training could use Wikipedia and slashdot. To pass a law exam.
...same way a lot of them made MCSE back in the dot-boom: braindump websites.
Re:Lockdown (Score:5, Informative)
For exam takers, a secondary machine and internet capable cellphone is not an option. The exam doesn't take place in your living room but at a monitored location. In my state, the exam proctors don't even let you bring in your own pencil. Pulling out a cellphone would be a great way to be kicked out and never be allowed to take the exam again.
I am not sure the current state of virtual machines and ExamSoft, but at least a few years ago the ExamSoft software would not run when a virtual environment was present. While I am sure people have found workarounds, the point of the software (and why most law schools and state bars use it) is to avoid that result.
Re: (Score:1)
I wonder what all of these skill based systems will do when Neural interfaces and cybernetic coprocessors become possible. do courtrooms even have faraday cages? Else lawyer dude could link in to Lexus Nexus and a legal expert system on the fly and eat the other lawyer for breakfast. Same for doctors linking in to a medical expert system, the AMA datastore, and others on the fly.
is it really cheating then, or a hidebound insistence on doing things the way they have always been done, linked with a large a
exam taking best practices (disabling an AV) (Score:2)
there exam taking best practices (including disabling antivirus programs) and NO VM??? on your own hardware?
Re:Lockdown (Score:4, Informative)
I noticed that the exam software we used was running on XP and appeared to have been originally programmed for Windows 98. I wonder if they ever upgraded those boxes to Win7...?
Re: (Score:2)
Besides handling the uploading of completed exam questions, ExamSoft locks down the computer on which it runs, so Wikipedia is not an option.
Yeah, that'll work, because nobody has internet capable cellphones, secondary machines or even Virtual Machines.
It doesn't need to be perfect, just decent enough to make it harder to cheat. Things like the consequences of getting caught also apply--law is a highly regulated profession, and getting caught would keep a person from ever becoming a lawyer. Failing the bar exam generally just means you retake it six months later and study more.
Cellphones are not permitted in the exam room; so are second computers; and I believe the software is designed not to run on at least some class of virtual machines.
Lawsuit Just Begging to Happen (Score:5, Funny)
AI (Score:2)
"...leaving many graduates temporarily unable to complete the exams needed to practice law."
I guess that's what we call Artificial Intelligence.
Can you break https? (Score:2)
EULA (Score:2)
I hope they have a good EULA ;-)
Trust (Score:5, Insightful)
If we can't trust these applicants to take the test honestly, how can we trust them to act as officers of a court?
Re: (Score:2)
Now of course the nerds among us (you, me, most everyone else here) can think of clever ways someone could conceivably cheat—a tiny scroll in 4pt font rolled up into your pen, rul
Re: (Score:2)
Re: (Score:1)
Not defending ExamSo
Re: (Score:2)
Re: (Score:2)
Those are preparing to be lawyers, not judges or prosecutors.
Re: (Score:3)
Those are preparing to be lawyers, not judges or prosecutors.
I thought that even civil and defense lawyers are considered officers of the court.
I also think that even they are given certain powers not available to regular citizens, such as issuing subpoenas. I thought that was one of the reasons for requiring even them to be of good character.
Re: (Score:1)
I know there's some special stuff attorneys get to do by virtue of being officers of the court, but the main thing is actually practice law (represent clients) and keep nearly unassailable confidentiality (atty-client privilege). One of the gotchas is that your duty to the cou
Re: (Score:2)
how can we trust them to act as officers of a court?
You shouldn't.
Any system based on trust will be abused.
Re: (Score:2)
Victims should sue (Score:2)
Oh wait... they haven't passed the bar yet.
perspective from one of the victims (Score:5, Informative)
So I took the NY Bar yesterday and can validate this is all true.
This thread has seen a lot of jokes, but just to put things in perspective:
This software costs $100 for a one time use accounting for two 3 hour sessions. Furthermore, it is bound to your computer, so if you need to transfer it, you need to pay for an additional license.
The software is not complex. It has exactly 3 main functions:
1. Provide limited word processing functionality
2. Lock the user out of other programs
3. Automatically upload the answer files to Examsoft servers upon closing.
At my administration of the exam, there were perhaps 1000 people. Mine was in Albany, but there were also administrations in NYC (the largest), Buffalo, and I think one other location. So say 5000 people. Several other states were offering their bar exam with Examsoft on the same day, so lets be generous and say there were 50,000 students who needed to upload files over the course of an evening. The files uploaded consisted of 2 250k files in their proprietary format. So we are talking 25 whopping Gigabytes TOTAL being thrown at them. And they were paid roughly $5M for one day of testing. Also, bear in mind, that there is a winter administration as well, albeit with fewer candidates, and that Examsoft is used for many other types of test as well, so their yearly gross is probably well into the 8 figures.
Yet somehow, they didn't have the bandwidth/and/or the server capacity to handle the connections or puny amount of data being thrown at them? This is unacceptable by any business standard. And they have been the exclusive provider of this service for years, so it's not like they had no notice of what kind of volume they should be prepared for!
I personally paid $300 just to take this exam ($200 to NY for the exam itself, easily one of the cheapest fees among the states, + $100 for Examsoft). I also spent about $1000 in travel expenses. After many tries, I apparently managed to upload the files (my software said they failed, but I received confirmation emails saying they had succeeded). Examsoft can't confirm either way whether data corruption has occurred. If they did not manage to upload in one piece, my exam will have automatically failed by the Bar's standards, a decision which is unappealable. So I will be out my financial investment, close to two months of study time, as well as 6 months in lowered earning potential SINCE I WON'T BE LICENSED.
This was a massive, massive failure, and I will frankly be shocked if multiple lawsuits aren't filed against Examsoft over this.
Re: (Score:2)
This was a massive, massive failure, and I will frankly be shocked if multiple lawsuits aren't filed against Examsoft over this.
However, those that haven't passed the exam won't be allowed to sue; Tisias must be laughing in his grave. Seriously, though, the whole online examination business needs a shakeup.
Re: (Score:2)
Re: (Score:2)
No, those students will hire a lawyer to sue.
Remember the whole self-representation thing (as in - you don't do it. "A man who is his own lawyer has a fool for a client".
And it'll be a lawyer representing soon-to-be lawyers against a company that isn't a bunch of lawyers.
Re: (Score:2)
No, those students will hire a lawyer to sue.
Yes, of course. I was making a joke. Obviously not a very good one.
Re: (Score:2)
Let Me Get This Straight (Score:2, Insightful)
... So the end result is fewer lawyers in the world?
That's not a bug. It's a feature.
That there is even a need for lawyers (Score:2)
Shows you just how much of an unjust, deeply shackled, and corrupt society you live in. At least I can find state law online these days. I can go through the thousands upon thousands of pages myself if I need to.
Stress could not be understated (Score:1)
My wife was one the exam takers affected by the examsoft upload issue. I'm not sure that most people understand how much stress is on this test. My wife literally spend 9 hours a day, 7 days a week for 10 weeks studying for this test. This is the second time she's taken it because she went to school part time and has had two kids during that time and she just barely missed the pass line on her first go around. The stress is beyond immense because 3-5 years of school are rendered meaningless unless she can p
Re: (Score:2)
My wife's a doctor and we recently moved to a new state with very protectionistic licensing policies. For example, you're required to have passed the medical boards within the last ten years. Doesn't matter if you're a professor of medicine at Harvard: you had to have passed the boards recently. You know, the ones new doctors take in their senior year of med school when they've been doing nothing but studying for the last for years straight and it's still fresh in their minds. So my wife, who's owned a succ
Hits just keep on coming for lawyers... (Score:2)
It's actually interesting that the bar exam is administered using software running on somebody's personal computer. All the computer based tests I've taken (GRE, various vendor certification tests) have been at a Prometric or similar testing facility on their hardware. They're actually pretty strict -- no personal items of any kind allowed in the room, the only scratch paper you get is a whiteboard and marker, etc. I know the bar exam isn't a multiple choice test you can memorize the answers to, but even so
Everyone hates lawyers (Score:1)
Until someone pushes a shopping cart into their minivan. Then it's "Kill that motherfucker bring me his head on stick!!!"