Change to Image Adjustments
Click on the screenshot and if you can't figure it out the change...stop turking
Update: Btw This appears to be an anti-bot change (trying to keep bots frombeing able to trick mturk)
Update 2: Wow this is annoying....just a tip always click the black box on your way down it's easy to later on down click another one then have to go back up and find the black box. Secondly what is sucking is I keep getting ones with no black box only options.....so the actually place isn't in any of the photos so I have to give them one that is wrong (I usually just choose the best looking photo) Though the server just went down again...so maybe they changed their minds...lol
Update: Btw This appears to be an anti-bot change (trying to keep bots frombeing able to trick mturk)
Update 2: Wow this is annoying....just a tip always click the black box on your way down it's easy to later on down click another one then have to go back up and find the black box. Secondly what is sucking is I keep getting ones with no black box only options.....so the actually place isn't in any of the photos so I have to give them one that is wrong (I usually just choose the best looking photo) Though the server just went down again...so maybe they changed their minds...lol
posted by Eric Cranston at 6:14 PM
8 Comments:
I don't like it either. Tried to send them a feedback asking them to put the link back on the bottom but their feedback page is broken.
Wow this is really annoying, although from what I have been seeing it is obvious someone has set up a bot to just select 'none' every time. I wish they could come up with some HTML trickery to combat this though, because it is slowing me down a lot.
yeah this really blows.
If this is slowing you down, you're probably going too fast. My speed seems about the same (a little more than 150/hr, discounting the 20 or so an hour I return).
No doubt there's bots farming mturk, this change will be a (minor) obstacle to them. More importantly, it'll be a speedbump for human beings as well.
There's tons of a9 HITs that require a fine attention to detail in order to choose the correct building. You really need to squint to see certain building numbers and business names. I have no doubt that there's a horde of zombies just clicking "None of the above." on all non-obvious HITs.
Anyone who intends to farm mturk in the future beyond the beta should be concerned with the quality of answers given to the system. If the service doesn't produce results, who's going to pay?
600 HITs an hour...500 HITs an hour. hrm. No offense, but if you actually picked out the correct image you're approval rate would be closer to 85%-80%--many correct choices are "outvoted" by bots and zombies and rejected.
I'm guessing you're 600 HITs an hour consist of at least 300 junk answers. If mturk is filled with junk, then NO ONE WILL PAY. The experiment will fail.
Agreed that $4 an hour is pathetic for a job...it's not a job, it's a beta test of a system and something to do whilst not otherwise engaded. I suspect that, if the system works out the bugs (like zombies and bots) then there will be eventually class of HITs that a person *could* make a living on. But, again, that won't happen if the answers produced by the system are garbage.
No offense, that's just how it is.
It is possible that you (sandoz) in particular actually have a high level of quality. You might have an uncanny, superhuman ability to process visual information. (however, again, your high acceptance rate actually speaks more towards a low quality....you are "voting" with the pack, and the pack is wrong on at least 10% of the HITs by my estimation.)
...let's agree there are zombies out there who perform the "job" mindlessly, and choose junk answers. Amazon will have to figure out a way to curtail this, or the whole mturk thing just won't work.
Sorry for the double post, there's no way to edit my prior post:
another possiblity, sandoz, is that you have been verifying your own HITs, esp. since your volumn is so high. For example, when you answer the same HIT three times identically, you get 3 acceptances.
Note, this may have changed with the newest update. Your accuracy might fall back down to the average 85%, or maybe all of our accuracies will raise to 90% if bots and zombies are stymed by the update.
I'm impressed with your speed, sandoz! I was doing a little over 5 HITs a minute before the change, and a little under 5 since. That's in short bursts, though, as I generally don't go for extended periods of intense turking for fear of going looney (wait, too late!). I'll often do it in between doing other things or do it more leisurely.
I try to avoid places with lots of strip malls as they really slow you down, trying to see if you can see the business name in the distance (and if you can, will the others see it and match yours?). NYC is also a bit harder since they have so many businesses in each frame.
Another thing that slows me down is that I sometimes miss clicking the radio button on the first click and have to re-click it. I'm going to suggest to Amazon that they increase the size of the buttons, or better yet, fill in the box if you click on the photo.
Post a Comment
<< Home