Whoops ya'll is a psiTurk compatible experiment for paying people when an experiment goes badly for some reason. You enter the workerIds of people who you owe money to and can reject all others. Payment is handled quickly and easily via psiTurk's command line features. When you make a whoops, use "whoops ya'll"
** THIS IS BETA SOFTWARE. IT HAS NOT BEEN TESTED MUCH AT ALL. CONTRIBUTIONS WELCOME **
Breifly, assuming you have psiturk installed, working, have the AWS credentials and an account on psiturk.org.
Get the repo
git clone git@github.com:NYUCCL/whoops_yall.git
Make it yours
cd whoops_yall
- change to the project folder- edit
config.txt
to your liking (particular settinghost
to 0.0.0.0 if you plan to run on the public internet, also fill in thecontact_email_on_error
, your university/organization name, etc...) - edit the
templates/ad.html
file to reflect your university/organization and to identify yourself to workers pip install shortuuid
as a dependency
Update the database
psiturk
- launch psiturk[psiTurk server:off mode:sdbx #HITs:0]$ server on
- start server- visit http://SERVER/dashboard (e.g., http://localhost:22362/dashboard)
- login with the credentials you provided in the config.txt
- enter worker ids and bonus amounts
- listed below is a status list of where each person got in the reimbursement task. also listed are "completion codes"... random codes you should send to worker who had problems to identify them uniquely.
Test the end-user code
psiturk
- launch psiturk if it is not already running[psiTurk server:off mode:sdbx #HITs:0]$ server on
- start server if not already running[psiTurk server:on mode:sdbx #HITs:0]$ debug
- test it locally (will pop open a browser stepping you through)[psiTurk server:on mode:sdbx #HITs:0]$ create hit
- to create the hit on the AMT sandbox- Test the experiment by finding your listing on the Amazon sandbox (keep in mind the workerId and completion code must be valid)
Run live
- If all is going well and looks how you expect,
[psiTurk server:on mode:sdbx #HITs:0]$ mode
- to switch to "live" mode [psiTurk server:on mode:live #HITs:0]$ create hit
- to create the hit on the live server, usually something like 0.01 (minium price)[psiTurk server:on mode:live #HITs:0]$ worker approve --hit <yourhitid>
- to approve and pay everyone who has finished[psiTurk server:on mode:live #HITs:0]$ worker bonus --hit <yourhitid> --auto
- to assign bonuses to everyone who has completed the task correctly