A model to understand exploration exploitation dilemma approaches in human decisions along with GLMs for fMRI correlation

Scripts are in /ncf/gershman/Lab/scripts/matlab/Exploration/.

Data are in /ncf/gershman/Lab/Exploration/.

Useful links:

• CBS cluster FAQ -- how to use the cluster, send jobs, ArcGet.py, slurm, sacct, etc
• CBS central login -- where the fMRI data live
• ccnl_fmri wiki -- how to use Sam's fMRI pipeline

0. Copy everything to the cluster and login
   • See scp_to_ncf.sh, maybe edit it accordingly and run it ./scp_to_ncf.sh
1. Open downloadConvertSBatch.sh and edit subjects to include the new subject only.
2. Open downloadConvert.sh and edit fileNames if necessary. Read comments for details
3. Run ./downloadConvertSBatch.sh
   • Takes ~30 mins to complete.
   • Make sure there are no scary errors in the .err file or the .out file.
   • Make sure all files (struct.nii, run001.nii, etc) are written normally in the .out file
   • Go to /ncf/gershman/Lab/Exploration/subjects/ and make sure all subject files are there
4. Open exploration_getSubjectsDirsAndRuns.m and append new subject info to subjects, subjdirs, and nRuns accordingly (so they include info for all subjects). Read comments for details.
5. Open ccnl_fmri_preproc.sh and edit subjects to include the index of the new subject only. This index is the ordinal of the subject info in exploration_getSubjectsDirsAndRuns.m
6. Run ./ccnl_fmri_preproc.sh
   • Takes ~10 hours (!) to complete.
   • Make sure there are no scary errors in the .err file or the .out file.
   • Make sure all files are in the data directory (compare with previous subjects).
7. Open MATLAB with a GUI and cd into scripts directory
   • Log into one of the cluster terminals in Northwest (e.g. by the fMRI scanner),
   • or download XQuartz on your Mac, ssh -X into the cluster on one of the nvdi nodes, e.g. ssh -X mtomov13@ncfvdi.rc.fas.harvard.edu, and run matlab on the command line. You should see the MATLAB splash screen
8. Run ccnl_plot_movement(exploration_expt(), XX), where XX is the subject index (e.g. 1)
   • Make sure subject didn't move too much during runs
9. Run ccnl_check_registration(exploration_expt(), XX), where XX is the subject index
   • Click around (e.g. around ventricles), make sure average functional (top) is aligned with the structural (bottom)
10. Append the subject's behavioral data to data.csv and upload it to the cluster

Tips

• Always check that the job is running with sacct
• Wait until some output is printed to the .out file, to be sure that it didn't fail at the very beginning
  • particularly important for long-running jobs

Common errors and mistakes

• ArcGet.py doesn't exist -> happens sometimes, idk why
• ArcGet.py can't access CBS Central -> read the CBS FAQ on ArcGet.py; you need to set it up first
• ArcGet.py can't find subject on CBS central -> make sure that the subject ID (e.g. 180807_UEP_025) is exactly as it is on CBS Central
  • check date
  • check spaces and underscores
  • make sure no commas in the subjects array in the script downloadConvertSBatch.sh
  • make sure subject was actually sent to CBS central
  • make sure all scans were sent to CBS central
• ArcGet.py can't write to data directory
  • make sure you have permissions or someone else didn't download that subject already
  • make sure data directory exists
  • make sure that the directories in the scripts are correct
• Runs (run###.nii) or structurals (struct.nii) missing or empty -> make sure the file order in fileNames in the script downloadConvert.sh is the same as the session order of the subject
  • e.g. if another structural was acquired after run 4, it should be fileNames=(struct_1 run001 run002 run004 run004 struct_2 run005 run006 run007 run008)
  • e.g. if run 6 was interrupted and restarted, it should be `fileNames=(struct run001 run002 run004 run004 run005 run006_bad run006 run007 run008

1. Add the GLM to exploration_create_multi.m
2. Test the GLM locally
   • Call multi = exploration_create_multi(...) in MATLAB
   • Inspect multi and make sure all the names, onsets, and pmods make sense
   • Batch test for all subjects and runs using exploration_create_multi_sanity.m
3. Copy exploration_create_multi.m to the cluster
   • See scp_to_ncf.sh
4. Log into the cluster and run an interactive job, e.g. with ./srun.sh
5. Run MATLAB in the interactive job, e.g. with ./matlab.sh
6. Test the GLM on the cluster
   • repeat same steps as testing locally
7. Dry run the GLM in MATLAB by calling ccnl_fmri_glm(...) to make sure SPM actually likes it; then interrupt it with Ctrl+C once it looks like it's working
   • Optionally use the fake_glm=true argument
8. Exit MATLAB and edit ccnl_fmri_glm.sh
   • Change goodSubjects = (...) to include all subjects
   • Change for model in {...} to use your GLM only
9. Run ./ccnl_fmri_glm.sh

1. Add your contrast to run_ccnl_fmri_con.m
   • Copy-paste one of the calls to ccnl_fmri_con and modify accordingly
   • Please keep all previous contrasts, just comment them out
2. Copy run_ccnl_fmri_con.m to the cluster
3. Log into the cluster and run an interactive job, e.g. with ./srun.sh
4. Run MATLAB in the interactive job, e.g. with ./matlab.sh
5. Test the contrast on the cluster
   • Call run_ccnl_fmri_con in MATLAB, make sure it starts doing stuff and Ctrl+C it
6. Exit MATLAB and run ./run_ccnl_fmri_con.sh

1. Run MATLAB with a GUI and cd into scripts directory
   • look for X11 above
2. Run ccnl_view with the corresponding GLM and contrast
   • e.g. ccnl_view(exploration_expt(), 1, 'RR - SS')

1. TODO