# MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks

We provide the dataset and code that can reproduce the table/experiment in the paper.

# Replicate result

**Note**:
All data are in `data` folder. To replicate result, please visit the `code/python` folder.

In order to run GPT-3 model, you need to first provide your credential as `credential.txt` saved into this folder.
We expect `credential.txt` to contain two lines:
```text
secrete key: sk-x
organization key: org-x
```

## Prompts

All prompts are stored in `code/python/prompts` folder. Prompts are written with PromptSource library and in `.jinja` format.

## Personas

All the personas are stored in `code/python/personas` folder. We randomly sampled 25 personas using a fixed random seed.