%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% EXPERIMENT 1 %%%%%%%%%%%%%%%%%%%%%%%%%%%%%% %%%%%%%%%%%%%%%%%%%%%%%%%%%%%% Instructions %%%%%%%%%%%%%%%%%%%%%%%%%%%%%% Dear Colleague, We would be very thankful if you could help us in establishing the upperbound of correctness for a series of computational experiments on automatic classification of verbs that we are running. This is usually done by measuring the inter-judge agreement of a group of experts. We would like to ask you to classify the following list of verbs into the 3 categories: unergative, unaccusative, object-drop. Please classify the verbs without using any external source of knowledge, but using your judgement and expertise only. Do the classification in one session, without interruption. Verbs might have different senses. Classify the sense that comes first to mind. Please, assign only one classfication per verb. Use the following definitions in determining the classification: Unergative: A verb that assigns an agent theta role to the subject in the intransitive. If it is able to occur transitively, it can have a causative meaning. Unaccusative: A verb that assigns a patient/theme theta role to the subject in the intransitive. When it occurs transitively, it has a causative meaning. Object-Drop: A verb that assigns an agent role to the subject and patient/theme role to the object, which is optional. When it occurs transitively, it does not have a causative meaning. (Note: For the purpose of this work, we do not distinguish theme and patient roles, so please do not take that into account in your classification.) We would appreciate it if you could classify the verbs as one of the classes defined as above. However, if you have any disagreement about the definitions, please indicate them to us in comments returned with your classification table. That might help us re-defining our classes in the future. We thank you very much in advance for your help and we will certainly let you know the results as soon as they are available. Paola Merlo and Suzanne Stevenson %%%%%%%%%%%%%%%%% MATERIALS %%%%%%%%%%%%%%%%%%%%%%%%%%%%%% ----------------------- expert 1 ----------------------------- Unerg Unacc Objdrop ------------------------------------------------------------ rushed ----------------------------------------------------------- carved ----------------------------------------------------------- wandered ----------------------------------------------------------- danced ----------------------------------------------------------- jumped ----------------------------------------------------------- melted ----------------------------------------------------------- raced ----------------------------------------------------------- vaulted ----------------------------------------------------------- fractured ----------------------------------------------------------- painted ----------------------------------------------------------- boiled ----------------------------------------------------------- washed ----------------------------------------------------------- played ----------------------------------------------------------- typed ----------------------------------------------------------- marched ----------------------------------------------------------- kicked ----------------------------------------------------------- opened ----------------------------------------------------------- reaped ----------------------------------------------------------- hardened ----------------------------------------------------------- hurried ----------------------------------------------------------- knitted ----------------------------------------------------------- leaped ----------------------------------------------------------- paraded ----------------------------------------------------------- solidified ----------------------------------------------------------- yelled ----------------------------------------------------------- exploded ----------------------------------------------------------- flooded ----------------------------------------------------------- dissolved ----------------------------------------------------------- cracked ----------------------------------------------------------- floated ----------------------------------------------------------- skipped ----------------------------------------------------------- swallowed ----------------------------------------------------------- studied ----------------------------------------------------------- packed ----------------------------------------------------------- folded ----------------------------------------------------------- glided ----------------------------------------------------------- scurried ----------------------------------------------------------- inherited ----------------------------------------------------------- hiked ----------------------------------------------------------- cleaned ----------------------------------------------------------- divided ----------------------------------------------------------- borrowed ----------------------------------------------------------- rented ----------------------------------------------------------- stabilized ----------------------------------------------------------- widened ----------------------------------------------------------- changed ----------------------------------------------------------- hopped ----------------------------------------------------------- sketched ----------------------------------------------------------- jogged ----------------------------------------------------------- scooted ----------------------------------------------------------- simmered ----------------------------------------------------------- trotted ----------------------------------------------------------- galloped ----------------------------------------------------------- called ----------------------------------------------------------- tiptoed ----------------------------------------------------------- organized ----------------------------------------------------------- cleared ----------------------------------------------------------- collapsed ----------------------------------------------------------- cooled ----------------------------------------------------------- ----------------------- Expert 2 ----------------------------- Unerg Unacc Objdrop ------------------------------------------------------------ marched ----------------------------------------------------------- fractured ----------------------------------------------------------- washed ----------------------------------------------------------- leaped ----------------------------------------------------------- paraded ----------------------------------------------------------- hurried ----------------------------------------------------------- melted ----------------------------------------------------------- jumped ----------------------------------------------------------- floated ----------------------------------------------------------- raced ----------------------------------------------------------- yelled ----------------------------------------------------------- flooded ----------------------------------------------------------- carved ----------------------------------------------------------- solidified ----------------------------------------------------------- typed ----------------------------------------------------------- hardened ----------------------------------------------------------- danced ----------------------------------------------------------- wandered ----------------------------------------------------------- rushed ----------------------------------------------------------- cracked ----------------------------------------------------------- reaped ----------------------------------------------------------- painted ----------------------------------------------------------- boiled ----------------------------------------------------------- opened ----------------------------------------------------------- dissolved ----------------------------------------------------------- vaulted ----------------------------------------------------------- played ----------------------------------------------------------- exploded ----------------------------------------------------------- knitted ----------------------------------------------------------- kicked ----------------------------------------------------------- called ----------------------------------------------------------- changed ----------------------------------------------------------- studied ----------------------------------------------------------- inherited ----------------------------------------------------------- cooled ----------------------------------------------------------- sketched ----------------------------------------------------------- hopped ----------------------------------------------------------- glided ----------------------------------------------------------- stabilized ----------------------------------------------------------- rented ----------------------------------------------------------- packed ----------------------------------------------------------- folded ----------------------------------------------------------- scurried ----------------------------------------------------------- divided ----------------------------------------------------------- collapsed ----------------------------------------------------------- tiptoed ----------------------------------------------------------- skipped ----------------------------------------------------------- cleared ----------------------------------------------------------- simmered ----------------------------------------------------------- trotted ----------------------------------------------------------- borrowed ----------------------------------------------------------- organized ----------------------------------------------------------- widened ----------------------------------------------------------- swallowed ----------------------------------------------------------- hiked ----------------------------------------------------------- galloped ----------------------------------------------------------- scooted ----------------------------------------------------------- cleaned ----------------------------------------------------------- jogged ----------------------------------------------------------- ----------------------- Expert3 ----------------------------- Unerg Unacc Objdrop ------------------------------------------------------------ played ----------------------------------------------------------- flooded ----------------------------------------------------------- washed ----------------------------------------------------------- raced ----------------------------------------------------------- cracked ----------------------------------------------------------- melted ----------------------------------------------------------- jumped ----------------------------------------------------------- rushed ----------------------------------------------------------- floated ----------------------------------------------------------- leaped ----------------------------------------------------------- wandered ----------------------------------------------------------- fractured ----------------------------------------------------------- kicked ----------------------------------------------------------- painted ----------------------------------------------------------- marched ----------------------------------------------------------- carved ----------------------------------------------------------- hurried ----------------------------------------------------------- reaped ----------------------------------------------------------- solidified ----------------------------------------------------------- boiled ----------------------------------------------------------- danced ----------------------------------------------------------- dissolved ----------------------------------------------------------- opened ----------------------------------------------------------- knitted ----------------------------------------------------------- hardened ----------------------------------------------------------- vaulted ----------------------------------------------------------- yelled ----------------------------------------------------------- exploded ----------------------------------------------------------- paraded ----------------------------------------------------------- typed ----------------------------------------------------------- tiptoed ----------------------------------------------------------- cleared ----------------------------------------------------------- organized ----------------------------------------------------------- cleaned ----------------------------------------------------------- borrowed ----------------------------------------------------------- simmered ----------------------------------------------------------- skipped ----------------------------------------------------------- glided ----------------------------------------------------------- scooted ----------------------------------------------------------- studied ----------------------------------------------------------- galloped ----------------------------------------------------------- inherited ----------------------------------------------------------- hopped ----------------------------------------------------------- rented ----------------------------------------------------------- stabilized ----------------------------------------------------------- changed ----------------------------------------------------------- packed ----------------------------------------------------------- widened ----------------------------------------------------------- scurried ----------------------------------------------------------- sketched ----------------------------------------------------------- divided ----------------------------------------------------------- trotted ----------------------------------------------------------- swallowed ----------------------------------------------------------- cooled ----------------------------------------------------------- hiked ----------------------------------------------------------- called ----------------------------------------------------------- collapsed ----------------------------------------------------------- jogged ----------------------------------------------------------- folded -----------------------------------------------------------