%%%%%%%%%%%%%%%%%%%% EXPERIMENT 2 %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% %%%%%%%%%%%%%%%%%%%%% INSTRUCTIONS %%%%%%%%%%%%%%%%%%%%%%%%%%%%%% Dear Colleague, We would be very thankful if you could help us in establishing the upperbound of correctness for a series of computational experiments on automatic classification of verbs that we are running. This is usually done by measuring the inter-judge agreement of a group of experts. We would like to ask you to classify the following list of verbs into the 4 categories: unergative, unaccusative, object-drop, other. Please classify the verbs without using any external source of knowledge, but using your judgement and expertise only. The list of verbs has been divided in two parts. You can classify the two parts in different sessions, but please do each part in one session, without interruption. Verbs might have different senses. Classify the sense that comes first to mind. Please use the following definitions in determining the classification: Unergative: A verb that assigns an agent theta role to the subject in the intransitive. If it is able to occur transitively, it can have a causative meaning. Unaccusative: A verb that assigns a patient/theme theta role to the subject in the intransitive. When it occurs transitively, it has a causative meaning. Object-Drop: A verb that assigns an agent role to the subject and patient/theme role to the object, which is optional. When it occurs transitively, it does not have a causative meaning. Others: Verbs that cannot be classified as any of the above classes. (Note: For the purpose of this work, we do not distinguish theme and patient roles, so please do not take that into account in your classification.) We would appreciate it if you could classify the verbs as one of the classes defined as above. However, if you have any disagreement about the definitions, please indicate them to us in comments returned with your classification table. That might help us re-defining our classes in the future. We thank you very much in advance for your help and we will certainly let you know the results as soon as they are available. Paola Merlo and Suzanne Stevenson %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% %%%%%%%%%%%%%%%%%%%%%%% MATERIALS %%%%%%%%%%%%%% ----------------------- EXPERT 3 ----------------------------- ----------------------- Part 1------------------------------ Unerg Unacc Objdrop Others ------------------------------------------------------------ ----------------------------------------------------------- startled ----------------------------------------------------------- knitted ----------------------------------------------------------- fused ----------------------------------------------------------- dissolved ----------------------------------------------------------- perplexed ----------------------------------------------------------- paraded ----------------------------------------------------------- supplied ----------------------------------------------------------- painted ----------------------------------------------------------- sheltered ----------------------------------------------------------- exploded ----------------------------------------------------------- spruced ----------------------------------------------------------- cracked ----------------------------------------------------------- omitted ----------------------------------------------------------- fractured ----------------------------------------------------------- advertised ----------------------------------------------------------- carved ----------------------------------------------------------- engaged ----------------------------------------------------------- reaped ----------------------------------------------------------- emancipated ----------------------------------------------------------- floated ----------------------------------------------------------- sniffed ----------------------------------------------------------- yelled ----------------------------------------------------------- plunged ----------------------------------------------------------- solidified ----------------------------------------------------------- nursed ----------------------------------------------------------- leaped ----------------------------------------------------------- admired ----------------------------------------------------------- hardened ----------------------------------------------------------- threatened ----------------------------------------------------------- jumped ----------------------------------------------------------- spooked ----------------------------------------------------------- washed ----------------------------------------------------------- hypnotized ----------------------------------------------------------- played ----------------------------------------------------------- allocated ----------------------------------------------------------- boiled ----------------------------------------------------------- depressed ----------------------------------------------------------- kicked ----------------------------------------------------------- surmounted ----------------------------------------------------------- danced ----------------------------------------------------------- riled ----------------------------------------------------------- flooded ----------------------------------------------------------- flattered ----------------------------------------------------------- typed ----------------------------------------------------------- channeled ----------------------------------------------------------- raced ----------------------------------------------------------- scratched ----------------------------------------------------------- rushed ----------------------------------------------------------- hatched ----------------------------------------------------------- marched ----------------------------------------------------------- lowered ----------------------------------------------------------- hurried ----------------------------------------------------------- furnished ----------------------------------------------------------- melted ----------------------------------------------------------- relieved ----------------------------------------------------------- vaulted ----------------------------------------------------------- mingled ----------------------------------------------------------- wandered ----------------------------------------------------------- alternated ----------------------------------------------------------- opened ----------------------------------------------------------- ----------------------- Part 2------------------------------ Unerg Unacc Objdrop Others ------------------------------------------------------------ ----------------------------------------------------------- scared ----------------------------------------------------------- hiked ----------------------------------------------------------- stifled ----------------------------------------------------------- cleared ----------------------------------------------------------- flanked ----------------------------------------------------------- divided ----------------------------------------------------------- zipped ----------------------------------------------------------- organized ----------------------------------------------------------- flinched ----------------------------------------------------------- trotted ----------------------------------------------------------- agonized ----------------------------------------------------------- stabilized ----------------------------------------------------------- muddled ----------------------------------------------------------- widened ----------------------------------------------------------- baffled ----------------------------------------------------------- cooled ----------------------------------------------------------- jerked ----------------------------------------------------------- sketched ----------------------------------------------------------- housed ----------------------------------------------------------- packed ----------------------------------------------------------- dangled ----------------------------------------------------------- galloped ----------------------------------------------------------- sneaked ----------------------------------------------------------- folded ----------------------------------------------------------- checked ----------------------------------------------------------- scurried ----------------------------------------------------------- drained ----------------------------------------------------------- borrowed ----------------------------------------------------------- streamed ----------------------------------------------------------- studied ----------------------------------------------------------- framed ----------------------------------------------------------- cleaned ----------------------------------------------------------- worried ----------------------------------------------------------- glided ----------------------------------------------------------- prayed ----------------------------------------------------------- swallowed ----------------------------------------------------------- foamed ----------------------------------------------------------- scooted ----------------------------------------------------------- advised ----------------------------------------------------------- rented ----------------------------------------------------------- bubbled ----------------------------------------------------------- changed ----------------------------------------------------------- hammered ----------------------------------------------------------- collapsed ----------------------------------------------------------- strapped ----------------------------------------------------------- inherited ----------------------------------------------------------- sprouted ----------------------------------------------------------- tiptoed ----------------------------------------------------------- shelled ----------------------------------------------------------- skipped ----------------------------------------------------------- dispirited ----------------------------------------------------------- simmered ----------------------------------------------------------- listened ----------------------------------------------------------- called ----------------------------------------------------------- beamed ----------------------------------------------------------- hopped ----------------------------------------------------------- confiscated ----------------------------------------------------------- jogged ----------------------------------------------------------- correlated ----------------------------------------------------------- ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ %%%%%%%%%%%%%%% EXPERT 5 %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% ----------------------- Part 1------------------------------ Unerg Unacc Objdrop Others ------------------------------------------------------------ ----------------------------------------------------------- allocated ----------------------------------------------------------- solidified ----------------------------------------------------------- emancipated ----------------------------------------------------------- paraded ----------------------------------------------------------- surmounted ----------------------------------------------------------- wandered ----------------------------------------------------------- fused ----------------------------------------------------------- opened ----------------------------------------------------------- furnished ----------------------------------------------------------- danced ----------------------------------------------------------- threatened ----------------------------------------------------------- knitted ----------------------------------------------------------- perplexed ----------------------------------------------------------- washed ----------------------------------------------------------- admired ----------------------------------------------------------- raced ----------------------------------------------------------- depressed ----------------------------------------------------------- painted ----------------------------------------------------------- omitted ----------------------------------------------------------- reaped ----------------------------------------------------------- alternated ----------------------------------------------------------- rushed ----------------------------------------------------------- riled ----------------------------------------------------------- jumped ----------------------------------------------------------- spruced ----------------------------------------------------------- dissolved ----------------------------------------------------------- scratched ----------------------------------------------------------- carved ----------------------------------------------------------- supplied ----------------------------------------------------------- vaulted ----------------------------------------------------------- startled ----------------------------------------------------------- fractured ----------------------------------------------------------- lowered ----------------------------------------------------------- marched ----------------------------------------------------------- plunged ----------------------------------------------------------- exploded ----------------------------------------------------------- engaged ----------------------------------------------------------- boiled ----------------------------------------------------------- relieved ----------------------------------------------------------- cracked ----------------------------------------------------------- advertised ----------------------------------------------------------- kicked ----------------------------------------------------------- hypnotized ----------------------------------------------------------- melted ----------------------------------------------------------- hatched ----------------------------------------------------------- yelled ----------------------------------------------------------- spooked ----------------------------------------------------------- hardened ----------------------------------------------------------- flattered ----------------------------------------------------------- typed ----------------------------------------------------------- sniffed ----------------------------------------------------------- played ----------------------------------------------------------- sheltered ----------------------------------------------------------- floated ----------------------------------------------------------- channeled ----------------------------------------------------------- leaped ----------------------------------------------------------- nursed ----------------------------------------------------------- hurried ----------------------------------------------------------- mingled ----------------------------------------------------------- flooded ----------------------------------------------------------- ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ----------------------- Part 2------------------------------ Unerg Unacc Objdrop Others ------------------------------------------------------------ ----------------------------------------------------------- muddled ----------------------------------------------------------- hiked ----------------------------------------------------------- streamed ----------------------------------------------------------- organized ----------------------------------------------------------- stifled ----------------------------------------------------------- divided ----------------------------------------------------------- bubbled ----------------------------------------------------------- galloped ----------------------------------------------------------- baffled ----------------------------------------------------------- borrowed ----------------------------------------------------------- dispirited ----------------------------------------------------------- skipped ----------------------------------------------------------- flinched ----------------------------------------------------------- rented ----------------------------------------------------------- flanked ----------------------------------------------------------- cooled ----------------------------------------------------------- sprouted ----------------------------------------------------------- hopped ----------------------------------------------------------- advised ----------------------------------------------------------- tiptoed ----------------------------------------------------------- framed ----------------------------------------------------------- stabilized ----------------------------------------------------------- sneaked ----------------------------------------------------------- scooted ----------------------------------------------------------- zipped ----------------------------------------------------------- collapsed ----------------------------------------------------------- correlated ----------------------------------------------------------- sketched ----------------------------------------------------------- prayed ----------------------------------------------------------- widened ----------------------------------------------------------- shelled ----------------------------------------------------------- swallowed ----------------------------------------------------------- housed ----------------------------------------------------------- scurried ----------------------------------------------------------- worried ----------------------------------------------------------- cleared ----------------------------------------------------------- confiscated ----------------------------------------------------------- packed ----------------------------------------------------------- jerked ----------------------------------------------------------- simmered ----------------------------------------------------------- drained ----------------------------------------------------------- glided ----------------------------------------------------------- strapped ----------------------------------------------------------- studied ----------------------------------------------------------- scared ----------------------------------------------------------- inherited ----------------------------------------------------------- beamed ----------------------------------------------------------- changed ----------------------------------------------------------- hammered ----------------------------------------------------------- trotted ----------------------------------------------------------- foamed ----------------------------------------------------------- called ----------------------------------------------------------- dangled ----------------------------------------------------------- jogged ----------------------------------------------------------- checked ----------------------------------------------------------- folded ----------------------------------------------------------- agonized ----------------------------------------------------------- cleaned ----------------------------------------------------------- listened ----------------------------------------------------------- ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++