STS-B Instructions

The New York University Center for Data Science is collecting your answers for use in research on computer understanding of English. Thank you for your help!

We will present you with two sentences. Your job is to decide how similar these two sentences are to each other by picking a number between 0 and 5:

Choose 5 if the two sentences are completely equivalent, as they mean the same thing. Example:

“The bird is bathing in the sink.”

“Birdie is washing itself in the water basin.”
Choose 4 if the two sentences are mostly equivalent, but some unimportant details differ. Example:

“Two boys on a couch are playing video games.”

“Two boys are playing a video game.”
Choose 3 if the two sentences are roughly equivalent, but some important information differs/missing. Example:

“John said he is considered a witness but not a suspect.”

““He is not a suspect anymore.” John said.”
Choose 2 if the two sentences are not equivalent, but share some details. Example:

“They flew out of the nest in groups.”

“They flew into the nest together.”
Choose 1 if the two sentences are not equivalent, but are on the same topic. Example::

“The woman is playing the violin.”

“The young lady enjoys listening to the guitar.”
Choose 0 if the two sentences are completely dissimilar. Example:

“The black dog is running through the snow.”

A race car driver is driving his car through the mud.

You do not have to worry about whether the writing style is maintained across the two sentences.