Evaluating the Effectiveness of Automatic Speech Recognition

I am conducting an experiment on the effectiveness of Automatic Speech Recognition (ASR) systems as a part of a course I am taking. The goal is to correlate the output of a program that assesses the effectiveness of ASR with how humans perceive the output of ASR.

There are no right or wrong answers. This survey should take about 20 minutes to complete. Thank you in advance for helping me complete this research.

Robert Metzger

General Information

Your Native Language

  English is my native language
  I learned English as a second, third, or fourth language

Your Language Skills

  English is the only language I speak fluently.
  I speak two or more languages fluently.

Instructions

Read each pair of sentences. Click the button next to the number that indicates your feeling about how close the two sentences are in MEANING AS A UNIT OF THOUGHT .

Don't think about the sentences, just give your immediate "gut" reaction.

Click the "7" if the meanings are identical. Click the "1" if the meanings are completely different. Select a number in between if the sentences are similar. The more similar they are in meaning, the higher the number you should select.

For example, if one sentence were "The cat in the hat came back" and the other sentence were "Why do fools fall in love?", you would probably select a "1". If the two sentences were identical in every word, you would select a "7".

Remember, we want you to compare the MEANING AS A UNIT OF THOUGHT of the sentences, not the form (spelling or grammar).

If you spend longer than the time it takes to count to 5, you are spending too much time thinking about the differences.

WHEN YOU ARE FINISHED ANSWERING QUESTIONS,
MAKE SURE YOU CLICK THE SUBMIT BUTTON AT THE PAGE BOTTOM,
SO THAT YOUR ANSWERS ARE SENT TO ME.

1.

r. l. i. corporation a peoria illinois based insurance holding company will begin trading friday on the big board under the symbol r. l. i.

r. l. i. corporation of peoria illinois based insurance holding company will begin trading friday on the big board under the symbol or l. i.

Unrelated     1     2     3     4     5     6     7     Identical

2.

the rise in that category in july was led by increased orders for aircraft and parts nonelectrical machinery lumber and furniture

the rise in that category injured line was led by increased orders for aircraft and parts nonelectrical machinery lumber and furniture

Unrelated     1     2     3     4     5     6     7     Identical

3.

in a fundamental cents up the equity markets have very little today with what goes on in the commercial banks

in a fundamental sense the equity markets have very little to do with what goes on in the commercial banks

Unrelated     1     2     3     4     5     6     7     Identical

4.

there shouldn't be any risk to the banks in the sort of staff said lawrence cohn a banking analyst at merrill lynch and company

there shouldn't be any risk to the banks in this sort of stuff said lawrence cohn a banking analyst at merrill lynch and company

Unrelated     1     2     3     4     5     6     7     Identical

5.

the independent committee will recommend that holders accept the offer at a meeting expected to be held in december p. to be a day said

the independent committee will recommend that holders accept the offer at a meeting expected to be held in december t. w. a. said

Unrelated     1     2     3     4     5     6     7     Identical

6.

it can sign onto the plan file a competing plan or take a completely passive role that neither endorses nor opposes a plan

it can sign onto the plan while a competing plan or take a completely passive role that neither endorses nor opposes the plan

Unrelated     1     2     3     4     5     6     7     Identical

7.

prices are going out said george c. e. kids vice president and chief economist at general motors corporation

prices are going up said george c. eads vice president and chief economist at general motors corporation

Unrelated     1     2     3     4     5     6     7     Identical

8.

what we don't know his how much as price and how much as volume

what we don't know is how much is price and how much is volume

Unrelated     1     2     3     4     5     6     7     Identical

9.

first commodity appealed the expulsion and fine to the c. f. t. c.

for its commodity or killed the expulsion and fined to the c. f. t. c.

Unrelated     1     2     3     4     5     6     7     Identical

10.

a commission spokesman said a decision on the appeal is expected soon

a commission spokesman said the decision on the appeal is expected sound

Unrelated     1     2     3     4     5     6     7     Identical

11.

and then as the explanation of life teradyne's growth in japan is lower despite fifteen years of effort

and then there's the explanation of why teradyne's growth in japan is slow despite fifteen years of effort

Unrelated     1     2     3     4     5     6     7     Identical

12.

the company which runs retail automotive stores called shearson lehman brothers at its financial adviser to terminate discussions to sell the firm

the company which runs retail automotive stores told shearson lehman brothers its financial adviser to terminate discussions to sell the firm

Unrelated     1     2     3     4     5     6     7     Identical

13.

also a move to base it abroad will have tax advantages

also a move to basic abroad will have tax advantages

Unrelated     1     2     3     4     5     6     7     Identical

14.

elders finance an elders agribusiness it will remain based in australia

elders finance and elders agribusiness will remain based in australia

Unrelated     1     2     3     4     5     6     7     Identical

15.

to eight years ago b. a. s. have made three separate acquisitions and the u. s.

two years ago b. a. s. f. made three separate acquisitions in the u. s.

Unrelated     1     2     3     4     5     6     7     Identical

16.

unless otherwise noted changes involved direct holdings of common stock and took place in september and october of nineteen eighty seven

unless otherwise noted changes involved direct holdings of common stock into place in september in october of nineteen eighty seven

Unrelated     1     2     3     4     5     6     7     Identical

17.

about all the businessman can count on is that policy will be pretty volatile

about all the businessman can count on is the policy it will be pretty volatile

Unrelated     1     2     3     4     5     6     7     Identical

18.

if the fed but of the dollar higher in maker of the demand for u. s. x. parts

if the fed pushes the dollar higher it may curb the demand for u. s. exports

Unrelated     1     2     3     4     5     6     7     Identical

19.

the alleged that this is placed on a reduction of cross country loans that mr. minor men said

too much focus is placed on reduction of cross country loans mr. meyerman said

Unrelated     1     2     3     4     5     6     7     Identical

20.

closed end funds are traded on exchanges like stocks but invest in a wide portfolio of other securities

closed end funds are traded on exchanges like stocks that invest in a wide portfolio of other securities

Unrelated     1     2     3     4     5     6     7     Identical

21.

after the offer and the public new york will hold about forty nine percent of the affiliate

after the offering republic new york will hold about forty nine percent of the affiliate

Unrelated     1     2     3     4     5     6     7     Identical

22.

he also said that the company for the first time was developing drugs specifically for the over the counter consumer health care market

he also said that the company for the first time with developing drugs specifically for that over the counter consumer health care market

Unrelated     1     2     3     4     5     6     7     Identical

23.

he said such products would be marketed by other companies with experience in that business

he set such products to be marketed by other companies with experience and that business

Unrelated     1     2     3     4     5     6     7     Identical

24.

m. i. c. c. investments as three series of publicly traded preferred shares and ten series a privately held preferred stock

m. i. c. c. investments has three series of publicly traded preferred shares and ten series of privately held preferred stock

Unrelated     1     2     3     4     5     6     7     Identical

25.

shamrock has interests in television and radio stations energy services real estate and venture capital

shamrock has interests in television radio stations energy services real estate in venture capital

Unrelated     1     2     3     4     5     6     7     Identical

26.

we just received the suit and the document is massive it's two hundred pages

we just received the suit in the document is massive its two hundred pages

Unrelated     1     2     3     4     5     6     7     Identical

27.

but on the first read through the case is without merit and we intend to fight it

but on the first read through the cases without merit and we intend to find it

Unrelated     1     2     3     4     5     6     7     Identical

28.

that would fall a two point two percent drop in day

that would follow a two point two percent drop in may

Unrelated     1     2     3     4     5     6     7     Identical

29.

but if the winning bid there is high as they weren't some deals an earlier this year but we're not going to be winning bidders

but if the winning bids are as high as they were in some deals earlier this year then we're not going to be winning bidders

Unrelated     1     2     3     4     5     6     7     Identical

30.

in a dutch auction holders tender their shares at prices within a stated range in this case between twenty eight dollars and thirty three dollars a share

in a dutch auction holders tendered their shares at prices within the stated range in this case between twenty eight dollars and thirty three dollars a share

Unrelated     1     2     3     4     5     6     7     Identica3

31.

the company then accepts the shares tendered at the lowest price needed to reach its goal then pays that amount for all shares it purchases

the company then accepts the shares tendered at the lowest price needed to reach its gold then pays that amount for all shares of purchases

Unrelated     1     2     3     4     5     6     7     Identical

32.

foreigners are back and negotiating with the chinese will be as tough as ever

foreigners are back to negotiating with the chinese will be a staff is ever

Unrelated     1     2     3     4     5     6     7     Identical

33.

after the third period ashland's coal operations began a process of becoming an independent company

after the third period that ashland coal operations began a process of becoming an independent company

Unrelated     1     2     3     4     5     6     7     Identical

34.

in addition the u. s. west's data solutions business applied communications incorporated is working out well to performing ahead of all our schedules

in addition u. s. west's data solutions business applied communications incorporated is working out well and performing ahead of all our schedules

Unrelated     1     2     3     4     5     6     7     Identical

35.

as one of the most acquisition hungry of major banks citicorp is often required by regulators to raise additional capital as a condition of making acquisitions

as one of the most acquisition hungry of major banks citicorp is often required by regulators to raise additional capital at the condition of making acquisitions

Unrelated     1     2     3     4     5     6     7     Identical

36.

monday's crash is likely to affect at least one of a piece of pending legislation the sweeping trade bill that is now the subject of a house senate conference

monday's crash is likely to affect at least one other piece of pending legislation the sweeping trade bill that is now the subject of a house senate conference

Unrelated     1     2     3     4     5     6     7     Identica6

37.

incentives can move around sales but not create them said charles brady an oppenheimer and company auto stock analyst

incentives can move there and sales but not create them said charles brady an oppenheimer and company are the stock analyst

Unrelated     1     2     3     4     5     6     7     Identical

38.

the market's strength may show that demand is a dollar creation of incentives

the market's strength may show that demand isn't all a creation of incentives

Unrelated     1     2     3     4     5     6     7     Identical

39.

a change in the firm's ownership also should turn on a bright warning light

it aims in the firm's ownership are also should turn on a bright warning light

Unrelated     1     2     3     4     5     6     7     Identical

40.

many managers who sell their firms but then continue working for them may be less dedicated and a new ownership they say

money managers who sell their firms but then continue working for them may be less dedicated under new ownership they say

Unrelated     1     2     3     4     5     6     7     Identical

41.

owens illinois said its share purchases would be finance buy existing credit lines and new ones to be a range

owens illinois said its share purchases would be financed by existing credit lines and new ones to be arranged

Unrelated     1     2     3     4     5     6     7     Identical

42.

and both mortgage their loans to secure the loans they needed to start the business

and both mortgaged their homes to secure the loans they needed to start the business

Unrelated     1     2     3     4     5     6     7     Identical

43.

but it is mr. west upon him the outcome probably depends must

but it is mr. west upon whom the outcome probably depends most

Unrelated     1     2     3     4     5     6     7     Identical

44.

yesterday's session began with a sharp a quick decline in the industrial average of more than forty five points which some market analyst attributed to foreign selling

yesterday's session began with a sharp quick decline in the industrial average of more than forty five points which some market analysts attributed to foreign selling

Unrelated     1     2     3     4     5     6     7     Identical

45.

but to the surprise of almost every one stock prices began a steady climb to push the average above wednesday's close

but to the surprise of almost everyone stock prices began a steady climb that pushed the average above wednesday's close

Unrelated     1     2     3     4     5     6     7     Identical

46.

although those gains eroded during the afternoon stock prices stayed within a narrow range until the last half hour of trading

although those gains in reading during the afternoon stock prices stayed within a narrow range until the last half hour of trading

Unrelated     1     2     3     4     5     6     7     Identical

47.

if the fed pushes the dollar higher in a credit demand for u. s. exports

if the fed pushes the dollar higher it may curb the demand for u. s. exports

Unrelated     1     2     3     4     5     6     7     Identical

48.

the consensus was that a new piece of paper isn't required said one u. s. diplomat

the consensus was then new piece of paper is a required said one u. s. diplomat

Unrelated     1     2     3     4     5     6     7     Identical

49.

under the proposed transaction the los angeles group would acquire the case changed my sons and then sell itself to disney

under the proposed transaction the los angeles group would acquire the k. h. j. license and then sell itself to disney

Unrelated     1     2     3     4     5     6     7     Identical

50.

closely held times publishing also owns two washington based publications congressional quarterly which covers capital and governing which covers state and local governments

closely held times publishing also owns two washington based publications congressional quarterly which covers capitol hill and governing which covers state and local governments

Unrelated     1     2     3     4     5     6     7     Identical

51.

it also owns three state business magazines and floor to georgia and arizona

it also owns three state business magazines in florida georgia and arizona

Unrelated     1     2     3     4     5     6     7     Identical

52.

mr. robertson says he would only be attracted by a nineteen multiple if he thought the projected earnings growth rate was eighteen percent to twenty percent

mr. robertson says he would only be attracted by nineteen multiple the thought the projected earnings growth rate with fifteen percent to twenty percent

Unrelated     1     2     3     4     5     6     7     Identical

53.

sending the refugees back is in their idea it's just what the opposition politicians are saying in our country these days

sending the refugees back isn't their idea it's just what the opposition politicians are saying in our country these days

Unrelated     1     2     3     4     5     6     7     Identical

54.

employment look strong inflation will slow and consumer spending an investment were holding up reasonably well

employment looked strong inflation was low and consumer spending and investment were holding up reasonably well

Unrelated     1     2     3     4     5     6     7     Identical

55.

some critics including high reagan administration officials are raising the alarm that the fed's policy is too tight and could cause a recession next year

some critics including higher reagan administration officials are raising the alarm that the fed's policy is too tight and could cause recession next year

Unrelated     1     2     3     4     5     6     7     Identical

56.

increasingly people who test positive and china support groups that have sprung up across the country in the past year

increasingly people who test positive join the support groups that have sprung up across the country in the past year

Unrelated     1     2     3     4     5     6     7     Identical

57.

shearson lehman hutton incorporated's index of long term treasury bonds state in a very small range just a day finishing very close to wednesday's closing level

shearson lehman hutton incorporated's index of long term treasury bonds stayed in a very small range yesterday finishing very close to wednesday's closing level

Unrelated     1     2     3     4     5     6     7     Identical