Collected Word Lists

Word Lists

These word lists have been collected from a variety of sources over time. The consist of a set of lines. Each line has one word.

• ahd.w (78008 words)
  American Heritage Dictionary word frequency study

• bell.w (24473 words)
  word list for Unix Spell program

• brown.w (60441 words)
  Brown Corpus word frequency study

• d10.w (76047 words)
  word list from the DEC-10

• gpo.w (18470 words)
  Government Printing Office Hyphenation Book word list

• guy.w (94220 words)
  Word list from Guy Harris at CMU (?)

• ibm.w (70375 words)
  Base word list for IBM speller from AOSL

• long.w (20506 words)
  Longman's Dictionary (British)

• netlist.w (4149 words)
  Word list from off the UUCP net

• nyt.w (70144 words)
  New York Times word frequency study (Amsler)

• radc.w (28689 words)
  List from Rome Air Development Center

• random.w (50030 words)
  List from Random House Dictionary

• w2.w (234933 words)
  Webster's 2nd Unabridged (typed in at CMU?)

• w7.w (81627 words)
  webster's 7th Collegiate Dictionary (1965)

• its (14993 words)
  A list of words from MIT

• mit (88528 words)
  A list of words from MIT

• mitbert.w (88528 words)
  A list of words from MIT

• rhh (54025 words)
  A list of words from MIT (user rhh)

• score (76128 words)
  A list of words picked off a Stanford machine

• small (66071 words)
  A list of words produced by processing some of the others

• ispell (15044 words)
  A list of words for ispell spelling checker (suffix tags)

• s2000.w (306293 words)
  A list posted to http://wwsupernet-2000.com/ (which is now gone). .w

• webster.hy
  Should be a hyphenation list for webster's from the Frame files. Still encoded in some way. Needs to have its format determined and decoded.

• master.ops
  The master dictionary file for ops from interleaf should be based on American-Heritage. Still encoded in some way. Needs to have its format determined and decoded.

• hyphen.tex
  The hyphenation list from Knuth's TeX. Still encoded in some way. Needs to have its format determined and decoded.

• g.w (70375 words) Origin unknown.
  

• mine.w (4871 words)
  Origin unknown. Possibily the list of all words in my own writing.

• cs61a (XXX words)
  Found on the net at http://www-inst.eecs.berkeley.edu/~cs61a/lectures/words (while searching in Yahoo for a "Bosch Brute Breaker Cart" -- it appears that this search can find lists of words which have these four words).

• entropy (XXX words)
  Found on the net at http://www.ravenousbirds.com/eolson/papers/englishentropy/source/d5/words.txt (All caps)

• missing.w (54 words) The 54 words that were used in Webster's 7th Collegiate dictionary, but not defined.
  

• self.w (1708 words) Origin unknown. Possibily a list of words with common suffixes.
  

• talk/index.html A list of words for speech generation.
  

• short.wrf A short list (20,998 words) consisting of:
  1. The word (all lower case, some apostrophe's and hyphens)
  2. Rank, from 1 ("the" most frequent) to 20,998 ("vacationers" least frequent)
  3. Frequency, from 20629 "vacationers" to 323302702 "the". There are duplicate frequencies (20646 for both "blushed" and "unravel").

  The sum of all frequencies is 5,834,759,708; so "the" accounts for about 5.5 percent of all words. This data was probably generated and used for A Note on Undetected Typing Errors , although the summary numbers appear to be different.