jamestown (part 1)

Hide hard words

⚙️ Jamestown°hard word, North Dakota°hard word, is located°hard word along I-94 in the eastern°hard word half of the state.

Today's°hard word focus°hard word is on "word frequency°hard word".

----

I started with two corpuses°hard word: one of 19th°hard word century literature°hard word (from Project Gutenberg°hard word), one of 20th°hard word century "sci-fi°hard word" literature°hard word. I got a rough word-rank°hard word for each, and combined°hard word them ⚙️ using°hard word the harmonic°hard word mean to get a combined°hard word word-list°hard word.

While many high-frequency°hard word function°hard word words such as°hard word the, and, and of maintain°hard word consistent°hard word rankings°hard word, others like said, her, she, and me show substantial divergence°hard word, suggesting notable°hard word stylistic°hard word or thematic°hard word shifts°hard word between the two periods and genres°hard word.

----

It is also a word-list°hard word at all. Some of the notes:

  • The word "whale" shows up a lot more in the 19th°hard word century corpus°hard word. This is because one of the books is Moby°hard word Dick°hard word.
  • I am hoping°hard word to run an exhaustive°hard word listing of a few attributes°hard word. These include°hard word:
  • polysemy°hard word. ⚙️ I am less concerned°hard word with words like get which have so many meanings as-to°hard word be indefinable°hard word, but instead words like saw ( or 锯子) or face (面向 or )
  • by lemma°hard word. "went" (108th°hard word) v. "go" (80th°hard word).
  • by part-of-speech°hard word. defined°hard word as°hard word "what the LLMs°hard word define°hard word as°hard word part-of-speech°hard word".
  • a "second-level°hard word" of word-type°hard word details.