Skip to content

TheRedBull/Tokenizer

Repository files navigation

Tokenizer

A simple tokenizer program

This program is a simple tokenizer that reads a master file, opens and reads the contents of file names included in the master file, and parses each file to create a list of individule words. These words are then printed (sorted by frequency) in the console.

About

A simple tokenizer program

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages