The earliest human migrants all spoke languages that have been lost in the mists of time. However, Elvish
records (among others) record that shortly after initial contact the various Humans were speaking what become
known as their "Mother Tongue".
Since then these Mother Tongues have evolved and been influenced by other races and cultures. Others still have
died out. Here is a visual reference of how the human languages have changed over time.