Why were all Europeans in 17th century Russia called Germans?

In Russia, people who could not speak were called “nemtyr” (in modern language – dumb).
Many foreigners poured into Russia during Peter the Great’s times – Germans, French, Dutch, etc. I suppose that in the head of the Russian people and the indigenous population of Russia, two words – Nemtyr and German – merged into one, shorter, “German.”