Middle English word yoman comes from Frankish -

Detailed word origin of yoman

Dictionary entry	Language	Definition
-	Frankish (frk)
goymann	Middle Dutch (dum)
yoman	Middle English (enm)	Subordinate, hireling. Yeoman, freeholder.