to Cable Forum
You need a router that has a proper 10/100 ethernet port on the WAN (internet) side.
These days a router with included wireless access point isn't that much more than one without. Even if you don't want wireless today, what about tommorrow? You can always disable it if not required. The Linksys WRT54G series routers will do wired and wireless.
Don't know about wired only. I'm sure there will be some recommendations soon.