If you go for something like the Linksys WRT54G then it will certainly do what you want it to.
It's a wireless router as well.
You can control be MAC address, IP address, IP address range, restrict web access by keywords in URLs, restrict access to certain specific sites, restrict access by time of day or day of week..... The list goes on