Yes that will do, but if you follow that route you'll end up with multiple boxes at the router end.. Can I suggest instead that you use long ethernet cables, leave the plug on the router end and chop the plugs off the access point end and then attach a box to it
Just remember to label the plug/router end so you know which one goes where.. The boxes can be bought from screwfix, pcworld, B&Q..etc..
Use this site for color codes and pin-outs
http://www.ertyu.org/steven_nikkel/ethernetcables.html