Just a cable from one of the 'pc' ports on the router to the switch. Then you can plug all your PC's into the switch (or some into the router / some into the switch). I would advise against buying a Hub - they offer rather low performance in comparison to a switch.
Switch - Takes in a 'packet' looks at where it is supposed to go, looks in a table of addresses and figures out what port the destination is on, and forwards the packet there.
Hub - Takes in a packet - forwards it out all other ports, every time.
And also I agree that leasing for $3/mo from comcast isn't a bad deal, they can't just say oh its your modem then because its THEIR modem

, if it aint broke I wouldn't mess with it.
If you are looking to hook up 8+ Devices I'd reccomend a 16 port switch, you are going to need 1 port for the connection up to the router, so that'll leave you some room to expand also, something like this would work:
http://www.mwave.com/mwave/skusearch.hmx?SCriteria=1098773&CartID=done&nextloc=
You could go cheaper or more expensive, you don't really need all the features the more expensive managed switch would provide so just a soho switch should work just fine.