I have a quick question on image quality -- is it better to take larger pics and then resize them to what you want. Or just shoot in the size you want?

Example: On my S3IS, I usually have it on 2272x1704 and then I will resize the pics to 640x480. I can change it to 640x480 but I thought image quality is lost?

Anyone want to explain? lol