How to extract data off a Laptop?

My laptop (Windows 7) Gave me the blue screen and now decided not to get past the 'loading windows' page. I am wanting to get some data off it, preferably without going inside the laptop. I have several USB pens and a USB HD (500gb) and I am getting a replacement sent from the supplier. Is it possible to set up a boot on a USB to boot the old laptop to transfer data onto a USB pen then onto the new laptop? Or will I have to remove the HDD from the old laptop?