Remove from oven and slice in half lengthwise. Reduce the oven temperature to 375 degrees F. Scoop out the flesh of the potatoes into a medium size bowl, leaving a thin layer of potato inside. Place skins on the baking sheet face side up, drizzle with olive oil and bake for 10 minutes.