I agree with what others have said. You really need to have the right shoes for your feet. I recommend going to a specialty running store and have them watch you walk/run, then they can help fit you for the proper shoe. It almost sounds like your shoes arches may be too high for your foot. Running shoes come in all shapes and sizes and there are specific shoes for flat feet, medium arches and high arches. Anyway, it could be socks also, but I would go have someone work with you.
Jo