You may have an inner ear problem. The inner ear contains structures that act like an internal gyroscope to keep us steady. When this mechanism malfunctions, dizziness often results. This is most often a temporary situation, but it could suggest a more persistent or recurrent disorder.
Do you have ringing in the ear or loss of hearing associated with the dizziness?