You may have an inner ear problem. This is most often a temporary situation, but it could suggest a more persistent or recurrent disorder.
Do you have ringing in the ear or loss of hearing associated with the dizziness?