So far you have indicated that you have mild to moderate shortness of breath without wheezing or symptoms of infection. Shortness of breath that comes and goes suggests certain possibilities, such as an anxiety or panic disorder or blood clots that travel to the lung (called pulmonary emboli). Also some people have intermittent shortness of breath with asthma even though they don't hear any wheezing.
Does your shortness of breath come and go, or is it always present?