Hi Dear ,
Welcome to HCM,
Understanding your concern. As per you query you are suffering from headaches, pain in arms and neck while on 
BP medication . Well there can be many reasons for vertigo like benign paroxysmal positional vertigo , Vertigo may also be caused by inflammation within the inner ear sometimes due to infection , meniere's disease , 
acoustic neuroma and multiple sclerosis . But as you mention in query about arm pain i would suggest you to 
consult cardiologist once also to rule out any angina or stroke like condition . 
Consult ENT specialist for condition like meniere's disease . Doctor may order certain test like CT scan , MRI , 
blood test , audiometery test , rotatory chair test and ECG to confirm the diagnosis . Doctor may prescribe ant emetic drug , sedatives , antibiotics and some ear aid . Doctor may also refer you to cardiologist for heart problem or orthopedic surgeon for neck and arm pain . For now avoid bending foreword and drink green tea thrice a day . 
Hope your concern has been resolved.
Get Well Soon.
Best Wishes,
Dr. Harry Maheshwari