I keep having this recurring rash that causes small itchy mosquito bite like bumps to form on my arms that gradually get more swollen and sometimes even fill with pus
That could be folliculitis which needs immediate attention from your doctor,visit dermatologist for appropriate management.