Personally, I'd let it heal. Pain like that isn't worth a cute stud. You're not allergic, more than likely, it hasn't healed all the way and you're reopening it every time you take one out and put a new one in. Let one stay in your nose for several more weeks and see if that changes anything. Make sure not to change it. -- or, just let it heal.