Yes, I've had this happen and made the mistake of rubbing my eyes! I soaked my hands in milk which helped a little, but I learned my lesson and always wear gloves now when cutting jalapenos. Your soup recipe sounds delicious, I can't wait to try it!
I do A LOT of work and cooking with different peppers, and am not comfortable with gloves. I feel clumsy. I pour some plain cold milk in a bowl, and dip my hands before and during the pepper process! I basically wash my hands constantly with the stuff, and it helps! The only trouble spots are under fingernails. If I'm not careful, I go to rub my eye later and Whao momma! Don't forget to clean under your nails with the milk! It does enough to neutralize the acid until I'm done; then I can wash my hands very well with soap and water. I am also careful to not handle the peppers with all of my hands but carefully try to use my finger tips. Less handling is less acid to worry with.
I had the same experience but with green bell peppers...I had no idea.
Like you nothing I tried to cool the fire worked. I had to just wait it out.