I've Had This Hard Bump On My Labia Majora For

I've had this hard bump on my labia majora for about 3 weeks now. The bump seems to be under the skin and moves around when I squeeze it. A few days ago it popped and white/yellow pus leaked out. A few days later it was just blood. Is this some sort of boil? I am sexually active, however, my last sexual encounter was 2 months ago. I do shave that area as well.