I Noticed A Pea Sized Lump Inside The Shaft Of

I noticed a pea sized lump inside the shaft of my penis about 6 months ago. I had it checked and the doc said possible Peronies? It has since grown in size, sort of longer and flatter in the head of the penis. The head does curve slightly when erect. Now I feel a smaller pea size about 3/4 down the shaft? Same thing? Doc said nothing to worry about, could get better could stay the same or get worse. As long as it presented so sexual problems or pain not to worry. Do you agree?