I Asked My 17 Year Old To Follow Me To

I asked my 17 year old to follow me to take the car in for a recall repair. I accidentally put his wallet in my husbands cooler. He refused to drive without his lisence the 6 miles to take the car in. My husband and I were very upset. My hubby told him he can't use the car anymore except for work and bank. My son says he's getting punished for us trying yo gave him break the law. Is he right