Is It OK To Fly With A Skull Fracture ?

I fractured my skull five weeks ago, i feel fine apart from being tired and needed more rest than usual, my vision isnt as good either, i just get a bad head ( it feels like a clump) when i have been at work ( office job) and stressful)) my concentration isnt as good and i do forget things, but im due to fly within the week on a 4.5 hour flight and im wondering if i will be ok? I did fly twice after my accident the first time after 1 day only a 40 min flight and then a week later on a 4.5 hour flight and i was fine, my only concern is that i seemed to somedays be worse than when i first had the fracture, this i cannot work out as surely i should be getting better ? Thanks