Too long to go back?

I am very ill with Akathisia. I got it worse when tapered down to 3.5 Valium. Gone up to 20mg but still ill. Is it too late to change back to 10 after 2 updosing for 2 weeks or do I have to taper again!