L.A. Reid is voting himself off the "The X Factor." “I have decided that I will not return to ‘The X Factor’ next year,” he told Access Hollywood. “I have to go back and I have a company to run that I’ve kind of neglected and it saddens me a little bit, but only a little bit.” A representative for Epic Records confirmed Reid's departure on Thursday. Reid is currently the chairman and CEO of Epic…