Mr Fisher, currently based in Spain, also took exception to being described in the media as a 'staunch' Leeds fan. He is, of course, a former Huddersfield Town chairman.
He said in the Huddersfield Daily Examiner: "Huddersfield Town are in my heart and always will be, but I do follow Leeds as Yorkshire's only Premiership club and, when I wasn't welcome down at the McAlpine a few years ago, I took tickets there which I still have.
"I do miss being involved in football and, if I was asked in future, I would consider helping out at Leeds, but I am not involved in this consortium and I am and always will be a staunch Huddersfield Town fan."