Being close to Akhilesh Yadav proved costly for Avdhesh