He was a co-host alongside comedian Rob Huebel for four seasons. Buress decided to leave the show after just two episodes into season four in 2014. It seems that he left because of creative differences between himself and series creator/star Eric Andre.

Did Hannibal actually quit Eric Andre?

“It's been an amazing decade,” he said. Episode two of season five had Hannibal Buress abruptly leave the set, announcing that he was done. Andre, true to form, turned the situation into a comedy skit, in which he attempted to clone Buress. ... Andre commented, saying that he is proud of Buress.

What happened between Hannibal and Eric Andre?

Not missing a beat, Eric takes one of Hannibal's discarded nose hairs and uses it to create a monstrous clone dubbed Blannibal to replace him as co-host. ... Andre admitted he was devastated to lose his comedy partner, but at least managed to convince him to return for a couple of episodes to give him a proper exit.