Siakandar Raza lifted Zimbabwe from a precarious 23-4, followed by 59-5, after Sri Lankan left-arm spinner Rangana Herath rattled the visitors' batting with four early wickets.
Cremer's leg-spin and two crucial run outs left Sri Lanka reeling at 293-7 at stumps.
Ervine's career-best effort lifted Zimbabwe from a precarious 70-4 to 344-8 at stumps.
Arjuna Ranatunga on Friday demanded an investigation into the country's 2011 World Cup final defeat by India amid allegations of match fixing.
Chandimal will lead the islanders in a Test for the first time after Angelo Mathews resigned.
Sri Lanka appointed two new captains on Wednesday to replace Angelo Mathews, who resigned.
Zimbabwe notched their first win abroad in eight years after claiming the one-day international series against Sri Lanka 3-2
The series in also Zimbabwe’s first away win against a Test playing nation other than Bangladesh in 16 years – with New Zealand in 2001 being the last away victory
Zimbabwe clinched their second win of the series, courtesy Craig Ervine's quickfire 69 in a rain curtailed game, setting up the final ODI nicely on Monday
DG ISPR clears the confusion regarding his viral pic
Naseem Shah included as Pakistan announce 15-man squad for Under-19 World Cup
'I looked at the talent and that is the key motivating factor' - Mickey Arthur
Fawad Alam returns to Test side after 10 years, Usman Shinwari earns maiden call-up
PSL 5 Draft: How the final squads stack up
Young Zeeshan Malik continues to impress everyone
Ali Zafar takes on Shoaib Akhtar on a cricketing field
Shoaib Malik, Colin Ingram and others released as PSL franchises reveal retention lists
Spinners give Pakistan upper hand before New Zealand rebuild
Kohli wants Dukes balls to be used for Tests worldwide