The Baobab tree is a tough tree and resists drought, fire and termites. They simply regrow their bark if it is stripped. When they die, they simply rot from the inside and suddenly collapse, leaving a heap of fibers. Perhaps it leaves locals to think they just disappear in a poof of magic, leaving just a fibrous heap.
Photo credit: African Safari News, Eyes on Africa