Mormonism and the 'prophet' Joseph Smith's sons

I was reading through the history of Mormonism, and after the founder's death, Joseph Smith Jr. he left behind 5 children (the rest of Smith's children died in childbirth or soon after) in Nauvoo, Illinois, none of which were followers of Brigham Young and established a rival "church" to the Utah Mormon "church":

1 adopted daughter--Julia Murdock Smith who was 13 years old when her adopted father Joseph Smith Jr ("the prophet") died, making her the oldest. As a result of one of her marriages, she converted to Catholicism, whether she stayed Catholic-- I don't know.

3 sons:

Joseph Smith III, who was 11 when his father died. He eventually was his father's successor in the rival Mormon sect and an opponent of polygamy. He lead the Reorganized LDS church, now called the "Community of Christ." 

Alexander Hale Smith, who was about 6 years old when his father died. He was a leader with his older brother Joseph III in the RLDS.

David Hyrum Smith, who was about 5 months old when his father died. He was a missionary for the RLDS, and tried to even get the LDS in Utah to convert to the RLDS.

Doesn't it seem strange that none of Smith's children (that we know of) even cared to follow the rest of the Mormons into Utah? I suppose a LDS missionary will blame the children's mother.  What is interesting, is a similar phenomenon occurred with Islam when the "prophet" Muhammad died, there was a schism over who was to lead.