Entertainment sites TMZ and ET said Jackson died Wednesday morning in Los Angeles after a battle with cancer.
Family members confirmed the death on social media. Grandson Randy Jackson Jr tweeted, "RIP to the king that made everything possible!!! I love you grandpa."
Fellow grandson Taj Jackson asked on Twitter for space to grieve, saying his grandfather was "loved by our ENTIRE family" and criticizing media portrayals of the patriarch.
Representatives of family members did not immediately respond to requests for details on his death, but Jackson himself hinted at his impending death in a tweet two days ago.
"I have seen more sunsets than I have left to see. The sun rises when the time comes and whether you like it or not the sun sets when the time comes," he wrote.
A strict disciplinarian father of 11 children, the steel worker in Gary, Indiana turned into one of music history's most unlikely but most successful managers as he created The Jackson 5 from his family.
His most famous child, King of Pop Michael Jackson, would later break down in tears even as an adult when recalling his father beating him with his belt and, while publicly forgiving him, wrote him out of his will.
More about: Joe-Jackson