This plant material isn't much to look at, but scientists say it should serve as a warning to the world about where climate change could take us if carbon emissions go unchecked.
The time period is an epoch geologists call the Pliocene, 2.6-5.3 million years ago.
It was marked by temperatures that were significantly warmer than today, perhaps by 2-3 degrees globally.
These were conditions that permitted plant growth even in the middle of the White Continent.
Higher, too, were sea-levels. It's uncertain by how much, but possibly in the region of 10-20m above the modern ocean surface.
What's really significant, though, is that the amount of carbon dioxide in the atmosphere was very similar to what it is today - at around 400 CO2 molecules for every million molecules of air.
Indeed, the Pliocene was the last time in Earth history that the air carried this same concentration of the greenhouse gas.
And it tells you where we're heading if we don't get serious about addressing the climate problem, cautions Prof Martin Siegert from the Grantham Institute at Imperial College London.
Temperatures may currently be lower than in the Pliocene, but that's only because there is a lag in the system, he says.
"If you put your oven on at home and set it to 200C, the temperature doesn't get to that level immediately; it takes a bit of time," he told reporters.
"And it's the same with Earth's climate. If you ratchet up the level of CO2 at 400 parts per million (ppm), it won't suddenly get to an equilibrium overnight. It will take maybe 300 years or something.
"So, the question to us is: what is the equilibrium state; what is Earth's climate going to look like with 400ppm, all things being settled?"
Prof Siegert was among a group of scientists meeting in London on Wednesday to discuss the climate lessons from the Pliocene.
These experts want to see much more research into the parallels between then and now.
A lot of the knowledge we have presently about the epoch comes from ocean sediments.
These muds, drilled off the coast of Antarctica, contain fossil organisms whose geochemistry can be used to reconstruct ancient temperatures and the corresponding likely volume of ice on the planet.
If, as the scientists suspect, sea-levels were 10-20m higher in the Pliocene, it indicates the ice sheets must also have looked very different.
"The Greenland Ice Sheet holds about 7m (equivalent of sea-level rise). That was probably gone," said Imperial's Prof Tina van De Flierdt.
"In Antarctica, we have the smaller West Antarctic Ice Sheet which holds about 5m. That was probably gone, too.
"And then we have the big chunk in East Antarctica. There are certain parts of that which people have believed to be stable for a very long time. But that kind of doesn't work with the numbers. If we need more than 10m of sea level rise, we need East Antarctica to be unstable as well."
This could certainly explain the presence of plants in the middle of a continent where today only lichens and mosses can survive.
Prof Jane Francis, the director of the British Antarctic Survey, pulled her fossilised shrub material from rocks just 500km from the South Pole.
"These are twigs similar to southern beech," she told BBC News. "I like to call them the remnants of the last forests of Antarctica.
"They're probably Pliocene in age. What we're looking at is a time when the glaciers retreated and we were left with areas in front of those glaciers where tiny little shrubs could grow. It wouldn't have been a nice place to live; it would have been a tundra kind of environment, but with enough sunshine in summer and temperatures (able to rise) up to about 5C."
More about: climatechange