Caldwell-Palm House
Round Rock, Williamson County, Texas
Marker Inscription
Tennessee native T. J. Caldwell (1812-1892) and his wife Letitia (1824-1877) built this house in 1860. The surrounding land provided limestone for the walls and cedars for the foundation, rafters, and floor joists. Caldwell's slaves helped build the house. The Caldwells' daughter, Mary, married Sven William Palm, and the couple bought the property from the Caldwell estate in 1892; the house stayed in the family more than 100 years. The two-story, five-bay, rough-cut limestone house features a center passage floor plan and a two-story wooden gallery. The surrounding Caldwell Heights community included a school, cotton gin, and this and other rural homes. Recorded Texas Historic Landmark - 1967
Erected by Texas Historical Commission
The Story
T. J. Caldwell and his wife Letitia raised this sturdy limestone house on the eve of the Civil War in 1860, quarrying its walls from the surrounding land and, as the marker plainly records, relying on the labor of enslaved people to build it. Their daughter Mary married Swedish immigrant Sven William Palm, whose family kept the property for more than a century. Around it grew the small Caldwell Heights community of school, cotton gin, and farmsteads.
Why it matters
The house embodies two defining threads of 19th-century central Texas — the enslaved labor that underlay antebellum farming and the Swedish immigration that reshaped the region's rural communities.
The story behind this marker
AI contextThe era
When this limestone house went up in 1860, central Texas stood on the very edge of the coming storm. Texas had been a state for only fifteen years, and within months of the house's completion the nation would fracture over slavery and secession. The rural districts of Williamson County were being settled by farmers who built with what the land gave them — and, in the antebellum South, too often with labor they claimed to own.
The surrounding country supplied the raw materials directly: limestone for the thick walls, cedar for the foundation, rafters, and floor joists. This was frontier construction in the most literal sense — a house quarried and hewn from its own acreage. Around such homesteads, small rural communities took shape, complete with the institutions that made settled life possible.
After the Civil War and emancipation, central Texas entered a new chapter, one shaped powerfully by immigration. Among the newcomers who transformed the region were Swedes, who settled in Williamson County in numbers large enough to leave a lasting mark on its rural landscape and family names.
People & events
T. J. Caldwell, born in Tennessee in 1812, and his wife Letitia, born in 1824, built this house in 1860. The marker records something many such monuments once left unsaid but this one states plainly: Caldwell's slaves helped build the house. Those enslaved people, whose names the inscription does not preserve, quarried the stone and raised the walls that still stand — a truth the house cannot be honestly understood without.
Letitia died in 1877, and T. J. in 1892. That same year, the story turned toward a new America. Their daughter Mary had married Sven William Palm, a Swedish immigrant, and the couple bought the property from the Caldwell estate. Through the Palm family, the house stayed in the same bloodline for more than a hundred years — passing from a slaveholding Tennessee family into the keeping of a Swedish immigrant's descendants.
The house sat at the heart of the Caldwell Heights community, a small rural neighborhood with its own school, cotton gin, and cluster of farmsteads. Substantial and dignified — two stories, five bays wide, rough-cut limestone, with a center passage and a two-story wooden gallery — it was recognized as a Recorded Texas Historic Landmark in 1967.
Its place in the American story
Few buildings hold two of the nineteenth century's defining American stories under one roof as directly as this one. The first is slavery. The plain acknowledgment that enslaved people built the house is a small act of historical honesty with large meaning: the antebellum Southern economy, including in Texas, rested on coerced Black labor, and the very walls of its finest homes were often the work of people who owned none of it. Naming that fact on a public marker matters.
The second story is immigration. When Mary Caldwell married Sven William Palm, the house passed into the great wave of European newcomers who remade rural America after the Civil War. Scandinavian immigrants transformed the farm country of the Midwest and reached deep into central Texas as well, and the Palm name is part of that legacy in Williamson County.
Together, in a single family and a single house, you can trace the country's passage from the world of slavery to the world of immigrant farm communities — the closing of one American era and the opening of another, told in stone and family record.
If you visit
Approach the house as a piece of hand-built history. It is two stories of rough-cut limestone, five bays across, with a two-story wooden gallery and a center-passage plan — the kind of dignified farmhouse that announced a family had put down deep roots. Every surface was worked from materials found on the surrounding land.
Stand before those walls and hold the full truth of them. The stone was quarried and the house raised with the labor of enslaved people whose names are lost to us. A visit here is a chance to remember them, not as a footnote but as the builders they were — the honesty the marker itself models is the honesty the place asks of you.
Then let your mind follow the house forward: from the Caldwells to their daughter Mary and her Swedish husband, and down through a century of the Palm family. Picture the little community of Caldwell Heights around it, with its school and cotton gin. It makes a thoughtful stop on any route through Round Rock and Williamson County, a place where a road trip can slow down and take history seriously.
Written by AI to add context, grounded in the marker’s inscription and the historical record. The inscription above is the original, unaltered text.
Own a business near here? Add it to the map.
Related people
- · T. J. Caldwell
- · Letitia Caldwell
- · Mary Caldwell Palm
- · Sven William Palm
Themes & tags
Nearby & related markers
Williamson County
Georgetown, TX
Carved out of the young state of Texas in 1848, Williamson County took its name from Robert McAlpin Williamson — the peg-legged "Three-Legged Willie," a San Jacinto veteran and early justice of the Republic's Supreme Court. Georgetown grew as the seat of a county whose blackland and prairie soils drew a strikingly mixed population of Anglo, Czech, German, Mexican, Swedish, and — as the supplemental plaque records — a large community of African Americans, who made up nearly a fifth of residents by 1860. Early mills turned out lumber, flour, and cloth, and Southwestern University traced its charter back to the Republic itself.
Hutto
Hutto, TX
This corner of Williamson County was settled in 1855 by J. E. Hutto and Adam Orgain, a former slave, near the early village of Shiloh. When Hutto sold land to the International & Great Northern Railroad in 1876 a town took shape, and he became its first postmaster the next year. Fueled by the railroad and by Swedish immigrants who turned nearby farms over to cotton, Hutto grew from a single church and school in 1882 to a bustling town that incorporated in 1911.
Pflugerville Schools
Pflugerville, TX
German immigrants who settled northeast Travis County in 1849 prized education, opening a one-room school on a farm in 1872 with lessons in both English and German. A brick school rose in Pflugerville in 1907 on land donated by George Pfluger, and the community's district was chartered in 1919. Through consolidations, a WPA-built rock gym, and a record-setting football team, the schools grew into a district serving more than 23,000 students, integrating in 1965.
St. John's Cemetery
Georgetown, TX
This burial ground began with a Swedish Methodist church that immigrant families established in the Brushy Creek area in the early 1880s, its earliest known grave that of an infant in 1881. When the congregation relocated in 1906 it eventually became St. John's United Methodist Church, but the cemetery endured under a caretaking association formed in 1984. Pioneers, community leaders, and veterans reaching back to World War I rest here.