Charlotte, Emily and Anne, along with their brother Branwell, were born in the village, before the family moved to the parsonage at Haworth.
Barry Whitaker, who has owned the Grade II-listed property since 1980, said: “The Lord of the Manor would have had access to the church from the grounds and would have known Patrick Bronte.
“There’s a presumption that the young Bronte sisters played in the garden at the manor before the family moved to Haworth.
“There’s also a school of thought that the description of Thornfield Hall in Jane Eyre bears architectural resemblance to Thornton Hall.”
Thornton Hall dates back to the 11th century, when the original wooden structure of the property, owned by Gemill of Thornton, was named in the Doomsday Book of 1086.
The property was rebuilt in 1598 and was renovated extensively in the late 19th century, by John Foster, owner Black Dyke Mills in Queensbury.
Mr Whitaker said: “The mills can be seen from the master bedroom of the manor so Mr Foster would have been able to look out and see the smoke from the chimneys and make sure everyone was working hard.
“He would have been taken across the valley by his coachman to the mills. All our children have grown up now and are living in America and France so we are going to downsize and spend time visiting them.
“We are giving someone else the chance to be Lord of the Manor in Thornton.”