A very good description is to be found in the relevant chapter in History of the County of Fife: From the Earliest Period to the Present Time by John M Leighton, published 1840, online at Google Books
Old Newburgh (Stenlake Publishing) contains many photographs and full descriptions.
Lindores Abbey and its Burgh of Newburgh (published 1876) is at the Open Library.