Text this: Preliminary analysis of transformer bases /