All flour starts as brown then you sieve or 'bolt' it to take out the bran and make it white flour. This is hard work and takes time, so only the rich had white bread.