How language impacts our perceptions of colour

One of the first indicators for a parent as to how intelligent their infant offspring is, is how quickly the child picks up the colour terms.  But is it that we learn the names of the colours as we see them, or that we see the colours in terms of how they are labelled?  This clip from a BBC documentary shows how language affects the way we understand colour.