What do the green squares represent in the diagram?

The green squares represent special execution units dedicated for instructions such as load/store or sin/cos.