Would the CPU usage graph reflect when these threads are idling? For example, if we are waiting for something off the network, or even for accessing non-cache memory, will this impact the usage graph?

If the operating system puts the thread to sleep while waiting for that event, yes.