Most Internet connections use shared bandwidth at some point in the path, for ADSL this will be at the local exchange. The degree of sharing used to be referred to as the contention ratio.
Basically, if your Servers become more active at night your speed can be affected.
It is possible for...