Even in the same server, the data request of the same program in your computer to the linked server is not necessarily consistent, and the local CPU responds to the requests of different programs in turn.
If the difference is not big, it won't have much impact.