Is there a way to prevent this, & only Send or Receive manually?

In accounts properties > Incoming, disable "check for new messages every x minutes". I guess it will help.