to 'go' means that you stop at the place.
to 'go by' means: to pass
for example:
I go to school every day.
I go by the mailbox every day.
another expression:
to have something on your mind
or
to have a lot on your mind
means
to be worried about something
