fix(server): should respect hmr port when middlewareMode=false

[sun0day]

Description

fix #12964
refs #12734

Additional context

There are server init & restart steps below:

(1) create new vite-server instance
(2) new vite-server listening
(3) close old vite-server

(4) create new ws-server instance
(5) new ws-server listening
(6) close old ws-server

After this PR and #12734, (vite-server & ws-server)'s init and restart flows become:

middlewareMode=false, sharing vite-server

• init flow: (4) (1) (2)
• restart flow: (4) (1) (3) (2)

middlewareMode=false, splitting vite-server & ws-server

• init flow: (4) (1) (5) (2)
• restart flow: (4) (1) (6) (3) (5) (2)

middlewareMode=true

• init flow: (4) (5) (1)
• restart flow: (4) (1) (6) (5)

---

What is the purpose of this pull request?

• Bug fix
• New Feature
• Documentation update
• Other

Before submitting the PR, please make sure you do the following

• Read the Contributing Guidelines.
• Read the Pull Request Guidelines and follow the PR Title Convention.
• Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
• Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. fixes #123).
• Ideally, include relevant tests that fail without this PR but pass with it.

[stackblitz]

Run & review this pull request in StackBlitz Codeflow.

[sapphi-red]

Thanks!