fastcgi: Fix for #1788. Align atomic fields to 64-bit word (Go bug)

Also clarified a comment in SiteConfig

Move fallbackHosts to vhostTrie

httpserver: Add global FallbackHosts for vhost matching

mitm: Fix out of bounds error when checking software version in UA

httpserver: Encapsulate WriteSiteNotFound error

proxy: fix hang on chunked websocket server

Signed-off-by: Tw <tw19881113@gmail.com>

Pushes for /index.html work when surfing to /

Use httpserver.IndexFile() to determine index files

Test if middleware pushes indexfile when requesting directory

Fix codereview issues

Serve original request first, push later

Revert "Serve original request first, push later"

This reverts commit 2c66f01115747e5665ba7f2d33e2fd551dc31877.

log,error: fix roller parser issue

Signed-off-by: Tw <tw19881113@gmail.com>

Include test for iOS 11 beta

* Revert fastcgi to emove persistent connections.

* Fix linting errors

* reintroduce timeout tests

* check for non-zero timeout

* ensure resp is not nil

* Adding nobots directive

* Moving nobots directive behind log one.

* Move nobots directive to a better position

gzip: change ETag to weak etag after gzip

According to https://tools.ietf.org/html/rfc7232#section-2.1
> Likewise, a validator is weak if it is shared by two or more
representations of a given resource at the same time, unless those
representations have identical representation data.  For example, if
the origin server sends the same validator for a representation with
a gzip content coding applied as it does for a representation with no
content coding, then that validator is weak.

Therefore, after gzip, we should change the original etag to weak etag.

Not much changed but it's a clean pull now; easier for future reference.

* uses more of the builtin functionality for starting and stopping of the process by using command and command_args along with procname
* removed -f from daemon as this was hiding error message that were sent to stdout on startup, now writing stdout to the logfile directly

for example, this was being hidden:

“Activating privacy features.. [www.domain.com] failed to get certificate: Error presenting token: Could not find the start of authority”

it now shows up in the log

* aded “caddy_env” to allow the setting of environment variables that caddy might need, for example when setting creds for “DNS Challenge”

* added a check to ensure caddy_config_path file exists

* rename requestid request_id

* rename folder

* folder name match package name requestid

proxy: add Header load balancing policy

gzip,mime: show response header instead of the request one in test message

adds unix timestamp placeholder