chore: refactor e2e tests to playwright #6567
Annotations
10 errors, 5 warnings, and 1 notice
|
Run E2E tests for webpack version latest:
test\e2e\history-api-fallback.test.js#L637
1) [chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
Error: expect(received).toMatchSnapshotWithArray(expected)
Expected: "D:\\a\\webpack-dev-server\\webpack-dev-server\\test-results\\history-api-fallback-histo-c4431--request-in-same-way-as-GET-chromium\\historyApiFallback-option-in-memory-files-should-perform-HEAD-request-in-same-way-as-GET-text-snap-actual.webpack5"
Received: "In-memory file·
"
635 | expect(responseGet.statusText).toMatchSnapshotWithArray("status text");
636 |
> 637 | expect(responseGet.text).toMatchSnapshotWithArray("text");
| ^
638 |
639 | const responseHead = await page.evaluate(async () => {
640 | const response = await fetch("/foo", { method: "HEAD" });
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\history-api-fallback.test.js:637:32
|
|
Run E2E tests for webpack version latest:
test\e2e\history-api-fallback.test.js#L639
1) [chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
Error: page.evaluate: Test ended.
637 | expect(responseGet.text).toMatchSnapshotWithArray("text");
638 |
> 639 | const responseHead = await page.evaluate(async () => {
| ^
640 | const response = await fetch("/foo", { method: "HEAD" });
641 |
642 | return {
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\history-api-fallback.test.js:639:39
|
|
Run E2E tests for webpack version latest:
test\e2e\history-api-fallback.test.js#L637
1) [chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toMatchSnapshotWithArray(expected)
Expected: "D:\\a\\webpack-dev-server\\webpack-dev-server\\test-results\\history-api-fallback-histo-c4431--request-in-same-way-as-GET-chromium-retry1\\historyApiFallback-option-in-memory-files-should-perform-HEAD-request-in-same-way-as-GET-text-snap-actual.webpack5"
Received: "In-memory file·
"
635 | expect(responseGet.statusText).toMatchSnapshotWithArray("status text");
636 |
> 637 | expect(responseGet.text).toMatchSnapshotWithArray("text");
| ^
638 |
639 | const responseHead = await page.evaluate(async () => {
640 | const response = await fetch("/foo", { method: "HEAD" });
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\history-api-fallback.test.js:637:32
|
|
Run E2E tests for webpack version latest:
test\e2e\history-api-fallback.test.js#L639
1) [chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.evaluate: Test ended.
637 | expect(responseGet.text).toMatchSnapshotWithArray("text");
638 |
> 639 | const responseHead = await page.evaluate(async () => {
| ^
640 | const response = await fetch("/foo", { method: "HEAD" });
641 |
642 | return {
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\history-api-fallback.test.js:639:39
|
|
Run E2E tests for webpack version latest:
test\e2e\history-api-fallback.test.js#L637
1) [chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toMatchSnapshotWithArray(expected)
Expected: "D:\\a\\webpack-dev-server\\webpack-dev-server\\test-results\\history-api-fallback-histo-c4431--request-in-same-way-as-GET-chromium-retry2\\historyApiFallback-option-in-memory-files-should-perform-HEAD-request-in-same-way-as-GET-text-snap-actual.webpack5"
Received: "In-memory file·
"
635 | expect(responseGet.statusText).toMatchSnapshotWithArray("status text");
636 |
> 637 | expect(responseGet.text).toMatchSnapshotWithArray("text");
| ^
638 |
639 | const responseHead = await page.evaluate(async () => {
640 | const response = await fetch("/foo", { method: "HEAD" });
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\history-api-fallback.test.js:637:32
|
|
Run E2E tests for webpack version latest:
test\e2e\history-api-fallback.test.js#L639
1) [chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.evaluate: Test ended.
637 | expect(responseGet.text).toMatchSnapshotWithArray("text");
638 |
> 639 | const responseHead = await page.evaluate(async () => {
| ^
640 | const response = await fetch("/foo", { method: "HEAD" });
641 |
642 | return {
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\history-api-fallback.test.js:639:39
|
|
Run E2E tests for webpack version latest:
test\e2e\history-api-fallback.test.js#L637
1) [chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
Retry #3 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toMatchSnapshotWithArray(expected)
Expected: "D:\\a\\webpack-dev-server\\webpack-dev-server\\test-results\\history-api-fallback-histo-c4431--request-in-same-way-as-GET-chromium-retry3\\historyApiFallback-option-in-memory-files-should-perform-HEAD-request-in-same-way-as-GET-text-snap-actual.webpack5"
Received: "In-memory file·
"
635 | expect(responseGet.statusText).toMatchSnapshotWithArray("status text");
636 |
> 637 | expect(responseGet.text).toMatchSnapshotWithArray("text");
| ^
638 |
639 | const responseHead = await page.evaluate(async () => {
640 | const response = await fetch("/foo", { method: "HEAD" });
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\history-api-fallback.test.js:637:32
|
|
Run E2E tests for webpack version latest:
test\e2e\history-api-fallback.test.js#L639
1) [chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
Retry #3 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.evaluate: Test ended.
637 | expect(responseGet.text).toMatchSnapshotWithArray("text");
638 |
> 639 | const responseHead = await page.evaluate(async () => {
| ^
640 | const response = await fetch("/foo", { method: "HEAD" });
641 |
642 | return {
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\history-api-fallback.test.js:639:39
|
|
Run E2E tests for webpack version latest:
test\e2e\server.test.js#L425
2) [chromium] › server.test.js:410:7 › server option › as object › ca, pfx, key and cert are strings › should handle GET request to index route (/)
Error: expect(received).toMatchSnapshotWithArray(expected)
Expected: "D:\\a\\webpack-dev-server\\webpack-dev-server\\test-results\\server-server-option-as-ob-284d1-GET-request-to-index-route--chromium\\server-option-as-object-ca-pfx-key-and-cert-are-strings-should-handle-GET-request-to-index-route-undefined-snap-actual.webpack5"
Received: {"ca": "-----BEGIN RSA PRIVATE KEY-----·
MIIEpQIBAAKCAQEAxAUVLFM+K3XDLQkBi7xt0s1Ip7JoHYDskzUDQNHjjMkUq5kv·
C/hf5Ei1J6qruJs3Xqg86Nl4+ed4ynUajAkRRibhp0P1SG1tgPssIK6iC7g8heYu·
Dy9WkFuMie0513zjSn6bMEAK5TegxYAWCbaCZX/Fw9bDniabL/zuOv4sf8J4EPhs·
EENnH6sUE9HxPUgQmNt1Tbd0j1Cd5PXrSTLyfVPRh0m9QhXTUHuxsse8XSn9U2sw·
duxJTWRINmhffYn+O7kbJGI77xYr8u58Rsf3HCMI8DTKZNvQLChvvtLJ9ckyu7Q+·
T8emgklStASm3V2UtnriaK/IQEhgSdxqVRib3QIDAQABAoIBAGqWKPE1QnT3T+3J·
G+ITz9P0dDFbvWltlTZmeSJh/s2q+WZloUNtBxdmwbqT/1QecnkyGgyzVCjvSKsu·
CgVjWNVAhysgtNtxRT4BVflffBXLVH2qsBjpsLRGU6EcMXuPGTiEp3YRHNuO6Aj8·
oP8fEsCGPc9DlJMGgxQRAKlrVF8TN/0j6Qk+YpS4MZ0YFQfBY+WdKu04Z8TVTplQ·
tTkiGpBI+Oj85jF59aQiizglJgADkAZ6zmbrctm/G9jPxh7JLS2cKI0ECZgK5yAc·
pk10E1YWhoCksjr9arxy6fS9TiX9P15vv06k+s7c4c5X7XDm3X0GWeSbqBMJb8q7·
BhZQNzECgYEA4kAtymDBvFYiZFq7+lzQBRKAI1RCq7YqxlieumH0PSkie2bba3dW·
NVdTi7at8+GDB9/cHUPKzg/skfJllek57MZmusiVwB/Lmp/IlW8YyGShdYZ7zQsV·
KMWJljpky3BEDM5sb08wIkfrOkelI/S4Bqqabd9JzOMJzoTiVOlMam8CgYEA3ctN·
yonWz2bsnCUstQvQCLdI5a8Q7GJvlH2awephxGXIKGUuRmyyop0AnRnIBEWtOQV7·
yZjW32bU+Wt+2BJ247EyJiIQ4gT+T51t+v/Wt1YNbL3dSj9ttOvwYd4H2W4E7EIO·
GKIF4I39FM7r8NfG7YE7S1aVcnrqs01N3nhd9HMCgYEAjepbzpmqbAxLPk97oase·
AFB+d6qetz5ozklAJwDSRprKukTmVR5hwMup5/UKX/OQURwl4WVojKCIb3NwLPxC·
DTbVsUuoQv6uo6qeEr3A+dHFRQa6GP9eolhl2Ql/t+wPg0jn01oEgzxBXCkceNVD·
qUrR2yE4FYBD4nqPzVsZR5kCgYEA1yTi7NkQeldIpZ6Z43T18753A/Xx4JsLyWqd·
uAT3mV9x7V1Yqg++qGbLtZjQoPRFt85N6ZxMsqA5b0iK3mXq1auJDdx1rAlT9z6q·
9JM/YNAkbZsvEVq9vIYxw31w98T1GYhpzBM+yDhzir+9tv5YhQKa1dXDWi1JhWwz·
YN45pWkCgYEAxuVsJ4D4Th5o050ppWpnxM/WuMhIUKqaoFTVucMKFzn+g24y9pv5·
miYdNYIk4Y+4pzHG6ZGZSHJcQ9BLui6H/nLQnqkgCb2lT5nfp7/GKdus7BdcjPGs·
fcV46yL7/X0m8nDb3hkwwrDTU4mKFkMrzKpjdZBsttEmW0Aw/3y36gU=·
-----END RSA PRIVATE KEY-----·
", "cert": "-----BEGIN CERTIFICATE-----·
MIIDXTCCAkWgAwIBAgIJALz8gD/gAt0OMA0GCSqGSIb3DQEBCwUAMEUxCzAJBgNV·
BAYTAkFVMRMwEQYDVQQIDApTb21lLVN0YXRlMSEwHwYDVQQKDBhJbnRlcm5ldCBX·
aWRnaXRzIFB0eSBMdGQwHhcNMTgxMDIzMTgyMTQ5WhcNMTkxMDIzMTgyMTQ5WjBF·
MQswCQYDVQQGEwJBVTETMBEGA1UECAwKU29tZS1TdGF0ZTEhMB8GA1UECgwYSW50·
ZXJuZXQgV2lkZ2l0cyBQdHkgTHRkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB·
CgKCAQEAxAUVLFM+K3XDLQkBi7xt0s1Ip7JoHYDskzUDQNHjjMkUq5kvC/hf5Ei1·
J6qruJs3Xqg86Nl4+ed4ynUajAkRRibhp0P1SG1tgPssIK6iC7g8heYuDy9WkFuM·
ie0513zjSn6bMEAK5TegxYAWCbaCZX/Fw9bDniabL/zuOv4sf8J4EPhsEENnH6sU·
E9HxPUgQmNt1Tbd0j1Cd5PXrSTLyfVPRh0m9QhXTUHuxsse8XSn9U2swduxJTWRI·
NmhffYn+O7kbJGI77xYr8u58Rsf3HCMI8DTKZNvQLChvvtLJ9ckyu7Q+T8emgklS·
tASm3V2UtnriaK/IQEhgSdxqVRib3QIDAQABo1AwTjAdBgNVHQ4EFgQUDZBhVKdb·
3BRhLIhuuE522Vsul0IwHwYDVR0jBBgwFoAUDZBhVKdb3BRhLIhuuE522Vsul0Iw·
DAYDVR0TBAUwAwEB/zANBgkqhkiG9w0BAQsFAAOCAQEABh9WWZwWLgb9/DcTxL72·
6pI96t4jiF79Q+pPefkaIIi0mE6yodWrTAsBQu9I6bNRaEcCSoiXkP2bqskD/UGg·
LwUFgSrDOAA3UjdHw3QU5g2NocduG7mcFwA40TB98sOsxsUyYlzSyWzoiQWwPYwb·
hek1djuWkqPXsTjlj54PTPN/SjTFmo4p5Ip6nbRf2nOREl7v0rJpGbJvXiCMYyd+·
Zv+j4mRjCGo8ysMR2HjCUGkYReLAgKyyz3M7i8vevJhKslyOmy6Txn4F0nPVumaU·
DDIy4xXPW1STWfsmSYJfYW3wa0wk+pJQ3j2cTzkPQQ8gwpvM3U9DJl43uwb37v6I·
7Q==·
-----END CERTIFICATE-----·
", "key": "-----BEGIN PRIVATE KEY-----·
MIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDEBRUsUz4rdcMt·
CQGLvG3SzUinsmgdgOyTNQNA0eOMyRSrmS8L+F/kSLUnqqu4mzdeqDzo2Xj553jK·
dRqMCRFGJuGnQ/VIbW2A+ywgrqILuDyF5i4PL1aQW4yJ7TnXfONKfpswQArlN6DF·
gBYJtoJlf8XD1sOeJpsv/O46/ix/wngQ+GwQQ2cfqxQT0fE9SBCY23VNt3SPUJ3k·
9etJMvJ9U9GHSb1CFdNQe7Gyx7xdKf1TazB27ElNZEg2aF99if47uRskYjvvFivy·
7nxGx/ccIwjwNMpk29AsKG++0sn1y
|
|
Run E2E tests for webpack version latest:
test\e2e\server.test.js#L427
2) [chromium] › server.test.js:410:7 › server option › as object › ca, pfx, key and cert are strings › should handle GET request to index route (/)
Error: expect.toHaveScreenshot: Test ended.
Call log:
- expect.toHaveScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- failed to take screenshot -
425 | ).toMatchSnapshotWithArray();
426 | expect(response.status()).toBe(200);
> 427 | await expect(page).toHaveScreenshot();
| ^
428 | expect(
429 | consoleMessages.map((message) => message.text()),
430 | ).toMatchSnapshotWithArray("console messages");
at D:\a\webpack-dev-server\webpack-dev-server\test\e2e\server.test.js:427:28
|
|
Run E2E tests for webpack version latest:
[chromium] › web-socket-server-url.test.js#L1
[chromium] › web-socket-server-url.test.js took 1.1m
|
|
Run E2E tests for webpack version latest:
[chromium] › client-reconnect.test.js#L1
[chromium] › client-reconnect.test.js took 43.0s
|
|
Run E2E tests for webpack version latest:
[chromium] › hot-and-live-reload.test.js#L1
[chromium] › hot-and-live-reload.test.js took 36.4s
|
|
Run E2E tests for webpack version latest:
[chromium] › allowed-hosts.test.js#L1
[chromium] › allowed-hosts.test.js took 35.9s
|
|
Run E2E tests for webpack version latest:
[chromium] › overlay.test.js#L1
[chromium] › overlay.test.js took 32.6s
|
|
Run E2E tests for webpack version latest
4 failed
[chromium] › history-api-fallback.test.js:618:5 › historyApiFallback option › in-memory files › should perform HEAD request in same way as GET
[chromium] › server.test.js:410:7 › server option › as object › ca, pfx, key and cert are strings › should handle GET request to index route (/)
[chromium] › server.test.js:503:7 › server option › as object › ca, pfx, key and cert are array of strings › should handle GET request to index route (/)
[chromium] › server.test.js:972:7 › server option › as object › ca, pfx, key and cert are strings, key and pfx are objects › should handle GET request to index route (/)
5 flaky
[chromium] › api.test.js:46:7 › API › WEBPACK_SERVE environment variable › should be present ───
[chromium] › app.test.js:59:9 › app option › should work using "express" application and "http" server › should handle GET request to index route (/)
[chromium] › range-header.test.js:27:3 › 'Range' header › should work with "Range" header using "GET" method
[chromium] › server.test.js:1184:7 › server option › as object › spdy server with options › should handle GET request to index route (/)
[chromium] › static-public-path.test.js:505:5 › static.publicPath option › defaults to CWD › should handle request to page
11 skipped
467 passed (10.1m)
|
Loading