-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Sometimes Report is not aggregated(created) for the test suite #86
Comments
Ive had another report of that. It seems that the new json stream library
has some issue somewhere. I will have to look into it
Rich
…On Fri, Apr 22, 2022 at 4:01 AM andriuspit ***@***.***> wrote:
Stumbled to issue that sometimes for the same test suite report is not
aggregated and in logs error is displayed: "[ERROR] default - Invalid
Metrics computed: undefined -- undefined"
—
Reply to this email directly, view it on GitHub
<https://github.com/rpii/wdio-html-reporter/issues/86>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEABIEPEBOVO4C6AXF7YEYLVGKBCDANCNFSM5UB7CUSA>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
this is the new code:
let jsonFile = reportData.reportFile.replace('.html',
'.json');
try {
reportOptions.LOG.info("Json write starting: " +
jsonFile );
(async () => {
await json.stringify({
body: reportData
})
.then(function(stringified) {
fs.outputFileSync(jsonFile, stringified);
reportOptions.LOG.info("Json write
completed: " + jsonFile );
})
.catch((error) => {
reportOptions.LOG.error("Json write failed:
" + error );
});
})();
can you see if the log messages are showing anything? Have to turn that
logging on
Rich
…On Sat, Apr 23, 2022 at 10:27 AM Rich Peters ***@***.***> wrote:
Ive had another report of that. It seems that the new json stream library
has some issue somewhere. I will have to look into it
Rich
On Fri, Apr 22, 2022 at 4:01 AM andriuspit ***@***.***>
wrote:
> Stumbled to issue that sometimes for the same test suite report is not
> aggregated and in logs error is displayed: "[ERROR] default - Invalid
> Metrics computed: undefined -- undefined"
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/rpii/wdio-html-reporter/issues/86>, or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AEABIEPEBOVO4C6AXF7YEYLVGKBCDANCNFSM5UB7CUSA>
> .
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***>
>
|
Should I put this provided code snippet somewhere? But looking at debug level logs of report aggregator there some logs that contain javascript code, that maybe could not be stringified (?). Node: Tests use "wdio-intercept-service" Example:
|
no, thats what saves the json file of the report. for each suite you
should see the console messages that are in that fragment
…On Sun, Apr 24, 2022 at 10:54 PM andriuspit ***@***.***> wrote:
Should I put this provided code snippet somewhere?
—
Reply to this email directly, view it on GitHub
<https://github.com/rpii/wdio-html-reporter/issues/86#issuecomment-1108105311>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEABIEPEQKESUF7R74PVK73VGYXK5ANCNFSM5UB7CUSA>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Its happening for me all the time in v.8.0.0 |
OK I think I found what that was. please try 8.0.1 and let me know.
Rich
…On Fri, May 27, 2022 at 5:53 AM Rafal Fusik ***@***.***> wrote:
Its happening for me all the time in v.8.0.0
Downgraded
"wdio-html-nice-reporter": "^7.7.14",
and the issue is not longer showing
—
Reply to this email directly, view it on GitHub
<https://github.com/rpii/wdio-html-reporter/issues/86#issuecomment-1139590794>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEABIEO5JDPIQHRKNBKFPBDVMDASNANCNFSM5UB7CUSA>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
[2022-05-28T09:50:02.854] [INFO] default - Html Generation started but the aggregate report html is not created for some reason i checked: Have a question for you, what's the setting to get screenshots w/o the video reporter I cant get it to work, screenshots are never taken
|
So are you saying that it is still failing?
On the video:so make sure that useOnAfterCommandForScreenshot is false in
the report aggregator constructor.
I am using just
[video, {
saveAllVideos: true, // If true, also saves videos for
successful test cases
videoSlowdownMultiplier: 3, // Higher to get slower videos,
lower for faster videos [Value 1-100]
videoRenderTimeout: 5, // Max seconds to wait for a video
to finish rendering\
outputDir: 'reports/html-reports/screenshots',
}],
and that works..
…On Sat, May 28, 2022 at 12:59 AM Rafal Fusik ***@***.***> wrote:
[2022-05-28T09:50:02.854] [INFO] default - Html Generation started
[2022-05-28T09:50:02.857] [INFO] default - Json write starting:
/Users/rafalfusik/gitprojects/omp/reports/html-reports/Hiring%20Manager%20L2%20has%20active%2Finactive%20employeessuite1/0-1/report.json
[2022-05-28T09:50:03.930] [INFO] default - Json write completed:
/Users/rafalfusik/gitprojects/omp/reports/html-reports/Hiring%20Manager%20L2%20has%20active%2Finactive%20employeessuite1/0-1/report.json
[2022-05-28T09:50:04.007] [INFO] default - Report Aggregation started
[2022-05-28T09:50:04.041] [INFO] default - Aggregated 2 specs, 2 suites, 2
reports,
[2022-05-28T09:50:04.042] [INFO] default - Html Generation started
[2022-05-28T09:50:04.043] [INFO] default - Json write starting:
/Users/rafalfusik/gitprojects/omp/reports/html-reports/master-report.json
[2022-05-28T09:50:04.045] [INFO] default - Report Aggregation completed
[2022-05-28T09:50:04.093] [INFO] default - copyfiles complete :
/Users/rafalfusik/gitprojects/omp/node_modules/wdio-html-nice-reporter/css/
to /Users/rafalfusik/gitprojects/omp/reports/html-reports/
but the aggregate *report html* is not created for some reason
i checked:
$ ls -la
/Users/rafalfusik/gitprojects/omp/node_modules/wdio-html-nice-reporter/css/
total 64
drwxr-xr-x 4 rafalfusik staff 128 28 May 09:48 .
drwxr-xr-x 15 rafalfusik staff 480 28 May 09:48 ..
-rw-r--r-- 1 rafalfusik staff 23320 26 Oct 1985
glyphicons-halflings-regular.woff
-rw-r--r-- 1 rafalfusik staff 7631 26 Oct 1985 report-styles.css
Have a question for you, what's the setting to get screenshots w/o the
video reporter
[image: image]
<https://user-images.githubusercontent.com/445435/170816362-06785b0c-ef55-46ea-aba1-f42d27781f57.png>
I cant get it to work, screenshots are never taken
["html-nice", {
debug: true,
outputDir: './reports/html-reports/',
filename: 'report.html',
reportTitle: 'HTML Report',
linkScreenshots: true,
//to show the report in a browser when done
showInBrowser: false,
collapseTests: false,
//to turn on screenshots after every test
useOnAfterCommandForScreenshot: true,
LOG: logger
}]
—
Reply to this email directly, view it on GitHub
<https://github.com/rpii/wdio-html-reporter/issues/86#issuecomment-1140201059>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEABIEK5QT4JXPDZPIPXXD3VMHGZNANCNFSM5UB7CUSA>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
video note:
|
Are you showing that in intelliJ? it may not have refreshed that folder.
…On Sun, May 29, 2022 at 2:14 AM Rafal Fusik ***@***.***> wrote:
So are you saying that it is still failing?
yes, it doesnt produce the master hmtl file for me, even though logs says
otherwise
[image: Screenshot 2022-05-29 at 11 12 39]
<https://user-images.githubusercontent.com/445435/170860810-485ff885-f15e-43a4-a7ca-c82bc897f4f3.png>
—
Reply to this email directly, view it on GitHub
<https://github.com/rpii/wdio-html-reporter/issues/86#issuecomment-1140409017>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEABIELJQBPS25HBIBOQSVLVMMYMZANCNFSM5UB7CUSA>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Can everyone try version 8.0.2. I fixed another async issue. json files
should now be generated
Rich
…On Fri, Apr 22, 2022 at 4:01 AM andriuspit ***@***.***> wrote:
Stumbled to issue that sometimes for the same test suite report is not
aggregated and in logs error is displayed: "[ERROR] default - Invalid
Metrics computed: undefined -- undefined"
—
Reply to this email directly, view it on GitHub
<https://github.com/rpii/wdio-html-reporter/issues/86>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEABIEPEBOVO4C6AXF7YEYLVGKBCDANCNFSM5UB7CUSA>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
Hi Rich, Still not working Rafals-MacBook-Air:html-reports rafalfusik$ ls -la this time around, no json, no master report to css generated
|
Thats ugly. seems to have fixed the first problem and made the second one
worse. Do you have this code in your project?
onComplete: function (exitCode, config, capabilities, results) {
(async () => {
await reportAggregator.createReport();
})();
}
…On Mon, May 30, 2022 at 12:25 PM Rafal Fusik ***@***.***> wrote:
Hi Rich,
Still not working
Rafals-MacBook-Air:html-reports rafalfusik$ ls -la
total 0
drwxr-xr-x 5 rafalfusik staff 160 May 30 21:21 .
drwxr-xr-x 4 rafalfusik staff 128 May 27 14:54 ..
drwxr-xr-x 3 rafalfusik staff 96 May 30 21:20
Hiring%20Manager%20L1%20has%20active%2Finactive%20employeessuite1
drwxr-xr-x 3 rafalfusik staff 96 May 30 21:21
Hiring%20Manager%20L2%20has%20active%2Finactive%20employeessuite1
drwxr-xr-x 2 rafalfusik staff 64 May 30 21:19 screenshots
this time around, no json, no master report to css generated
[2022-05-30T21:21:13.603] [INFO] default - Json report write starting: /Users/rafalfusik/gitprojects/omp/reports/html-reports/Hiring%20Manager%20L2%20has%20active%2Finactive%20employeessuite1/0-1/report.json
[2022-05-30T21:21:17.582] [INFO] default - Json write completed: /Users/rafalfusik/gitprojects/omp/reports/html-reports/Hiring%20Manager%20L2%20has%20active%2Finactive%20employeessuite1/0-1/report.json
[2022-05-30T21:21:17.662] [INFO] default - Report Aggregation started
[2022-05-30T21:21:17.689] [INFO] default - Included metrics for suite: 0-0
[2022-05-30T21:21:17.690] [INFO] default - Included metrics for suite: 0-1
[2022-05-30T21:21:17.693] [INFO] default - Aggregated 2 specs, 2 suites, 2 reports,
[2022-05-30T21:21:17.694] [INFO] default - Html Generation started
[2022-05-30T21:21:17.695] [INFO] default - Json report write starting: /Users/rafalfusik/gitprojects/omp/reports/html-reports/master-report.json
—
Reply to this email directly, view it on GitHub
<https://github.com/rpii/wdio-html-reporter/issues/86#issuecomment-1141430865>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEABIEPFZFTIQ2XW6V4PZ6DVMUIYHANCNFSM5UB7CUSA>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
I use the same code all the time, just changing the version... |
Weird, are you using mocha or cucumber.? maybe try it again... Ive tested
on 5 or 6 machines and its working there
thanks
Rich
…On Mon, May 30, 2022 at 10:47 PM Rafal Fusik ***@***.***> wrote:
I use the same code all the time, just changing the version...
—
Reply to this email directly, view it on GitHub
<https://github.com/rpii/wdio-html-reporter/issues/86#issuecomment-1141691467>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEABIELOI5SKFDICZM53RNLVMWRVFANCNFSM5UB7CUSA>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Ok. I found a big test that fails. Looking into it
…On Tue, May 31, 2022 at 1:58 PM Rich Peters ***@***.***> wrote:
Weird, are you using mocha or cucumber.? maybe try it again... Ive
tested on 5 or 6 machines and its working there
thanks
Rich
On Mon, May 30, 2022 at 10:47 PM Rafal Fusik ***@***.***>
wrote:
> I use the same code all the time, just changing the version...
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/rpii/wdio-html-reporter/issues/86#issuecomment-1141691467>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AEABIELOI5SKFDICZM53RNLVMWRVFANCNFSM5UB7CUSA>
> .
> You are receiving this because you commented.Message ID:
> ***@***.***>
>
|
Jasmine, here is the full config
|
Can everyone try version 8.0.2. I fixed another async issue. json files
should now be generated
Rich
…On Sun, May 29, 2022 at 12:07 PM Rich Peters ***@***.***> wrote:
Are you showing that in intelliJ? it may not have refreshed that folder.
On Sun, May 29, 2022 at 2:14 AM Rafal Fusik ***@***.***>
wrote:
> So are you saying that it is still failing?
>
> yes, it doesnt produce the master hmtl file for me, even though logs says
> otherwise
> [image: Screenshot 2022-05-29 at 11 12 39]
> <https://user-images.githubusercontent.com/445435/170860810-485ff885-f15e-43a4-a7ca-c82bc897f4f3.png>
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/rpii/wdio-html-reporter/issues/86#issuecomment-1140409017>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AEABIELJQBPS25HBIBOQSVLVMMYMZANCNFSM5UB7CUSA>
> .
> You are receiving this because you commented.Message ID:
> ***@***.***>
>
|
@rpii I tested before with 8.0.2 |
Hi, onComplete: function (exitCode, config, capabilities, results) {
(async () => {
await reportAggregator.createReport();
})();
} Using the following onComplete function report generation seem to be working again. async onComplete: function (exitCode, config, capabilities, results) {
await reportAggregator.createReport();
} Could someone please confirm whether change resolves their issues with report generation? |
@alpako it works for me! I was going CRAZY because of this issue. Thanks for sharing. |
Stumbled to issue that sometimes for the same test suite report is not aggregated and in logs error is displayed: "[ERROR] default - Invalid Metrics computed: undefined -- undefined"
The text was updated successfully, but these errors were encountered: