Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More wikibee issues #29

Open
Adrthegamedev opened this issue Mar 16, 2022 · 5 comments
Open

More wikibee issues #29

Adrthegamedev opened this issue Mar 16, 2022 · 5 comments

Comments

@Adrthegamedev
Copy link

First of all, Bumble Bee is only doing bot segments in increments of 5: for example, it does segment 5, then 10, and then 15, but nothing inbetween, which effectively skips hundreds of sites. Secondly, audit bee is now erroring with "Unhandled exception global name 'audit_success' is not defined.".

@hexmode
Copy link
Contributor

hexmode commented Mar 16, 2022

  • only doing bot segments in increments of 5 -- this is because I was trying to control the load by changing the bots from running once a minute to once every 5. I've changed it back but will keep an eye on it.
  • "Unhandled exception global name 'audit_success' is not defined." -- I was working on tracking this down yesterday but didn't have much success. The error implies that the audit_success method is not in scope here even though it is defined here. I'm not a python guru, so if you (or anyone else) has insight, that would help.

@Adrthegamedev
Copy link
Author

Adrthegamedev commented Mar 17, 2022

Note: if durations get above 200 seconds or the sites processed by any segment go over 800 attention must be given.

Well, uh, that's currently happening right now. A few of the bot segments are going way over 200 seconds, and all segments have about 900 sites.

@Adrthegamedev
Copy link
Author

I also noticed a few sites only having /whois created, like Official Terraria Wiki (es) and Dark Deity Wiki (wiki.gg).

@hexmode
Copy link
Contributor

hexmode commented Mar 17, 2022

Note: if durations get above 200 seconds or the sites processed by any segment go over 800 attention must be given.

Thanks for pointing out that message from the bot log looks like we have some re-balancing to do.

@Adrthegamedev
Copy link
Author

Additionally, it seems like it's skipping 99% of data collection per segment, as it had "skipped_stats: 921 skipped_general: 924" on a segment with 967 sites.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants