Bukkit

Describe to us the issue that you're having:
I have noticed for the past few months i have been getting lots of these in the server logs and the more players online the more rapidly they appear. Anyone have any ideas or suggestions as to why or what that means? I have googled it and nothing comes up. Anyone else have this problem or think they know how to fix it?

Which steps will reproduce this problem?:
1) It happens randomly and consistently either or nothing specific triggers this.

Do you have an error log of what happened?
[Essentials] Lag Notice - Slow Permissions System (bPermissions) Response - Request took over 572.439ms!

Which version of bPermissions are you using?: (Please don't say "latest"!!!)
I had 2.10.9m and upgraded recently to 2.12 Beta 1 but BOTH give same problem.

Which version of CraftBukkit?: (Please don't say "latest"!!!)
Server is running Spigot 1.8.3

Which OS?
Server is Centos 6.5

Any other information we may need (plugins, configs, etc):
Timings: http://timings.aikar.co/?url=12698827
Profiler: http://play.mc-ecoworld.com:23000/stack
SLogs: http://pastebin.com/LRQauCyG
Groups: http://pastebin.com/Drz89EGe (I have tried all 3 styles and they dont make a difference)
Config: is default i didn't change anything in config
Mirror: I have the default world mirrored to 9 other worlds for a total of 10 worlds using the groups.yml.

Please fill out this form properly! Failing to do so may result in your ticket being marked invalid.

I get lag issues with bperms too and my cpu usage is through the roof !

http://timings.aikar.co/?url=12766738

From the looks of both your timings, I'd say the new "Spigot" version of Essentials, doesn't like bPerms, and from my experience that particular plugin isn't anything like what it used to be either.

I'm spotting A LOT of other plugins with spiked timings in both reports, so somewhere something isn't communicating properly. So I hope more reports were made to these other plugins as well?

Your example Groups file, seems to have some parsing issues. :P I hope this is not the case in the actual files on your server? As this can also cause errors or delay when the plugin is attempting to read the file properly.

@sakura_blades: Go

Thanks for your input... I can not speak for the anyone else but, yes those are EXAMPLE group files i linked, my regular ones are good. Yes, I report all issues to all plugins that are not working properly. And yes many of since i posted that timings report many of the other large spikes have been resolved by other plugin owners/managers or myself. Still waiting on an official response from any of the 20 people supposedly managing this plugin!!!!!! Thanks

@AdminZero: Go

I find it so strange that you're having trouble with this particular plugin, as I've said once before I've not once found an issue myself. Do you perhaps have a large amount of player data within bperms?
Perhaps running a cleanup command to eliminate anyone who doesn't have anything special to their permissions may help a little if that is the case?

Unfortunately I have found that the authors of bperms have been rather inactive most of the time, which does make it difficult to resolve problems that are encountered with it. It's a shame, as I do find bpermissions to be one of the greater permission plugins as far as functionality.
You would think that with 3 coder/authors and SEVERAL ticketmanagers, at least someone would be active somewhere to help out. Though I also find that in many cases plugins found on bukkit.org tend to go un-noticed for updated versions located else-where of their plugins since Bukkit's "death".

When are you experiencing the lagging on your server? Is it specifically when a player logs in, offline, ranking up?
I cannot say I use the ranking system myself and have always added a new group and removed the old one instead. Perhaps if ranking is an issue, you can try stop using the ranking function and attempt the other method of applying a new group?

@sakura_blades: Go

To be honest, the list of authors and ticket managers is rather... inaccurate. In practice, the only active person left maintaining this plugin is me, and I'm very busy with college at the moment. The plugin isn't dead yet, however it's quite low on my list of priorities right now, especially as I don't really play Minecraft anymore.

@AdminZero: Go

I'm aware of this issue, and it has been reported before in this ticket: http://dev.bukkit.org/bukkit-plugins/bpermissions/tickets/681-extreme-lag-with-only-20-players/

Unfortunately I've been unable to reproduce the issue before, but I'll have another shot at reproducing the issue on Saturday, and if possible fixing it.

@rymate1234: Go

Thanks for the reply... I will try to gather some "fresh" data for you today and post it here for your reference. If you would like any specific data from me please let me know ASAP.

@sakura_blades: Go

Not sure what you consider "large" but the files i use are:

My main world is: world I have 9 other worlds mirrored in the: mirrors.yml world_towny: world world_wild: world world_the_end: world world_nether: world world_arenas: world world_games: world world_creative: world world_dungeons: world world_kitpvp: world

In the "world" folder i use the two files: groups.yml users.yml

Groups has 321 lines of code and 15 groups and the max group depth is 10 with inheritance. Users has slightly over 31,000 lines of code and about 6,200 users. 98% are default group.

Other permissions nodes are also utilized form the bukkit permissions.yml, townyperms.yml and several some other plugins that maintain their own perms files. I have tried all combinations of these and I can't seem to "reduce" or eliminate the problem.

However, you did mention a "users cleanup" so i did the /permissions cleanup and I will monitor and see if that makes any difference.

Okay I feel like a complete NOOB! After ruining the command /permissions cleanup my users file went from 690k to 8k in size and I have been testing timings reports for 12 hours and not once had a "bad" timings report from the worldyaml file and everything seems NORMAL like it should: http://pastebin.com/68BWwywq

HOWEVER, I am still getting random and repeated ESSENTIAL LAG Notices: http://pastebin.com/Wbk4S4iP which are a bit of a pain the the butt.

@AdminZero: Go

Right, that gives me a clear reason what causes the issue - tomorrow I'll implement a way to ensure people in the default group don't get saved in the users.yml

@rymate1234: Go

I think this would be a great step towards cutting back on file size and saving/file read times.
Unless a "default group" user has any meta data, I don't personally see a reason for it to be saved myself. :P

@AdminZero: Go

I would say that this is rather large. That's a lot of users to keep track of and a lot of data to check through when it's being called on.
Glad running a cleanup on the users helped out with your timings!

The bug has now (hopefully) been fixed - see latest release at http://dev.bukkit.org/bukkit-plugins/bpermissions/files/172-v2-12-beta-2/

No changes other than the new users saving logic, which I've tested and it works fine, so if you're already running Beta 1 I highly recommend you upgrade.

Bug will be closed as soon as I have confirmation it works.

@AdminZero: Go

In terms of the essentials lag message, could you attach your users yml? Maybe I can figure out why essentials has a bad time with it sometimes.

@rymate1234: Go

Okay I just updated to Beta v3 today (as i been away on holiday last 2 weeks) and i will monitor the progress over next few days and get back to you with the findings.

However, I also have some additional information that may or may not matter for the Beta v1 version. Since i understand the possibility of it being a Spigot Essentials problem I changed to EssentialsX which also works on spigot to see if it would make a difference..

Sadly it did not make a difference in getting the Essentials Lag messages except in the small factor of the "error message" is WORDED slightly different probably cause of the slight differences between the two versions.

Anyways this is the Error Messages i am getting with bPermissions Beta v1 and Spigot 1.8.8 and EssentialsX: http://pastebin.com/vnvbWrSL

And here is the users.yml you requested as of today before i updated to BETA v2: http://pastebin.com/humidu05

give me a few days and i will post my findings since installing the Beta v2 :) thanks

PS. i understand changing from SpigotEssentials to EssentialsX causes a slight bump in troubleshooting problems but they are almost mirror images of each other so im hopping the root of the problems can still be resolved. And since they both seem to give similar errors i imagine its a common problem elsewhere.

PPS. not sure if this helps but i made the same ticket in Essentials and i the response i was given was this: "This is a problem with bPermissions returning groups slowly via Vault. Update to the latest beta, and contact them about this issue."

Okay its seems to be running much better with the Beta v3 as far as the timings and any loading spikes... BUT still getting essentials notices. I will attach my FULL log files for 2 days that maybe it will help but im not sure what else i can do?

@AdminZero: Go

I think I have a fix for this in the latest jenkins build (see http://rymatemc.co.uk/jenkins/job/bPermissions/). These builds are not approved by bukkitdev staff, and aren't tested as much by me. It does appear to work though, so it might be worth a try.