Wouldnt mind seeing my name up there somewhere, we've played together a few times.
How, can you do a poll for known players that you aren't that familiar with, that are nominated, or under consideration, that allowed players to vote with comments? Maybe a "companion thread". This way you could edit the poll as new candidates came up, and then evaluate the feedback, and add up the input. Folks could still request or "apply" to be on the list, and others could weigh in at what level they thought they were. When players got enough "input" they could be "promoted" to the next tier with an announcement post.
What do you think?
edit: I vote Mr_Book tier 2 and rising. Played a 4v6 game with him last night where it was jj, book, anhpp, and one other against 4 quasi-tiers (myself included), and 2 ubah-noobs. It was a combat crash dummy exercise, but book was flawless. Not that I know what flawless looks like, but if I had to make an educated guess, the replay showed him prosecuting and executing with authority.